51 to 75 of 251 Permanent Data Lake Jobs

solutions that support the Sales Compensation division. The ideal candidate will have experience with Microsoft SQL Server, Azure SQL, Azure Data Factory, and Azure Data Lake Storage Gen2 (ADLS Gen2). This position requires a dynamic, hard-working professional with a solid technical background and a desire to work in a fast-paced, large corporate … environment.Job Description Key Responsibilities: Assist in the design and creation of logical and physical data models. Develop, implement, test, and optimize complex stored procedures, functions, and views using T … SQL in Microsoft SQL Server and Azure SQL databases. Design and implement scalable, secure data pipelines using Azure Data Factory and Azure Data Lake, supporting both batch and incremental processing. Establish and promote data integration best practices including naming conventions, metadata standards, and pipeline orchestration patterns. Identify and resolve gaps in More ❯

Overview We're seeking a Senior Data Scientist to lead the development of advanced analytics and AI/ML solutions that unlock real value across our business. This is a contract role for 6 months . In this contract role, you'll work with proprietary and B2B research datasets to design, deliver, and scale data-driven … Research, and Technology, you'll help turn strategic ideas into working MVPs-ensuring high standards of methodology, quality, and business relevance throughout. You'll also help shape the data science environment by working alongside our tech teams to support a robust and flexible infrastructure, including sandbox environments for onboarding and evaluating new data sources. This is … analytics "products" could be refined and productionized in the future. Work with Tech colleagues to improve the Data Science workspace, including providing requirements for Data Lake, Data Pipeline, and Data Engineering teams. Expand on the tools and techniques already developed. Help us understand our customers (both internal and external) better so More ❯

Data Services Manager, Must live within 2 hours of London and be able to come in for ad-hoc meetings when required. Primarily home based though. Role 90% management and 10% technical and you will manage a team of 6. Salary £ 80000 - 85000 + good benefits. Expanding financial services client are looking for a Data Services … years and is looking to further develop their management career. Guiding a team of 6 you will be responsible for supporting the day to day operations of the data function, with a focus on leading and mentoring data engineers to deliver high quality, scaleable data solutions. Working across the business with multiple stakeholders you … mentoring, coaching, team development etc) Very strong technical skills that will include - SQL, SSIS, SSRS, SAS, Power BI, Power Platform, Azure Data Factory, Azure Data Lake, Databricks A good understanding of dimensional modelling techniques, including Kimball's Business Development Lifecycle Ability to design hybrid data solutions across on-prem and cloud data More ❯

an opening with one of our clients, please let me know if you are available for this role. Location: Dauphin County, PA (Hybrid) Duration: 6+ months REQUIREMENTS The Data Modeler/Data Architect is a senior level resource with specialized knowledge and experience in data analysis, data modeling and database design. The … data dictionaries, and metadata repositories. REQUIRED SKILLS: The Data Modeler/Architect can design, develop, and implement data models and data lake architecture to provide reliable and scalable applications and systems to meet the organization's objectives and requirements. The Data Modeler is familiar with a variety of database … dimensions, and star schema concepts and terminology Strong proficiency with SQL Server, T-SQL, SSIS, stored procedures, ELT processes, scripts, and complex queries Working knowledge of Azure Databricks, Delta Lake, Synapse and Python Experience with evaluating implemented data systems for variances, discrepancies, and efficiency Experience with Azure DevOps and Agile/Scrum development methods Auditing databases to More ❯

the new position The Wingbrace Development organization is charged with identifying, developing and applying new technologies that can address the Government's most challenging Software, Systems, Cloud and Data Engineering problems. This is an opportunity for experienced software and systems engineers who are highly motivated, innovative and self-directed. This position provides challenging opportunities to apply and expand … s cloud engineering, full stack (equally versed in front and back-end coding), systems architecture experience. Specific areas of interest include software and systems architecture capture, data lake/data warehouse implementation, data visualization, analysis of complex systems, and decision support. This position is located in Lincoln Massachusetts. This position will require working … interface management and architecture change management processes using best-of-breed tools like Rational DOORS and Siemens Teamcenter Developing a data analytics pipeline using data lake and data warehouse architectures and visualizations with Python Estimating, planning, scheduling, and executing data engineering activities Supporting proposal efforts to capture new business Organizing work More ❯

Senior Data Architect Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to Be Yourself At Work. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that we recruit and develop as diverse a range of talent … Focused on maintaining our nimble, agile and entrepreneurial culture. Your Capco Day/Key Responsibilities You will accompany and lead complex agile consulting projects supporting our clients with data architecture design and delivery. You will work with technology leaders across Financial Services to provide best practice guidance for data management and data architecture development … . Knowledge of the relevant procedures, architectures and technologies in one or more of the following topics: Contextual Datamodelling, Entity Relationship Modelling, Logical & Physical Datamodelling and Data Lake design. Experience designing and implementing cloud data migration and storage patterns on one or more of AWS, GCP and Microsoft Azure Experience implementing and integrating data More ❯

Job summary The role holder is responsible for the leading the design, development, and ongoing enhancement of organisations data infrastructure and pipelines to support advanced data collection, storage, processing, and analysis. Main duties of the job The role holder is accountable for a team of data engineers, fostering a culture of technical excellence and … continuous improvement. The role holder will work collaboratively with cross-functional teams, including analysts, software engineers, and key stakeholders, to ensure that data solutions are robust, scalable, and aligned with the strategic goals of delivering high-quality care for our patients. About us Since 2012, CHEC has been working with the NHS to increase patient choice and provide … applicants may be required to undertake an Enhanced Disclosure via the Disclosure and Barring Service (DBS). Job description Job responsibilities Lead the design and execution of scalable data storage solutions, including databases, data warehouses, and data lakes, ensuring efficient handling of large data volumes. Oversee development and optimisation of ETL pipelines More ❯

Senior Data Engineer - Azure, Data Factory, Datalakes, SQL - £65,000 - Remote Industry: Retail & eCommerce Role: Senior Data Engineer Location: Remote Salary: £65,000 Benefits The Company We're working with one of the UK's leading retail and e-commerce brands; a business that's experiencing rapid growth and investing heavily in data, analytics, and technology to stay ahead of the competition. With millions of customers, an ever-expanding online presence, and a dynamic product offering, data is at the heart of every decision they make. Their mission is to transform how data is captured, engineered, and consumed across the organisation. Enabling & empowering smarter insights and creating … driven recruitment consultancy supporting data and technology professionals connect with forward-thinking businesses who enhance our tomorrow. Senior Data Engineer - Azure, Data Factory, Datalakes, SQL - £65,000 - Remote More ❯

behind database performance, resilience, and compliance, while steering the evolution from traditional systems to modern cloud-based solutions. From enterprise-scale SQL Server estates to emerging data lake technologies, this role offers both breadth and depth, with real influence across business-critical systems. What you'll be doing Lead database strategy, ensuring high availability, scalability and cost … efficiency. Drive performance tuning, optimisation and proactive monitoring for reliable services. Oversee upgrades, migrations and integrations with modern platforms (Azure, Data Lake, Fabric). Manage BAU operations: patching, security updates, backups and incident resolution. Partner with teams and providers to ensure governance, GDPR, PCI-DSS compliance and operational excellence. Support new change deployments and contribute to the … replication and DR strategies. Experience with Azure services (Data Factory, Logic Apps, Data Sync) and exposure to data lakes (Azure Data Lake, Fabric, Delta Live Tables). Understanding of Windows Server, Active Directory and infrastructure dependencies. Excellent communication skills with the ability to engage stakeholders. Familiarity with DevOps (CI/CD More ❯

Office West Crk - 12800 Tuckahoe Creek Parkway, Richmond, Virginia, 23238 CarMax, the way your career should be! Essential Responsibilities: Partner with stakeholders across various business units and other Data & Analytics leaders to influence strategic plans and roadmaps. Identify new opportunities for Data & Analytics solutions by cultivating relationships with leaders across the organization and foster those partnerships. … and efficiently leveraging team talent Guide teams to design and implement intelligent, predictable, reliable, scalable, cost-efficient, and easy-to-use platforms/solutions/services to serve Data & Analytics needs of the organization and solve for complex business problems Maintain FinOps focus for cloud costs and actively manage contracts and consulting expenditure. Continuously optimize the spend using … 8+ years of Data & Analytics experience in an enterprise-level environment in two or more of the following areas: Data Engineering (Enterprise Data Lake/Data Warehouse), Cloud Computing, Systems Engineering, Master Data Management (MDM), Machine Learning (ML) Engineering, Infrastructure & Operations, Site Reliability Engineering (SRE), Data Governance More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £65,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … Cloud data platform development and deployment. Expertise across data warehouse and ETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on Offer: Salary to £65,000 + benefits Hybrid working More ❯

Data Services Manager, Must live within 2 hours of London and be able to come in for ad-hoc meetings when required. Primarily home based with occasional office meetings. Role 90% management and 10% technical and you will manage a team of 6. Salary £ 80000 - 85000 + good benefits. Expanding financial services client are looking for a Data … years and is looking to further develop their management career. Guiding a team of 6 you will be responsible for supporting the day to day operations of the data function, with a focus on leading and mentoring data engineers to deliver high quality, scaleable data solutions. Working across the business with multiple stakeholders you … and then into a management Very strong technical skills that will include - SQL, SSIS, SSRS, SAS - Power BI, Power Platform - Azure Data Factory, Azure Data Lake, Databricks A good understanding of dimensional modelling techniques, including Kimball's Business Development Lifecycle Ability to design hybrid data solutions across on-prem and cloud data More ❯

The Data Engineer is responsible for the end-to-end design, build, and deployment of M1's centralized data platform within the Azure Government Community Cloud (GCCH) environment. This senior-level role requires deep technical expertise to architect, implement, and sustain secure, scalable, and compliant data infrastructure. In addition to technical delivery, the Data … engineering and predictive analytics initiatives. Primary responsibilities include but are not limited to the following: Architecture and Build Out Design, implement, and manage M1's centralized Data Lake/Data Intelligence Platform in Azure GCCH. Develop secure, scalable pipelines to ingest, transform, and integrate diverse data sources (operational, personnel, parts, aircraft, and program … data platforms end-to-end (architecture through production). Hands-on expertise with: o Azure Synapse Analytics, Data Factory, Databricks, Event Hubs, Data Lake Storage (Gen2). o Database technologies (SQL Server, PostgreSQL, Cosmos DB). o Programming languages (Python, PySpark, SQL). Strong experience in data security, access management, and More ❯

Enterprise Architect - AI/Data Department: Information Technology Location: Onsite -Washington, DC Role Type: 6-Month contract (with possibility for extension based on performance) About Our Client This organization is a global technology solutions provider with a strong history of delivering innovation and results across industries. They partner with major technology leaders as well as emerging players, employing … they pride themselves on fostering a culture of collaboration, growth, and customer success. Job Description You will use your deep knowledge of Enterprise Architecture principles, AI technologies, and data management practices to guide decision-making and ensure that the architecture supports business objectives and enhances operational capabilities. Duties and Responsibilities - Design and develop end-to-end AI and … and on-premises data architectures using platforms like Azure, AWS, or Google Cloud. - Work with big data technologies (e.g., Hadoop, Spark) and data lake architectures to ensure the organization's data can be ingested, processed, and analyzed at scale. - Manage the integration of AI models and algorithms into big data More ❯

Data Engineer - Azure/Microsoft Fabric City of London - Hybrid Working Circa £60k-70k + Bonus & Benefits Our client, a forward-thinking and globally connected staffing & consulting organization is seeking a skilled and driven Data Engineer to join their growing Data & Analytics team. Based in the City of London, this role presents a fantastic … a data engineering or similar technical role Hands-on experience with key Microsoft Azure services: Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Azure SQL Database Solid understanding of data modeling, ETL/ELT, and warehousing concepts Proficiency in SQL and one or more programming languages (e.g., Python, Scala … with software testing methodologies and development team collaboration Experience working with Power BI and DAX Strong documentation, communication, and stakeholder engagement skills Preferred Qualifications: Experience with Lakehouse architecture, Delta Lake, or Databricks Exposure to Agile/Scrum working practices Microsoft certifications (e.g., Azure Data Engineer Associate) Background in consulting or professional services Understanding of data More ❯

Data/AI Enterprise Architect Washington, DC - 100% ONSITE Must be able to obtain Public Trust - 12-16 week process ALTA IT Services is in search of a candidate who has deep knowledge of enterprise architecture principles, AI technologies, and data management practices to guide decision-making and ensure that the architecture supports business objectives and … enhances operational capabilities. Key Responsibilities: • Design and develop end-to-end AI and data architectures that support business goals, ensuring scalability, performance, security, and maintainability. • Create architectural blueprints and roadmaps that guide the integration of AI and data solutions across the organization. • Lead the development and implementation of data platforms and AI-driven systems … and on-premises data architectures using platforms like Azure, AWS, or Google Cloud. • Work with big data technologies (e.g., Hadoop, Spark) and data lake architectures to ensure the organization's data can be ingested, processed, and analyzed at scale. • Manage the integration of AI models and algorithms into big data More ❯

Senior Data Engineer, Databricks, £ 60000 - 65000 + benefits. Strong Performant SQL and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role. Knowledge of testing, the finance sector or energy sector is a distinct advantage. Expanding SaaS product company are looking … for a number of Senior Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing … technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Senior Data Engineer, Databricks (Mid Level roles also available), £ 50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Knowledge of the finance sector or energy sector is an advantage. Expanding SaaS product company are looking for a … number of Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean … the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning) and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

A client of Innova Solutions is immediately hiring a Data Architect. Position Type: Full Time, Direct Hire Duration: Direct Hire Location: Tampa, FL (Onsite) As a Data Architect, you will: • Defines and plans database architectures for enterprise systems. • Working with the Business to assess requirements, the incumbent will design and implement an Enterprise Data solution to drive data-driven decision making, optimize reporting accuracy and improve operational efficiency. • Serve as the subject matter expert on data management, emerging technologies, and market trends, advising leadership on best practices. • Communicate effectively with end-users, support staff, management, and other departments on all data-related initiatives. • Establish and maintain … delivery • Deep understanding of SQL, query optimization, and performance tuning • 7+ years of database design and Modeling • 5+ years of experience in Data Warehouse Data Lake • Knowledgeable in designing and constructing data architectures, operational data stores, data marts, and lakehouses with a good understanding of AI foundational requirements • Demonstrated More ❯

Data Architect £130,000 GBP Remote WORKING Type: Permanent Data Architect Up to £130,000 Bonus Location: Homeworker- UK Additional Locations: Belfast, Birmingham, London Type: Permanent A global leader in IT solutions in Consulting is seeking a Data Architect with experience across the UK Public sector to join their elite, fast growing Data practice & Intelligence practice. This is a key role in an award-winning Data & AI Team , using cutting-edge technology and industry -leading expertise to solve real-world problems. You'll drive driving SME data architecture strategies, in a client-facing leadership role with a focus on managing employee performance and team development. A successful … defining information handling models and capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem Enterprise Data Architecture experience. Why Choose This Data Architect Role? Competitive salary up More ❯

Data Architect £130,000 GBP Remote WORKING Type: Permanent Data Architect Up to £130,000 Bonus Location: Homeworker- UK Additional Locations: Belfast, Birmingham, London Type: Permanent A global leader in IT solutions in Consulting is seeking a Data Architect with experience across the UK Public sector to join their elite, fast growing Data practice & Intelligence practice. This is a key role in an award-winning Data & AI Team , using cutting-edge technology and industry -leading expertise to solve real-world problems. You'll drive driving SME data architecture strategies, in a client-facing leadership role with a focus on managing employee performance and team development. A successful … defining information handling models and capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem Enterprise Data Architecture experience. Why Choose This Data Architect Role? Competitive salary up More ❯

As a Senior Data Engineer specializing in Natural Gas and Power, you will support the design, development, and optimization of advanced data infrastructure and products that support critical trading, risk, and market analytics functions. You will collaborate closely with traders, quantitative analysts, risk managers, and IT stakeholders to ensure data systems are scalable, secure … ETL/ELT frameworks and orchestration tools (e.g., Airflow, Azure Data Factory, Dagster). Proficient in cloud platforms (preferably Azure) and services such as Data Lake, Synapse, Event Hubs, and Functions. Authoring reports and dashboards with either open source or commercial products (e.g. PowerBI, Plot.ly, matplotlib) Programming OOP DevOps Web technologies HTTP/S REST … with time-series databases (e.g., InfluxDB, kdb+, TimescaleDB) and real-time data processing. Familiarity with distributed computing and data warehousing technologies (e.g., Spark, Snowflake, Delta Lake). Strong understanding of data governance, master data management, and data quality frameworks. Solid grasp of web technologies and APIs (REST, JSON, XML More ❯

Enterprise Architect - AI/Data Washington, DC (5 days a week on-site) Public Trust You will use your deep knowledge of enterprise architecture principles, AI technologies, and data management practices to guide decision-making and ensure that the architecture supports business objectives and enhances operational capabilities. Key Responsibilities: • Design and develop end-to-end AI … and data architectures that support business goals, ensuring scalability, performance, security, and maintainability. • Create architectural blueprints and roadmaps that guide the integration of AI and data solutions across the organization. • Lead the development and implementation of data platforms and AI-driven systems that facilitate advanced analytics, machine learning, and automation. • Define AI strategy and … and on-premises data architectures using platforms like Azure, AWS, or Google Cloud. • Work with big data technologies (e.g., Hadoop, Spark) and data lake architectures to ensure the organization's data can be ingested, processed, and analyzed at scale. • Manage the integration of AI models and algorithms into big data More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯