26 to 50 of 386 Data Lake Jobs

that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … re underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP More ❯

A Manchester based FMCG is seeking a highly skilled Senior/LeadData Engineer to join their growing data team. This role will be instrumental in designing, building, and maintaining a modern data warehouse and data infrastructure to support advanced analytics and reporting needs for a fast-growing organisation. Key Responsibilities: Design … develop, and maintain scalable data pipelines using SQL and Python (PySpark) . Ingest, transform, and curate data from multiple sources into Azure Data Lake and Delta Lake formats. Build and optimize datasets for performance and reliability in Azure Databricks . Collaborate with analysts and business stakeholders to translate data requirements … in SQL for data transformation and performance tuning. Solid experience with Python , ideally using PySpark in Azure Databricks . Hands-on experience with Azure Data Lake Storage Gen2 . Understanding of data warehouse concepts , dimensional modelling , and data architecture . Experience working with Delta Lake and large-scale data More ❯

The Role We are looking for a hands-on Azure Data Engineer who will lead the final phase of our Client's cloud migration and design the enterprise-grade data platform from the ground up. This is a hybrid role with a strong technical focus—blending architecture, automation, and data engineering—to empower s … across Europe, the US, and APAC. As they scale globally and accelerate their AI capabilities, they are completing their transition to the cloud and building a company-wide data platform to power insight-driven transformation for their consultants and clients Required Skills & Experience Must-Haves: 3+ years of hands-on Azure engineering experience (IaaS PaaS), including Infra as … SME—guiding system administrators and upskilling junior technical team members. What You'll Achieve in Year 1 Months 3-12: Design and build their Azure data lake using Synapse , Fabric , or an alternative strategy. Ingest data from core platforms: NetSuite , HubSpot , and client RFP datasets. Automate data pipelines using ADF , Fabric Dataflows More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization … of diverse business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating … data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization … of diverse business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating … data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments More ❯

UK Head Office - Manchester Hybrid/PERMANENT/SALARY: COMPETITIVE Job Purpose The Data Lead is responsible for leading and growing MPM's data capabilities. Managing the data team, overseeing the design, delivery, and governance of data infrastructure, pipelines, and analytics solutions. The Data Lead is also responsible for setting … and executing the vision for data within the organisation, enabling accurate, timely, and actionable insights through data practices, collaboration, and strong leadership. This role deals with a wide variety of tasks including, but not limited to the following: Manage, mentor, and grow the newly formed Data Team to deliver high-quality solutions that meet … evolving business objectives. Define and maintain the roadmap for data infrastructure, tools, and quality standards. Lead a data-first culture across the organisation, championing data literacy and self-service capabilities. Represent the Data Team in leadership discussions and ensure alignment with business priorities. Continuously improve data operations, governance, and platform More ❯

people too - creating new challenges and opportunities all the time. We're a business that never stands still. Join us on our journey to as a Head of Data Engineering & Insight, and you won't either. As part of our accelerated digital transformation and the implementation of our new Next Generation BI platform, we are looking for a … years' experience in Business Intelligence, with 5+ years in a BI leadership role in a global or matrixed organisation . Proven expertise in modern BI architecture (Data Lake, EDW, Streaming, APIs, Real-Time & Batch Processing). Demonstrated experience delivering cloud-based analytics platforms (Azure, AWS, GCP). Strong knowledge of data governance, cataloguing, security, automation … Engineering & Insight will work within a modern, cloud-based BI ecosystem , including: Data Integration: Fivetran , HVR, Databricks , Apache Kafka, Google BigQuery , Google Analytics 4 Data Lake & Storage: Databricks Delta Lake, Amazon S3 Data Transformation: dbt Cloud Data Warehouse: Snowflake Analytics & Reporting: Power BI, Excel, Snowflake SQL REST API Advanced Analytics More ❯

people too - creating new challenges and opportunities all the time. We're a business that never stands still. Join us on our journey to as a Head of Data Engineering & Insight, and you won't either. As part of our accelerated digital transformation and the implementation of our new Next Generation BI platform, we are looking for a … years' experience in Business Intelligence, with 5+ years in a BI leadership role in a global or matrixed organisation . Proven expertise in modern BI architecture (Data Lake, EDW, Streaming, APIs, Real-Time & Batch Processing). Demonstrated experience delivering cloud-based analytics platforms (Azure, AWS, GCP). Strong knowledge of data governance, cataloguing, security, automation … Engineering & Insight will work within a modern, cloud-based BI ecosystem , including: Data Integration: Fivetran , HVR, Databricks , Apache Kafka, Google BigQuery , Google Analytics 4 Data Lake & Storage: Databricks Delta Lake, Amazon S3 Data Transformation: dbt Cloud Data Warehouse: Snowflake Analytics & Reporting: Power BI, Excel, Snowflake SQL REST API Advanced Analytics More ❯

We are on the lookout for a Data Engineer with a robust background in SQL Server and ideally Azure Data Factory. The ideal candidate will have a wealth of experience in business intelligence, data modelling, and visualisation, and will be proficient in Agile Scrum Development methodology. This pivotal role involves leading the development of … based in Middlesbrough, with on-site presence 2-3 times weekly. Day to Day of the role: Lead the development of BI Solution Architecture, Replication Warehouse, and secure data sets using the Microsoft application stack. Create and maintain secure data sets for systems, enabling Key users to produce reports. Perform ETL integrations and support tasks using … a related role. Proficiency with SQL Management Server, SSRS, SSIS, and other related systems. Experience with Microsoft Azure stack and technologies such as ADF, Logic Apps, Data Lake, Data Bricks, Power Query, etc. Experience in low code MS related technologies, SharePoint, Nintex, Power Apps, Power Bi, etc. ETL related experience using SSIS, ADF, or similar More ❯

We are on the lookout for a Data Engineer with a robust background in SQL Server and ideally Azure Data Factory. The ideal candidate will have a wealth of experience in business intelligence, data modelling, and visualisation, and will be proficient in Agile Scrum Development methodology. This pivotal role involves leading the development of … based in Goldthorpe, with on-site presence 2-3 times weekly. Day to Day of the role: Lead the development of BI Solution Architecture, Replication Warehouse, and secure data sets using the Microsoft application stack. Create and maintain secure data sets for systems, enabling Key users to produce reports. Perform ETL integrations and support tasks using … a related role. Proficiency with SQL Management Server, SSRS, SSIS, and other related systems. Experience with Microsoft Azure stack and technologies such as ADF, Logic Apps, Data Lake, Data Bricks, Power Query, etc. Experience in low code MS related technologies, SharePoint, Nintex, Power Apps, Power Bi, etc. ETL related experience using SSIS, ADF, or similar More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI software development including database/reporting development, full … development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI/MI solutions in line with agreed architectural principles and toolsets. Capable of working closely with … movements, including assisting with solution design for new and existing requirements. Collaborate with the business to understand needs. Design and develop ETL/ELT processes, data lake storage architecture, data warehouse, data marts, cubes, reports and dashboards; in-line with the company data management framework and enterprise data More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI software development including database/reporting development, full … development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI/MI solutions in line with agreed architectural principles and toolsets. Capable of working closely with … movements, including assisting with solution design for new and existing requirements. Collaborate with the business to understand needs. Design and develop ETL/ELT processes, data lake storage architecture, data warehouse, data marts, cubes, reports and dashboards; in-line with the company data management framework and enterprise data More ❯

We are looking for a hands-on, technically driven Data Engineer to join our expanding data team. This role is ideal for someone with a strong foundation in SQL and data management, who has recently graduated from a Data Science or Data Engineering programme and is eager to apply their … skills in a modern, forward-thinking environment. You will be responsible for developing and maintaining robust data solutions that support reporting, automation, and strategic decision-making across the business. The successful candidate will have up-to-date knowledge of data tooling and methodologies, particularly in SQL, Power BI, and data automation, with an interest … Experience with Power Automate for data-driven workflows. Understanding of ETL concepts and processes. Exposure to modern data platforms such as Azure Data Lake , Databricks , or Microsoft Fabric is a bonus. Analytical Skills: Ability to understand complex data structures and derive actionable insights. Strong problem-solving ability with attention to detail. More ❯

achieving their strategic goals and empower our people to make an impact and develop their own unique career path. About the team and your role Our Digital and Data Advisory practice, as part of our broader Business Transformation client offering, consists of three teams: Digital Finance team working with clients to understand how their finance functions work, assisting … throughout their digital transformation journey from defining a digital strategy and roadmap, creating a business case, selecting the right software, documenting user stories, to managing and assuring projects. Data analytics and insights team working with clients to help them understand their level of data analytics maturity and to develop a data analytics strategy that … Analysis Services (SSAS), SQL Server Data Tools (SSDT), SQL Server Reporting Services (SSRS), Azure Data Resources, Azure Data Factory, Azure Data Lake, Azure Data Bricks and Azure Analysis Services. Able to support clients and prospects in their evaluation of Business Intelligence solutions providing information and demonstrations to help them More ❯

Product Owner (Data & Analytics) Bristol Hybrid - 3 days pw onsite £60,000 to £70,000 We currently have an exciting opportunity for a Data Product Owner to join a leading and customer centric financial services company. In this role, you’ll drive the evolution and implementation of data products, ensuring high-quality, accessible, and … trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between business stakeholders, data scientists, analysts, engineers, and governance teams, you'll manage the data product backlog and ensure continuous delivery of data capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. What you'll bring... Experience as a Data Product More ❯

Operations is seeking an experienced Product Owner to become an integral part of our Agile development team. In this role, you'll drive the evolution and implementation of data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products … that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between business stakeholders, data scientists, analysts, engineers, and governance teams, you'll manage the data product backlog and ensure continuous delivery of data capabilities that align with enterprise objectives. Acting as a liaison between stakeholders … translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. About You Strong experience as a Product Owner or Data Product Owner in Agile environments. Experience managing data products or platforms, ideally customer data platforms (CDPs), data warehouses (e.g. Snowflake, BigQuery), or data More ❯

seeking an experienced Product Owner to become an integral part of our Agile development team. In this role, you'll drive the evolution and implementation of Finance and data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products … that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between Finance business stakeholders, data scientists, analysts and engineers, you'll manage the Finance product backlog and ensure continuous delivery of capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will … translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. About You Strong experience as a Product Owner or Data Product Owner in Agile environments. Ideally experience managing Finance and data products or platforms, ideally data warehouses (e.g. Snowflake, BigQuery), or data lakes. More ❯

seeking an experienced Product Owner to become an integral part of our Agile development team. In this role, you'll drive the evolution and implementation of Finance and data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products … that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between Finance business stakeholders, data scientists, analysts and engineers, you'll manage the Finance product backlog and ensure continuous delivery of capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will … translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. Qualifications Strong experience as a Product Owner or Data Product Owner in Agile environments. Ideally experience managing Finance and data products or platforms, ideally data warehouses (e.g. Snowflake, BigQuery), or data lakes. Familiarity More ❯

seeking an experienced Product Owner to become an integral part of our Agile development team. In this role, you'll drive the evolution and implementation of Finance and data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products … that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between Finance business stakeholders, data scientists, analysts and engineers, you'll manage the Finance product backlog and ensure continuous delivery of capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will … translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. Qualifications Strong experience as a Product Owner or Data Product Owner in Agile environments. Ideally experience managing Finance and data products or platforms, ideally data warehouses (e.g. Snowflake, BigQuery), or data lakes. Familiarity More ❯

Job Summary: GridIron IT is looking for a Data Management Technical Lead to support a large U.S. Department of Justice (DOJ) program. The Antitrust Division of the U.S. Department of Justice (DOJ) is responsible for enforcing federal antitrust laws and promoting fair competition in the marketplace. The Data Management Technical Lead will be responsible for overseeing … DC area. Key Responsibilities: • Lead the configuration, deployment, and administration of Azure cloud resources and services, ensuring optimal performance, scalability, and security. • Manage Azure Storage, Azure Data Lake, and Azure SQL Database for data storage and analysis needs. • Oversee Azure Active Directory and other Azure services to manage user access, security, and compliance. • Implement automation … management, with at least 3+ years in a technical leadership or SME role. • Expertise in Azure Administration and management, including Azure SQL Database, Azure Data Lake, and Azure Storage. • Deep understanding of SQL Server/Database Administration, including performance tuning, backup strategies, and migrations. • Hands-on experience with Apache Tomcat for web application and service More ❯

You are enthusiastic about data engineering and you want to help in supporting and optimizing BI solutions. You have a basic understanding of BI in Azure and a strong desire to learn, particularly in areas such as data pipelines, error management, and visualization. Activities Serve as the primary point of contact for customer inquiries regarding our … BI solutions. Handle support requests independently through the ticket system, actively contributing to solution development. Support customers with tasks such as: Managing data loading jobs Error handling, including logging, documentation, resolution, or escalation Collaborate with the support team to maintain, enhance, and ensure the reliability of our BI systems hosted on Microsoft Azure. Optimize and manage Azure data … Hands on experience with Cloud platform. Microsoft Azure is preferable. Particularly Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Synapse Analytics, and Azure Data Lake Storage. Familiarity with programming languages such as Python, Scala, Java, C#. Bachelor's or Master's degree in computer science or Business Administration or related field. Knowledge of data More ❯

Join a Leading Semiconductor Company as an ESG Data Reporting Manager ! Job Overview: Be at the forefront of sustainability transformation in a global tech leader. This is a unique opportunity to lead the development of a cutting-edge ESG data infrastructure, supporting regulatory compliance and strategic reporting. You’ll drive the integration of platforms like Workiva … and a new Carbon Management system to create a trusted, enterprise-wide ESG data ecosystem. Contract Details Contract Length: 12 months (with potential to extend or convert to permanent) Location: Cambridge (hybrid – twice per week on-site) Daily Rate: £700 per day through umbrella … Key Responsibilities Lead the design and implementation of an ESG data governance framework (policies, ownership, controls, RACIs). Oversee the development of an ESG data lake and integration with Workiva and Carbon Management platforms. Map and standardize ~100 ESG metrics; develop scalable templates for future data needs. Automate manual data feeds More ❯

talk with your recruiter to learn more. Base pay range Direct message the job poster from NineTech NineTech's client are looking for a highly skilled and experienced Data Architect to lead the design, development, and implementation of data architecture solutions across the organization. This role is an INSIDE IR35 position and paying up to … P/D DOE Below is a breakdown of the role. The ideal candidate will possess deep expertise in ServiceNow , Oracle , Data Lakes , and Data Migration strategies. Knowledge of Elastic Search and modern data engineering practices is highly desirable. Key Responsibilities: Design and maintain scalable, secure, and high-performing data architectures. Develop … integration and migration strategies between legacy and modern systems. Lead architecture initiatives related to ServiceNow data modeling , integration, and reporting. Architect and support enterprise Data Lake solutions, ensuring data availability, quality, and consistency. Drive the design and execution of data migration projects , especially those involving Oracle-based systems. Collaborate with stakeholders More ❯

future of data within the business, designing and maintaining robust data pipelines and curated data products within a cloud-based data lake environment. You will play a key role in embedding data engineering best practices, supporting colleagues across the data community, and ensuring the delivery of impactful … power analytics, machine learning, and operational efficiencies. Key Responsibilities: Design, develop and maintain data pipelines and data assets within an AWS-based data lake architecture (S3, Glue, Lake Formation). Act as the technical subject matter expert on data engineering, offering in-house consultancy support to multiple business areas. Engage … SageMaker, QuickSight). Strong documentation, communication, and stakeholder management skills. Adept at managing multiple priorities in a fast-paced environment, with strong attention to detail. Desirable: Familiarity with AWS Lake Formation and real-time streaming tools (e.g., AWS Kinesis/Firehose). Experience within the transport, travel, or leisure industries. Knowledge of AWS Redshift and traditional data More ❯

My FTSE 100 Client is urgently recruiting for a Data Solutions Architect, the chosen Candidate will be at the forefront of shaping end-to-end data architectures that support analytics, AI, and enterprise reporting across the organisation. You will lead solution design, champion best practices, and work closely with business … and technical stakeholders to deliver robust, scalable, and secure data platforms. Key Responsibilities Design and implement modern data architectures using Azure Synapse , Data Lake , Data Factory , Databricks , and Microsoft Fabric . Lead the development of integrated data solutions supporting BI, advanced analytics, and real-time data processing. … Define data governance, security, and compliance standards across the data lifecycle. Collaborate with cross-functional teams to translate business requirements into technical blueprints. Stay ahead of emerging trends in cloud, data, and AI, bringing innovative thinking into the organisation. About You Proven experience as a Data Architect or similar role in cloud More ❯