1 to 25 of 276 Permanent Data Lake Jobs in England

Senior Data Engineer - (Azure/Databricks) Axis Capital London, United Kingdom Apply now Posted 15 days ago Permanent Competitive Senior Data Engineer - (Azure/Databricks) Axis Capital London, United Kingdom Apply now This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding … data solutions are secure, efficient, and optimized. Key Responsibilities: Design and implement data solutions using Azure services, including Azure Databricks, ADF, and Data Lake Storage. Develop and maintain ETL/ELT pipelines to process structured and unstructured data from multiple sources. - Automate loads using Databricks workflows and Jobs Develop, test and … warehousing, and real-time streaming. Knowledge of developing and processing full and incremental loads. Experience of automated loads using Databricks workflows and Jobs Expertise in Azure Databricks, including Delta Lake, Spark optimizations, and MLflow. Strong experience with Azure Data Factory (ADF) for data integration and orchestration. Hands-on experience with Azure DevOps, including pipelines, repos More ❯

Job summary We are looking for an experienced Senior Data Engineer with strong technical expertise and innovative mindset to drive our team forward. Main duties of the job Data Engineer will be involved in the entire data pipeline from data acquisition to data extraction, ensuring that the data is accurate, reliable, and accessible, and fit-for-purpose for business intelligence, analytics, and data science functions. Data Engineer will be collaborating with cross-functional teams to support the delivery of impactful analytics work for our clients. About us We are the official research support team for the NHS Benchmarking Network, working with over … healthcare organisations across the UK to identify opportunities for service development and quality improvement. We also serve as the primary source of benchmarking data for the NHS England Workforce, Training and Education team, providing in-depth analysis across national mental health services. Our unique and comprehensive datasets support strategic decision-making and resource allocation across the UK healthcare More ❯

that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … re underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP More ❯

Broster Buchanan are partnered global business within the food industry with a turnover of £8Bn+ who are looking for a Fabric Data Engineer to join as they set up an exciting new project team within the group. This would suit an experienced Azure Data Engineer with good Fabric experience looking to join a new, growing team … Collaborate with their wider technology and business teams to ensure goals and visions are aligned and achieved Help with setting up the data warehousing and lake processes, including collaborating with their architecture teams to figure out what that will look like At times, guide and mentor the junior data engineers within the team … end project lifecycle Strong experience with setting up and using big data storage solutions, including data warehouses, data lakes or data lake houses Able to build and demonstrate a solid understanding of the concepts of real time data streaming, batch data processing and data transformation More ❯

Peaple Talent has partnered with a global digital engineering consultancy who are recruiting for a Lead Data Engineer on a permanent basis based out of their Sunderland office. You will have a great understanding of technology consultancy services along with fantastic communication and stakeholder engagement skills as this role will be client facing. Skills and experience: Proven experience … as a Lead Data Engineer with a focus on Azure cloud services. Experience of managing small teams whilst also being hands-on. Strong database fundamentals including SQL/TSQL, performance and schema design. Experience architecting and building data … applications using Azure, specifically a Data Warehouse and/or Data Lake. Technologies : Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and More ❯

to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be … or solving tough engineering challenges. You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We're technology agnostic, and we're open minded when it More ❯

that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … re underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization … of diverse business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating … data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments More ❯

support EQ's transition into a stronger, more profitable, product-led business, driven by real insights and the needs of its customers. We are looking for a skilled Data Engineer to join our Data team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines … cloud-based data pipelines and architectures Strong expertise in Microsoft Fabric and Databricks, including data pipeline development, data warehousing, and data lake management Proficiency in Python, SQL, Scala, or Java Experience with data processing frameworks such as Apache Spark, Apache Beam, or Azure Data Factory Strong understanding … Azure and or AWS Strong collaboration and communication skills, with the ability to work effectively with cross-functional teams Desirable: Experience with Azure Synapse Analytics, Azure Data Lake Storage, or other Azure data services Experience with agile development methodologies and version control systems such as Git Certification in Microsoft Azure, Databricks, or other relevant technologies More ❯

Data Solutions Architect – Any Cloud (Banking) Location: London, United Kingdom (Flexible Hybrid Working) Type: Permanent, Full-Time A leading global consultancy is seeking an experienced Data Solutions Architect to join its growing Data Management practice. This is a strategic, client-facing role focused on modernising data platforms within the banking sector , enabling … large-scale cloud transformation and data-driven decision-making. You will lead architecture design, influence enterprise data strategies, and guide technical delivery across cloud ecosystems like Azure , AWS , or GCP . This role also involves significant pre-sales engagement—translating client requirements into solution blueprints and supporting proposal development. Key Responsibilities Architect and oversee the delivery … of enterprise-scale data platforms (data lakes, lakehouses, warehouses) using tools like Databricks , Snowflake , Synapse , and Azure Fabric Define and execute cloud migration strategies, leveraging CI/CD pipelines, Terraform, Azure DevOps, and GitHub Support RFP/RFI responses, conduct client workshops, and shape pre-sales proposals (40–50% of the role) Advise senior client stakeholders More ❯

Data Solutions Architect – Any Cloud (Banking) Location: London, United Kingdom (Flexible Hybrid Working) Type: Permanent, Full-Time A leading global consultancy is seeking an experienced Data Solutions Architect to join its growing Data Management practice. This is a strategic, client-facing role focused on modernising data platforms within the banking sector , enabling … large-scale cloud transformation and data-driven decision-making. You will lead architecture design, influence enterprise data strategies, and guide technical delivery across cloud ecosystems like Azure , AWS , or GCP . This role also involves significant pre-sales engagement—translating client requirements into solution blueprints and supporting proposal development. Key Responsibilities Architect and oversee the delivery … of enterprise-scale data platforms (data lakes, lakehouses, warehouses) using tools like Databricks , Snowflake , Synapse , and Azure Fabric Define and execute cloud migration strategies, leveraging CI/CD pipelines, Terraform, Azure DevOps, and GitHub Support RFP/RFI responses, conduct client workshops, and shape pre-sales proposals (40–50% of the role) Advise senior client stakeholders More ❯

Lead Data Engineer - Manchester - Hybrid - £75k - £80k This is an excellent opportunity for a highly experienced data engineer to join a growing tech consultancy and contribute to the leadership of their data engineering practice. If you are an experienced and capable data engineer with a history of using Microsoft products and working … of clients to gather requirements and deliver solutions. Be willing to engage and assist in pre-sales activities, bids, proposals etc. Use key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. Consistently utilise key processes in the engineering delivery cycle including Agile … and DevOps, Git, APIs, Containers, Microservices and Data Pipelines. Assist in building out, developing, and training the data engineering function. What do I need to apply Strong MS data engineering expertise (Fabric, ADF, ADL, Synapse, SQL) Expert use of Databricks Strong Python experience Consultancy experience Leadership experience My client are looking to book in More ❯

Lead Data Engineer - Manchester - Hybrid - £75k - £80k This is an excellent opportunity for a highly experienced data engineer to join a growing tech consultancy and contribute to the leadership of their data engineering practice. If you are an experienced and capable data engineer with a history of using Microsoft products and working … of clients to gather requirements and deliver solutions. Be willing to engage and assist in pre-sales activities, bids, proposals etc. Use key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. Consistently utilise key processes in the engineering delivery cycle including Agile … and DevOps, Git, APIs, Containers, Microservices and Data Pipelines. Assist in building out, developing, and training the data engineering function. What do I need to apply Strong MS data engineering expertise (Fabric, ADF, ADL, Synapse, SQL) Expert use of Databricks Strong Python experience Consultancy experience Leadership experience My client are looking to book in More ❯

Job Description Role : Data Architect (GCP) Location : London Salary : £80,000 to £130,000 (Multiple grades) + bonus & benefits We are supporting a global technology services provider in the strategic expansion of their Google Cloud Data and AI practice, with multiple opportunities available for experienced professionals across architecture and engineering. This unit is driving major transformation … initiatives with flagship enterprise clients, with a focus on intelligent data platforms, AI-driven analytics, and scalable cloud- solutions. Role Overview This is a strategic and hands-on opportunity for an experienced Data Architect to lead the development of a robust, scalable data architecture on Google Cloud Platform (GCP). You’ll be responsible … for defining the platform strategy, leading a team of data engineers, and ensuring high standards of data quality, compliance, and performance across enterprise-grade data environments. Key Responsibilities: Design and implement enterprise-level data architecture strategies on GCP. Gather client requirements and translate business challenges into scalable data solutions. Act More ❯

Get AI-powered advice on this job and more exclusive features. Direct message the job poster from Tenth Revolution Group Data & Analytics Recruitment Specialist | Connecting Top Data Talent with Innovative Organisations in the UK Data Solutions Architect – Any Cloud (Banking) Location: London, United Kingdom (Flexible Hybrid Working) Type: Permanent, Full-Time A leading global … consultancy is seeking an experienced Data Solutions Architect to join its growing Data Management practice. This is a strategic, client-facing role focused on modernising data platforms within the banking sector , enabling large-scale cloud transformation and data-driven decision-making. You will lead architecture design, influence enterprise data strategies … This role also involves significant pre-sales engagement—translating client requirements into solution blueprints and supporting proposal development. Key Responsibilities Architect and oversee the delivery of enterprise-scale data platforms (data lakes, lakehouses, warehouses) using tools like Databricks , Snowflake , Synapse , and Azure Fabric Define and execute cloud migration strategies, leveraging CI/CD pipelines, Terraform, Azure More ❯

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office 39,784 - 49,477 (National) 45,456- 55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - 62,000 (National) and 67,000 (London within the M25) Homeworking allowance of 581 per annum Job Ref: J12964 The role of the … Senior Azure Data Engineer is to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The role holder will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for … re-use, adaptation and efficient engineering. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable components and products. Design, write and iterate code from More ❯

A Manchester based FMCG is seeking a highly skilled Senior/LeadData Engineer to join their growing data team. This role will be instrumental in designing, building, and maintaining a modern data warehouse and data infrastructure to support advanced analytics and reporting needs for a fast-growing organisation. Key Responsibilities: Design … develop, and maintain scalable data pipelines using SQL and Python (PySpark) . Ingest, transform, and curate data from multiple sources into Azure Data Lake and Delta Lake formats. Build and optimize datasets for performance and reliability in Azure Databricks . Collaborate with analysts and business stakeholders to translate data requirements … in SQL for data transformation and performance tuning. Solid experience with Python , ideally using PySpark in Azure Databricks . Hands-on experience with Azure Data Lake Storage Gen2 . Understanding of data warehouse concepts , dimensional modelling , and data architecture . Experience working with Delta Lake and large-scale data More ❯

Join a Leading Semiconductor Company as an ESG Data Reporting Manager ! Job Overview: Be at the forefront of sustainability transformation in a global tech leader. This is a unique opportunity to lead the development of a cutting-edge ESG data infrastructure, supporting regulatory compliance and strategic reporting. You’ll drive the integration of platforms like Workiva … and a new Carbon Management system to create a trusted, enterprise-wide ESG data ecosystem. Contract Details Contract Length: 12 months (with potential to extend or convert to permanent) Location: Cambridge (hybrid – twice per week on-site) Daily Rate: £700 per day through umbrella … Key Responsibilities Lead the design and implementation of an ESG data governance framework (policies, ownership, controls, RACIs). Oversee the development of an ESG data lake and integration with Workiva and Carbon Management platforms. Map and standardize ~100 ESG metrics; develop scalable templates for future data needs. Automate manual data feeds More ❯

talk with your recruiter to learn more. Base pay range Direct message the job poster from NineTech NineTech's client are looking for a highly skilled and experienced Data Architect to lead the design, development, and implementation of data architecture solutions across the organization. This role is an INSIDE IR35 position and paying up to … P/D DOE Below is a breakdown of the role. The ideal candidate will possess deep expertise in ServiceNow , Oracle , Data Lakes , and Data Migration strategies. Knowledge of Elastic Search and modern data engineering practices is highly desirable. Key Responsibilities: Design and maintain scalable, secure, and high-performing data architectures. Develop … integration and migration strategies between legacy and modern systems. Lead architecture initiatives related to ServiceNow data modeling , integration, and reporting. Architect and support enterprise Data Lake solutions, ensuring data availability, quality, and consistency. Drive the design and execution of data migration projects , especially those involving Oracle-based systems. Collaborate with stakeholders More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization … of diverse business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating … data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization … of diverse business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating … data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments More ❯

UK Head Office - Manchester Hybrid/PERMANENT/SALARY: COMPETITIVE Job Purpose The Data Lead is responsible for leading and growing MPM's data capabilities. Managing the data team, overseeing the design, delivery, and governance of data infrastructure, pipelines, and analytics solutions. The Data Lead is also responsible for setting … and executing the vision for data within the organisation, enabling accurate, timely, and actionable insights through data practices, collaboration, and strong leadership. This role deals with a wide variety of tasks including, but not limited to the following: Manage, mentor, and grow the newly formed Data Team to deliver high-quality solutions that meet … evolving business objectives. Define and maintain the roadmap for data infrastructure, tools, and quality standards. Lead a data-first culture across the organisation, championing data literacy and self-service capabilities. Represent the Data Team in leadership discussions and ensure alignment with business priorities. Continuously improve data operations, governance, and platform More ❯

Senior Data Engineer - AWS Leeds/Hybrid, c. 2x per week Salary - Competitve/Negotiable The Role Joining one of the best tech consultancies in the North. The Senior Data Engineer role focuses on the production of scalable and robust data solutions for clients, through conception, deployment and their ongoing evolution. Working closely with … stakeholders across the business - including product managers, analysts, and software developers you will ensure seamless data integration and reporting capabilities to support informed decision-making. The role focuses on building and optimising data pipelines, managing data warehousing, and ensuring high-quality data availability for business insights. You will be instrumental in enabling … efficient data processing, transformation, and analysis through best-in-class technologies and methodologies. Your ability to design scalable data solutions, solve problems creatively, and collaborate with both technical and non-technical teams will be crucial to success. While technical expertise is at the core of the role, strong communication skills and a proactive mindset are equally More ❯

people too - creating new challenges and opportunities all the time. We're a business that never stands still. Join us on our journey to as a Head of Data Engineering & Insight, and you won't either. As part of our accelerated digital transformation and the implementation of our new Next Generation BI platform, we are looking for a … years' experience in Business Intelligence, with 5+ years in a BI leadership role in a global or matrixed organisation . Proven expertise in modern BI architecture (Data Lake, EDW, Streaming, APIs, Real-Time & Batch Processing). Demonstrated experience delivering cloud-based analytics platforms (Azure, AWS, GCP). Strong knowledge of data governance, cataloguing, security, automation … Engineering & Insight will work within a modern, cloud-based BI ecosystem , including: Data Integration: Fivetran , HVR, Databricks , Apache Kafka, Google BigQuery , Google Analytics 4 Data Lake & Storage: Databricks Delta Lake, Amazon S3 Data Transformation: dbt Cloud Data Warehouse: Snowflake Analytics & Reporting: Power BI, Excel, Snowflake SQL REST API Advanced Analytics More ❯

people too - creating new challenges and opportunities all the time. We're a business that never stands still. Join us on our journey to as a Head of Data Engineering & Insight, and you won't either. As part of our accelerated digital transformation and the implementation of our new Next Generation BI platform, we are looking for a … years' experience in Business Intelligence, with 5+ years in a BI leadership role in a global or matrixed organisation . Proven expertise in modern BI architecture (Data Lake, EDW, Streaming, APIs, Real-Time & Batch Processing). Demonstrated experience delivering cloud-based analytics platforms (Azure, AWS, GCP). Strong knowledge of data governance, cataloguing, security, automation … Engineering & Insight will work within a modern, cloud-based BI ecosystem , including: Data Integration: Fivetran , HVR, Databricks , Apache Kafka, Google BigQuery , Google Analytics 4 Data Lake & Storage: Databricks Delta Lake, Amazon S3 Data Transformation: dbt Cloud Data Warehouse: Snowflake Analytics & Reporting: Power BI, Excel, Snowflake SQL REST API Advanced Analytics More ❯