676 to 700 of 913 Data Engineer Jobs in the UK

Senior Data Engineer – Snowflake Platform Build Location: London (2 days a week on site) Contract: 6 month sign on (18–24 month project) We’re building the next version of our data platform, with Snowflake at the core. The PoC is in place — now we need someone … been through this before to lead the implementation and help scale the platform across the business. The project involves migrating our current on-prem Data Lake to Snowflake, while keeping storage on a private cloud . You’ll be setting the foundations: building out ETL pipelines, establishing best practices … background in Python , PySpark , and Spark Hands-on with platform setup – ideally with a DevOps-first approach Exposure to AWS environments Experience working with data from trading platforms or within commodities, banking, or financial services Tech environment: Primary Platform: Snowflake Other Tech: DBT, Databricks, Spark, PySpark, Python Cloud: AWS More ❯

Position : Lead Data Engineer (Platform) Location : London (Hybrid, 2 days a week in-office) Salary : £95,000 per annum + Benefits Package Join an iconic UK-based organisation in the media industry looking to modernise and expand its data engineering capabilities. In the role, you’ll be … responsible for overseeing the stability, scalability, and continuous enhancement of a well-established cloud-native data platform. Key Responsibilities: Lead and coach a team of skilled data engineers, fostering best practices and a strong engineering culture Take ownership of critical platform components, ensuring performance, reliability, and security Manage … and optimise complex data pipelines using Airflow within a Google Cloud Platform environment Drive continuous improvements to architecture, infrastructure, and workflow automation Core Tech Stack: Must-have : Google Cloud Platform (GCP), Apache Airflow Nice-to-have : dbt, Terraform, Kubernetes Bonus : Familiarity or curiosity about generative AI tools (e.g. ChatGPT More ❯

our global technical platform that supports these different processes and drives forward long-term solutions to enhance Group capabilities. We are looking for a Data Engineer to help achieve this goal - ideally someone who is comfortable diving into different tasks to support each team using a variety of … developing relationships across the company while explaining technical processes in the most appropriate way, and who keeps an eye on scalable solutions to support data growth. This is therefore an exciting opportunity to take on a role that combines complex data engineering, visual analytics and business critical need. … Markets teams to design and build key operational and reporting pipelines across all Octopus Energy regions; Taking responsibility for the maintenance of these critical data pipelines supporting core trading, forecasting, risk and PPA processes; Developing automations and alerts to quickly debug where these pipelines are failing or showing unprecedented More ❯

A leading UK consultancy is seeking an experienced Lead Data Engineer to join their growing team. This role is ideal for a technically strong, hands-on professional with proven experience designing and delivering modern data solutions-particularly within AWS environments-and leading technical teams. What You'll … Do: Design and build scalable data solutions using AWS services (Redshift, Glue, S3, Step Functions). Lead the development of robust ETL/ELT workflows with AWS Glue and Python. Manage and mentor Data Engineers and Analysts across multiple projects. Collaborate with DevOps to maintain CI/CD … pipelines (Jenkins, GitHub, AWS tools). Align data strategy with business goals through close client collaboration. Engage with senior stakeholders to define and deliver data-driven architecture. What You Bring: Degree in IT or a related technical field (minimum 2:1 classification). Eligibility for SC Clearance Proven More ❯

A leading UK consultancy is seeking an experienced Lead Data Engineer to join their growing team. This role is ideal for a technically strong, hands-on professional with proven experience designing and delivering modern data solutions-particularly within AWS environments-and leading technical teams. What You'll … Do: Design and build scalable data solutions using AWS services (Redshift, Glue, S3, Step Functions). Lead the development of robust ETL/ELT workflows with AWS Glue and Python. Manage and mentor Data Engineers and Analysts across multiple projects. Collaborate with DevOps to maintain CI/CD … pipelines (Jenkins, GitHub, AWS tools). Align data strategy with business goals through close client collaboration. Engage with senior stakeholders to define and deliver data-driven architecture. What You Bring: Degree in IT or a related technical field (minimum 2:1 classification). Eligibility for SC Clearance Proven More ❯

they need to deliver better quality care and improve efficiency across most day-to-day operations. This enables us to collect over 1.5 billion data points on care recipient wellbeing each year, making Birdie the holder of the largest structured community healthcare dataset in Europe. Birdie was founded in … home healthcare. Together, we will continue to make a meaningful difference in the lives of millions. Your mission at Birdie We strongly believe that data holds the key to unlock innovation in social care. It is the foundation of how we learn as a company as well as how … we enable our customers to improve their services. Our applications and services generate a wealth of rich data - it is essential that we're able to process, analyse & deliver as much of it as possible to improve the lives of older adults. You will help maintain and build out More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can transform enterprise operations? Do you possess the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? If so, you might be the ideal candidate for the Data … goals. This initiative requires significant thought leadership, technical know-how, and the ability to navigate complex challenges while leading a team of top-tier data and analytics professionals. In this role, you will operate globally, collaborating with engineering teams across growth products, to develop and maintain robust data pipelines and storage solutions supporting analytics and machine learning initiatives. You will report to the Director of Data Engineering Solutions. Responsibilities: Technical Leadership: Provide leadership to data and DevOps engineers, guiding the design and evolution of scalable data platforms, fostering a culture of innovation and high More ❯

sorting and pack-out-Locus Robotics empowers businesses to meet peak demands and adapt to ever-changing operational needs. Are you a skilled Python Data Engineer with a passion for building scalable, production-level systems and an interest in machine learning? We want to hear from you!At … Locus Robotics, we're evolving our data infrastructure to support advanced machine learning capabilities and real-time analytics. As a key member of our team, you'll help migrate our existing codebase into machine learning territory, drive innovation across multiple deployment sites, and collaborate closely with our optimization and … ll develop robust Python code, analyze system performance, and contribute to deployment pipelines that power critical operations. If you're an independent, hands-on engineer who thrives on writing production-grade Python code, analyzing logs, debugging complex systems, and delivering real-world solutions, this role is for you. This More ❯

in analytical thinking, metrics-driven decision making, and solving problems with innovative solutions? If so, join our Transportation team. We are seeking top-tier Data Engineers to join our world-class Business Intelligence for Transportation team. 4-7 years of experience in quantitative analysis, preferably within Internet or Technology … sectors. Strong expertise in Data Warehouse and Business Intelligence application development. Understanding of business processes, logical data models, and relational database implementation. Proficiency in SQL, with the ability to optimize complex queries. Basic knowledge of statistical analysis, testing design, and measurement. Ability to conduct research projects and produce … design and testing scenarios. Experience with scripting languages like Perl, Python is preferred. BSc/MS in Computer Science. Experience evaluating and implementing big-data technologies (e.g., Redshift, Hive/EMR, Spark) for processing large datasets efficiently. Additional pluses include experience with large-scale data processing, data More ❯

Lead Data Integration Engineer/Hybrid Working We're seeking a skilled and experienced Lead Data Integration Engineer to join our dynamic Engineering team. In this role, you'll play a key part in delivering our digital transformation roadmap, enhancing our capabilities, and supporting our Engineering … drive improvements across teams. Our client is undergoing a major digital transformation, focusing on building out a Single Digital Platform centered around Salesforce, integrating data with legacy systems, and utilizing a significant .NET estate, Azure services, and various frontend web applications. What You'll Be Doing: Lead by example … and implementation. Take ownership of ensuring delivery outcomes are met, as outlined in our product roadmap. Drive the design, development, and ongoing support of data integrations for our strategic customer platform (Salesforce-based). Work in a DevOps environment to build and maintain data integrations, with a focus More ❯

Data Engineering Manager £70,000 - £80,000 Hybrid - 2x per week in Portsmouth/London We are representing a large company operating across Scotland and the south of England, that concentrates on the maintenance and upgrade of critical infrastructure to ensure reliable energy supply. They are looking for an … Data Engineering Manager to head up their successful, dynamic team. As the Data Engineering Manager, you will own the data engineering strategy and roadmap, design and architect data pipelines, and manage and optimise the data platform. You will lead a team of 2, alongside individuals … from a 3rd party. We are looking for: Proven experience in managing teams, providing technical guidance and coaching Experience developing the Data strategy, vision, and control budgets Experience with AWS, SQL, and Python If this sounds of interest, please apply today More ❯

Data Engineering Manager £70,000 - £80,000 Hybrid - 2x per week in Portsmouth/London We are representing a large company operating across Scotland and the south of England, that concentrates on the maintenance and upgrade of critical infrastructure to ensure reliable energy supply. They are looking for an … Data Engineering Manager to head up their successful, dynamic team. As the Data Engineering Manager, you will own the data engineering strategy and roadmap, design and architect data pipelines, and manage and optimise the data platform. You will lead a team of 2, alongside individuals … from a 3rd party. We are looking for: Proven experience in managing teams, providing technical guidance and coaching Experience developing the Data strategy, vision, and control budgets Experience with AWS, SQL, and Python If this sounds of interest, please apply today More ❯

truly exciting journey of growth and transformation - we're going places! This is where you come in. The Opportunity We're looking for a Data Engineer to join the Core Data team within the Redemption function at IAG Loyalty. At IAG Loyalty, data is central to … everything we do-driving decisions, innovation, and impact across the business. In this role, you'll join a product squad focused on building data solutions that power the Redemption space-how customers turn Avios points into meaningful rewards. Whether it's understanding booking behavior or improving the reward experience … work will have a direct impact on our products and decision-making. We've made great progress migrating from legacy systems to a modern data stack, and you'll help us continue that journey-building new platforms and evolving the tools we've already delivered. Though we're a More ❯

Lead Data Integration Engineer - Bournemouth Hybrid working model - 2-3 days per week in the office The Company: The company is a leader in its field and is an Insurance business with an excellent reputation both in the UK and abroad. The role: This opportunity is for an … experienced Lead Data Integration Engineer to join the Engineering team, to help delivery of the digital roadmap, develop people and capabilities, and support Engineering strategy to drive improvements across all teams. This is a fantastic opportunity to work in a product-led operating model, where all teams are … to get from idea to done with minimal hand-offs. The focus is on building out a Single Digital Platform, centred around Salesforce, with data integrations to the legacy platforms and involving a significant .NET estate, use of Azure services and various frontend web applications. What you'll be More ❯

Lead Data Integration Engineer - Leeds Hybrid working model - 2-3 days per week in the office The Company: The company is a leader in its field and is an Insurance business with an excellent reputation both in the UK and abroad. The role: This opportunity is for an … experienced Lead Data Integration Engineer to join the Engineering team, to help delivery of the digital roadmap, develop people and capabilities, and support Engineering strategy to drive improvements across all teams. This is a fantastic opportunity to work in a product-led operating model, where all teams are … to get from idea to done with minimal hand-offs. The focus is on building out a Single Digital Platform, centred around Salesforce, with data integrations to the legacy platforms and involving a significant .NET estate, use of Azure services and various frontend web applications. What you'll be More ❯

The role Hexegic are looking for an innovative data engineer to join our expanding data team in London. This is an SC cleared role, where candidates will work to ensure data-driven projects can be rapidly prototyped, within a defence setting. About us Hexegic are a … company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career. Core Responsibilities Assist in customer data visualisation Give input to business insights using proprietary commercial software Ensure data-driven projects can be rapidly prototyped and delivered in line with … customer needs Use tools such as Tableau and AWS to conduct data engineering activities What we are looking for Experience with Tableau, AWS and/or other data engineering tools Capability to work independently, own and execute tasks, whilst effectively reporting within a larger team Be inquisitive, with More ❯

The role Hexegic are looking for an innovative data engineer to join our expanding data team in London. This is an SC cleared role, where candidates will work to ensure data-driven projects can be rapidly prototyped, within a defence setting. About us Hexegic are a … company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career. Core Responsibilities Assist in customer data visualisation Give input to business insights using proprietary commercial software Ensure data-driven projects can be rapidly prototyped and delivered in line with … customer needs Use tools such as Tableau and AWS to conduct data engineering activities What we are looking for Experience with Tableau, AWS and/or other data engineering tools Capability to work independently, own and execute tasks, whilst effectively reporting within a larger team Be inquisitive, with More ❯

Data Operations Engineer/Junior Data Architect London – Hybrid Fulltime Industry: Banking/Asset Management/Investment Management Working Hours: 8 per day/40 per week Core Focus: A hands-on, all-round Data Operations specialist with architecture skills. Someone who can manage and run … the data platform , especially during new asset acquisitions – ensuring data flows properly, systems function smoothly, and operations scale efficiently. Experience Desired: Background in financial services or start-up environments (ideally both). Comfortable working across the full spectrum from Back Office to Front Office . Hybrid mindset – both … technical and business-oriented . Experience working between Operations and Risk , understanding both the technology and business needs . Exposure to reporting, investment data, financial reports , and dataset nuances . Familiarity working in environments with little process – someone comfortable helping to define SOPs and build structure from scratch. Tech More ❯

Data Operations Engineer/Junior Data Architect London – Hybrid Fulltime Industry: Banking/Asset Management/Investment Management Working Hours: 8 per day/40 per week Core Focus: A hands-on, all-round Data Operations specialist with architecture skills. Someone who can manage and run … the data platform , especially during new asset acquisitions – ensuring data flows properly, systems function smoothly, and operations scale efficiently. Experience Desired: Background in financial services or start-up environments (ideally both). Comfortable working across the full spectrum from Back Office to Front Office . Hybrid mindset – both … technical and business-oriented . Experience working between Operations and Risk , understanding both the technology and business needs . Exposure to reporting, investment data, financial reports , and dataset nuances . Familiarity working in environments with little process – someone comfortable helping to define SOPs and build structure from scratch. Tech More ❯

Job Description: A Data Engineer specializing in Python and PySpark to be part of data efforts from on-premises systems to AWS. The candidate will design, build, and optimize data pipelines using Python, PySpark, and DBT onto Snowflake on AWS, ensuring a secure and efficient framework. … This role requires expertise in Python, PySpark, DBT, Airflow, and hands-on experience with exposure to Snowflake and the Big Data tech stack Technical Skills: Python PySpark DBT Airflow AWS, especially S3 and Glue Apache Iceberg SQL Git Kubernetes and Docker Shell Snowflake and Big Data tech stack More ❯

Job Description: A Data Engineer specializing in Python and PySpark to be part of data efforts from on-premises systems to AWS. The candidate will design, build, and optimize data pipelines using Python, PySpark, and DBT onto Snowflake on AWS, ensuring a secure and efficient framework. … This role requires expertise in Python, PySpark, DBT, Airflow, and hands-on experience with exposure to Snowflake and the Big Data tech stack Technical Skills: Python PySpark DBT Airflow AWS, especially S3 and Glue Apache Iceberg SQL Git Kubernetes and Docker Shell Snowflake and Big Data tech stack More ❯

Role Overview We are seeking a Machine Learning (ML) Engineer to join our expanding Data & AI team, focusing on delivering AI solutions for public sector and enterprise clients. The ML Engineer will collaborate with data scientists, architects, software engineers, business analysts, and project managers to develop … solutions. This role offers the chance to work with a passionate team on impactful projects across various industries, helping clients achieve strategic goals through data and AI. Responsibilities Create and customize machine learning models, primarily using Azure AI services, for use cases like NLP, computer vision, speech recognition, and … anomaly detection. Integrate Azure AI services with other Azure tools such as Azure Machine Learning, Azure Databricks, and Azure Cognitive Search. Handle data ingestion, processing, and storage for AI and analytics applications. Design and develop AI agents for creating intelligent autonomous systems. Optimize performance, scalability, and reliability of ML More ❯

at Clarksons, visit us at www.clarksons.com Role Summary As part of the Digital Transformation team, you will be helping us build the best shipping data platform and reporting, enabling us to provide accurate and timely insights to the business and our clients. We’ve been building out a central … data platform for the last year and have proved its worth. We are now looking for an individual to help scale the platform and accelerate its roll out across the business. What you’ll be doing Work with data engineers & analysts to problem solve, build & deliver data products from ideation to production. Lead and own the full lifecycle of data engineering deliverables. Deliver complex data flows to process external data sources to provide the company with a competitive edge. Act as a consultant to the business to meet their needs. Maintain existing data More ❯

at Clarksons, visit us at www.clarksons.com Role Summary As part of the Digital Transformation team, you will be helping us build the best shipping data platform and reporting, enabling us to provide accurate and timely insights to the business and our clients. We’ve been building out a central … data platform for the last year and have proved its worth. We are now looking for an individual to help scale the platform and accelerate its roll out across the business. What you’ll be doing Work with data engineers & analysts to problem solve, build & deliver data products from ideation to production. Lead and own the full lifecycle of data engineering deliverables. Deliver complex data flows to process external data sources to provide the company with a competitive edge. Act as a consultant to the business to meet their needs. Maintain existing data More ❯

Contract Data Software Engineer £450-£500 per day (outside IR35) 6 months GCP, Python, dbt, SQL Remote working (London based company) VC backed AI marketing services startup I am partnered with one of the UK's most exciting marketing startups who are looking for a contract Data/Analytics Engineer to come in and take ownership around the development of the data and analytics platform. Further to strong technical/analytical skills, they need someone highly self-motivated, ready to take ownership of projects and drive them to successful completion, as well as someone … who possesses a curious growth mindset, seeks continuous improvement in data techniques, and is comfortable interacting and working effectively with backend and full stack engineers. Expertise required with the following tools: GCP Python, SQL dbt Docker/Terraform Software engineering principles and practices If you're interested in the More ❯