176 to 200 of 280 Data Engineer Jobs in London

Senior Data Engineer | Microsoft Fabric🧵 | £60,000-£80,000 We’re working with a growing consultancy known for delivering modern, scalable data solutions. Their work sits at the intersection of strategy, engineering and innovation, empowering organisations to unlock value through cutting-edge Microsoft technologies. As part of their continued growth, they’re now seeking a Senior Data Engineer to take a pivotal role in delivering enterprise-grade data solutions, with a strong focus on Microsoft Fabric and the wider Azure ecosystem. What you’ll do: Lead the design and implementation of data platforms powered by Microsoft Fabric Guide delivery teams through complex builds across cloud-native architectures Bridge the gap between hands-on … engineering and technical strategy Collaborate closely with clients and internal stakeholders to translate needs into scalable solutions What you bring: Deep experience with Microsoft Azure , particularly around data services Proven track record delivering with tools such as Fabric , Synapse , or Databricks Proficiency in SQL, Python, and modern data engineering patterns Leadership experience within engineering or delivery teams A More ❯

Senior Data Engineer | Microsoft Fabric🧵 | £60,000-£80,000 We’re working with a growing consultancy known for delivering modern, scalable data solutions. Their work sits at the intersection of strategy, engineering and innovation, empowering organisations to unlock value through cutting-edge Microsoft technologies. As part of their continued growth, they’re now seeking a Senior Data Engineer to take a pivotal role in delivering enterprise-grade data solutions, with a strong focus on Microsoft Fabric and the wider Azure ecosystem. What you’ll do: Lead the design and implementation of data platforms powered by Microsoft Fabric Guide delivery teams through complex builds across cloud-native architectures Bridge the gap between hands-on … engineering and technical strategy Collaborate closely with clients and internal stakeholders to translate needs into scalable solutions What you bring: Deep experience with Microsoft Azure , particularly around data services Proven track record delivering with tools such as Fabric , Synapse , or Databricks Proficiency in SQL, Python, and modern data engineering patterns Leadership experience within engineering or delivery teams A More ❯

Position: Data EngineerLocation: Central London or Bristol (3 days per week onsite)Salary: £600 to £650 p.d inside IR35Security Clearance: SC Clearance Required About the Role A leading IT consultancy delivering innovative solutions to the UK public sector is seeking an experienced Data Engineer to support a high-profile programme. You'll collaborate with cross-functional teams … to build scalable data pipelines and contribute to digital transformation initiatives across government departments. Key Responsibilities Design, develop and maintain robust data pipelines using PostgreSQL and Airflow or Apache Spark Collaborate with frontend/backend developers using Node.js or React Implement best practices in data modelling, ETL processes and performance optimisation Contribute to containerised deployments (Docker/… Kubernetes) - experience in this area is desirable, not essential Operate within Agile teams and support DevOps practices What We're Looking For Proven experience as a Data Engineer in complex environments Strong proficiency in PostgreSQL and either Airflow or Spark Solid understanding of Node.js or React for integration and tooling Familiarity with containerisation technologies (Docker/Kubernetes) is More ❯

Data Engineer | £60-75K | London (5 days p/w Onsite) Build a greenfield data platform from scratch! A major logistics company is undergoing a massive digital transformation. Legacy systems are being dismantled, replaced with a clean, cloud-native Azure stack - and the new data team is central to making it all work. You'll … be working directly with their Head of Data, building Azure-based pipelines from the ground up, and shaping how the company uses data to drive decisions. There's real investment, real urgency, and real interest in doing this properly - not endless meetings and PowerPoints. What you'll be doing: Designing, building, and optimising end-to-end data … using Azure Databricks, PySpark, ADF, and Delta Lake Implementing a medallion architecture - from raw to enriched to curated Working with Delta Lake and Spark for both batch and streaming data Collaborating with analysts to validate and refine datasets for reporting Applying CI/CD and DevOps best practices (Git, Azure DevOps) Enforcing data governance using Azure Purview and More ❯

Data QA Engineer We are seeking a QA Engineer with a strong background in data and analytics to help ensure the accuracy and reliability of both data pipelines and machine learning models . This role combines hands-on testing, automation, and close collaboration with engineering and data teams. About the Role You’ll take … ownership of quality assurance for data pipelines; you’ll have a strong understanding of SQL to verify data consistency and accuracy. You’ll support with automated QA solutions for data pipelines and testing the outputs of ML models. Responsibilities Design, develop, and execute comprehensive test plans and test cases for data pipelines and ML models. Implement … and maintain automated testing frameworks for data and ML quality assurance Perform thorough manual testing during initial development and complex feature releases Collaborate closely with Data Engineers, Data Scientists, and Product Managers Proactively identify, document, and track bugs and quality issues. Participate in code reviews and provide constructive feedback from a QA perspective. What We’re Looking More ❯

Data QA Engineer We are seeking a QA Engineer with a strong background in data and analytics to help ensure the accuracy and reliability of both data pipelines and machine learning models . This role combines hands-on testing, automation, and close collaboration with engineering and data teams. About the Role You’ll take … ownership of quality assurance for data pipelines; you’ll have a strong understanding of SQL to verify data consistency and accuracy. You’ll support with automated QA solutions for data pipelines and testing the outputs of ML models. Responsibilities Design, develop, and execute comprehensive test plans and test cases for data pipelines and ML models. Implement … and maintain automated testing frameworks for data and ML quality assurance Perform thorough manual testing during initial development and complex feature releases Collaborate closely with Data Engineers, Data Scientists, and Product Managers Proactively identify, document, and track bugs and quality issues. Participate in code reviews and provide constructive feedback from a QA perspective. What We’re Looking More ❯

Data QA Engineer We are seeking a QA Engineer with a strong background in data and analytics to help ensure the accuracy and reliability of both data pipelines and machine learning models . This role combines hands-on testing, automation, and close collaboration with engineering and data teams. About the Role You’ll take … ownership of quality assurance for data pipelines; you’ll have a strong understanding of SQL to verify data consistency and accuracy. You’ll support with automated QA solutions for data pipelines and testing the outputs of ML models. Responsibilities Design, develop, and execute comprehensive test plans and test cases for data pipelines and ML models. Implement … and maintain automated testing frameworks for data and ML quality assurance Perform thorough manual testing during initial development and complex feature releases Collaborate closely with Data Engineers, Data Scientists, and Product Managers Proactively identify, document, and track bugs and quality issues. Participate in code reviews and provide constructive feedback from a QA perspective. What We’re Looking More ❯

Data QA Engineer We are seeking a QA Engineer with a strong background in data and analytics to help ensure the accuracy and reliability of both data pipelines and machine learning models . This role combines hands-on testing, automation, and close collaboration with engineering and data teams. About the Role You’ll take … ownership of quality assurance for data pipelines; you’ll have a strong understanding of SQL to verify data consistency and accuracy. You’ll support with automated QA solutions for data pipelines and testing the outputs of ML models. Responsibilities Design, develop, and execute comprehensive test plans and test cases for data pipelines and ML models. Implement … and maintain automated testing frameworks for data and ML quality assurance Perform thorough manual testing during initial development and complex feature releases Collaborate closely with Data Engineers, Data Scientists, and Product Managers Proactively identify, document, and track bugs and quality issues. Participate in code reviews and provide constructive feedback from a QA perspective. What We’re Looking More ❯

Fimador is currently recruiting for a Principal Data Engineer to join a team developing cutting-edge data-driven products. This role is helping the firm pioneer AI and ML in the global environment. This role is central to designing and maintaining scalable pipelines, data platforms, and integrations, while ensuring solutions meet regulatory standards and align with … architectural best practices. Key Responsibilities: Build and optimise scalable data pipelines using Databricks and Apache Spark (PySpark). Ensure performance, scalability, and compliance (GxP and other standards). Collaborate on requirements, design, and backlog refinement. Promote engineering best practices including CI/CD, code reviews, and testing. Research and introduce new tools, technologies, and methodologies. Ideal experience: Experience with … efficient, reliable data pipelines that improve time-to-insight. Knowledge of secure, auditable, and compliant data workflows. Know how on optimising performance and reducing costs through Spark and Databricks tuning. Be able to create reusable, well-documented tools enabling collaboration across teams. A culture of engineering excellence driven by mentoring and high-quality practices. Preferred Experience Databricks in More ❯

Fimador is currently recruiting for a Principal Data Engineer to join a team developing cutting-edge data-driven products. This role is helping the firm pioneer AI and ML in the global environment. This role is central to designing and maintaining scalable pipelines, data platforms, and integrations, while ensuring solutions meet regulatory standards and align with … architectural best practices. Key Responsibilities: Build and optimise scalable data pipelines using Databricks and Apache Spark (PySpark). Ensure performance, scalability, and compliance (GxP and other standards). Collaborate on requirements, design, and backlog refinement. Promote engineering best practices including CI/CD, code reviews, and testing. Research and introduce new tools, technologies, and methodologies. Ideal experience: Experience with … efficient, reliable data pipelines that improve time-to-insight. Knowledge of secure, auditable, and compliant data workflows. Know how on optimising performance and reducing costs through Spark and Databricks tuning. Be able to create reusable, well-documented tools enabling collaboration across teams. A culture of engineering excellence driven by mentoring and high-quality practices. Preferred Experience Databricks in More ❯

Fimador is currently recruiting for a Principal Data Engineer to join a team developing cutting-edge data-driven products. This role is helping the firm pioneer AI and ML in the global environment. This role is central to designing and maintaining scalable pipelines, data platforms, and integrations, while ensuring solutions meet regulatory standards and align with … architectural best practices. Key Responsibilities: Build and optimise scalable data pipelines using Databricks and Apache Spark (PySpark). Ensure performance, scalability, and compliance (GxP and other standards). Collaborate on requirements, design, and backlog refinement. Promote engineering best practices including CI/CD, code reviews, and testing. Research and introduce new tools, technologies, and methodologies. Ideal experience: Experience with … efficient, reliable data pipelines that improve time-to-insight. Knowledge of secure, auditable, and compliant data workflows. Know how on optimising performance and reducing costs through Spark and Databricks tuning. Be able to create reusable, well-documented tools enabling collaboration across teams. A culture of engineering excellence driven by mentoring and high-quality practices. Preferred Experience Databricks in More ❯

Fimador is currently recruiting for a Principal Data Engineer to join a team developing cutting-edge data-driven products. This role is helping the firm pioneer AI and ML in the global environment. This role is central to designing and maintaining scalable pipelines, data platforms, and integrations, while ensuring solutions meet regulatory standards and align with … architectural best practices. Key Responsibilities: Build and optimise scalable data pipelines using Databricks and Apache Spark (PySpark). Ensure performance, scalability, and compliance (GxP and other standards). Collaborate on requirements, design, and backlog refinement. Promote engineering best practices including CI/CD, code reviews, and testing. Research and introduce new tools, technologies, and methodologies. Ideal experience: Experience with … efficient, reliable data pipelines that improve time-to-insight. Knowledge of secure, auditable, and compliant data workflows. Know how on optimising performance and reducing costs through Spark and Databricks tuning. Be able to create reusable, well-documented tools enabling collaboration across teams. A culture of engineering excellence driven by mentoring and high-quality practices. Preferred Experience Databricks in More ❯

Lead Data Engineer Salary: £90,000 - £115,000 Location: West London (3 Days in Office) Using data science at their core, they transform complex property and customer data into insights that enhance targeting, retention, and performance. The Opportunity This flexible, data-driven start-up places Data Science at the heart of its business, using … cutting-edge UK property data to deliver powerful insights for real estate partners and retailers. By leveraging advanced analytics, predictive modelling, and customer segmentation, the company helps clients better understand and engage with their audiences, improving marketing precision, timing, and overall performance. With a strong technical foundation and a collaborative team led by experienced data leaders, the company … is building efficient, automated data pipelines and scalable systems to power intelligent decision-making. This is an exciting opportunity for forward-thinking professionals to join a growing team, shape best practices, and make a real impact in a fast-evolving data and technology environment. The Role and Responsibilities This is an exciting opportunity for a technically strong, hands More ❯

Data Engineer Must be London-based, able to work from site in London with occasional travel to Croydon SC Clearance required/or eligible for clearance Contract duration: 2 years + Up To £41,000 per annum, depending on experience Job Purpose/The Role: We are seeking 3 experienced Data Engineers to support a high-profile … Public Sector client. These roles will be part of a large project, contributing to the ongoing development and live support of critical systems within a secure, agile, and data-driven environment. Your Key Responsibilities: Work collaboratively in a multi-disciplinary Agile & DevOps team to deliver data solutions and maintain live systems. Apply best practices for data integration … transformation, and delivery in a secure and scalable environment. Support data pipelines and ETL processes across various technologies and cloud platforms Maintain, monitor, and troubleshoot systems using a wide array of tools and platforms. Contribute to automation and continuous integration/deployment (CI/CD) efforts. Engage directly with clients and stakeholders, demonstrating excellent problem-solving and communication skills. More ❯

Senior Data Engineer - Hybrid - Contract - Outside IR35 Our client is expanding their core data engineering function and hiring two Senior Data Engineers to strengthen a modern, scalable data platform. Both will be Databricks specialists, with one role focused on deep technical delivery and the other combining hands-on engineering with team leadership and upskilling responsibilities. … Live Tables (DLT) pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and … automate deployments. (For leadership-focused role) Mentor and upskill engineers, define coding standards, and embed engineering excellence across the team. What’s Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and real-time More ❯

Senior Data Engineer - Hybrid - Contract - Outside IR35 Our client is expanding their core data engineering function and hiring two Senior Data Engineers to strengthen a modern, scalable data platform. Both will be Databricks specialists, with one role focused on deep technical delivery and the other combining hands-on engineering with team leadership and upskilling responsibilities. … Live Tables (DLT) pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and … automate deployments. (For leadership-focused role) Mentor and upskill engineers, define coding standards, and embed engineering excellence across the team. What’s Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and real-time More ❯

Senior Data Engineer - Hybrid - Contract - Outside IR35 Our client is expanding their core data engineering function and hiring two Senior Data Engineers to strengthen a modern, scalable data platform. Both will be Databricks specialists, with one role focused on deep technical delivery and the other combining hands-on engineering with team leadership and upskilling responsibilities. … Live Tables (DLT) pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and … automate deployments. (For leadership-focused role) Mentor and upskill engineers, define coding standards, and embed engineering excellence across the team. What’s Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and real-time More ❯

Senior Data Engineer - Hybrid - Contract - Outside IR35 Our client is expanding their core data engineering function and hiring two Senior Data Engineers to strengthen a modern, scalable data platform. Both will be Databricks specialists, with one role focused on deep technical delivery and the other combining hands-on engineering with team leadership and upskilling responsibilities. … Live Tables (DLT) pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and … automate deployments. (For leadership-focused role) Mentor and upskill engineers, define coding standards, and embed engineering excellence across the team. What’s Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and real-time More ❯

Platform Engineer - Data, Azure, AI, IaC, Terraform £Market Rate (Inside IR35) London/Hybrid 6 months We are currently working with a client who urgently require a Platform Engineer with strong knowledge of Data to play a pivotal role in designing and engineering a robust, scalable Data Platform, with a strong focus on Azure and … This is a hands-on role requiring deep technical expertise, resilience, and the ability to thrive in a fast-paced, complex environment. Key Requirements: Proven experience as a Platform Engineer, within large, complex organisations Focus on Azure-based Data Platforms Strong hands-on experience with Azure Data Factory (ADF), Azure AI, Data Lake, Cognitive Services and … Excellent communication skills and stakeholder engagement Nice to have: Immediate availability Background in Infrastructure to understanding concepts such as Networking, Firewalls and Security Previous experience of deploying Virtual Machines, Data Lakes, Data vaults Some exposure to GCP and it's AI capabilities Scripting knowledge of Powershell/Bash/Python Awareness of operational challenges If you're interested More ❯

Platform Engineer - Data, Azure, AI, IaC, Terraform £Market Rate (Inside IR35) London/Hybrid 6 months We are currently working with a client who urgently require a Platform Engineer with strong knowledge of Data to play a pivotal role in designing and engineering a robust, scalable Data Platform, with a strong focus on Azure and … This is a hands-on role requiring deep technical expertise, resilience, and the ability to thrive in a fast-paced, complex environment. Key Requirements: Proven experience as a Platform Engineer, within large, complex organisations Focus on Azure-based Data Platforms Strong hands-on experience with Azure Data Factory (ADF), Azure AI, Data Lake, Cognitive Services and … Excellent communication skills and stakeholder engagement Nice to have: Immediate availability Background in Infrastructure to understanding concepts such as Networking, Firewalls and Security Previous experience of deploying Virtual Machines, Data Lakes, Data vaults Some exposure to GCP and it's AI capabilities Scripting knowledge of Powershell/Bash/Python Awareness of operational challenges If you're interested More ❯

Overview Role: Data Engineer Job Type: Contract Day Rate: £400 per day (inside IR35) Duration: 6 Months + likely to extend Work Location: ideally commutable to London, Bristol, or Manchester office Please look for Security Cleared candidate. Candidate Information Name: Contact No: Email Id: Total Years of Experience Vendor Name Worked with Defra/Public sector : Yes/…/v Visa Day Rate/Salary Current Location Current Company Open for Permanent/Contract Current offers/Interviews in pipeline Interview availability Holidays booked Role Requirements Role: Data Engineer having technical expertise in Informatica tool (4-6 years of Informatica experience). Candidate Must have used Informatica with Oracle as target database. Must have advanced SQL … ability to write complex SQL queries). Should have done Informatica workflow/session performance tuning as newly developed Informatica ETL jobs have to complete within a defined SLA (Data refresh window). More ❯

We’re hiring an AI Data Engineer to turn 3D assets and visuals into high-quality datasets for next-gen AI in digital play. Own the full data pipeline and help build scalable, creative systems at the crossroads of AI, data, and fun RESPONSIBILITIES Design and operate data ingestion pipelines for 3D assets, geometry, images … annotation vendors, and automate quality checks to ensure scalable, reliable datasets. Define schemas and metadata for digital assets, maintaining catalogues, lineage, and versioning to ensure reproducibility and governance. Enforce data quality, drift detection, and compliance (GDPR/COPPA), including watermarking and traceability to safeguard IP and user privacy. Collaborate with AI infrastructure engineers to optimize data storage and … compute performance for large-scale processing. Work with AI engineers to define data specifications, support experimentation, and integrate active learning loops that improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). Hands-on experience with More ❯

We’re hiring an AI Data Engineer to turn 3D assets and visuals into high-quality datasets for next-gen AI in digital play. Own the full data pipeline and help build scalable, creative systems at the crossroads of AI, data, and fun RESPONSIBILITIES Design and operate data ingestion pipelines for 3D assets, geometry, images … annotation vendors, and automate quality checks to ensure scalable, reliable datasets. Define schemas and metadata for digital assets, maintaining catalogues, lineage, and versioning to ensure reproducibility and governance. Enforce data quality, drift detection, and compliance (GDPR/COPPA), including watermarking and traceability to safeguard IP and user privacy. Collaborate with AI infrastructure engineers to optimize data storage and … compute performance for large-scale processing. Work with AI engineers to define data specifications, support experimentation, and integrate active learning loops that improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). Hands-on experience with More ❯

We’re hiring an AI Data Engineer to turn 3D assets and visuals into high-quality datasets for next-gen AI in digital play. Own the full data pipeline and help build scalable, creative systems at the crossroads of AI, data, and fun RESPONSIBILITIES Design and operate data ingestion pipelines for 3D assets, geometry, images … annotation vendors, and automate quality checks to ensure scalable, reliable datasets. Define schemas and metadata for digital assets, maintaining catalogues, lineage, and versioning to ensure reproducibility and governance. Enforce data quality, drift detection, and compliance (GDPR/COPPA), including watermarking and traceability to safeguard IP and user privacy. Collaborate with AI infrastructure engineers to optimize data storage and … compute performance for large-scale processing. Work with AI engineers to define data specifications, support experimentation, and integrate active learning loops that improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). Hands-on experience with More ❯

We’re hiring an AI Data Engineer to turn 3D assets and visuals into high-quality datasets for next-gen AI in digital play. Own the full data pipeline and help build scalable, creative systems at the crossroads of AI, data, and fun RESPONSIBILITIES Design and operate data ingestion pipelines for 3D assets, geometry, images … annotation vendors, and automate quality checks to ensure scalable, reliable datasets. Define schemas and metadata for digital assets, maintaining catalogues, lineage, and versioning to ensure reproducibility and governance. Enforce data quality, drift detection, and compliance (GDPR/COPPA), including watermarking and traceability to safeguard IP and user privacy. Collaborate with AI infrastructure engineers to optimize data storage and … compute performance for large-scale processing. Work with AI engineers to define data specifications, support experimentation, and integrate active learning loops that improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). Hands-on experience with More ❯