1 to 25 of 90 Contract Data Pipeline Jobs in the UK

Databricks Engineer (SC Cleared) London (Hybrid) 6 Month Contract £(Apply online only)/day (Inside IR35) Data Engineer needed with strong Databricks expertise and active SC Security Clearance. 6 Month Contract based in Central London (Hybrid). Developing a cutting-edge Azure Databricks platform for economic data … techniques + data integration patterns. Experience of working with complex data pipelines, large data sets, data pipeline optimization + data architecture design. Implementing complex data transformations using Spark, PySpark or Scala + working with SQL/MySQL ...

Data Engineer (Inside IR35) £425 Per day SC Cleared London o support the formation of a new Data Team, there is a critical need to establish robust, scalable, and secure data infrastructure. Currently, data is dispersed across multiple systems with inconsistent formats … performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence ...

Data Engineer - £350PD - Remote Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality frameworks, and reconciliation checks Strong error handling, monitoring, and retry strategies in production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary ...

Data Engineer - £350PD - Remote Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality frameworks, and reconciliation checks Strong error handling, monitoring, and retry strategies in production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary ...

Azure Data Engineer - £500PD - Hybrid We are seeking an Azure Data Engineer with strong experience in Databricks to design, build, and optimize scalable data pipelines and analytics solutions on the Azure cloud platform. The ideal candidate will have hands-on expertise across Azure data services, data modeling, ETL/ELT development, and collaborative engineering practices. Key Responsibilities * Design, develop, and maintain scalable data pipelines using Azure Databricks (Python, PySpark, SQL). * Build and optimize ETL/ELT workflows that ingest data from various on-prem ...

Contract Data Engineer 3 month initial contract (with good chance of extension) Manchester, 2 days per week on-site Outside IR35 Start before Christmas Overview My client are a well knwon organsation just outside Manchester looking for a contract Data Engineer. You will review and improve … Skills Strong hands-on Data Engineering experience Advanced Python for data transformation Google Cloud Platform production experience Data pipeline design and optimisation Data quality automation and monitoring Customer data and identity matching GDPR and data governance delivery ...

Data Engineer £250 Outside IR35 - Remote Job Summary We are seeking a skilled Azure Data Engineer to design, build, and maintain scalable data solutions on Microsoft Azure. The ideal candidate has strong hands-on experience with Azure Databricks and Azure Synapse Analytics … stakeholders to deliver data solutions Implement security, governance, and compliance best practices (RBAC, data masking, encryption) Monitor, troubleshoot, and resolve pipeline and performance issues Document data architecture, pipelines, and operational processes Required Qualifications 3+ years of experience as a Data Engineer ...

Data Engineer £250 Outside IR35 - Remote Job Summary We are seeking a skilled Azure Data Engineer to design, build, and maintain scalable data solutions on Microsoft Azure. The ideal candidate has strong hands-on experience with Azure Databricks and Azure Synapse Analytics … stakeholders to deliver data solutions Implement security, governance, and compliance best practices (RBAC, data masking, encryption) Monitor, troubleshoot, and resolve pipeline and performance issues Document data architecture, pipelines, and operational processes Required Qualifications 3+ years of experience as a Data Engineer ...

Role Title: Data Engineer Role Type: Contract (inside ir35) Role Location: London, UK Mandatory: Active Security Clearance Job Description:- Essential Skills & Experience: ·10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks. ·Good proficiency in Python … Database. ·Experience working with large datasets and complex data pipelines. ·Experience with data architecture design and data pipeline optimization. ·Proven expertise with Databricks, including hands-on implementation experience and certifications. ·Experience with SQL and NoSQL databases. ·Experience with data quality ...

experienced Data Engineer to design, build, and optimise data solutions within the Microsoft Azure ecosystem. The role focuses on pipeline development, data modelling, governance, and supporting analytics teams with high-quality, reliable data. Key Responsibilities: Develop and maintain scalable data pipelines … data security and governance, including Row-Level Security (RLS) and compliance standards. Maintain documentation and metadata for data assets and pipeline architecture. Collaborate with analysts, data scientists, and stakeholders to deliver trusted data products. Provide technical support and troubleshoot production issues. ...

experienced Data Engineer to design, build, and optimise data solutions within the Microsoft Azure ecosystem. The role focuses on pipeline development, data modelling, governance, and supporting analytics teams with high-quality, reliable data. Key Responsibilities: Develop and maintain scalable data pipelines … data security and governance, including Row-Level Security (RLS) and compliance standards. Maintain documentation and metadata for data assets and pipeline architecture. Collaborate with analysts, data scientists, and stakeholders to deliver trusted data products. Provide technical support and troubleshoot production issues. ...

Data Engineer- Azure £500-£525 pd via Umbrella Birmingham- 1-2 days per week in the office Leading business is looking to bring in a Data Engineer to develop, maintain, and operate data-ingestion routines across the estate to create a single, trusted data source that supports a data-driven culture. Role: Design and implement scalable, secure data-processing pipelines using Azure Data Factory, Azure Synapse, and other Azure services. Manage and optimize data storage solutions, including Azure Data Lake Storage ...

Role Overview We are seeking an experienced Data Architect to lead the design and implementation of enterprise-grade data solutions on the Azure platform. The successful candidate will define and deliver scalable, secure, and cost-optimised architectures that support modern data strategies. Key Responsibilities … design patterns. Hands-on experience with Azure data services and modern data platforms. Expertise in ETL/ELT processes and pipeline optimisation. Familiarity with CI/CD practices for data solutions. Strong understanding of data security, compliance, and governance frameworks. Desirable ...

Data Engineer (Databricks & Azure) - 3-Month Rolling Contract Rate: £400-£450 per day Location: Remote IR35 Status: Outside IR35 Duration: Initial 3 months (rolling) About the Company Join a leading Databricks Partner delivering innovative data solutions for enterprise clients. You'll work on cutting-edge projects … leveraging Databricks and Azure to transform data into actionable insights. About the Role We are seeking an experienced Data Engineer with strong expertise in Databricks and Azure to join our team on a 3-month rolling contract. This is a fully remote position, offering flexibility ...

Data Engineer (Databricks & Azure) - 3-Month Rolling Contract Rate: £400-£450 per day Location: Remote IR35 Status: Outside IR35 Duration: Initial 3 months (rolling) About the Company Join a leading Databricks Partner delivering innovative data solutions for enterprise clients. You'll work on cutting-edge projects … leveraging Databricks and Azure to transform data into actionable insights. About the Role We are seeking an experienced Data Engineer with strong expertise in Databricks and Azure to join our team on a 3-month rolling contract. This is a fully remote position, offering flexibility ...

Title: Microsoft Fabric Data Engineer Location: Remote Contract: 3 months with the possibility of extension Clearance: Active SC clearance or eligible Are you an experienced Microsoft Data Engineer with experience in Microsoft Fabric? We are seeking a proactive and skilled Microsoft Fabric Data Engineer … PySpark for data manipulation, analysis, and automation, alongside advanced T-SQL. Performance Optimisation: Experience of monitoring, troubleshooting, and optimising data pipeline and storage performance within Microsoft Fabric. Team Collaboration: Ability to communicate technical concepts clearly and collaborate effectively within a team to ensure data ...

Title: Microsoft Fabric Data Engineer Location: Remote Contract: 3 months with the possibility of extension Clearance: Active SC clearance or eligible Are you an experienced Microsoft Data Engineer with experience in Microsoft Fabric? We are seeking a proactive and skilled Microsoft Fabric Data Engineer … PySpark for data manipulation, analysis, and automation, alongside advanced T-SQL. Performance Optimisation: Experience of monitoring, troubleshooting, and optimising data pipeline and storage performance within Microsoft Fabric. Team Collaboration: Ability to communicate technical concepts clearly and collaborate effectively within a team to ensure data ...

Skills & Expertise AWS Core Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing ETL pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data … Performance optimization & troubleshooting Python: Automation scripts Data processing workflows Monitoring, debugging, validation scripts AWS Support/Operations: Troubleshooting ETL failures, performance bottlenecks, pipeline issues Monitoring cloud workloads (CloudWatch, CloudTrail) Handling incidents, root-cause analysis (RCA), patching & releases Cost optimization and resource usage tracking Data quality ...

Robert Half Technology are assisting a large, market-leading media organisation to recruit a Data Engineer on a contract basis . Hybrid working - London based. Role * The Data Engineer will design, develop, and maintain modern cloud-based data infrastructure to ensure reliability, scalability … transformation, orchestration, and workflow management.* Optimise ELT/ETL processes for improved performance, cost efficiency, and scalability.* Troubleshoot and resolve data pipeline issues swiftly and effectively across the data platform.* Work with orchestration tools such as Airflow, ADF, or Prefect to schedule and automate workflows. ...

Role title: Snr Data Engineer Security Clearance required: SC Clearance IR35 Status: Inside IR35 Pay Rates: £500/d - £525/d Contract length: 6 months Base Location: London - 3/d a week Skills required: - Azure/Azure Data bricks - ADF/ETL - Pyspark/… large data sets, and complex data pipelines. Understanding of Data Architecture and Design, and Data pipeline optimisation. Proven expertise with Data bricks, including hands on implementation experience and certifications. Reasonable Adjustments: Respect and equality are core values to us. ...

Role title: Snr Data Engineer Security Clearance required: SC Clearance IR35 Status: Inside IR35 Pay Rates: £500/d - £525/d Contract length: 6 months Base Location: London - 3/d a week Skills required: - Azure/Azure Data bricks - ADF/ETL - Pyspark/… large data sets, and complex data pipelines. Understanding of Data Architecture and Design, and Data pipeline optimisation. Proven expertise with Data bricks, including hands on implementation experience and certifications. Reasonable Adjustments: Respect and equality are core values to us. ...

Contract Data Engineer - Charity Sector (Outside IR35) Location: Fully Remote Duration: 3 Months (Extension Likely) Day Rate: £200-£250 per day (Outside IR35) About the Role: We're looking for an experienced Data Engineer to join a consultancy delivering a data project … sector client. This is a fully remote contract, ideal for someone who thrives in fast-paced environments and has strong experience with modern data platforms. Key Responsibilities: Design, build, and optimize data pipelines using Azure Data Factory and Databricks . Work with Azure Synapse ...

Tittle: Data Scientist/Data Engineer Rate: £450-£550 Outside IR35 Contract duration: 3 months (Initially) Start date: January start date! I'm working with a cutting-edge tech business building a next-generation data platform, and they're looking for a Data Scientist/Data Engineer to join at a critical early stage. This is a hands-on role working closely with the CTO, owning the design and delivery of end-to-end data pipelines and advanced AI-driven capabilities. You'll be responsible for ingesting ...

Data Engineer - 14-Week Contract (Outside IR35) Likely to Extend Start Date: 12th January Rate: £350 per day Location: Remote (UK-based) Interview: Immediate - Offer before Christmas We are seeking an experienced Data Engineer to join a 14-week project focused on building robust data … REST APIs , PIM systems, and potentially SAP. Ensure data quality, governance, and lineage tracking throughout the project. Required Skills ETL/ELT pipeline design and data validation frameworks. Advanced Python (pandas, numpy, boto3) and SQL (complex queries, optimisation). Experience with AWS Glue , Step Functions ...

Data Engineer - 14-Week Contract (Outside IR35) Likely to Extend Start Date: 12th January Rate: £350 per day Location: Remote (UK-based) Interview: Immediate - Offer before Christmas We are seeking an experienced Data Engineer to join a 14-week project focused on building robust data … REST APIs , PIM systems, and potentially SAP. Ensure data quality, governance, and lineage tracking throughout the project. Required Skills ETL/ELT pipeline design and data validation frameworks. Advanced Python (pandas, numpy, boto3) and SQL (complex queries, optimisation). Experience with AWS Glue , Step Functions ...