1 to 25 of 51 Contract Data Pipeline Jobs in London

Data Engineer (Inside IR35) £425 Per day SC Cleared London o support the formation of a new Data Team, there is a critical need to establish robust, scalable, and secure data infrastructure. Currently, data is dispersed across multiple systems with inconsistent formats … performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence ...

Data Engineer - £350PD - Remote Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality frameworks, and reconciliation checks Strong error handling, monitoring, and retry strategies in production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary ...

Data Engineer - £350PD - Remote Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality frameworks, and reconciliation checks Strong error handling, monitoring, and retry strategies in production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary ...

Data Engineer £250 Outside IR35 - Remote Job Summary We are seeking a skilled Azure Data Engineer to design, build, and maintain scalable data solutions on Microsoft Azure. The ideal candidate has strong hands-on experience with Azure Databricks and Azure Synapse Analytics … stakeholders to deliver data solutions Implement security, governance, and compliance best practices (RBAC, data masking, encryption) Monitor, troubleshoot, and resolve pipeline and performance issues Document data architecture, pipelines, and operational processes Required Qualifications 3+ years of experience as a Data Engineer ...

Data Engineer £250 Outside IR35 - Remote Job Summary We are seeking a skilled Azure Data Engineer to design, build, and maintain scalable data solutions on Microsoft Azure. The ideal candidate has strong hands-on experience with Azure Databricks and Azure Synapse Analytics … stakeholders to deliver data solutions Implement security, governance, and compliance best practices (RBAC, data masking, encryption) Monitor, troubleshoot, and resolve pipeline and performance issues Document data architecture, pipelines, and operational processes Required Qualifications 3+ years of experience as a Data Engineer ...

Role Title: Data Engineer Role Type: Contract (inside ir35) Role Location: London, UK Mandatory: Active Security Clearance Job Description:- Essential Skills & Experience: ·10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks. ·Good proficiency in Python … Database. ·Experience working with large datasets and complex data pipelines. ·Experience with data architecture design and data pipeline optimization. ·Proven expertise with Databricks, including hands-on implementation experience and certifications. ·Experience with SQL and NoSQL databases. ·Experience with data quality ...

Essential Skills & Experience: 10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks . Good proficiency in Python and Spark (PySpark) or Scala. Deep understanding of data warehousing principles, data modelling techniques, and data … Database . Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks , including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality ...

experienced Data Engineer to design, build, and optimise data solutions within the Microsoft Azure ecosystem. The role focuses on pipeline development, data modelling, governance, and supporting analytics teams with high-quality, reliable data. Key Responsibilities: Develop and maintain scalable data pipelines … data security and governance, including Row-Level Security (RLS) and compliance standards. Maintain documentation and metadata for data assets and pipeline architecture. Collaborate with analysts, data scientists, and stakeholders to deliver trusted data products. Provide technical support and troubleshoot production issues. ...

experienced Data Engineer to design, build, and optimise data solutions within the Microsoft Azure ecosystem. The role focuses on pipeline development, data modelling, governance, and supporting analytics teams with high-quality, reliable data. Key Responsibilities: Develop and maintain scalable data pipelines … data security and governance, including Row-Level Security (RLS) and compliance standards. Maintain documentation and metadata for data assets and pipeline architecture. Collaborate with analysts, data scientists, and stakeholders to deliver trusted data products. Provide technical support and troubleshoot production issues. ...

Data Engineer (Databricks & Azure) - 3-Month Rolling Contract Rate: £400-£450 per day Location: Remote IR35 Status: Outside IR35 Duration: Initial 3 months (rolling) About the Company Join a leading Databricks Partner delivering innovative data solutions for enterprise clients. You'll work on cutting-edge projects … leveraging Databricks and Azure to transform data into actionable insights. About the Role We are seeking an experienced Data Engineer with strong expertise in Databricks and Azure to join our team on a 3-month rolling contract. This is a fully remote position, offering flexibility ...

Data Engineer (Databricks & Azure) - 3-Month Rolling Contract Rate: £400-£450 per day Location: Remote IR35 Status: Outside IR35 Duration: Initial 3 months (rolling) About the Company Join a leading Databricks Partner delivering innovative data solutions for enterprise clients. You'll work on cutting-edge projects … leveraging Databricks and Azure to transform data into actionable insights. About the Role We are seeking an experienced Data Engineer with strong expertise in Databricks and Azure to join our team on a 3-month rolling contract. This is a fully remote position, offering flexibility ...

Skills & Expertise AWS Core Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing ETL pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data … Performance optimization & troubleshooting Python: Automation scripts Data processing workflows Monitoring, debugging, validation scripts AWS Support/Operations: Troubleshooting ETL failures, performance bottlenecks, pipeline issues Monitoring cloud workloads (CloudWatch, CloudTrail) Handling incidents, root-cause analysis (RCA), patching & releases Cost optimization and resource usage tracking Data quality ...

Robert Half Technology are assisting a large, market-leading media organisation to recruit a Data Engineer on a contract basis . Hybrid working - London based. Role * The Data Engineer will design, develop, and maintain modern cloud-based data infrastructure to ensure reliability, scalability … transformation, orchestration, and workflow management.* Optimise ELT/ETL processes for improved performance, cost efficiency, and scalability.* Troubleshoot and resolve data pipeline issues swiftly and effectively across the data platform.* Work with orchestration tools such as Airflow, ADF, or Prefect to schedule and automate workflows. ...

Role Title: Data Integration & Risk Management Specialist Location: London Duration: 28/02/2026 Days on site: 2-3 Rate : 434 £/day on umbrella MUST BE PAYE THROUGH UMBRELLA Role Description: We are seeking a highly skilled Data Integration & Risk Management Specialist to support … BCBS239 compliance program and enhance our enterprise data ecosystem. The ideal candidate will have strong expertise in data engineering, risk data aggregation, and reporting frameworks, with hands-on experience in Teradata, Informatica, and risk modeling tools. Key Responsibilities Data Platform Management ...

Role title: Snr Data Engineer Security Clearance required: SC Clearance IR35 Status: Inside IR35 Pay Rates: £500/d - £525/d Contract length: 6 months Base Location: London - 3/d a week Skills required: - Azure/Azure Data bricks - ADF/ETL - Pyspark/… large data sets, and complex data pipelines. Understanding of Data Architecture and Design, and Data pipeline optimisation. Proven expertise with Data bricks, including hands on implementation experience and certifications. Reasonable Adjustments: Respect and equality are core values to us. ...

Role title: Snr Data Engineer Security Clearance required: SC Clearance IR35 Status: Inside IR35 Pay Rates: £500/d - £525/d Contract length: 6 months Base Location: London - 3/d a week Skills required: - Azure/Azure Data bricks - ADF/ETL - Pyspark/… large data sets, and complex data pipelines. Understanding of Data Architecture and Design, and Data pipeline optimisation. Proven expertise with Data bricks, including hands on implementation experience and certifications. Reasonable Adjustments: Respect and equality are core values to us. ...

Data Engineer - 14-Week Contract (Outside IR35) Likely to Extend Start Date: 12th January Rate: £350 per day Location: Remote (UK-based) Interview: Immediate - Offer before Christmas We are seeking an experienced Data Engineer to join a 14-week project focused on building robust data … REST APIs , PIM systems, and potentially SAP. Ensure data quality, governance, and lineage tracking throughout the project. Required Skills ETL/ELT pipeline design and data validation frameworks. Advanced Python (pandas, numpy, boto3) and SQL (complex queries, optimisation). Experience with AWS Glue , Step Functions ...

Data Engineer - 14-Week Contract (Outside IR35) Likely to Extend Start Date: 12th January Rate: £350 per day Location: Remote (UK-based) Interview: Immediate - Offer before Christmas We are seeking an experienced Data Engineer to join a 14-week project focused on building robust data … REST APIs , PIM systems, and potentially SAP. Ensure data quality, governance, and lineage tracking throughout the project. Required Skills ETL/ELT pipeline design and data validation frameworks. Advanced Python (pandas, numpy, boto3) and SQL (complex queries, optimisation). Experience with AWS Glue , Step Functions ...

Data Engineer - Contract Duration: 6 months Location: Central London - 2/3 days per week in the office. Rate: £750 Inside IR35 I'm partnering with a technology-led organisation to hire a Senior Data Engineer with strong cloud and Python experience and hands-on exposure … PyTorch-based ML workloads . This role sits firmly in data engineering rather than data science or pure ML engineering and will suit someone who has supported ML pipelines and datasets in production cloud environments. You'll work on large-scale, cloud-based data ...

Title: Data Business Analyst Role Type: Contract Location: Remote (Occasional travel to client sites) About the Role Our client is seeking an experienced Data Business Analyst to support a major cloud migration project. This role involves working closely with technical teams to analyse, design, and transition … legacy data warehouse feeds to modern cloud-based platforms. Key Responsibilities Conduct detailed analysis of legacy data feeds, including schema structures, transformations, access controls, and queries, to assess suitability for cloud migration. Design optimised data models and structures for the new cloud platform, ensuring ...

Title: Data Business Analyst Role Type: Contract Location: Remote (Occasional travel to client sites) About the Role Our client is seeking an experienced Data Business Analyst to support a major cloud migration project. This role involves working closely with technical teams to analyse, design, and transition … legacy data warehouse feeds to modern cloud-based platforms. Key Responsibilities Conduct detailed analysis of legacy data feeds, including schema structures, transformations, access controls, and queries, to assess suitability for cloud migration. Design optimised data models and structures for the new cloud platform, ensuring ...

Title: Data Test Analyst - Contract - Outside IR35 - London Location: London (Hybrid: 3 days onsite/2 days WFH) Contract Rate: C* £600 p/day Outside IR35 Duration: 6 months with view to extend About the Role: We are seeking a highly technical Data Test Analyst … join a leading London Market Insurance client on a major data modernisation programme. You will play a key role in ensuring data integrity across Snowflake, DBT transformations, and BI dashboards. This is a hands-on role for someone with strong SQL expertise, a good understanding ...

Senior Data Engineer - Contract - Inside IR35 - London A leading global organisation is undertaking a major back-office transformation and has established a new Divisional Data Team to deliver an enterprise-wide data platform. They are now looking for two Senior Data Engineers … join on an initial 6-month contract , playing a key role in building a brand-new data warehouse from scratch. This is a high-impact role working directly with the AVP of Data Engineering, with the opportunity to shape architecture, pipelines, and delivery standards across ...

Azure Data Engineer (Databricks Specialist) About the Role We are seeking an experienced Azure Data Engineer with a strong focus on Databricks to join our team on a 3-month contract. This role is fully remote and outside IR35, offering flexibility and competitive day rates. … will play a key role in designing, building, and optimising scalable data solutions in Azure, with Databricks at the core of the project. Responsibilities* Design and implement data pipelines using Azure Databricks.* Collaborate with developers, analysts, and DevOps teams to ensure smooth data integration. ...

Data Engineer - Azure, ADF, Power BI, Data Pipelines, Fabric Up to £550 per day (Inside IR35 - Umbrella) London/Hybrid (Must be UK Based, 1-2 days per week onsite may be required) I am currently working with a leading consultancy who are looking … Data Engineer with strong Azure, ADF, Power BI, Data Pipelines and ideally Fabric experience, to work closely with a high profile end customer.Key Requirements: Proven experience as Data Engineer within a large Enterprise Scale organisation Demonstrable experience using Azure related tooling such as Azure ...