8 of 8 Contract Data Pipeline Jobs in Central London

IR35) Databricks Engineer needed with active SC Security Clearance for 6 Month Contract based in Central London (Hybrid). Developing a cutting-edge Azure Databricks platform for economic data modelling, analysis, and forecasting. Start asap ideally in October 2025. Hybrid Working - 2 days/week remote (WFH), and 3 days/week working on-site from the Central … London office. A chance to work with a leading global IT and Digital transformation business specialising in Government projects: In-depth Data Engineering + strong hands-on Azure Databricks expertise. Azure Data Services, Azure Data Factory, Azure Blob Storage + Azure SQL Database. Designing, developing, building + optimising data pipelines, implementing data … including data modelling techniques + data integration patterns. Experience of working with complex data pipelines, large data sets, data pipeline optimization + data architecture design. Implementing complex data transformations using Spark, PySpark or Scala + working with SQL/MySQL databases. Experience with data More ❯

Engineer Location: London (hybrid 3 times a week) Department: IT Type: 3 months rolling contract Outside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. … Key Responsibilities Design and build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high experience within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and More ❯

Location - London, Bristol or Manchester (1 day a month onsite) Duration - 6 months Rate - £550 - £600pd (inside ir35) As a Data Engineer in the Cyber and Domains Protection Team you will: Work within an Agile team to support the development of dashboards and build automated reports to meet the needs of technical and non-technical users Work with … the data analyst and user researcher to update relevant data models to allow business intelligence data to meet the organisation's specific needs Develop business intelligence reports that can be automated, reused and shared with users directly Implement data flows to connect operational systems, data for analytics and business intelligence … for ETL and data cataloging Amazon Redshift or Athena for data warehousing and analytics Lambda for event-driven data processing. ETL/ELT pipeline development : experience in designing, building, and maintaining robust, automated data pipelines. You should be comfortable with both the theory and practical application of extracting, transforming, and loading More ❯

Data Analytics Engineer Location: Central London - hybrid working Rate: £500.00 per day inside IR35 Duration: 12 months We are working with a leading global player in the travel industry who are seeking a Data Analytics Engineer to join their data team. This role sits at the intersection of data analysis and data engineeringideal for someone who enjoys building scalable data solutions while staying close to business impact. The Role As a Data Analytics Engineer , youll design, build, and maintain reliable data pipelinesprimarily using PySpark, SQL, and Python to ensure business teams (analysts, product managers, finance, operations) have access to well-modeled, actionable data. Youll … Engineers, youll be closer to the business, shaping analytics-ready datasets. Unlike pure Data Analysts, youll spend more time coding, managing data infrastructure, and ensuring pipeline reliability. Who Were Looking For Data Analytics : Analysts who have strong experience building and maintaining data pipelines (particularly in PySpark/SQL ) and want to More ❯

Contract Role Remote Working £600 - £700, Inside IR35 We're partnering with a Global IT Partner who are looking for a Databricks Solution Architect to provide guidance on data architecture and design and optimise Databricks solutions. As a Databricks Solution Architect, you will be responsible for: Lead end-to-end architecture of data lakes to Azure … Databricks Design and implement data pipelines in Azure Databricks, optimizing for performance, cost, and scalability Advise of data lake migration, data modelling and pipeline optimisation Refactor and modernize existing data models to integrate with Power BI Coordinate phased migrations to ensure zero disruption to live operations Replace legacy tools by consolidating … experience with Azure Data Lake Storage Gen2, Azure Data Factory, and Azure Synapse Analytics Proficiency in SQL and Python for data transformation and pipeline logic Please note: you will be working in a US time zone. Please contract/01676545407 to discuss in more detail. ECS Recruitment Group Ltd is acting as an More ❯

Data Engineer Must be London-based, able to work from site in London with occasional travel to Croydon SC Clearance required/or eligible for clearance Contract duration: 2 years + Up To £41,000 per annum, depending on experience Job Purpose/The Role: We are seeking 3 experienced Data Engineers to support a high … Public Sector client. These roles will be part of a large project, contributing to the ongoing development and live support of critical systems within a secure, agile, and data-driven environment. Your Key Responsibilities: Work collaboratively in a multi-disciplinary Agile & DevOps team to deliver data solutions and maintain live systems. Apply best practices for data integration, transformation, and delivery in a secure and scalable environment. Support data pipelines and ETL processes across various technologies and cloud platforms Maintain, monitor, and troubleshoot systems using a wide array of tools and platforms. Contribute to automation and continuous integration/deployment (CI/CD) efforts. Engage directly with clients and stakeholders, demonstrating excellent problem More ❯

Position: Data Engineer Location: Central London or Bristol (3 days per week onsite) Salary: £600 to £650 p.d inside IR35 Security Clearance: SC Clearance Required About the Role A leading IT consultancy delivering innovative solutions to the UK public sector is seeking an experienced Data Engineer to support a high-profile programme. You'll collaborate with … cross-functional teams to build scalable data pipelines and contribute to digital transformation initiatives across government departments. Key Responsibilities Design, develop and maintain robust data pipelines using PostgreSQL and Airflow or Apache Spark Collaborate with frontend/backend developers using Node.js or React Implement best practices in data modelling, ETL processes and performance optimisation … Docker/Kubernetes) - experience in this area is desirable, not essential Operate within Agile teams and support DevOps practices What We're Looking For Proven experience as a Data Engineer in complex environments Strong proficiency in PostgreSQL and either Airflow or Spark Solid understanding of Node.js or React for integration and tooling Familiarity with containerisation technologies (Docker/ More ❯

and platform teams during privacy incidents or investigations. Provide technical insight during incident triage, root cause analysis, and remediation planning. Coach teams in privacy-preserving engineering practices, including data minimisation, anonymisation/pseudonymisation, and consent management. Cross-Functional Collaboration Collaborate with Product Owners, Architects, Security Engineers and Lega to ensure privacy compliance is aligned with business and technical … Architecture to embed privacy considerations early in design phases. Contribute to the continuous improvement of privacy engineering practices across the organisation. Experience Technical Expertise: Background in software or data engineering, with hands-on familiarity across data pipelines, APIs, SDKs, client/server tracking, consent tooling, and event-driven systems. Understanding of cloud environments, modern data … Regulatory Literacy: Working knowledge of GDPR, PECR and relevant regulatory guidance from authorities such as the ICO or EDPB. Capable of identifying potential compliance risks and escalating to Data Protection or Legal teams when appropriate. Agile & SAFe Proficiency: Experience embedding Non-Functional Requirements (NFRs) and Behaviour-Driven Development (BDD) practices within agile workflows. Comfortable participating in agile ceremonies More ❯