51 to 75 of 303 Data Pipeline Jobs in London

consultancy seeking a Microsoft BI Stack Developer to design, build, and support end-to-end business intelligence and analytics solutions using the Microsoft data and analytics ecosystem. This is initially a 3 month contract with potential to extend and will be a hybrid role based in London … role will focus on transforming complex data into trusted, actionable insights through semantic models, dashboards, and reporting solutions aligned to business and stakeholder needs. You will work closely with data engineers, analysts, and business stakeholders to deliver scalable, secure, and high-performing BI solutions, often within ...

Databricks Data Engineer (Contract) | London (Hybrid) | £500–£650 per day (Inside IR35) Peaple Talent are working with a data consultancy who partner with a range of enterprise clients to deliver modern cloud data platforms. They’re currently looking for a Databricks Data Engineer to support multiple client engagements across large-scale data transformation programmes. 💻 The Role This is a hands-on Databricks Data Engineering contract where you’ll be working across different client environments, helping design, build and optimise scalable data platforms. ...

shapes best practice for years to come. If you enjoy ownership, influence, and hands-on technical work across Databricks, data modelling, and pipeline development, this role offers genuine impact and long-term career growth. The Company They are investing heavily in their data capabilities … orchestration tools. • Ability to translate business needs into logical, scalable data models. • Comfortable working across multiple data sources and handling pipeline design. • Experience with Power BI, including semantic models or Tabular Editor. • Curious, collaborative mindset with the ability to push back constructively and guide stakeholders. ...

Data Engineer IAM/Security Data London/Hybrid 12 month contract Were looking for a hands-on Data Engineer to support a major Identity & Access Management data programme within a complex enterprise environment. This is not a generic data engineering role. Youll be working on data pipelines, models and automation tied to identity, access, privileged accounts, controls, metrics and reporting . The right person will be comfortable sitting between data engineering and security/IAM teams . What youll be doing Build ...

Data Engineer (Mid Level) £45,000–£55,000 Remote (1-2 days per month London, Leeds or Preston) Tech Stack: GCP (BigQuery, Dataflow), DBT, Terraform, Airflow (Composer), Python, SQL VIQU are working with a growing, data-driven organisation they are building out a modern Data Platform following a successful migration from on-premise to Google Cloud. Sitting within a well-established Data Office, the team is now focused on developing a scalable Data Mesh architecture. This is a strong opportunity for a mid-level Data Engineer ...

Data Engineer (Mid Level) £45,000–£55,000 Remote (1-2 days per month London, Leeds or Preston) Tech Stack: GCP (BigQuery, Dataflow), DBT, Terraform, Airflow (Composer), Python, SQL VIQU are working with a growing, data-driven organisation they are building out a modern Data Platform following a successful migration from on-premise to Google Cloud. Sitting within a well-established Data Office, the team is now focused on developing a scalable Data Mesh architecture. This is a strong opportunity for a mid-level Data Engineer ...

essential. Your work will directly impact patient outcomes by ensuring our predictive models are always running, always accurate, and always improving. Key Responsibilities ML Pipeline Orchestration & Automation Own and extend Circadia’s ML pipeline orchestration using Apache Airflow, including training, evaluation, and deployment workflows. Build and maintain automated … pipelines for model retraining, validation, and promotion across development, staging, and production environments. Implement pipeline monitoring, alerting, and failure recovery to eliminate silent failures and ensure operational reliability. Design pipeline architectures that support rapid experimentation while enforcing production-grade reproducibility. Model Deployment & Serving Deploy and manage ML models ...

sectors Demonstrated strong analytical and interpersonal skills Expertise in Data engineering: Relational databases, big data technologies, and data pipeline development. Data analytics: Statistical analysis, geospatial modelling, machine learning, and visualisation. Ability to communicate findings to multiple audiences Track record of independently …/projects Self-driven with a commitment to delivering high-quality outputs Strong academic background Desirable Experience Desirable experience includes the application of data analytics methods to solve business problems in one or more of the following fields: Sales and Marketing Customer Experience Network Performance Network Planning Previous ...

Data/RAG Engineer - watsonx.ai & Data Contract | July-December 2026 Up to £550 per day | Inside IR35 UK-based | Mostly Remote (occasional onsite required) British-born nationals or UK residents (5+ years) | One passport only Previous SC clearance highly advantageous Build AI-driven solutions using watsonx … looking for an experienced Data/RAG Engineer to support the delivery of a high-profile AI MVP using watsonx.ai and watsonx.data . This role will play a key part in designing, implementing and optimising Retrieval-Augmented Generation (RAG) pipelines and data foundations that enable ...

Hybrid/Remote Clearance: Active SC clearance required (minimum) Start: June Day Rate: Competitive market rates Overview We are recruiting a contract Databricks Data Engineer for a large-scale UK Government programme delivering critical, cloud-native data platforms. This is a long-term engagement within … Experience with Delta Lake , data lakes and data warehouses Strong understanding of data modelling and scalable pipeline design Experience with Git , CI/CD and agile ways of working Active SC clearance (mandatory) Desirable Experience Previous UK government or public sector contracts Experience ...

leading London Market Underwriter is looking for a Senior Data Business Analyst to lead the discovery, definition, and delivery of data-focused projects across a well established Change and Transformation function. This role offers the opportunity to take ownership of data processes, reporting … intelligence initiatives, while influencing the evolution of the organisation’s Business Analysis framework. Key Responsibilities: Lead the initiation, discovery, and delivery of multiple data and BI projects, ensuring scope, budget, and timelines are controlled. Play a key role in developing the data business analysis function , with ...

Software Delivery Manager (Data Products/SaaS) Location: Blackfriars, London (5 days onsite) We are looking for an experienced Software Delivery Manager/Agile Delivery Manager to lead the end-to-end delivery of data-driven products within a fast-paced, data-centric environment. … hands-on familiarity with data environments, including: Tools: Python, SQL, Tableau/Power BI (or similar) Data concepts: ETL pipelines, data modelling, reporting layers Metrics: Accuracy, latency, completeness, recall/precision (where relevant) Ability to confidently interpret and challenge data to inform ...

Senior AWS Data Engineer - SC Cleared Rate: Up to £475 per day IR35 Status: Inside IR35 - engagement via an umbrella company Duration: 6 months Location: Hybrid - occasional on-site workshops (typically a couple of days per month) in Telford or Hove Security Clearance: Active SC Clearance required Role … Overview We are seeking an experienced Senior AWS Data Engineer to support a large-scale central government data transformation programme . The role sits within a major data delivery area that provides data and analytics solutions aligned to critical business priorities, including ...

looking for a highly analytical and technically proficient Product Analyst to join our team. The ideal candidate has a strong background in data analysis, a passion to improve data driven product improvements and a proven ability to translate complex data into actionable product insights. … This role requires hands-on expertise with various data tools and a solid understanding of data pipelines. This is a 12 month Fixed Term Contract Product Performance Analysis:Data Manipulation & Reporting:Write, optimize, and execute complex SQL queries to extract and manipulate data ...

looking for a highly analytical and technically proficient Product Analyst to join our team. The ideal candidate has a strong background in data analysis, a passion to improve data driven product improvements and a proven ability to translate complex data into actionable product insights. … This role requires hands-on expertise with various data tools and a solid understanding of data pipelines. This is a 12 month Fixed Term Contract Product Performance Analysis:Data Manipulation & Reporting:Write, optimize, and execute complex SQL queries to extract and manipulate data ...

seeking an experienced Senior Data Engineer with strong Databricks expertise to design, build, and maintain a scalable cloud-based data platform for a private equity firm. This is a 6-month contract based in London with hybrid working. Key Responsibilities Design and build robust data pipelines using Azure Data Factory and Databricks Develop ETL/ELT processes to transform raw data into analytics-ready datasets Architect and maintain data lake solutions using Azure Data Lake Storage Implement Databricks solutions using Delta Lake and medallion architecture ...

looking for a highly analytical and technically proficient Product Analyst to join our team. The ideal candidate has a strong background in data analysis, a passion to improve data driven product improvements and a proven ability to translate complex data into actionable product insights. … This role requires hands-on expertise with various data tools and a solid understanding of data pipelines. This is a 12 month Fixed Term Contract Product Performance Analysis: Data Manipulation & Reporting: Write, optimize, and execute complex SQL queries to extract and manipulate data ...

looking for a highly analytical and technically proficient Product Analyst to join our team. The ideal candidate has a strong background in data analysis, a passion to improve data driven product improvements and a proven ability to translate complex data into actionable product insights. … This role requires hands-on expertise with various data tools and a solid understanding of data pipelines. This is a 12 month Fixed Term Contract Product Performance Analysis: Data Manipulation & Reporting: Write, optimize, and execute complex SQL queries to extract and manipulate data ...

looking for a highly analytical and technically proficient Product Analyst to join our team. The ideal candidate has a strong background in data analysis, a passion to improve data driven product improvements and a proven ability to translate complex data into actionable product insights. … This role requires hands-on expertise with various data tools and a solid understanding of data pipelines. This is a 12 month Fixed Term Contract Product Performance Analysis: Data Manipulation & Reporting: Write, optimize, and execute complex SQL queries to extract and manipulate data ...

looking for a highly analytical and technically proficient Product Analyst to join our team. The ideal candidate has a strong background in data analysis, a passion to improve data driven product improvements and a proven ability to translate complex data into actionable product insights. … This role requires hands-on expertise with various data tools and a solid understanding of data pipelines. This is a 12 month Fixed Term Contract Product Performance Analysis: Data Manipulation & Reporting: Write, optimize, and execute complex SQL queries to extract and manipulate data ...

looking for a highly analytical and technically proficient Product Analyst to join our team. The ideal candidate has a strong background in data analysis, a passion to improve data driven product improvements and a proven ability to translate complex data into actionable product insights. … This role requires hands-on expertise with various data tools and a solid understanding of data pipelines. This is a 12 month Fixed Term Contract Product Performance Analysis: Data Manipulation & Reporting: Write, optimize, and execute complex SQL queries to extract and manipulate data ...

Senior Data Engineer (Contract) Location: London (2 days onsite per week) Day Rate : £500-550 Per day (Outside IR35) Duration: 6-month contract Start: ASAP Contact : Matthew.Makranczy@forsythbarnes.com Overview We are looking for a Senior Data Engineer to join a high-performing team delivering advanced data … teams to generate actionable insights from large-scale datasets. This is a hands-on leadership position focused on building robust, scalable, and governed data solutions using modern cloud technologies. The Role Own the end-to-end design, build, optimisation, and support of scalable Spark/PySpark data ...

client, a prominent entity in the Defence and Security sector, is currently seeking a dedicated Data Engineer to join their team in a permanent capacity. Key Responsibilities: Build, configure, and maintain a modern cloud-based data platform in alignment with architectural blueprints and design standards. Develop … robust data pipelines that ingest, transform, and publish data from multiple source systems into trusted reporting layers. Ensure solutions support financial reporting requirements including accuracy, completeness, auditability, and traceability. Collaboration & Technical Input: Work closely with Data Architects to refine designs, challenge assumptions, and contribute ...

Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients … senior, hands-on Data Engineer role. As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose ...

Senior Data Engineer London Hybrid Salary £80,000 - £90,000 (depending on experience) VIQU has partnered with a leading organisation in the clean energy sector to recruit a Senior Data Engineer. You will design and build scalable data infrastructure, turning complex datasets into valuable … collaborative, agile team, you ll take ownership of key initiatives while contributing to best practices and mentoring others. Key Responsibilities of the Senior Data Engineer: • Build and maintain scalable data infrastructure using cloud technologies • Develop and optimise ETL pipelines for efficient data processing • Support ...