451 to 475 of 1,061 Data Pipeline Jobs in England

Data Operations Team Leader Hybrid - two days per week onsite in London £80k - £90k + bonus & benefits Step into a newly defined data operations management position at the centre of a major data transformation. You’ll lead a small, capable team responsible for the reliability, performance, and observability of modern data platforms … that power decisions across a complex, regulated organisation. This is a hands-on leadership role, part strategist, part problem-solver - shaping how data operations are delivered across a modern cloud environment (AWS and Azure). If you thrive on improving how data pipelines run, building resilient systems, and driving operational excellence, this is your chance to … make a visible impact in a high-profile business. What You’ll Do Lead data operations and second line support to ensure data pipelines, platforms, and integrations run reliably with full observability and proactive monitoring. Optimise performance across Snowflake and connected data platforms, driving continuous improvement and automation. Define and embed support models and More ❯

and Azure engineering skills to join a major transformation programme within the financial-markets domain. This role is fully hands-on, focused on building and optimising large-scale data pipelines, dataflows, semantic models, and lakehouse components. Key Responsibilities Design, build and optimise Spark-based data pipelines for batch and streaming workloads Develop Fabric dataflows, pipelines, and … semantic models Implement complex transformations, joins, aggregations and performance tuning Build and optimise Delta Lake/delta tables Develop secure data solutions including role-based access, data masking and compliance controls Implement data validation, cleansing, profiling and documentation Work closely with analysts and stakeholders to translate requirements into scalable technical solutions Troubleshoot and improve … and workload performance Essential Skills Strong hands-on experience with PySpark, Spark SQL, Spark Streaming, DataFrames Microsoft Fabric (Fabric Spark jobs, dataflows, pipelines, semantic models) Azure: ADLS, cloud data engineering, notebooks Python programming; Java exposure beneficial Delta Lake/Delta table optimisation experience Git/GitLab, CI/CD pipelines, DevOps practices Strong troubleshooting and problem-solving ability More ❯

and Azure engineering skills to join a major transformation programme within the financial-markets domain. This role is fully hands-on, focused on building and optimising large-scale data pipelines, dataflows, semantic models, and lakehouse components. Key Responsibilities Design, build and optimise Spark-based data pipelines for batch and streaming workloads Develop Fabric dataflows, pipelines, and … semantic models Implement complex transformations, joins, aggregations and performance tuning Build and optimise Delta Lake/delta tables Develop secure data solutions including role-based access, data masking and compliance controls Implement data validation, cleansing, profiling and documentation Work closely with analysts and stakeholders to translate requirements into scalable technical solutions Troubleshoot and improve … and workload performance Essential Skills Strong hands-on experience with PySpark, Spark SQL, Spark Streaming, DataFrames Microsoft Fabric (Fabric Spark jobs, dataflows, pipelines, semantic models) Azure: ADLS, cloud data engineering, notebooks Python programming; Java exposure beneficial Delta Lake/Delta table optimisation experience Git/GitLab, CI/CD pipelines, DevOps practices Strong troubleshooting and problem-solving ability More ❯

m working with a fast-growing global hospitality group that’s redefining modern travel. With several properties across key international cities and airports, they’re expanding quickly, and data is at the heart of their next stage of growth. They’re now hiring a Growth Analytics Manager to join their central commercial team in London. This is a … newly created position designed to modernise how the business uses data across marketing, digital, and revenue. You’ll sit at the intersection of revenue, marketing, and digital, translating data into insight that drives bookings, optimises campaigns, and informs commercial strategy. Your work will directly support senior leadership and shape data-driven decisions across multiple … markets. 🚀 Performance Analytics & Data Strategy This role combines strategic thinking with hands-on delivery. You’ll use data to identify opportunities, improve how we capture and model information, and help build scalable reporting frameworks that bring clarity to business performance. Working closely with the commercial and marketing teams, you’ll consolidate data from multiple More ❯

m working with a fast-growing global hospitality group that’s redefining modern travel. With several properties across key international cities and airports, they’re expanding quickly, and data is at the heart of their next stage of growth. They’re now hiring a Growth Analytics Manager to join their central commercial team in London. This is a … newly created position designed to modernise how the business uses data across marketing, digital, and revenue. You’ll sit at the intersection of revenue, marketing, and digital, translating data into insight that drives bookings, optimises campaigns, and informs commercial strategy. Your work will directly support senior leadership and shape data-driven decisions across multiple … markets. 🚀 Performance Analytics & Data Strategy This role combines strategic thinking with hands-on delivery. You’ll use data to identify opportunities, improve how we capture and model information, and help build scalable reporting frameworks that bring clarity to business performance. Working closely with the commercial and marketing teams, you’ll consolidate data from multiple More ❯

Senior Data Engineer Hybrid (3 Days Per Week) - London Up to £80,000 + Benefits We're partnering with one of the most exciting InsurTech scale-ups in the market - a company transforming how brokers and insurers exchange risk, already processing over $150m in premium and targeting $1B by 2027 . They're looking for a Senior Data Engineer (3-5 years' experience) to help scale their modern data platform as they continue rapid growth. What you'll do: Build and maintain scalable, automated, reliable data pipelines across a modern cloud stack Extend and improve a cutting-edge Data & Analytics Platform supporting mission-critical insurance products Implement data quality checks, observability metrics and troubleshooting processes Manage cloud resources via Infrastructure-as-Code Ensure strong data security, access control, and governance Work closely with commercial, analytics and engineering teams to deliver high-quality data products What you'll bring: 3-5 years' experience as a Data Engineer Strong SQL and Python More ❯

Senior Data Engineer Hybrid (3 Days Per Week) - London Up to £80,000 + Benefits We're partnering with one of the most exciting InsurTech scale-ups in the market - a company transforming how brokers and insurers exchange risk, already processing over $150m in premium and targeting $1B by 2027 . They're looking for a Senior Data Engineer (3-5 years' experience) to help scale their modern data platform as they continue rapid growth. What you'll do: Build and maintain scalable, automated, reliable data pipelines across a modern cloud stack Extend and improve a cutting-edge Data & Analytics Platform supporting mission-critical insurance products Implement data quality checks, observability metrics and troubleshooting processes Manage cloud resources via Infrastructure-as-Code Ensure strong data security, access control, and governance Work closely with commercial, analytics and engineering teams to deliver high-quality data products What you'll bring: 3-5 years' experience as a Data Engineer Strong SQL and Python More ❯

these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience … with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates … Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯

these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience … with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates … Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯

Analytics Engineer Location: London About the Role: We are seeking an experienced Analytics Engineer to help design and scale a modern data platform for a global organisation. This role is ideal for someone passionate about building robust data architectures, enabling actionable insights, and driving analytics maturity across the business. Enjoy owning the full analytics workflow from … raw ingestion to dashboards. Value clean, documented, and tested data models. Have a product mindset and embrace stakeholder feedback. Stay current with modern data tooling and best practices. Key Responsibilities: Design and maintain scalable data warehouse architecture using the Medallion model (Bronze/Silver/Gold layers). Build, test, and deploy dbt/… dataform models with reusable SQL-based transformations. Develop and optimise BI dashboards and data products using Tableau, translating business needs into visual insights. Orchestrate and monitor data pipelines, ensuring data quality and timely delivery. Implement data quality checks, observability, and maintain data cataloging and lineage. Drive CI/CD practices More ❯

Analytics Engineer Location: London About the Role: We are seeking an experienced Analytics Engineer to help design and scale a modern data platform for a global organisation. This role is ideal for someone passionate about building robust data architectures, enabling actionable insights, and driving analytics maturity across the business. Enjoy owning the full analytics workflow from … raw ingestion to dashboards. Value clean, documented, and tested data models. Have a product mindset and embrace stakeholder feedback. Stay current with modern data tooling and best practices. Key Responsibilities: Design and maintain scalable data warehouse architecture using the Medallion model (Bronze/Silver/Gold layers). Build, test, and deploy dbt/… dataform models with reusable SQL-based transformations. Develop and optimise BI dashboards and data products using Tableau, translating business needs into visual insights. Orchestrate and monitor data pipelines, ensuring data quality and timely delivery. Implement data quality checks, observability, and maintain data cataloging and lineage. Drive CI/CD practices More ❯

A well-established business in Brentford is seeking an experienced BI Developer to join their BI & Data Team as they embark on a major transformation journey, moving from legacy systems towards a modern Microsoft ecosystem built on Azure and Fabric. The team operates mostly remotely, with office collaboration up to once per week alongside the wider BI & Data … and ensure the new set-up supports analytics, forecasting, and AI enablement. Key responsibilities will include: Designing and delivering scalable BI solutions using Microsoft Fabric Building and managing data pipelines with OneLake, Dataflows Gen2, and Data Factory Developing semantic models in Power BI and integrating with DirectLake or Warehouse datasets Optimising data models for … performance and reusability Supporting governance, security, and compliance best practices in a modern data platform Tooling for migration and reconciliation of data from legacy systems or acquisitions Providing technical support and hands-on data engineering across the full stack We are looking for: Strong experience as a BI Developer, Data Engineer, or More ❯

A well-established business in Brentford is seeking an experienced BI Developer to join their BI & Data Team as they embark on a major transformation journey, moving from legacy systems towards a modern Microsoft ecosystem built on Azure and Fabric. The team operates mostly remotely, with office collaboration up to once per week alongside the wider BI & Data … and ensure the new set-up supports analytics, forecasting, and AI enablement. Key responsibilities will include: Designing and delivering scalable BI solutions using Microsoft Fabric Building and managing data pipelines with OneLake, Dataflows Gen2, and Data Factory Developing semantic models in Power BI and integrating with DirectLake or Warehouse datasets Optimising data models for … performance and reusability Supporting governance, security, and compliance best practices in a modern data platform Tooling for migration and reconciliation of data from legacy systems or acquisitions Providing technical support and hands-on data engineering across the full stack We are looking for: Strong experience as a BI Developer, Data Engineer, or More ❯

Our client is a leading hedge fund in London, leveraging cutting-edge technology and data to drive investment decisions across diverse asset classes. They're looking for a skilled Data Engineer to play a crucial role in building and optimizing the firm's data infrastructure. Responsibilities: Design, develop, and maintain robust data pipelines and ETL processes. Collaborate with data scientists and analysts to support data-driven strategies. Ensure data accuracy, consistency, and security across various data sources. Drive innovation by exploring new technologies and best practices in data engineering. Requirements: Bachelor’s or Master’s in Computer Science, Engineering, or … a related field. 1+ years of experience in data engineering. Proficiency in SQL, Python, and big data tools like Spark. Excellent problem-solving skills and a collaborative mindset. More ❯

Our client is a leading hedge fund in London, leveraging cutting-edge technology and data to drive investment decisions across diverse asset classes. They're looking for a skilled Data Engineer to play a crucial role in building and optimizing the firm's data infrastructure. Responsibilities: Design, develop, and maintain robust data pipelines and ETL processes. Collaborate with data scientists and analysts to support data-driven strategies. Ensure data accuracy, consistency, and security across various data sources. Drive innovation by exploring new technologies and best practices in data engineering. Requirements: Bachelor’s or Master’s in Computer Science, Engineering, or … a related field. 1+ years of experience in data engineering. Proficiency in SQL, Python, and big data tools like Spark. Excellent problem-solving skills and a collaborative mindset. More ❯

Training Manager – Digital Enablement and Data Platform Learning Location: London/Hybrid Clearance: Security clearance (Level 2 or above) highly desirable Salary: Up to £95,000 + 15% bonus About the Organisation We are a specialist technology consultancy delivering secure, data-driven transformation for government and national security clients. Our teams work across mission-critical environments … helping organisations adopt advanced data platforms, digital tools, and analytical workflows. We are expanding our capability in digital enablement and platform training , ensuring our clients can confidently adopt and scale their use of modern data ecosystems such as Palantir Foundry and other enterprise data platforms. The Role We are seeking a Training Manager to … design, deliver, and manage technical enablement programmes that empower client and internal teams to maximise their use of integrated data platforms. This role will bridge the gap between engineering, data operations, and end users helping to embed best practices, standardise training materials, and ensure lasting adoption. This position suits a confident communicator with experience designing and More ❯

Training Manager – Digital Enablement and Data Platform Learning Location: London/Hybrid Clearance: Security clearance (Level 2 or above) highly desirable Salary: Up to £95,000 + 15% bonus About the Organisation We are a specialist technology consultancy delivering secure, data-driven transformation for government and national security clients. Our teams work across mission-critical environments … helping organisations adopt advanced data platforms, digital tools, and analytical workflows. We are expanding our capability in digital enablement and platform training , ensuring our clients can confidently adopt and scale their use of modern data ecosystems such as Palantir Foundry and other enterprise data platforms. The Role We are seeking a Training Manager to … design, deliver, and manage technical enablement programmes that empower client and internal teams to maximise their use of integrated data platforms. This role will bridge the gap between engineering, data operations, and end users helping to embed best practices, standardise training materials, and ensure lasting adoption. This position suits a confident communicator with experience designing and More ❯

Data Integration Engineer - Hybrid (Telford) Day Rate: 513 (Inside IR35) Contract Length: 6 months Location: Hybrid - 2 days per week onsite in Telford Security Clearance: Active SC clearance required About the Role We're seeking an experienced Data Integration Engineer to join a new Scrum team within the Minerva Platform, supporting HMRC's Modernizing, Mandating Tax … Advisor Registration (MMTAR) initiative. This project will deliver a unified, automated registration journey for tax agents across multiple regimes, incorporating risk assessment and advanced data processing. You'll play a key role in designing and implementing ingestion and risking capabilities within the SAS Platform, including IDP, as part of a high-impact transformation program. Key Responsibilities Design, develop … and deploy data integration and transformation solutions using Pentaho , Denodo , Talend , and SAS . Architect scalable data pipelines and services to support BI and analytics platforms. Collaborate with cross-functional teams to define technical specifications and deliver robust solutions. Champion Agile/Scrum methodologies and drive timely sprint delivery. Implement DevOps practices for CI/CD More ❯

Data Integration Engineer - Hybrid (Telford) Day Rate: £513 (Inside IR35) Contract Length: 6 months Location: Hybrid - 2 days per week onsite in Telford Security Clearance: Active SC clearance required About the Role We're seeking an experienced Data Integration Engineer to join a new Scrum team within the Minerva Platform, supporting HMRC's Modernizing, Mandating Tax … Advisor Registration (MMTAR) initiative. This project will deliver a unified, automated registration journey for tax agents across multiple regimes, incorporating risk assessment and advanced data processing. You'll play a key role in designing and implementing ingestion and risking capabilities within the SAS Platform, including IDP, as part of a high-impact transformation program. Key Responsibilities Design, develop … and deploy data integration and transformation solutions using Pentaho , Denodo , Talend , and SAS . Architect scalable data pipelines and services to support BI and analytics platforms. Collaborate with cross-functional teams to define technical specifications and deliver robust solutions. Champion Agile/Scrum methodologies and drive timely sprint delivery. Implement DevOps practices for CI/CD More ❯

We are looking for an experienced Test Analyst to join our Data Analytics team to support the team to quality assure the development of new Data Analytics products data pipelines datasets reports and dashboards Essential skills and experience Developing test solutions test plans test cases and execute the test cases Planning and implementing testing … Writing test documentation Strong analytical skills enabling effective translation of requirements and technical specifications into quality test artefacts eg test cases test scripts test data etc Full project development lifecycle testing experience Working as part of an agile team Experience of testing in data analytics environments eg o experience with ETL testing and validating multiple source … databases to target data warehouse tables data platform datasets o experience with testing BI reporting eg Tableau dashboards excel outputs Proven ability to define and adapt a test approach appropriate to specific technologies and business domain Broad knowledge of test tools techniques and approaches and ability to recommend where and how to use them Experience working More ❯

We are looking for an experienced Test Analyst to join our Data Analytics team to support the team to quality assure the development of new Data Analytics products data pipelines datasets reports and dashboards Essential skills and experience Developing test solutions test plans test cases and execute the test cases Planning and implementing testing … Writing test documentation Strong analytical skills enabling effective translation of requirements and technical specifications into quality test artefacts eg test cases test scripts test data etc Full project development lifecycle testing experience Working as part of an agile team Experience of testing in data analytics environments eg o experience with ETL testing and validating multiple source … databases to target data warehouse tables data platform datasets o experience with testing BI reporting eg Tableau dashboards excel outputs Proven ability to define and adapt a test approach appropriate to specific technologies and business domain Broad knowledge of test tools techniques and approaches and ability to recommend where and how to use them Experience working More ❯

Data Engineering Lead - Summary A leading global construction firm is seeking a Data Engineering Lead to drive the evolution of its hybrid Azure/Databricks data platform. This role is central to building scalable, high-performance data solutions that bridge infrastructure and business intelligence. Key Responsibilities:* Design and maintain robust data pipelines for ingestion, transformation, and delivery* Leverage Azure, Databricks, and Azure Data Factory to integrate and enrich data from diverse sources* Implement orchestration, monitoring, and error-handling best practices* Optimize hybrid cloud architecture for performance, scalability, and cost-efficiency* Lead a team of BI Developers, ensuring timely delivery of dashboards and data products* Promote adoption of best practices and continuous learning within the team* Enforce data quality, governance, and security standards Technical Requirements:* Deep experience with Azure, SQL, Databricks, Azure Data Factory, and medallion architecture* Strong ETL design and hybrid cloud integration skills* Proficiency in Power BI and DAX for dashboard development* Solid understanding of KPI More ❯

Data Scientist [Analyst/Associate] About the job As a Data Scientist on the AI team at Cerberus, you’ll work on high-impact projects that combine the pace of a startup with the reach of a global investment platform. Our team partners directly with internal investment desks as well as portfolio companies across industries to … and validating robust predictive models for pricing and valuation across diverse asset classes to dynamically optimizing prices under changing market conditions. You’ll be expected to translate complex data into actionable insights and ensure your solutions are not only technically sound but also adopted and delivering measurable business value, supporting deal team members and portfolio company executives. We … re looking for data scientists who are passionate about impact—those who bring deep statistical knowledge, thrive in fast-paced environments, and want to see their models deployed, used, and making a difference. What you will do Build and deliver AI solutions: Design and implement advanced models and systems as both an individual contributor and as part of More ❯

Data Scientist [Analyst/Associate] About the job As a Data Scientist on the AI team at Cerberus, you’ll work on high-impact projects that combine the pace of a startup with the reach of a global investment platform. Our team partners directly with internal investment desks as well as portfolio companies across industries to … and validating robust predictive models for pricing and valuation across diverse asset classes to dynamically optimizing prices under changing market conditions. You’ll be expected to translate complex data into actionable insights and ensure your solutions are not only technically sound but also adopted and delivering measurable business value, supporting deal team members and portfolio company executives. We … re looking for data scientists who are passionate about impact—those who bring deep statistical knowledge, thrive in fast-paced environments, and want to see their models deployed, used, and making a difference. What you will do Build and deliver AI solutions: Design and implement advanced models and systems as both an individual contributor and as part of More ❯

Data Engineer - Microsoft Fabric - Azure - London - Hybrid - 70k A well-established multinational organisation is undergoing a major data transformation, moving from legacy systems to a modern Microsoft ecosystem built on Azure and Fabric. We're looking for a Data Engineer with hands-on Microsoft Fabric experience to lead this migration, design scalable architecture, and … support analytics, forecasting, and AI enablement. Key Responsibilities: Spearhead the migration to Microsoft Fabric Build robust data pipelines using OneLake, Dataflow and Data Factory Deliver full-stack data engineering solutions What You'll Bring: Proven experience in BI or Data Engineering roles Strong skills in Microsoft Fabric and Azure Data Services Solid knowledge of SQL and Power BI Experience with data migration and modern data platforms What's on Offer: Competitive salary up to £70,000 (DOE) Hybrid working - just 2-4 days per month onsite in London A pivotal role in a high-impact transformation project Supportive, flexible, and collaborative team culture Interviews More ❯