Data Pipeline Jobs in England

276 to 300 of 1,053 Data Pipeline Jobs in England

Data Engineer

London, England, United Kingdom
Hybrid/Remote Options
Harnham
Contract Data Engineer £500/day - Outside IR35 6 Months (initial) Fully Remote A major hospitality operator is embarking on a large-scale data transformation project to build a Single Customer View (SCV) that will power personalised engagement across its portfolio of brands. This is a greenfield opportunity to shape the data foundation behind … one of the UK's biggest customer data platforms (CDP). You'll work alongside the Lead Data Engineer to design and implement scalable data pipelines, unify disparate data sources, and deliver clean, reliable datasets that drive smarter marketing and customer insights. THE ROLE: As a Data Engineer , you will … Design and build robust data pipelines to consolidate customer data into a single, trusted view. Clean, transform, and enrich data for marketing activation and segmentation within the CDP. Collaborate with cross-functional teams to translate business requirements into technical solutions. Automate data ingestion, transformation, and testing processes aligned with DevOps best practices. More ❯
Posted:

Data Engineer

London, South East, England, United Kingdom
Hybrid/Remote Options
Harnham - Data & Analytics Recruitment
Contract Data Engineer £500/day - Outside IR35 6 Months (initial) Fully Remote A major hospitality operator is embarking on a large-scale data transformation project to build a Single Customer View (SCV) that will power personalised engagement across its portfolio of brands. This is a greenfield opportunity to shape the data foundation behind … one of the UK's biggest customer data platforms (CDP). You'll work alongside the Lead Data Engineer to design and implement scalable data pipelines, unify disparate data sources, and deliver clean, reliable datasets that drive smarter marketing and customer insights. THE ROLE: As a Data Engineer , you will … Design and build robust data pipelines to consolidate customer data into a single, trusted view. Clean, transform, and enrich data for marketing activation and segmentation within the CDP. Collaborate with cross-functional teams to translate business requirements into technical solutions. Automate data ingestion, transformation, and testing processes aligned with DevOps best practices. More ❯
Employment Type: Contractor
Rate: £450 - £520 per day
Posted:

Azure Data Engineer

West Midlands, England, United Kingdom
Focus on SAP
Position: Azure Data Engineer Employment Type: Contract Start: ASAP (November/December 2025) Duration: 6 Months Location: West Midlands, UK Language(s): English Focus on SAP is a specialist SAP and ERP Recruitment organisation offering both permanent and contract staffing solutions on a global scale. Client – Partnered with a global leader in digital transformation and IT services, working … people and communities they serve. For you, this means working on challenging projects that demand innovation, collaboration, and thought leadership . Role – We are seeking an experienced Azure Data Engineer to join a leading technology-driven organisation. You will play a key role in designing, building, and optimising data pipelines and integration workflows within the Microsoft … Azure ecosystem. You will work closely with cross-functional teams to deliver efficient, scalable, and secure data solutions that enable advanced analytics and business intelligence capabilities. Key Responsibilities: Design, build, and maintain data pipelines using Azure Data Factory (ADF) . Develop ETL/ELT processes to integrate and transform large datasets across cloud and More ❯
Posted:

Data Engineer

chester, north west england, united kingdom
Hybrid/Remote Options
Fuelius
Are you a data engineer who gets genuinely excited about clean data architectures and solving complex business problems? We're looking for someone exceptional to join our elite data practice. About Us We're a HubSpot CRM Elite Partner - one of the most advanced globally. We handle the biggest, most complex CRM implementations for … global brands who need serious technical solutions, not basic consultancy. We're the grown-ups in this space, and we're building something genuinely innovative: the only true data practice in the HubSpot ecosystem. The Role You'll be joining our existing data team to build cutting-edge solutions as we become a Microsoft Fabric end … to-end partner. This isn't about maintaining legacy systems - you'll be architecting the future of how enterprise clients handle data migration, implementation, and ongoing data strategy. What You'll Do Build robust ETL pipelines using Python and SQL for complex enterprise data migrations and integrations Work with Microsoft Fabric across the full More ❯
Posted:

Business Intelligence Analyst

Liverpool, Merseyside, England, United Kingdom
Reed Talent Solutions
lead in the preparation and development of key business intelligence to enable efficient, effective and commercially focussed performance reporting within the business. The role will also ensure the data requirements of claims processing activity are met to ensure the business submits its claims in a timely and efficient manner. The Business Intelligence Analyst is responsible for researching reporting … requirements for a variety of stakeholders for current and newly awarded contracts, including designing robust controls to ensure the accuracy of the data presented. The role will work closely with other departments to ensure business reporting requirements are delivered in an efficient and cost-effective manner and will ensure usage of the BI tool is maximised. This Job … of Power BI dashboards and reports, ensuring they are insightful, scalable, and user-friendly. Collaborate with stakeholders to understand business needs and translate them into actionable insights and data products. Influence and inform decision-makers using compelling data storytelling, strategic analysis, and visual narratives. Act as a subject matter expert in Power BI, including DAX, data More ❯
Employment Type: Full-Time
Salary: £32,000 - £40,000 per annum
Posted:

Data Engineer

SG1, Stevenage, Hertfordshire, United Kingdom
Cirrus Selection Limited
three-time gold investor in people award winner, an advocate of supporting women in engineering and developing their people to be the best they can be? As a data engineer specialising in generative AI; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. The opportunity: The business is looking for a Data Engineer to join an Information Management GenAI delivery Office, who will be able to evaluate design, deploy, improve and support the companies data sets. The Data Engineer will ensure data pipelines … are designed to be resilient, secure and responsive. You will use your data engineering expertise to collaborate with different internal customers regarding their data, ensuring they are optimised and secured for their needs. The Data Engineer will provide knowledge in data management and data quality to guarantee compliance to company More ❯
Employment Type: Permanent
Salary: £45000 - £55000/annum Overtime, bonus & benefits
Posted:

SC cleared - Azure Data Engineer

England, United Kingdom
Methods
Duration: initial contract until end of March 26, with possible extension Daily rate : £495 inside IR35 Location: Remote Clearance : active SC Key Responsibilities: Design, develop, and optimize data pipelines using Microsoft Fabric and Azure services (eg, Azure Data Factory, Azure Synapse Analytics, Azure Databricks). Build and maintain scalable, high-performance data architectures to … support analytics, reporting, and machine learning workloads. Implement data ingestion, ETL/ELT processes, and data warehousing solutions. Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions. Ensure data quality, security, and compliance with organizational and regulatory standards. Monitor and troubleshoot data pipelines … optimizing for performance and cost-efficiency. Experience: Strong hands-on experience with Microsoft Fabric. Proficient in Python for data engineering (eg, Pandas, PySpark, asyncio, automation scripts). Strong SQL skills (T-SQL or similar) for transforming and modeling data. Experience building scalable ETL/ELT pipelines using cloud technologies. Good understanding of data modeling (star/ More ❯
Posted:

Data Engineer London, England, United Kingdom London, England, United Kingdom

London, United Kingdom
Axon Enterprise
Location: London, England, United Kingdom Join Axon and be a Force for Good. Design, build, and maintain scalable, secure, and efficient data pipelines using modern data tools and cloud-native technologies Work with a variety of data sources-structured, semi-structured, unstructured-to support diverse analytics and operational workloads Ensure data quality … and consistency by incorporating automated testing, data validation, and monitoring mechanisms Drive best practices around data engineering, including testing, observability, security, and documentation Troubleshoot and resolve issues in production environments to ensure data integrity and platform reliability What you bring: 5+ years of professional experience in data engineering roles, preferably for a … customer facing data product Expertise in designing and implementing large-scale data processing systems with data tooling such as Spark, Kafka, Airflow, dbt, Snowflake, Databricks, or similar Strong programming skills in languages such as SQL, Python, Go or Scala Demonstrable use and an understanding of effective use of AI tooling in your development process More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer

London Area, United Kingdom
Hybrid/Remote Options
Identify Solutions
Mid/Senior Data Engineer | 🚀 Series C Scale-up | $50m raise in 2025(Python,, GCP) | Permanent | London (1 day a week on-site) My client are a fast-scaling SaaS scale-up (Series C, $50m raised in 2025) that is redefining how global powerhouses operate. Their AI-enabled platform supports over 1,000+ brands worldwide, streamlining business processes … like never seen before. With 10× revenue growth in the past year and aggressive expansion across the UK, US, and EU, the company is scaling at pace. Data is the backbone: from APIs and pipelines to governance and observability, their data platform directly powers customer-facing products and AI-driven insights. They’re now hiring a … flexibility to work from anywhere What you’ll be doing: API strategy & development – own and scale FastAPI endpoints that deliver real-time access to platform data. Data pipeline development – build ingestion and replication pipelines with best-in-class observability, latency, and resilience. Platform technical vision – influence architecture and orchestration, shaping how the business handles data More ❯
Posted:

Data Engineer

City of London, London, United Kingdom
Hybrid/Remote Options
Identify Solutions
Mid/Senior Data Engineer | 🚀 Series C Scale-up | $50m raise in 2025(Python,, GCP) | Permanent | London (1 day a week on-site) My client are a fast-scaling SaaS scale-up (Series C, $50m raised in 2025) that is redefining how global powerhouses operate. Their AI-enabled platform supports over 1,000+ brands worldwide, streamlining business processes … like never seen before. With 10× revenue growth in the past year and aggressive expansion across the UK, US, and EU, the company is scaling at pace. Data is the backbone: from APIs and pipelines to governance and observability, their data platform directly powers customer-facing products and AI-driven insights. They’re now hiring a … flexibility to work from anywhere What you’ll be doing: API strategy & development – own and scale FastAPI endpoints that deliver real-time access to platform data. Data pipeline development – build ingestion and replication pipelines with best-in-class observability, latency, and resilience. Platform technical vision – influence architecture and orchestration, shaping how the business handles data More ❯
Posted:

Senior Data Engineer (AI/ML Deployment)

London, United Kingdom
Hybrid/Remote Options
Datatech Analytics
Senior Data Engineer - (AI/ML Deployment Experience Required) Location: London (Hybrid: Monday-Wednesday in office) Salary: £65,000-£75,000 DoE Job Ref: J13026 An AI-first SaaS company on a mission to help organisations unlock the full potential of their first-party data is seeking a forward-thinking Senior Data Engineer with … strong deployment experience to help manage and scale its intelligent platform. Data sits at the heart of everything they do - transforming complex, messy datasets into actionable insights that empower smarter decisions and accelerate growth across industries. As they enter an exciting phase of rapid expansion, they're looking for a talented engineer to join them on this journey … and help shape the future of their data-driven platform. The Role The Senior Data Engineer will take ownership, shape the data foundations, and help power the next generation of AI-driven solutions. This is a hands-on, high-impact role where you'll design and build cloud-native data pipelines, champion More ❯
Employment Type: Permanent
Salary: £75,000
Posted:

Data Architect

Reigate, England, United Kingdom
Hybrid/Remote Options
esure Group
the industry operates and putting customers at the heart of everything we do. Having completed our recent multi-year digital transformation, we’re now leveraging advanced technology and data-driven insights alongside exceptional service, to deliver personalised experiences that meet our customers ever-changing needs today and in the future. Job Description We are currently looking for a … Data Architect to join our forward thinking Data department. You’ll work in a team of data engineers, analytics engineers, data scientists and AI specialists to design and evolve scalable data platforms and modern data products that enable self-service analytics, advanced modelling, and AI-driven decision-making … across our insurance business. What you’ll do: Design and manage scalable cloud data platforms (Databricks on AWS) across development, staging, and production environments, ensuring reliable performance and cost efficiency. Integrate and model data from diverse sources – including warehouses, APIs, marketing platforms, and operational systems – using DBT, Delta Live Tables, and dimensional modelling to deliver consistent More ❯
Posted:

Data Migration Delivery Lead

England, United Kingdom
Hybrid/Remote Options
Swi-tch
Data Migration Delivery Lead (SQL to BigQuery) Location: Hybrid (must be able to travel to London when required) Contract Type: Fixed-Term Contract (9-12 months) We’re supporting a fast-growing cycling and lifestyle brand as they modernise their data ecosystem, migrating from an on-premise SQL database (within Nvision ERP) into a new, scalable … Google Cloud BigQuery environment. This role is critical in ensuring the successful replatforming, consolidation, and optimisation of core business data to power next-generation analytics and reporting. We’re seeking a Delivery/Product Lead with hands-on experience leading data migration or cloud data platform programmes. You will act as the key interface … business stakeholders, the existing BI consultant, and the external Google Cloud partner responsible for the technical execution. You will oversee delivery governance, coordinate cross-functional teams, and ensure data accuracy, integrity, and accessibility throughout the migration process. You will also manage a junior resource supporting documentation, communications, and coordination. Key Responsibilities End-to-end delivery of the data More ❯
Posted:

Technology Lead - Kafka, Confluent cloud and Data Integration - UK

City of London, London, United Kingdom
Infosys
Role – Technology Lead Technology – Kafka, Confluent cloud and Data Integration Location – London, UK Job Description We are looking for an experienced Kafka and Confluent Cloud Specialist to join our team onsite as a Subject Matter Expert (SME) and primary technical lead for all data onboarding activities across on-premises and cloud environments. This role demands strong … expertise in event streaming platforms, excellent SQL skills, and the ability to collaborate with multiple stakeholders to ensure smooth data integration and delivery. As a secondary skill, experience with Fivetran, SSIS, ADF or Snowflake will be considered a strong plus. Your role In the role of a Data Integration Lead , you will drive the design, implementation … and optimization of enterprise-grade data integration solutions, with a strong focus on real-time streaming and cloud-native platforms. You will lead initiatives involving Apache Kafka and Confluent Cloud, enabling scalable, event-driven architectures that support high-throughput, low-latency data movement across systems. You will anchor engagements from requirement gathering and solution architecture to More ❯
Posted:

Technology Lead - Kafka, Confluent cloud and Data Integration - UK

London Area, United Kingdom
Infosys
Role – Technology Lead Technology – Kafka, Confluent cloud and Data Integration Location – London, UK Job Description We are looking for an experienced Kafka and Confluent Cloud Specialist to join our team onsite as a Subject Matter Expert (SME) and primary technical lead for all data onboarding activities across on-premises and cloud environments. This role demands strong … expertise in event streaming platforms, excellent SQL skills, and the ability to collaborate with multiple stakeholders to ensure smooth data integration and delivery. As a secondary skill, experience with Fivetran, SSIS, ADF or Snowflake will be considered a strong plus. Your role In the role of a Data Integration Lead , you will drive the design, implementation … and optimization of enterprise-grade data integration solutions, with a strong focus on real-time streaming and cloud-native platforms. You will lead initiatives involving Apache Kafka and Confluent Cloud, enabling scalable, event-driven architectures that support high-throughput, low-latency data movement across systems. You will anchor engagements from requirement gathering and solution architecture to More ❯
Posted:

Senior Data Engineer

London, England, United Kingdom
Ensemble
Senior Data Engineer (Cloud, ML & BI Pipelines) About the Company Ensemble is digitalising workforce management in ports and multimodal industries. Our platform, Athena, helps operations teams schedule smarter - blending automation, forecasting, and real-world constraints into usable tools. About the Role We’re looking for a Senior Data Engineer who loves shaping the way data flows, someone who can design robust architectures, build cloud-native pipelines, and transform raw data into trusted, analytics-ready assets that power ML and BI. Responsibilities Design and deploy a robust data lakehouse architecture from the ground up. Build and maintain scalable data pipelines that ingest data from our databases … Redshift, Lambda, CDK in Python), Databricks, dbt, Terraform. Advanced knowledge of PostgreSQL, Docker, and CI/CD pipelines. A practical understanding of data modelling, metadata management, and pipeline orchestration. Strong Python skills (Pandas, PySpark, or SQLAlchemy a plus) and SQL. Curiosity about how ML models and BI tools connect back to real-world decisions. Bonus Points Experience More ❯
Posted:

Data Engineer Airflow

Birmingham, West Midlands, England, United Kingdom
Harnham - Data & Analytics Recruitment
DATA ENGINEER UP TO £75,000 + BENEFITS HYBRID - BIRMINGHAM If you're a technically strong, proactive Data Engineer looking to join a FTSE-listed business during a major transformation, this could be a fantastic next step. THE COMPANY: Having recently joined forces with a major FTSE 100 company, this client is merging systems, data, and teams - creating a once-in-a-career opportunity for a driven Data Engineer to make a visible impact.With a flat and collaborative structure, you will have direct access to senior decision-makers and be able to input how their data function evolves. THE ROLE: This is a hands-on engineering role sitting at … the heart of the data and digital transformation. You'll own and manage the data warehouse, ensuring data quality, reliability, and scalability, while contributing to how data is used to drive commercial decisions - particularly around pricing, revenue, and customer insight. Key responsibilities include: Manage and maintain the company's data More ❯
Employment Type: Full-Time
Salary: £70,000 - £75,000 per annum
Posted:

Senior Data Engineer

London Area, United Kingdom
Nicholson Search and Selection
On behalf of our client, we are looking for a Senior Data Engineer to join a fast-growing analytics team within a cutting-edge technology company. This is an exciting opportunity to work on large-scale data projects, build modern data infrastructure, and help shape the future of data-driven decision-making. … Responsibilities Design, build, and maintain scalable data pipelines and ETL processes. Collaborate with data scientists, analysts, and engineers to ensure high-quality data delivery. Develop and optimise data models for analytics and reporting. Implement best practices for data governance, security, and performance. Work closely with stakeholders to translate business requirements … into technical solutions. Requirements 5+ years of experience in Data Engineering or a similar role. Strong proficiency in Google Cloud Platform (GCP), BigQuery, Dataflow, Pub/Sub, Composer, etc. Expertise in SQL and programming with Python or Scala. Experience with Airflow, dbt, or other orchestration frameworks. Solid understanding of data warehousing, ETL, and data More ❯
Posted:

Senior Data Engineer

City of London, London, United Kingdom
Nicholson Search and Selection
On behalf of our client, we are looking for a Senior Data Engineer to join a fast-growing analytics team within a cutting-edge technology company. This is an exciting opportunity to work on large-scale data projects, build modern data infrastructure, and help shape the future of data-driven decision-making. … Responsibilities Design, build, and maintain scalable data pipelines and ETL processes. Collaborate with data scientists, analysts, and engineers to ensure high-quality data delivery. Develop and optimise data models for analytics and reporting. Implement best practices for data governance, security, and performance. Work closely with stakeholders to translate business requirements … into technical solutions. Requirements 5+ years of experience in Data Engineering or a similar role. Strong proficiency in Google Cloud Platform (GCP), BigQuery, Dataflow, Pub/Sub, Composer, etc. Expertise in SQL and programming with Python or Scala. Experience with Airflow, dbt, or other orchestration frameworks. Solid understanding of data warehousing, ETL, and data More ❯
Posted:

Data Engineer security cleared

Newcastle Upon Tyne, Tyne and Wear, England, United Kingdom
Hybrid/Remote Options
Reed
Join a fast-growing technology and engineering organisation that is on a mission to become the best engineering consultancy in the UK. We are looking for a Data Engineer who is passionate about technology, eager to develop their coding skills, and ready to make a significant impact in a collaborative and innovative environment. Due to the security cleared … can not accept applicants who don't possess indefinite leave to remain or are a UK resident. If you require sponsorship, then your application will not be considered. Data Engineer Annual Salary: £40,000 - £55,000 Location: UK (Flexible Hybrid Working) Job Type: Permanent Day-to-day of the role: Work on diverse client projects including building modern … data platforms and services using DevOps practices. Engage in large, distributed workloads, batch and streaming data pipelines, and high-quality monitoring. Collaborate with architects, technology consultants, and client stakeholders to help customers leverage their data effectively. Gain exposure to different industries and networks while working with the latest technologies. Spend time on internal projects More ❯
Employment Type: Full-Time
Salary: £40,000 - £55,000 per annum
Posted:

Data Team Lead

City of London, London, United Kingdom
InterEx Group
About: You will lead a team of data analysts, BI business process experts and BI analysts, who will benefit from your experience in coaching and your knowledge of the data and analytics domain. The Data Fabric team will ensure that your team has access to all relevant information and their skilled data engineers will develop the data pipelines for the projects in your team. Your team can further rely on a central competence and assistance of data science and business intelligence. Do you like new challenges that test your earlier experience in marketing? You will work closely together with the product managers and business development managers … to ensure that the development and analysis roadmap of your team reflects their requirements. Your team will mainly be using SAS and PowerBI, in combination with data pipeline development and analysis on the Azure cloud, using Databricks. The coding language used is Python. An earlier experience with these tools and languages will help you to coach your More ❯
Posted:

Data Team Lead

London Area, United Kingdom
InterEx Group
About: You will lead a team of data analysts, BI business process experts and BI analysts, who will benefit from your experience in coaching and your knowledge of the data and analytics domain. The Data Fabric team will ensure that your team has access to all relevant information and their skilled data engineers will develop the data pipelines for the projects in your team. Your team can further rely on a central competence and assistance of data science and business intelligence. Do you like new challenges that test your earlier experience in marketing? You will work closely together with the product managers and business development managers … to ensure that the development and analysis roadmap of your team reflects their requirements. Your team will mainly be using SAS and PowerBI, in combination with data pipeline development and analysis on the Azure cloud, using Databricks. The coding language used is Python. An earlier experience with these tools and languages will help you to coach your More ❯
Posted:

Data Integration Manager

City of London, London, United Kingdom
Hybrid/Remote Options
Ashdown Group
Data Delivery and Integration Manager - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML … and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning of More ❯
Employment Type: Permanent, Work From Home
Salary: £75,000
Posted:

Data Integration Manager

Lincoln, Lincolnshire, East Midlands, United Kingdom
Hybrid/Remote Options
Ashdown Group
Data Delivery and Integration Manager - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML … and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning of More ❯
Employment Type: Permanent, Work From Home
Salary: £75,000
Posted:

Data Engineering Manager

Cheshire, England, United Kingdom
Hybrid/Remote Options
Ashdown Group
Data Engineering and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯
Employment Type: Full-Time
Salary: £70,000 - £75,000 per annum
Posted:
Data Pipeline
England
10th Percentile
£44,375
25th Percentile
£55,000
Median
£70,000
75th Percentile
£85,500
90th Percentile
£113,750