201 to 225 of 991 Data Pipeline Jobs in England

Your Company: NET Recruit is assisting a distribution company in their search for an Apprentice Data Engineer based in the Kent area. Established over 40 years ago, this company has grown to become a leader in sourcing, producing, and distributing fresh produce to some of the UK’s top retailers. Known for its focus on quality, integrity, and … that its ongoing success depends on its people.As part of its ongoing investment in technology and digital innovation, the business is looking for an enthusiastic and motivated Apprentice Data Engineer to join its IT team, working five days per week. This position represents an exceptional opportunity for an individual with a passion for data, analytics, and … are actively encouraged. Your Role and Responsibilities While in this position your duties may include but are not limited to: Support the design, development, and maintenance of scalable data pipelines using tools such as Apache Airflow, dbt, or Azure Data Factory. Learn how to ingest, transform, and load data from a variety of sources More ❯

Data Engineer - London - Databricks - Azure - 75k + bonus + benefits Tech Stack: Azure | Databricks | Power BI | Python Are you ready to shape the future of data? We're looking for a Data Engineer to join a team that thrives on innovation and cutting-edge technology. If you love solving complex data challenges … and building scalable solutions, this is your chance to make an impact. What You'll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards ETL & Data Modelling: T-SQL, metadata-driven pipelines DevOps: CI/CD Bonus: Python What you'll do Design … and implement scalable Azure-based data solutions Build and optimize data pipelines for integration and transformation Develop Power BI dashboards for global stakeholders Ensure data quality, governance, and security Collaborate in an Agile environment with cross-functional teams What We're Looking For Hands-on experience with Azure & Databricks Strong data engineering More ❯

Data Architect (SQL Azure) Milton Keynes/WFH to £90k Are you a Data technologist with data architecture experience looking for an opportunity to take ownership and make an impact? You could be progressing your career at a well known household name within the fast food space as they invest heavily in their data strategy. As the Data Architect you'll be instrumental in delivering a modern cloud based data infrastructure, they have 16 million customer data points across the UK and Ireland that they're looking to use this to optimise customer retention, product quality and speedy and efficient delivery to the customer. Initially you … ll be responsible for migrating the current on-premise data platform to Azure using Databricks; you'll collaborate with the Head of Digital and AI to modernise the current Data infrastructure and monetise the data available, working with senior business stakeholders to deliver tangible business value. Location/WFH: There's a hybrid work More ❯

Data Engineer - London - Databricks - Azure - 75k + bonus + benefits Tech Stack: Azure | Databricks | Power BI | Python Are you ready to shape the future of data? We're looking for a Data Engineer to join a team that thrives on innovation and cutting-edge technology. If you love solving complex data challenges … and building scalable solutions, this is your chance to make an impact. What You'll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards ETL & Data Modelling: T-SQL, metadata-driven pipelines DevOps: CI/CD Bonus: Python What you'll do Design … and implement scalable Azure-based data solutions Build and optimize data pipelines for integration and transformation Develop Power BI dashboards for global stakeholders Ensure data quality, governance, and security Collaborate in an Agile environment with cross-functional teams What We're Looking For Hands-on experience with Azure & Databricks Strong data engineering More ❯

architecture you will: Build and orchestrate data pipelines across Snowflake and AWS environments. Apply data modeling, warehousing, and architecture principles (Kimball/Inmon). Develop pipeline programming using … Python, Spark, and SQL; integrate APIs for seamless workflows. Support Machine Learning and AI initiatives, including NLP, Computer Vision, Time Series, and LLMs. Implement MLOps, CI/CD pipelines, data testing, and quality frameworks. Act as an AI super-user, applying prompt engineering and creating AI artifacts. Work independently while providing clear justification for technical decisions. Key Skills … Experience Strong experience in data pipeline development and orchestration. Proficient with cloud platforms (Snowflake, AWS fundamentals). Solid understanding of data architecture, warehousing, and modeling. Programming expertise: Python, Spark, SQL, API integration. Knowledge of ML/AI frameworks, MLOps, and advanced analytics concepts. Experience with CI/CD, data testing frameworks, and versioning More ❯

architecture you will: Build and orchestrate data pipelines across Snowflake and AWS environments. Apply data modeling, warehousing, and architecture principles (Kimball/Inmon). Develop pipeline programming using … Python, Spark, and SQL; integrate APIs for seamless workflows. Support Machine Learning and AI initiatives, including NLP, Computer Vision, Time Series, and LLMs. Implement MLOps, CI/CD pipelines, data testing, and quality frameworks. Act as an AI super-user, applying prompt engineering and creating AI artifacts. Work independently while providing clear justification for technical decisions. Key Skills … Experience Strong experience in data pipeline development and orchestration. Proficient with cloud platforms (Snowflake, AWS fundamentals). Solid understanding of data architecture, warehousing, and modeling. Programming expertise: Python, Spark, SQL, API integration. Knowledge of ML/AI frameworks, MLOps, and advanced analytics concepts. Experience with CI/CD, data testing frameworks, and versioning More ❯

Data Scientist Location: Hybrid (Greater Bristol Area) Salary: £54,000 Python - PySpark - Azure - Pandas - Scikit-learn - TensorFlow - PyStats - Data Science - Power BI We're supporting a growing, forward-thinking organisation in their search for an experienced Data Specialist. This is an exciting opportunity to join a dynamic team at a pivotal point in its … growth, helping shape data strategy, deliver insightful analytics, and drive intelligent decision-making across the business. You'll work closely with stakeholders to uncover challenges, identify opportunities, and deliver actionable, measurable solutions through advanced machine learning models, statistical methods, and high-performance data pipelines. Skills & Experience Required To be considered, you will need: Strong proficiency in … real-world performance trade-offs. Experience building and maintaining end-to-end machine learning applications. Hands-on experience with Azure cloud technologies: Synapse, Fabric, AzureML, ADX, ADF, Azure Data Lake Storage, Event Hubs. Experience with visualisation tools such as Power BI and Streamlit. Familiarity with Parquet and Delta Parquet formats. Strong data modelling and architecture knowledge More ❯

Role: Operational Data Manager Location: Wilmslow (Hybrid) We are Citation. We are far from your average service provider. Our colleagues bring their brilliant selves to work every day and we create an environment where they can shine. We have been proudly delivering valuable HR and Health and Safety services to SMEs across the UK for over 20 years. … do and smile whilst they are doing it. As we continue our exciting international growth journey, we’re looking for a highly organised, strategic, and technically strong Operational Data Manager to lead our data operations and ensure the business continues to make smart, data-driven decisions. The Role As Operational Data Manager … you’ll own the creation, improvement, and automation of data processes from start to finish — making sure data is clean, connected, and driving smart business decisions. You’ll work with a wide range of stakeholders and technical teams, translating requirements into scalable, efficient solutions that make our operations faster, smarter, and more data-driven. More ❯

Data Engineer x4 days a week in their London office Join a fast-scaling, product-led tech company on a mission to transform how their sector performs in real time. With a strong focus on data-led decision-making and seamless mobile experiences, this team is building out their next-generation data infrastructure, and … they’re looking for another Data Engineer to help drive that forward. This is an exciting opportunity to shape the way data flows through a live product used by thousands, while working closely with analytics, engineering, and commercial teams. You’ll be joining a small, high-impact team, reporting to a technical leader with a strong … background in applied data architecture. What You’ll Be Doing Designing, building, and maintaining scalable data pipelines to power both internal analytics and customer-facing mobile/web applications Developing robust ETL processes for ingesting and transforming data from a variety of sources, particularly APIs Creating and optimising data architectures to ensure More ❯

Data Engineer x4 days a week in their London office Join a fast-scaling, product-led tech company on a mission to transform how their sector performs in real time. With a strong focus on data-led decision-making and seamless mobile experiences, this team is building out their next-generation data infrastructure, and … they’re looking for another Data Engineer to help drive that forward. This is an exciting opportunity to shape the way data flows through a live product used by thousands, while working closely with analytics, engineering, and commercial teams. You’ll be joining a small, high-impact team, reporting to a technical leader with a strong … background in applied data architecture. What You’ll Be Doing Designing, building, and maintaining scalable data pipelines to power both internal analytics and customer-facing mobile/web applications Developing robust ETL processes for ingesting and transforming data from a variety of sources, particularly APIs Creating and optimising data architectures to ensure More ❯

Bioinformatics | Data Engineer 📍 London OR Oxford About the Company We are a growing TechBio organization using data science and machine learning to accelerate drug discovery. Our teams integrate multi-omics and functional assay data to uncover insights into disease biology and therapeutic development. The Role We’re seeking a Bioinformatics Data Engineer … to design, build, and optimize data pipelines that integrate large-scale biological, multi-omics, and experimental datasets. You’ll collaborate closely with scientists, bioinformaticians, and ML engineers to deliver robust, compliant, and reusable data solutions that drive research and discovery. Key Responsibilities Develop and maintain ETL pipelines for bioinformatics and omics datasets across cloud and on … prem environments. Standardize and harmonize diverse data sources, ensuring metadata quality and FAIR compliance. Integrate multi-modal datasets (genomic, transcriptomic, proteomic, imaging, etc.) into unified data models. Automate data validation, quality control, and lineage tracking. Support analytics, visualization, and machine learning workflows. Contribute to data governance practices covering access, privacy, and lifecycle More ❯

Bioinformatics | Data Engineer 📍 London OR Oxford About the Company We are a growing TechBio organization using data science and machine learning to accelerate drug discovery. Our teams integrate multi-omics and functional assay data to uncover insights into disease biology and therapeutic development. The Role We’re seeking a Bioinformatics Data Engineer … to design, build, and optimize data pipelines that integrate large-scale biological, multi-omics, and experimental datasets. You’ll collaborate closely with scientists, bioinformaticians, and ML engineers to deliver robust, compliant, and reusable data solutions that drive research and discovery. Key Responsibilities Develop and maintain ETL pipelines for bioinformatics and omics datasets across cloud and on … prem environments. Standardize and harmonize diverse data sources, ensuring metadata quality and FAIR compliance. Integrate multi-modal datasets (genomic, transcriptomic, proteomic, imaging, etc.) into unified data models. Automate data validation, quality control, and lineage tracking. Support analytics, visualization, and machine learning workflows. Contribute to data governance practices covering access, privacy, and lifecycle More ❯

Senior Data Engineer – Hybrid (Hertfordshire, 1 day/week) Salary: £65,000–£75,000 + 10% discretionary bonus We’re partnering with a Private Equity–backed FMCG company. They are looking for a technically strong Senior Data Engineer to help shape and scale their data platform. The Role: You’ll play a key role … Maintain documentation, contribute to architectural decisions, and drive best practices Essential Requirements: Strong SQL skills and experience with modern cloud data warehouses (Snowflake preferred) ELT pipeline development and modern data stack understanding Solid software engineering practices (Git, testing, CI/CD) Own pipeline health, monitoring, and optimisations. API integration experience (REST APIs … Azure, or GCP Ability to work autonomously and make strong technical decisions Desirable Skills: dbt Python PostgreSQL or similar relational databases BI tools (QuickSight, Tableau, etc.) Reverse ETL, ML pipeline support, agile environment experience About You: You’re a technically strong data engineer who enjoys both hands-on implementation and the broader architectural picture. You take ownership More ❯

Lead Data Engineer London, UK (Hybrid) Innovative FinTech About the Company: We are partnered with a high-growth FinTech company headquartered in London that is redefining how technology and data can transform financial services. Their mission is to deliver smarter, faster, and more secure financial solutions through cutting-edge platforms powered by data. With rapid expansion … and strong investment backing, they are scaling their engineering and data capabilities to support ambitious growth plans. The Role: Our client is seeking a Lead Data Engineer to take ownership of their data infrastructure and lead the build-out of scalable, reliable, and secure data pipelines. This is a senior hands-on … role, where you'll also provide technical leadership to a small but growing team. You'll work closely with data scientists, analysts, and software engineers to ensure the company's data strategy underpins their innovative financial products. Key Responsibilities: Lead the design, development, and optimisation of data pipelines and ETL processes. Architect scalable data More ❯

Lead Data Engineer London, UK (Hybrid) Innovative FinTech About the Company: We are partnered with a high-growth FinTech company headquartered in London that is redefining how technology and data can transform financial services. Their mission is to deliver smarter, faster, and more secure financial solutions through cutting-edge platforms powered by data. With rapid expansion … and strong investment backing, they are scaling their engineering and data capabilities to support ambitious growth plans. The Role: Our client is seeking a Lead Data Engineer to take ownership of their data infrastructure and lead the build-out of scalable, reliable, and secure data pipelines. This is a senior hands-on … role, where you'll also provide technical leadership to a small but growing team. You'll work closely with data scientists, analysts, and software engineers to ensure the company's data strategy underpins their innovative financial products. Key Responsibilities: Lead the design, development, and optimisation of data pipelines and ETL processes. Architect scalable data More ❯

About the role As the world of data engineering becomes increasingly pivotal in driving modern digital ecosystems, The Coventry is looking to welcome a Senior DataOps Engineer who can inspire and coach our existing Data Engineering teams. This is more than just a technical role, were looking to build a culture of innovation, ownership, and continuous … improvement. Working alongside domain-oriented, multi-disciplinary data product teams to design, develop, and test high-quality data solutions that serve as the backbone of our decision-making and digital services. What Youll Be Doing Drive automation and CI/CD practices across data pipelines and infrastructure Build robust, scalable, and secure infrastructure that … supports our data platform strategy Lead and mentor data engineers, fostering a high-performance, collaborative environment Play a central role in designing and developing a new cloud-based Data Ecosystem Work closely with stakeholders to analyse requirements, design test strategies, and ensure data quality and integrity through comprehensive testing Collaborate in an More ❯

About the role As the world of data engineering becomes increasingly pivotal in driving modern digital ecosystems, The Coventry is looking to welcome a Senior DataOps Engineer who can inspire and coach our existing Data Engineering teams. This is more than just a technical role, were looking to build a culture of innovation, ownership, and continuous … improvement. Working alongside domain-oriented, multi-disciplinary data product teams to design, develop, and test high-quality data solutions that serve as the backbone of our decision-making and digital services. What Youll Be Doing Drive automation and CI/CD practices across data pipelines and infrastructure Build robust, scalable, and secure infrastructure that … supports our data platform strategy Lead and mentor data engineers, fostering a high-performance, collaborative environment Play a central role in designing and developing a new cloud-based Data Ecosystem Work closely with stakeholders to analyse requirements, design test strategies, and ensure data quality and integrity through comprehensive testing Collaborate in an More ❯

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle and … are looking for a talented Data Engineer to join their team. This role will focus on building and optimising systems that make complex datasets accessible, reliable, and valuable for the business. As a Data Engineer, you will take responsibility for the development of high-quality pipelines that process and manage large volumes of data from a range of external and internal sources. You'll play a key role in enhancing and maintaining their central data platform, ensuring the smooth delivery of information that supports investment decision-making. Working closely with stakeholders across the business, you'll help shape how data is accessed, tested, and leveraged to maximise value. More ❯

depending on experience) + benefitsSecurity: Must be able to undergo security clearanceAbout the RoleAs a Lead DataOps Engineer, you'll be at the forefront of delivering automated, scalable data solutions that power modern analytics and applications. This role combines the best of data engineering and DevOps, focusing on containerized environments, orchestration … and continuous delivery. You'll lead initiatives to streamline data workflows, optimize performance, and ensure reliability across cloud platforms-while guiding teams with strong technical leadership.Key Responsibilities* Pipeline Automation: Build and orchestrate data workflows using tools like Airflow, Prefect, or Dagster.* Containerization: Package and deploy data applications using Docker and Kubernetes (including EKS … your application with you before presenting it to any potential employer.Please note we are on the client's supplier list for this position.KeywordsLead DataOps Engineer, DataOps, Data Pipeline Automation, Airflow, Prefect, Dagster, Docker, Kubernetes, EKS, AKS, CI/CD, Terraform, Ansible, Grafana, Prometheus, Spark, Kafka, PostgreSQL, Infrastructure as Code, Cloud Data Engineering, Hybrid Working, Security More ❯

We are hiring a senior Data Engineer to lead the development of intelligent, scalable data platforms for Industry 4.0 initiatives. This role will drive integration across OT/IT systems, enable real-time analytics, and ensure robust data governance and quality frameworks. The engineer will collaborate with cross-functional teams to support AI/… ML, GenAI, and IIoT use cases in manufacturing and industrial environments. Key Responsibilities Architect and implement cloud-native data pipelines on AWS or Azure for ingesting, transforming, and storing industrial data. Integrate data coming from OT systems (SCADA, PLC, MES, Historian) and IT systems (ERP, CRM, LIMS) using protocols like OPC UA, MQTT, REST. Design and … implement profiling, cleansing, standardization, and anomaly detection frameworks. Security & Compliance:Knowledge of data privacy, access control, and secure data exchange protocols. Defining and creating MLOPs pipeline Good to Have Skills GenAI Exposure:Experience with LLMs, LangChain, HuggingFace, synthetic data generation, and prompt engineering. Digital Twin Integration:Familiarity with nVidia Omniverse, AWS TwinMaker, Azure More ❯

Data Engineer Salary: up to £35,000 Location: Home-based with occasional travel to the Newark office/UK Full time: 35 hours per week (Mondays to Fridays) Maternity Cover Contract until April 2027 Closing date for applications: 30 November 2025 First interview: 9/10 December 2025 Second interview: 16 December 2025 About Us The Wildlife Trusts … bold changes in the way The Wildlife Trusts work, not least in how we mobilise others and support them to organise within their own communities. About You As Data Engineer, you will play a crucial role in supporting the work of The Wildlife Trusts by maintaining and enhancing our data pipelines and infrastructure. You will be … responsible for ensuring the effectiveness, efficiency, and scalability of the federation wide data service system, a data lakehouse, providing key insights and solutions to support decision-making across the organisation and federation, responding to the needs of Wildlife Trusts and the delivery of our 2030 Strategy. Working collaboratively with various teams, you will develop data More ❯

Lead/Senior Data Engineer Hybrid – Burton-Upon-Trent (1-2 days per week in office) Salary: Up to £70k + discretionary 10% bonus Permanent We are partnering with a leading and innovative organisation to help recruit a Senior Data Engineer to join their evolving data team. This role provides a unique opportunity to … work with cutting-edge cloud data platforms, supporting the delivery of high-quality, reliable data solutions while contributing to automation and platform enhancements. What You’ll Be Doing As a Senior Data Engineer, you will play a key role in building, optimising, and maintaining cloud-based data solutions. Responsibilities include: Developing and … maintaining end-to-end data pipelines using Azure services such as Data Factory, Databricks, Synapse, and Data Lake. Designing and optimising data models, warehouses, and lakehouse architectures to support analytics and reporting requirements. Ensuring data governance, security, and compliance across cloud platforms, implementing access controls, encryption, and monitoring. Monitoring data More ❯

Master Data Management (MDM) Analyst Manchester - Hybrid, Up to £50K We're looking for a Master Data Management (MDM) Analyst to play a pivotal role in maintaining and enhancing the organisation's master data assets. This is an exciting opportunity to join a growing data team and directly contribute to building a … single, trusted view across the business. Reporting to the MDM Manager, you'll help ensure that data powering critical business systems is clean, consistent and reliable - enabling smarter decisions and greater efficiency across the organisation. The Role As an MDM Analyst, you'll support the daily operation of the Tamr platform, monitor data pipelines, validate records … and resolve data quality issues. You'll collaborate with Finance, Operations and Analytics teams to align data across systems and ensure it supports accurate reporting and business processes. You'll also help evolve MDM standards, contribute to data governance initiatives and work closely with both technical and business stakeholders to continually improve how data More ❯

Data Engineer Hybrid (West Midlands) Permanent Competitive Salary + Benefits Are you passionate about building scalable data solutions and working with cutting-edge technologies like Microsoft Fabric, Azure, and Power BI? TXP is looking for a talented Data Engineer to join our growing team and help shape the future of data-driven … of technology and people, and we help everyone here to succeed. At TXP, you can multiply your potential. What You'll Be Doing Designing, developing, and maintaining robust data pipelines. Building and optimising infrastructure for scalable data solutions. Integrating data from diverse sources across the business. Ensuring data integrity, security, and compliance … with best practices. Collaborating with cross-functional teams including analysts, developers, and business stakeholders. Leveraging Microsoft Fabric (Lakehouse, Data Pipelines) to modernise our data architecture. Supporting CI/CD and DevOps practices for data workflows. What We're Looking For Proven experience as a Data Engineer or in a similar role. Strong More ❯

Senior Data Engineer Hybrid - Birmingham (2 days per week in office) Salary: Up to £65k Permanent We are partnering with a forward-thinking, public sector organisation currently undergoing a major data and digital transformation. They are seeking a Senior Data Engineer to play a pivotal role in developing and maintaining a modern, cloud-based … data platform that underpins critical regulatory and strategic objectives. This is an exciting opportunity to work with cutting-edge Microsoft technologies and contribute to the creation of a secure, scalable, and insight-driven data ecosystem that supports the organisation’s mission to deliver better outcomes for customers, communities, and the environment. What You’ll Be Doing … As a Senior Data Engineer, you’ll take a hands-on role in building and optimising data services across both modern and legacy platforms. Key responsibilities include: Developing, maintaining, and optimising data pipelines and ELT processes using Microsoft Fabric, Azure Data Factory, Synapse, Purview, and Power BI. Designing and implementing scalable and More ❯