226 to 250 of 3,504 Data Pipeline Jobs in England

and building platforms that handle the complexity of modern cruising - all while keeping things collaborative and fun. Your Mission: Are you passionate about unlocking the power of customer data? We're looking for a talented Lead Data Engineer to spearhead the design, development, and optimisation of our critical CRM and customer data transformation. You … ll play a pivotal role in building the data foundations for advanced analytics, personalised customer experiences, and effective marketing activation. As a senior member of the team, you will lead data engineers and champion best practices within our data environment. What You'll Do: Design & Build: Architect, build, test, and deploy robust, scalable, and … Guide: Provide technical leadership to data engineers, fostering their growth and ensuring high standards in coding, testing, and documentation. Optimise: Continuously monitor and improve data pipeline performance, reliability, and cost-efficiency. Document: Create and maintain clear, comprehensive documentation for data models, pipeline architecture, and processes. What You'll Be Responsible For: The More ❯

can attract as much diversity as we possibly can. If this sounds good to you, then we're thrilled you're considering joining our team! Role Overview The Data Engineer will play a critical role in implementing and maintaining Lumon's technical data infrastructure. Reporting to the Head of Data, you will focus on … for a technically skilled professional who thrives on designing scalable data solutions and enjoys solving complex data challenges. Key Responsibilities Data Infrastructure and Pipeline Development Design, develop, and maintain ETL/ELT pipelines using Azure Synapse Analytics, Data Factory and other Azure related cloud warehouse tools. Optimise the Azure Synapse data … enhance efficiency. Required Experience 3+ years in data engineering or similar technical roles, preferably in financial services or a related field. Hands-on experience with Azure Synapse, Pipeline creations, Azure Data Factory, and Azure Data Lake Storage. Strong proficiency in SQL, including database management, query optimisation, and troubleshooting. Experience building and maintaining ETL More ❯

that drive innovation and transform businesses. From prototype to real-world impact - be part of a global shift by doing work that matters. Job Description Role Overview A Data Engineering Consultant designs, implements, and optimizes scalable data pipelines and architectures. This role bridges raw data and actionable insights … ensuring robustness, performance, and data governance. Collaboration with analysts and scientists is central to delivering high-quality solutions aligned with business objectives. Key Responsibilities Data Pipeline Development Architect, implement and maintain real-time and batch data pipelines to handle large datasets efficiently. Employ frameworks such as Apache Spark, Databricks, Snowflake or Airflow to …/ELT workflows, validation checks, and cleaning steps for data reliability. Automation & Process Optimization Automate data reconciliation, metadata management, and error-handling procedures. Continuously refine pipeline performance, scalability, and cost-efficiency. Collaboration & Leadership Coordinate with Data Scientists, Data Architects, and Analysts to ensure alignment with business goals. Mentor junior engineers and More ❯

and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from Intec Select Tech Recruiter & Account Manager at Intec Select Junior Data Engineer – Transport Manufacturing - 6-8 weeks project- £300-350pd – Hybrid or Remote Overview: An exciting opportunity has arisen for a Junior Data Engineer to join one … technologies to improve safety and the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business enterprise. Your responsibilities will include … resources and troubleshooting data-related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency and reliability. Project & Improvement: Assist More ❯

As a Senior Data Engineer , you will be responsible for designing, developing, and maintaining advanced, scalable data systems that power critical business decisions. You will lead the development of robust data pipelines, ensure data quality and governance, and collaborate across cross-functional teams to deliver high-performance data platforms in … production environments. This role requires a deep understanding of modern data engineering practices, real-time processing, and cloud-native solutions. Key Responsibilities: Design, implement, and maintain scalable and reliable data pipelines to ingest, transform, and load structured, unstructured, and real-time data feeds from diverse sources. Manage data pipelines for analytics and … and auditability across pipelines and environments. Machine Learning & Advanced Analytics Enablement: Collaborate with data scientists to prepare and serve features for ML models. Maintain awareness of ML pipeline integration and ensure data readiness for experimentation and deployment. Maintain thorough documentation including technical specifications , data flow diagrams , and operational procedures . Continuously evaluate and More ❯

who will work with Head of Data and Enterprise architecture to build data engineering process in AWS using modern tech stack. Responsibilities Data Pipeline Development : Design, build, and maintain scalable data pipelines to ingest, process, and store large sets of financial data from various internal and external sources. Cloud … security, and performance of data pipelines and integrations. Documentation & Best Practices : Maintain clear, well-organised documentation for all data engineering projects, including data pipeline processes, cloud infrastructure, and codebase. Data Governance & Security : Implement and enforce data governance policies and security practices, ensuring compliance with financial regulations and protecting sensitive … financial data. Troubleshooting & Optimisation : Monitor and troubleshoot data pipeline performance, addressing bottlenecks or issues promptly to ensure smooth data flow and operation. Requirements Several years of experience in data engineering, preferably in the financial services or similar regulated industries. Strong understanding of data engineering concepts, including data modelling, ETL More ❯

Join to apply for the Senior Data Engineer role at IBM Introduction In this role, you’ll work in one of our IBM Consulting Client Innovation Centres (Delivery Centres), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centres offer our clients locally based … maternity return schemes Standard benefits like holiday allowance, discounts, Employee Assistance Program, and a pension plan with employer contributions Your Role and Responsibilities We are seeking a Senior Data Engineer to join our team, focusing on public sector accounts. Your role involves designing, developing, and managing scalable data pipelines, integrating diverse systems, and implementing data … and schema design Provide technical support for data issues Stay updated with industry trends and emerging technologies Required Technical and Professional Expertise Experience in data pipeline and ETL development Collaboration with data teams Data quality assurance Data modeling and storage solutions Technical support and troubleshooting Knowledge of Java, Python More ❯

quo. We’re fueled by positive energy, fostering a culture of openness and doing the right thing. Both for people and the planet. About the role As Senior Data Engineer at Beams, you will play a crucial role in designing, building, and optimising our data infrastructure to support transformative insights, machine learning, generative AI, and data-driven decisions across the organisation. You’ll lead the development of scalable, reliable data pipelines and warehousing solutions on AWS (or GCP), ensuring our data ecosystem can seamlessly adapt to the growing needs of the business. Your work will be essential in making data a central, accessible asset that empowers every team … Lambda, S3, Redshift, and Step Functions. Strong knowledge of data modelling, ETL/ELT frameworks, and data warehousing best practices. Experience with data pipeline orchestration and automation. Excellent problem-solving skills and a proactive approach to designing scalable solutions. Excellent communication skills, both written and verbal. Desirable things we like Experience with MLOps More ❯

Social network you want to login/join with: Senior Data Engineer, sheffield, south yorkshire col-narrow-left Client: TTC Group Location: sheffield, south yorkshire, United Kingdom Job Category: Other … EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: Key aspects of the role include: Data Pipeline Development: Architect, develop, and optimise data extraction, transformation, and loading (ETL) processes for high-volume healthcare data. Integration of NHS Systems Data: Work directly with … NHS data sources and ensure seamless integration of systems like UDAL, NCDR, SUS+, HES, and ODS into our analytics platform. System Performance: Monitor and enhance the performance of our data systems to ensure reliability and responsiveness. Collaboration: Partner with data scientists, analysts, and stakeholders to ensure that data solutions align with business More ❯

you want to make a life-changing impact on Customers, there's nowhere better to develop your career. Main Purpose of Role The role is crucial in transforming data by bridging data warehousing and business analysis into robust data solutions for analytical consumption for key stakeholders. The role will be responsible for working to … build out and improve the company's data ingestion, transformation, transactional and data warehousing needs directly supporting the data science and analyst teams. This role is essential to building and scaling new and existing local data streams to support PML's growing data products and services. In addition to this … adhere to enterprise data analytics guidelines and utilize appropriate tooling. Skills, Experience and Competencies Required 8 years+ SME experience Strong skills in data architecture and pipeline development, with extensive experience in SQL and Python; PowerBI knowledge is a plus. Experience with ETL/ELT tools (e.g., Matillion, DBT). Strong understanding of data More ❯

Azure Data Engineer (DV Clearance Required) 12 MonthContract - £550+ We are looking for a skilled Azure Data Engineer with active DV clearance to design and optimize cloud-based data solutions in secure Azure environments. Key Responsibilities: Develop and manage Azure data pipelines and architectures. Build ETL processes using Azure Data Factory, Databricks, and Synapse Analytics. Manage scalable, secure cloud data platforms. Implement storage solutions like Azure Data Lake and SQL Database. Optimize data pipelines and monitor performance. Collaborate with data scientists, analysts, and stakeholders. Ensure compliance with data governance and security standards. Requirements: Active DV Clearance (Mandatory). … Proficient with Azure Data Factory, Databricks, Synapse, SQL, and Data Lake. Strong SQL, Python, or Scala skills for data transformation. Experience with CI/CD pipelines using Azure DevOps. Familiar with data governance and Power BI for visualization. Contract role with competitive day rates. #J-18808-Ljbffr More ❯

Director , Data Governance Location: Global Reporting to: VP - Data Excellence WHO WE ARE Choreograph is WPP's global data products and technology company. Our mission is to transform marketing by building the fastest, most connected data platform that bridges marketing strategy to scaled activation. We partner with agencies and clients to unlock … the full value of data by combining technology, data, and analytics expertise. This is delivered through the Open Media Studio, an AI-enabled media and data platform designed for the future of advertising. Our team of over 1,000 thinkers, builders, creators, and problem-solvers spans 20 markets worldwide, driving innovation and excellence in … Modelling , and visualization teams to ensure data governance principles are integrated into all aspects of the data platform development and operation. Data Pipeline Governance: Implement governance controls over data pipelines, ensuring data lineage, data quality, and security are maintained throughout the data flow. Data More ❯

Total Care, this rental model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their data needs as well as … data warehouses using Azure based data warehouse technologies such as Azure Data Factory, Analysis Services, SQL server and Azure Synapse. Data Pipeline Creation: Build and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, or similar services to ensure data is properly ingested More ❯

a bigger, better, and safer National Lottery that delivers more money to good causes. Key Responsibilities: BI Operations & System Monitoring: Ensure day-to-day smooth running of BI data pipelines, reporting systems, and cloud-based ETL/ELT workflows (AWS, Redshift, Glue, Airflow).Monitor system uptime and performance, proactively addressing issues to maintain SLA compliance.Setup monitoring dashboards and … ensuring change management process is followed. Approve or review changes published by Dev/Test teams on Production environments. SLA & Performance Compliance: Maintain SLAs for uptime, latency, and data freshness, using monitoring tools like AWS CloudWatch. Track and optimise system performance, reducing recurring issues. Data Governance & Quality: Oversee data validation, ensuring compliance with governance … processes, and reverse engineering. Database Expertise: Strong SQL scripting, database optimisation, and troubleshooting. Operations Experience: Incident & Problem Management: Identify root causes, troubleshoot, and implement fixes for data pipeline and platform issues. Manage L2 escalations effectively, ensuring timely resolution and minimizing business impact. Monitoring & Automation for Stability: Track data pipeline health, dependencies, and performance metrics More ❯

Reporting to one of our Lead Data & Analytics Engineers , our Data Engineer will work as part of a multi-disciplinary, agile, data delivery team focused on the delivery of innovative, robust, and efficient data solutionsto complex business problems. You'll work alongside a team of passionate data professionals including other … data and analytics engineers, test engineers, data scientists and data visualisation specialists. Our priority is the delivery ofhigh-quality, well-modelled, clean, and trustworthy data assetsfor use across the business. Our data teams also work hard to support all our data assets and ensure the business realise maximum … solution irrespective of underlying technology. Experience using cloud data warehouse technology would also be beneficial - Snowflake (preferred), Google BigQuery, AWS Redshift or Azure Synapse. Data Pipeline(highly desirable): Demonstrable experience working with data from a wide variety of data sources including different database platforms, flat files, API’s and event-driven More ❯

My client is based in the London area are currently looking to recruit for an experienced Lead GCP Data Architect to join their team. They are one of the leaders within the consulting space and are currently going through a period of growth and are looking for an experienced Lead Data Architect to join their team.They … AI within their organisation are looking to utilise the newest technologies on the market. Your role will include: Enterprise Architecture & Delivery: Spearhead the design and implementation of scalable data ecosystems-spanning data lakes, lakehouses, and warehouses-leveraging platforms such as GCP, BigQuery Snowflake, Synapse, or Microsoft Fabric. Cloud Transformation Strategy: Lead cloud adoption and modernization initiatives … grade data modeling using tools like ERwin, PowerDesigner, or ER/Studio, ensuring models are optimized for performance, scalability, and long-term maintainability. Data Integration & Pipeline Engineering: Design and implement resilient ETL/ELT workflows using technologies such as BigQuery, Dataflow, Informatica, or IBM DataStage, supporting both real-time and batch data processing. More ❯

pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from Xcede Associate Director – Data & AI Recruitment Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to … and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at … solutions, delivery plans, and architectural designs Build and maintain highly automated, scalable data pipelines using modern cloud-based tools Identify and resolve data quality and pipeline performance issues to ensure stability and integrity Contribute to the design and deployment of data lakes, warehouses, and streaming architectures Participate in mentoring and upskilling junior team More ❯

pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from Xcede Associate Director – Data & AI Recruitment Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to … and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at … solutions, delivery plans, and architectural designs Build and maintain highly automated, scalable data pipelines using modern cloud-based tools Identify and resolve data quality and pipeline performance issues to ensure stability and integrity Contribute to the design and deployment of data lakes, warehouses, and streaming architectures Participate in mentoring and upskilling junior team More ❯

pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from Xcede Associate Director – Data & AI Recruitment Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to … and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at … solutions, delivery plans, and architectural designs Build and maintain highly automated, scalable data pipelines using modern cloud-based tools Identify and resolve data quality and pipeline performance issues to ensure stability and integrity Contribute to the design and deployment of data lakes, warehouses, and streaming architectures Participate in mentoring and upskilling junior team More ❯

platform, people, and partners together to create limitless opportunities for growth. For more information, visit wppmedia.com About Choreograph: A Leading WPP Media Brand Choreograph is WPP's global data products and technology company. We're on a mission to transform marketing by building the fastest, most connected data platform that bridges marketing strategy to scaled activation. … We work with agencies and clients to transform the value of data by bringing together technology, data and analytics capabilities. We deliver this through the Open Media Studio, an AI-enabled media and data platform for the next era of advertising. We're endlessly curious. Our team of thinkers, builders, creators and problem solvers … Composer, Kafka, Snowflake, BigQuery, and a mix of data platforms such as Spark, AWS Athena, Postgres and Redis. Excellent SQL development, query optimization and data pipeline development skills required. Strong experience using public cloud platforms including AWS and GCP is required; experience with docker and Kubernetes strongly preferred. Experience in the use of multiple programming More ❯

pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from Xcede Associate Director – Data & AI Recruitment Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to … and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at … solutions, delivery plans, and architectural designs Build and maintain highly automated, scalable data pipelines using modern cloud-based tools Identify and resolve data quality and pipeline performance issues to ensure stability and integrity Contribute to the design and deployment of data lakes, warehouses, and streaming architectures Participate in mentoring and upskilling junior team More ❯

About the role North Northamptonshire Council are working to modernise their data management and visualisation processes. We are working to deliver our data analytics strategy. This role will … support the design and delivery of the data warehousing, data infrastructure and (where required) the migration of existing data sources (data pipeline and Extract Transform Load (ETL) processes), the primary objective is to create a secure and efficient route for dispersed data sets to be accessed, analysed and visualised … through tools such as Power BI and Excel power query. The current technology stack is predominantly based on Microsoft SQL databases, and we are focussing our data strategy on the Microsoft Azure, Fabric and Power BI toolsets. What will you be doing? The Key Responsibilities of the role will be: Understand and document the data landscape More ❯

About The Role North Northamptonshire Council are working to modernise their data management and visualisation processes. We are working to deliver our data analytics strategy. This role will … support the design and delivery of the data warehousing, data infrastructure and (where required) the migration of existing data sources (data pipeline and Extract Transform Load (ETL) processes), the primary objective is to create a secure and efficient route for dispersed data sets to be accessed, analysed and visualised … through tools such as Power BI and Excel power query. The current technology stack is predominantly based on Microsoft SQL databases, and we are focussing our data strategy on the Microsoft Azure, Fabric and Power BI toolsets. What will you be doing? The Key Responsibilities Of The Role Will Be Understand and document the data landscape More ❯

Data Engineer 6 month initial contract Outside IR35 Hybrid, 3 days a week in London We're working with a Global Consultancy to find data-driven professionals to join them in their digital function. We're looking for individuals who have experience across data engineering, data science, and product development projects. Knowledge … of data mining, machine learning, and natural language processing is an advantage. Skills they're looking for... Python Strong analytical and problem-solving skills with deep expertise in data modeling, ETL processes, data warehousing, and machine learning lifecycle management. Strong experience with Data Lakes SQL Building and managing fully automated data pipelines (ETL, ELT, ELTL) including: Designing and building data interfaces to source systems Combining and transforming data into the appropriate format for storage Developing data sets for analytics purposes Developing pipelines that can handle common issues/errors in a robust and automated way Cloud experience in AWS, Azure, or GCP Experience More ❯

Description A leading global investment bank with a long-standing reputation for excellence, innovation, and client service. With a strong presence in London, are looking to expanding there data engineering capabilities to support critical business functions, regulatory reporting, and data-driven decision-making. Role Overview They are seeking a highly skilled Senior AWS Data Engineer to join the London-based data platform team. You will play a key role in building and optimizing scalable, secure, and high-performance data pipelines and infrastructure on AWS. This is a great opportunity to work in a fast-paced, high-impact environment where technology drives the business. Key Responsibilities Design, build, and … maintain robust data pipelines using AWS services (Glue, Lambda, Step Functions, S3, etc.) Develop and optimize data lake and data warehouse solutions using Redshift, Athena, and related technologies Collaborate with data scientists, analysts, and business stakeholders to understand data requirements Ensure data quality, governance, and compliance with financial More ❯