1 to 25 of 930 Data Pipeline Jobs in England

Job Description Job Title: Data Architect Location: London - 3 days travel to office SC Cleared: Required Job Type: Full-Time Experience: 10+ years Job Summary : We are seeking a highly experienced and visionary Data Architect to lead the design and implementation of the data architecture for our cutting-edge Azure Databricks platform focused on … economic data. This platform is crucial for our Monetary Analysis, Forecasting, and Modelling efforts. The Data Architect will be responsible for defining the overall data strategy, data models, data governance framework, and data integration patterns. This role requires a deep understanding of data warehousing principles, big data technologies, cloud computing (specifically Azure), and a strong grasp of data analysis concepts within the economic domain. Key Experience: Extensive Data Architecture Knowledge: They possess a deep understanding of data architecture principles, including data modeling, data warehousing, data integration, and data governance. Databricks Expertise More ❯

About Us: ATREIDES is a leader in advanced geospatial technologies, big data solutions, and data analytics. We specialize in providing cutting-edge software platforms that enable our clients to process, analyze, and visualize large-scale geospatial and sensor data for critical decision-making. Our mission is to deliver innovative, scalable, and high-performance platforms … that help organizations unlock the full potential of their data for various industries, including defense, national security, environmental monitoring, and urban planning. We are seeking a highly skilled Senior Data Engineer with a strong focus on big data, data analytics, and geospatial data intelligence to join our engineering team. In … and technologies (AWS, Azure, GCP) for big data processing and platform deployment. Strong knowledge of data warehousing, data lakes, and data pipeline design for large-scale data integration and storage. Familiarity with machine learning and AI techniques for data analytics (e.g., classification, regression, clustering, anomaly detection). More ❯

Our OEM Client based in Whitley, Coventry, is searching for a Data Quality & Management Engineer (Test Data) to join their team, Inside IR35. This is a contract position until 31st March 2026. Umbrella Pay Rate: £28.06 per hour. Be a part of the team testing the next generation of electrified propulsion systems for our client s … Performance Index. DV Delivery Burndown. Key Accountabilities and Responsibilities: Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. Delivering data quality reviews in order to support programme targets and prove out chosen … Educated to degree level in a natural science, mathematical or engineering or computing discipline. Designing applications in different programming languages (preferable Python). Build data systems & pipelines, data validation and management in cloud platforms (AWS, Google Cloud). Data analysis skills, including hypothesis testing, uncertainty analysis, and process variation. Ability to work closely with More ❯

Our OEM Client based in Whitley, Coventry, is searching for a Data Quality & Management Engineer (Test Data) to join their team, Inside IR35. This is a contract position until 31st March 2026. Umbrella Pay Rate: £28.06 per hour. Be a part of the team testing the next generation of electrified propulsion systems for our client's … Performance Index. DV Delivery Burndown. Key Accountabilities and Responsibilities: Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. Delivering data quality reviews in order to support programme targets and prove out chosen … Educated to degree level in a natural science, mathematical or engineering or computing discipline. Designing applications in different programming languages (preferable Python). Build data systems & pipelines, data validation and management in cloud platforms (AWS, Google Cloud). Data analysis skills, including hypothesis testing, uncertainty analysis, and process variation. Ability to work closely with More ❯

that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … re underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data … data engineering projects. You will work closely with cross-functional teams and contribute to the strategic direction of our data initiatives. RESPONSIBILITIES Data Pipeline Development: Lead the design, implement, and maintain scalable data pipelines for ingesting, processing, and transforming large volumes of data from various sources using tools such More ❯

Job summary We are looking for an experienced Senior Data Engineer with … strong technical expertise and innovative mindset to drive our team forward. Main duties of the job Data Engineer will be involved in the entire data pipeline from data acquisition to data extraction, ensuring that the data is accurate, reliable, and accessible, and fit-for-purpose for business intelligence, analytics … and data science functions. Data Engineer will be collaborating with cross-functional teams to support the delivery of impactful analytics work for our clients. About us We are the official research support team for the NHS Benchmarking Network, working with over 300 healthcare organisations across the UK to identify opportunities for service development and quality improvement. More ❯

that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … re underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data … modelling, ETL (Extract, Transform, Load) processes, and big data technologies it becomes possible to develop robust and reliable data solutions. RESPONSIBILITIES Data Pipeline Development: Design, implement, and maintain scalable data pipelines for ingesting, processing, and transforming large volumes of data from various sources using tools such as databricks More ❯

Overview We are looking for a data engineer experienced in DevOps-based pipeline delivery, who can not only develop the pipeline but also establish the foundational framework for reusable data ingestion processes. The ideal candidate is proactive, a self-starter, and demonstrates a strong can-do attitude. While not essential, experience with Health Data … Framework Delivery: Responsible for building reusable metadata driven data pipelines within a framework to handle batch and near-real-time data feeds. Data Pipeline Development: Develop end-to-end data pipelines, including data load patterns, error handling, automation, and hardware optimisation. Requirements Formulation: Collaborate with Business Analysts, Architects, SMEs … updated on new data engineering technologies and best practices, especially in healthcare, and recommend adoption as needed. Lead proof of concepts, pilots, and develop data pipeline using agile and iterative methods. Qualifications Certifications such as DP 203 and AZ 900 or similar certification/experience. Essential skills Experience in working with healthcare data More ❯

consistency, and proactively collaborating with upstream and downstream teams to enable seamless data flow across the organization. In this role, you will not only troubleshoot and resolve pipeline issues but also contribute to enhancing data architecture, implementing best practices in data governance and security, and ensuring the scalability and performance of data … stakeholders This position requires client presence between 25%-50% of the time per month at the client's office, which is located in London. Key Responsibilities: Data Pipeline Development & Maintenance Build, maintain, and optimize scalable ETL/ELT pipelines using tools such as Dagster, or similar. Ensure high data availability, reliability, and consistency through rigorous … data validation and monitoring practices. Collaborate with cross-functional teams to align data pipeline requirements with business objectives and technical feasibility. Automate data workflows to improve operational efficiency and reduce manual intervention. Data Integrity & Monitoring Perform regular data consistency checks, identifying and resolvinganomalies or discrepancies. Implement robust monitoring frameworks More ❯

Our premium brand Automotive client is currently recruiting for the following role: Data Management and Validation Engineer - 28/hr (Inside IR35) - Coventry (hybrid potential) - 9 Months (potential for yearly renewal) The Opportunity Be a part of the team testing the next generation of electrified propulsion systems for luxury automotive products. Our client is at the forefront of … quality produced by the team. Key Accountabilities and Responsibilities - Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. - Delivering data quality reviews to support programme targets and prove out chosen technologies. - Develop … Experience - Educated to degree level in a natural science, mathematical or engineering or computing discipline. - Designing applications in different programming languages (preferable Python) - Build data systems & pipelines, data validation and management in cloud platforms (AWS, Google Cloud). - Data analysis skills, including hypothesis testing, uncertainty analysis, and process variation. - Ability to work closely with More ❯

Our premium brand Automotive client is currently recruiting for the following role: Data Management and Validation Engineer - £28/hr (Inside IR35) - Coventry (hybrid potential) - 9 Months (potential for yearly renewal) The Opportunity Be a part of the team testing the next generation of electrified propulsion systems for luxury automotive products. Our client is at the forefront of … quality produced by the team. Key Accountabilities and Responsibilities - Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. - Delivering data quality reviews to support programme targets and prove out chosen technologies. - Develop … Experience - Educated to degree level in a natural science, mathematical or engineering or computing discipline. - Designing applications in different programming languages (preferable Python) - Build data systems & pipelines, data validation and management in cloud platforms (AWS, Google Cloud). - Data analysis skills, including hypothesis testing, uncertainty analysis, and process variation. - Ability to work closely with More ❯

Report to: Director of Data Science Location : Hybrid (2 days/week in office, London Holborn) Salary : 60-65k DOE About Us The data team at Times Higher Education works with real-world data inputs from a number of external sources, and our work is reliant on this data being easily … also need to be shared across the company and to external parties, for a growing number of applications. Your role will be focused on supporting the delivery of data to our various internal stakeholders, within and outside the data team. You will work closely with our Dir. Of Data Science, Data Scientists … analyst/scientist with strong data engineering skills), who can work on ad-hoc data delivery as well as help strengthen our whole pipeline and governance, providing expert input and support to the team. Responsibilities Support Data Delivery team in data collection and provision processes Support Consultancy team in More ❯

the forefront of development in hybrid and full electric powertrains, aiming to deliver electrifying performance and peerless refinement. We are looking for individuals who are excited about our data management and validation and can bring their passion and experience to our growing team. This role will work across Electric machine, Electric Drive Unit (EDU), Inverter, Cell, Battery, Power … quality produced by the team. Key Accountabilities and Responsibilities: Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. Delivering data quality reviews in order to support programme targets and prove out chosen … Essential: Educated to degree level in a natural science, mathematical or engineering or computing discipline. Designing applications in different programming languages (preferable Python) Build data systems & pipelines, data validation and management in cloud platforms (AWS, Google Cloud). Data analysis skills, including hypothesis testing, uncertainty analysis, and process variation. Ability to work closely with More ❯

the forefront of development in hybrid and full electric powertrains, aiming to deliver electrifying performance and peerless refinement. We are looking for individuals who are excited about our data management and validation and can bring their passion and experience to our growing team. This role will work across Electric machine, Electric Drive Unit (EDU), Inverter, Cell, Battery, Power … quality produced by the team. Key Accountabilities and Responsibilities: Be responsible in data sources and data acquisition, data quality validation, data pipeline, data storage and data visualisation for physical test environment. Delivering data quality reviews in order to support programme targets and prove out chosen … Essential: Educated to degree level in a natural science, mathematical or engineering or computing discipline. Designing applications in different programming languages (preferable Python) Build data systems & pipelines, data validation and management in cloud platforms (AWS, Google Cloud). Data analysis skills, including hypothesis testing, uncertainty analysis, and process variation. Ability to work closely with More ❯

We're undertaking a fast paced data transformation into Databricks at E.ON Next using best practice data governance and architectural principles, and we are growing our data engineering capability within the Data Team. As part of our journey we're looking for a data architect to help bring our vision … to life to design and review data models, iterate on data architecture, and ensure data is efficiently stored and managed within our enterprise data lakehouse. Here's a taste of what you'll be doing You will work with the various data team families in designing, reviewing, and approving or … useful formats. Able to explain data storage concepts and logical data structures i.e. data warehousing. Able to make recommendations for data pipeline design based on business requirements. Be open to new ways of working, and open to working with new technologies. Be able to set your own goals and take the More ❯

Join to apply for the Data Architect (Trading) role at Keyrock Join to apply for the Data Architect (Trading) role at Keyrock About Keyrock Since our beginnings in 2017, we've grown to be a leading change-maker in the digital asset space, renowned for our partnerships and innovation. Data Architect About Keyrock Since … s progress with our research and governance initiatives. At Keyrock, we're not just envisioning the future of digital assets. We're actively building it. Position Overview The Data Architect is responsible for designing, implementing, and maintaining an organization's data architecture and strategy, ensuring that data is collected, stored, and processed efficiently and … securely to support business intelligence, data analytics, and machine learning operations (MLOps) practices. Key Responsibilities Designing Data Architecture: Plan and implement a robust, scalable data architecture that integrates data from various sources and supports diverse analytical needs, while optimizing costs and meeting business requirements. Implementing Data Engineering Pipelines: Design and More ❯

Senior Data Engineer - (Azure/Databricks) page is loaded Senior Data Engineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 7 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our … civil union status, family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. Senior Data Engineer (Azure/Databricks Job Family Grouping: Chief Underwriting Officer Job Family: Data & Analytics Location: London How does this role contribute to our collective success? The Data … services. Implement end-to-end data pipelines, ensuring data quality, data integrity and data security. Troubleshoot and resolve data pipeline issues while ensuring data integrity and quality. Implement and enforce data security best practices, including role-based access control (RBAC), encryption, and compliance with industry More ❯

Seasoned and HuffPost UK. The additional brands echo the existing business ethos and allow for increased audiences and a further strategic diversification of revenue streams. About You A data engineer with advanced knowledge of SQL and hands-on experience with both relational and non-relational databases, supporting data needs in fast-paced, content-driven environments. Experience … to best practice methods with the current framework. Key Responsibilities and Accountabilities Design and Maintain Data Pipelines: Develop and maintain robust, scalable, and efficient data pipeline architecture to support current and future business needs. Engineering and Integration: Assemble large, complex datasets from a variety of structured and unstructured sources, ensuring they meet functional requirements. Process … using Python, SQL, and Google Cloud Platform (GCP) big data technologies, such as BigQuery, Dataflow, Dataproc and Cloud Storage. Business Intelligence Enablement: Prepare and transform pipeline data to support downstream analytics and feed BI tools (DOMO), enabling data-driven decision-making across the organization. Cross-Functional Collaboration: Partner with internal stakeholders More ❯

Seasoned and HuffPost UK. The additional brands echo the existing business ethos and allow for increased audiences and a further strategic diversification of revenue streams. About You A data engineer with advanced knowledge of SQL and hands-on experience with both relational and non-relational databases, supporting data needs in fast-paced, content-driven environments. Experience … to best practice methods with the current framework. Key Responsibilities and Accountabilities Design and Maintain Data Pipelines: Develop and maintain robust, scalable, and efficient data pipeline architecture to support current and future business needs. Engineering and Integration: Assemble large, complex datasets from a variety of structured and unstructured sources, ensuring they meet functional requirements. Process … using Python, SQL, and Google Cloud Platform (GCP) big data technologies, such as BigQuery, Dataflow, Dataproc and Cloud Storage. Business Intelligence Enablement: Prepare and transform pipeline data to support downstream analytics and feed BI tools (DOMO), enabling data-driven decision-making across the organization. Cross-Functional Collaboration: Partner with internal stakeholders More ❯

Position : Senior Data Engineer Salary: Negotiable, depending on Experience Location : Hybrid - Bristol, Manchester, or London Security Requirement : SC Clearance to start and be willing/able to obtain DV Clearance We are seeking Data Engineers, with a keen interest/experience in AI/ML and strong proficiency in Python Scripting. To join our Consultancy client … working on meaningful projects in the Defence and Security sector. Required Experience: End-to-End Data Development : Strong experience with data pipelines, ETL processes, and workflow orchestration, demonstrating best practices across tech stacks. Strong Python Skills Diverse Data Handling : Familiarity with batch, streaming, real-time, and unstructured data sources. Architectural Design & Systems … AI Integration : Apply data engineering tools, integration frameworks, and query engines to create high-quality, standardised data for AI applications and reporting. Data Pipeline Development : Design and implement robust data pipelines and stores in collaboration with other engineers and developers. Innovative Problem Solving : Bring fresh approaches to challenging data More ❯

throughout all levels of the client organization, generating results that allow our clients to thrive. What You'll Bring Join a dynamic team transforming our organization into a data-driven enterprise! The Data Layer Team is where we build essential data connectors, data pipelines, and capabilities to empower our clients and colleagues … with high-quality and reusable data. Our Data Layer Team focuses on creating scalable data solutions and advancing our data infrastructure that are the foundation of AI products that will drive informed decision-making across the company. As the Data Layer Connectors & Ingestion Delivery Owner, you will oversee data engineering … practices, data connectors, integrations, while driving continuous improvement, and ensuring alignment with data governance, security, and compliance standards. You will lead the Platform Build & Connectors squad compose of data engineers, architects, and you will closely collaborate with cross-functional teams to ensure timely delivery and operational excellence. Your responsibilities include defining the data More ❯

are a brand embarking on a very exciting plan and we are seeking new members of the team who want to contribute to this. THE ROLE As a Data Architect (contract) for Project Nova, you will be instrumental in shaping AllSaints' journey to become a truly data-driven, AI-powered organisation. You will lead the design … and implementation of our enterprise data architecture. This role is central to the Data & Integration workstream of Project Nova, building on our existing data warehouse and BI capabilities to accelerate our data transformation and enable the use of greater AI-driven insight and actions. You will ensure our data assets … techniques and tools Strong hands-on experience with cloud data platforms, specifically Google Cloud Platform - BigQuery Experience with leading ETL/ELT tools and data pipeline orchestration (e.g., Dataflow, Apache Airflow, Talend, Informatica) Advanced SQL skills and deep knowledge of various database technologies (relational, columnar, NoSQL) Practical experience in establishing data governance frameworks More ❯

are a brand embarking on a very exciting plan and we are seeking new members of the team who want to contribute to this. THE ROLE As a Data Architect (contract) for Project Nova, you will be instrumental in shaping AllSaints' journey to become a truly data-driven, AI-powered organisation. You will lead the design … and implementation of our enterprise data architecture. This role is central to the Data & Integration workstream of Project Nova, building on our existing data warehouse and BI capabilities to accelerate our data transformation and enable the use of greater AI-driven insight and actions. You will ensure our data assets … techniques and tools Strong hands-on experience with cloud data platforms, specifically Google Cloud Platform - BigQuery Experience with leading ETL/ELT tools and data pipeline orchestration (e.g., Dataflow, Apache Airflow, Talend, Informatica) Advanced SQL skills and deep knowledge of various database technologies (relational, columnar, NoSQL) Practical experience in establishing data governance frameworks More ❯

Radius is seeking a highly talented Data Architect and Governance lead for my client going through a digital transformation. Data Strategy Define and lead enterprise-wide data strategy Design and maintain a scalable, secure data architecture Deep understanding of Data Governance Modern data platforms: Cloud Data Quality Management, metadata, lineage, and data modelling Experience with Data integration, master data management (MDM), and designing scalable data pipelines Data Privacy, regulatory compliance, and security best practices BI Tools: Power BI, Tableau, Looker Proficient in data modelling, SQL, and cloud platforms - Azure, AWS, GCP and … their Data services Key Responsibilities Define and implement data architecture strategies in line with the Customer Journey programme Guide the data-driven decision-making process, ensuring data is effectively utilized to inform business strategies and initiatives Develop a data plan to address data quality issues in line with More ❯

allowance based on a skills assessment Published on 10 July 2025 Deadline 30 July 2025 Location Croydon, Manchester, Sheffield About the job Job summary As a Lead Data Architect, you will create and uphold data architecture across critical Home Office systems, enabling secure, data-driven services that keep the country safe. Working under the … vision set by the Principal Data Architect, you'll design robust data models, metadata systems, and governance frameworks to serve diverse stakeholders. Your leadership will span strategic planning, mentoring junior data architects, and aligning technical decisions with business objectives. If you thrive on architecting solutions that integrate emerging technologies such as cloud-native platforms … data lakehouses, streaming data pipelines and AI-powered analytics while collaborating with multi disciplinary teams, this role offers you the chance to elevate how the Home Office exploits data for maximum public impact. Due to business requirements this post is available on a full time/flexible working basis. Where business needs allow, some More ❯