51 to 75 of 975 Data Pipeline Jobs in England

growing, values-driven team of specialists who work with government clients across Cyber, Telecommunications and Data. We are seeking a talented and motivated Data Engineer to join our team and contribute to our mission of protecting the UK through data-driven insights and solutions. As a … Data Engineer, you will work closely with our public sector clients and project teams to develop and implement data engineering pipelines to support data science and business/mission intelligence use cases. Key Responsibilities Assessing your clients' technical needs and understanding how their needs … are different to wants and managing clients' stakeholders relationship appropriately Identifying data sources, data extraction, transformation, and loading (ETL/ELT) concepts and methods Designing, evaluating, and implementing on-premise, cloud-based and hybrid data engineering solutions (including providing review and guidance on testing More ❯

AWS Data Engineer S3 Data Centre of Excellence AWS Data Engineer S3 Data Centre of Excellence Country: United Kingdom Interested in part-time, job-share or flexible working? We want to talk to you! Join our community. We have an exciting opportunity … to join our Data Centre of Excellence as an AWS Data Engineer. The AWS Data Engineer will work within a team of analysts to create the data and insights which support the functional areas of the bank. You'll use a variety … of skills, excellent communication, functional awareness and an extensive analytical capability in understanding the types of models and data frameworks that can support the business strategies around our data assets. If you're someone who's performed a similar role already, this is the perfect opportunity More ❯

with cutting-edge technology? If so, we have an exciting new role for you! Join our dynamic and forward-thinking team as a Data Engineer and help us build secure, scalable microservices that operationalise clinical research applications. This is your chance to make a meaningful impact on healthcare … while working with some of the most advanced technologies in data engineering. About Us We are a pioneering health tech company dedicated to revolutionising clinical research through innovative data solutions. Our cross-functional team, including Frontend Developers, QA Engineers, and DevOps Engineers, collaborates to create high … performance data pipelines and REST APIs that drive AI applications and external data integrations. Your Role As a Data Engineer, you will: Build and Optimise Data Pipelines: Implement high-performance data pipelines for AI applications using Databricks.Develop REST APIs: Create More ❯

Whatever your priorities - work/life balance, career progression, sustainability, volunteering - you'll find like-minded people driving change at Howden. Job Title: Data Architect Location: London/Hybrid Job Type: Full-time Job Summary Are you passionate about designing scalable, high-performance data architectures on … Azure and Databricks ? Do you thrive on solving complex data challenges, integrating modern data platforms, and defining best practices for enterprise data management? We are looking for a Data Architect to lead the design and implementation of cutting-edge data solutions in a cloud-native environment. You will play a key role in shaping data strategy, designing high-level and low-level architectures , and ensuring the seamless integration of data management tools. If you enjoy working with big data technologies, governance frameworks More ❯

Join IFS. Job Description Are you ready to make waves in the world of AI? We're on the hunt for a Principal Data Engineer to join our dynamic global R&D organization. We're looking for someone who brings the heat, fosters seamless collaboration, and is always … the ground up. From framing problems and experimenting with new data sources and tools to the grand finale of data pipeline implementation and deployment. You will ensure scalability and top-tier performance. Locking arms with ML Engineers, Data Scientists, Architects, and Product/… data processing with Spark or Dask. Strong in Python, Scala, C# or Java, cloud SDKs and APIs. AI/ML expertise for pipeline efficiency, familiar with TensorFlow, PyTorch, AutoML, Python/R, and MLOps (MLflow, Kubeflow). Solid in DevOps, CI/CD automation with Bitbucket Pipelines More ❯

Transform Healthcare with Cutting-Edge Tech! ???? Position: Data Engineer (Python/Databricks) Location: Remote Salary: Up to £80,000 + Benefits Are you driven by a passion for health tech and innovation? Do you dream of revolutionizing clinical research through advanced technology? If so, we have an incredible … opportunity for you! Join our trailblazing team as a Data Engineer and play a pivotal role in building secure, scalable microservices that power clinical research applications. This is your chance to make a significant impact on healthcare while working with the latest advancements in data engineering. … About Us We are a pioneering health tech company committed to transforming clinical research through innovative data solutions. Our collaborative team, which includes Frontend Developers, QA Engineers, and DevOps Engineers, creates high-performance data pipelines and REST APIs that drive AI applications and external data More ❯

Job Description: Data Modeler (Offshore) Location: India (Remote) Experience: 10+ years About Client A leading multinational IT services and consulting company specializing in digital transformation, cloud solutions, and AI-driven innovation. With a strong global presence, the company partners with enterprises across various industries to deliver cutting-edge … technology solutions. Must Have Skills: Solid expertise in data modeling, with considerable experience in database technologies, particularly Azure Databricks, Azure Synapse, and Azure Data Factory, to support business intelligence, analytics, and reporting initiatives. Strong understanding of best practices in data modeling to ensure that … experience, with strong domain knowledge in Clinical Research Organizations and Biopharmaceutical services preferred. Proven track record of designing, developing, and maintaining complex logical data models in multiple subject areas. Proficiency in data modeling tools such as ER/Studio, ERwin, or PowerDesigner. Strong proficiency in SQL More ❯

That to be considered you must be in possession of active NPPV3 clearance. THE ROLE To design, implement, and develop robust and scalable data infrastructure that supports advanced analytics and intelligence operations within the police department, enabling data-driven decision-making for crime prevention, investigations, and … safety. This post will work within a 130-strong team of intelligence professionals. Enabling seamless integration and analysis of complex criminological and intelligence data, empowering analysts and investigators to identify crime patterns, predict future incidents, and enhance investigative outcomes. Ensuring the integrity, security, and ethical use of sensitive … criminal justice information, adhering to stringent compliance standards and fostering public trust. Drive innovation in data management and analytics, leveraging cutting-edge technologies to enhance the department's ability to respond to evolving crime trends and emerging threats. Empower the department with the tools to transform data More ❯

Data Engineer Remote - UK based As a Data Engineer, you will lay the groundwork for extracting value from data by developing and maintaining powerful and efficient data infrastructure. In addition, you will help Zeelo's Data Team become the center … of excellence on data and responsible for educating other teams, establishing best practices, and facilitating knowledge sharing on data-related matters across the company. Zeelo and its clients have many data analytics needs all supported by Zeelo's data team. You will … support data analysts by engineering ETL pipelines to deliver useful, clean, clear, and timely data ready for analytics use. Zeelo's data maturity is growing, and you will help incorporate streaming and AI tools into the business effectively. You will also maintain Zeelo's More ❯

London, United Kingdom Posted on 16/04/2025 We are looking for a Data Architect to design, develop, and manage data solutions that align with business needs and industry standards. The ideal candidate will have expertise in Java, SQL, Python, and Spark (PySpark & SparkSQL … a plus. The role requires strong communication skills to collaborate effectively with both technical and non-technical stakeholders. You will be responsible for data governance, data modelling, metadata management, and ensuring compliance with data standards. Key Responsibilities: 1. Data Architecture & Engineering Design … and implement scalable data architectures that align with business objectives. Work with Java, SQL, Python, PySpark, and SparkSQL to build robust data pipelines. Develop and maintain data models tailored to organizational needs. Reverse-engineer data models from existing live systems. Utilize Microsoft More ❯

automation. This team will be required to build high quality data models and products that monitor and reports on data pipeline health and data quality. Lead project work efforts internally and externally setting project deliverables, review design documents, perform code reviews and help … junior members of the team. Collaborate with engineering teams to improve, maintain, performance tune, and respond to incidents on our big data pipeline infrastructure. Own building out key components for observability and intelligent monitoring of data pipelines and infrastructure to achieve early and automated anomaly … SQL and a proven ability to learn new programming languages Experience with workflow orchestration tools such as Airflow Deep understanding of end-to-end pipeline design and implementation. Attention to detail and quality with excellent problem solving and interpersonal skills Preferred Qualifications Advanced degrees are a plus. Strong data More ❯

Data Engineer London (hybrid) Salary up to £80,000 per annum An exciting opportunity has arisen to join a well established organisation in the insurance space, in a challenging Data Engineer role. There will be a lot of stakeholder engagement, so the ideal candidate will have … both hands on and business facing experience. Preferably in the insurance sector. Key responsibilities: Design Data Lake and Data Warehouse solutions. Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and efficient batch data pipelines and … streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial and Finance, to help with their data More ❯

Data Engineer London (hybrid) Salary up to £80,000 per annum An exciting opportunity has arisen to join a well established organisation in the insurance space, in a challenging Data Engineer role. There will be a lot of stakeholder engagement, so the ideal candidate will have … both hands on and business facing experience. Preferably in the insurance sector. Key responsibilities: Design Data Lake and Data Warehouse solutions. Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and efficient batch data pipelines and … streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial and Finance, to help with their data More ❯

DATA ARCHITECT Location: London, UK Reporting To: SVP, Technology Contract Term: Full time, permanent About LIV Golf The LIV Golf League is the world's only global golf league featuring 13 teams, a 14-tournament schedule, and many of the world's best golfers. Launched in 2022, the … level and create new value within the golfing ecosystem while enhancing the game's societal impact. Role Objective We are seeking a visionary Data Architect to lead the design, implementation, and optimization of LIV Golf's enterprise data ecosystem. This role will focus on building scalable … data infrastructure that supports real-time analytics, player performance tracking, fan engagement, and business intelligence initiatives. The ideal candidate will have a passion for sports, a deep understanding of data architecture, and a knack for solving complex data challenges in a dynamic environment. Responsibilities More ❯

Role : Data Engineer Work Mode : Hybrid Contract Role Location : London OR Edinburgh Experience : 10 -12 Years Job Description: Design, develop, and maintain ETL processes to move data from source systems to Snowflake, Teradata and SQL Server environments. Build scalable data pipelines for processing and … storing large datasets. Collaborate with analysts, and business stakeholders to define and implement data strategies. Optimize database performance, including query optimization, indexing, and partitioning across all enterprise data platforms. Work with cross-functional teams to gather requirements and develop effective data solutions. Ensure data … and workflows to meet business requirements. Create and maintain documentation for data systems, pipelines, and processes. Monitor and troubleshoot data pipeline performance issues and resolve them promptly. Assist in the migration and integration of data from legacy systems into Snowflake, and other strategic More ❯

is the largest independent online travel business specialising in cruise (and ) and ski () holidays. About the Role: We're looking for a Junior Data Engineer to join the IT department to help us fulfil the ambitious goals of the organisation. Many of these goals need to be supported … with quality data and our ability to process this data at scale. As a Junior Data Engineer, you will join a data engineering team with a broad skillset in the data space. You will work closely with one of our … able to work to sometimes tight timescales and adapt as source data changes without warning Have knowledge of cloud data pipeline tools (AWS preferred). Experience here is a plus Be passionate about data quality and the service we provide through data More ❯

is the largest independent online travel business specialising in cruise (and ) and ski () holidays. About the Role: We're looking for a Junior Data Engineer to join the IT department to help us fulfil the ambitious goals of the organisation. Many of these goals need to be supported … with quality data and our ability to process this data at scale. As a Junior Data Engineer, you will join a data engineering team with a broad skillset in the data space. You will work closely with one of our … able to work to sometimes tight timescales and adapt as source data changes without warning Have knowledge of cloud data pipeline tools (AWS preferred). Experience here is a plus Be passionate about data quality and the service we provide through data More ❯

is the largest independent online travel business specialising in cruise (and ) and ski () holidays. About the Role: We're looking for a Junior Data Engineer to join the IT department to help us fulfil the ambitious goals of the organisation. Many of these goals need to be supported … with quality data and our ability to process this data at scale. As a Junior Data Engineer, you will join a data engineering team with a broad skillset in the data space. You will work closely with one of our … able to work to sometimes tight timescales and adapt as source data changes without warning Have knowledge of cloud data pipeline tools (AWS preferred). Experience here is a plus Be passionate about data quality and the service we provide through data More ❯

We're currently seeking a Data Engineer to join one of the leading organisations responsible for coordinating the financing activities for one of the largest car manufacturer groups in the world! Ready to fuel your career? Drive your ambition with incredible car scheme perks, a fantastic bonus, and … data storage systems to ensure seamless data flow. Define and support the creation and maintenance of optimal data pipeline architecture, enabling faster and safer solution delivery. Consolidate and optimise large, complex data sets from diverse sources that meet both functional and … solutions. Solid understanding of data warehousing concepts , facilitating the creation of efficient and reliable warehouse solutions. Experience with data pipeline development and optimisation, ensuring streamlined data flows and enhanced performance. What’s In It For You? Location: Buckinghamshire (Hybrid) Work type: Permanent More ❯

About the role Reporting into the Data Systems Manager, the Data Systems Executive is a key position within the Operations arm of the Moorepay marketing team. The role will work with key stakeholders within the wider Data Operations team to enable and maintain the … Moorepay Data Platform' (MDP). This includes managing data quality as well as administration and maintenance of the ETL Engine and the Data Lakehouse, enabling the business to build value-adding data products at scale to support core business objectives. In particular … literate with strong data language expertise - SQL and Python primarily - for data manipulation and end-to-end data pipeline management Familiar with data-as-code methodology, specifically around version control and documentation/change controls Knowledge of working within GDPR and More ❯

Role: Data & Migration Workstream Lead Location: London (Oxford Circus) Hybrid: 1-2 days per week in the office About Monument Technology Limited In building its core UK banking business, Monument has developed an open, scalable, cloud native and world-leading banking technology platform, the third pillar of the … innovate at a fraction of the cost. From front end mobile apps, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole (“bank in a box”) or in part as required. Our technology stack has gained positive attention … co ordinate technical delivery teams and cross-functional contributors including the ability to effectively engage with non-technical audiences. Skilled in data pipeline development and reporting implementation. Experience of data governance and data quality frameworks. Basic familiarity with cloud hosted online data More ❯

Role: Data & Migration Workstream Lead Location: London (Oxford Circus) Hybrid: 1-2 days per week in the office About Monument Technology Limited In building its core UK banking business, Monument has developed an open, scalable, cloud native and world-leading banking technology platform, the third pillar of the … innovate at a fraction of the cost. From front end mobile apps, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole (“bank in a box”) or in part as required. Our technology stack has gained positive attention … co ordinate technical delivery teams and cross-functional contributors including the ability to effectively engage with non-technical audiences. Skilled in data pipeline development and reporting implementation. Experience of data governance and data quality frameworks. Basic familiarity with cloud hosted online data More ❯

Role: Junior Synapse Data Engineer Location: Blackburn, BB1 2FA Hours: Full-Time/Permanent Salary: £28,000 - £35,000 Bonus Scheme: Bonus Incentive Company: EG On The Move About the role As a Junior Synapse Data Engineer, you will support the design, development, and maintenance of … a Senior Data Engineer and a supportive data team, gaining real-world experience across data integration, transformation, and pipeline management. This role is ideal for someone starting their career in data engineering or with initial experience in cloud platforms and data … Lake. Performing basic SQL queries and data validation to ensure accuracy and consistency. Supporting the monitoring and troubleshooting of data pipeline performance and reliability issues. Helping to maintain up-to-date documentation for data processes, workflows, and implemented solutions. Actively participating in team More ❯

Data Engineering Lead (Snowflake & AWS Environment) Hybrid working: 3 days in TW6, Middlesex offices & 2 days home/remote Salary: Negotiable to £70,000 DOE plus 40 % bonus potential Job Ref: J12869 Please note we can only accept applications from those with current UK working rights for this … role, this client cannot offer visa sponsorship. An exciting opportunity has arisen within a FTSE 100 company for a Data Engineering Lead to play a pivotal role in operating and delivering the organisation’s data products. This position holds significant responsibility within the data leadership team, ensuring the data solutions and business processes are fully aligned and contribute to the vision and strategic direction of the organisation. This is an exciting to time to join the organisation as they are in the early stages of a major programme of work More ❯

Data Engineering Lead (Snowflake & AWS Environment) Hybrid working: 3 days in TW6, Middlesex offices & 2 days home/remote Salary: Negotiable to £70,000 DOE plus 40 % bonus potential Job Ref: J12869 Please note we can only accept applications from those with current UK working rights for this … role, this client cannot offer visa sponsorship. An exciting opportunity has arisen within a FTSE 100 company for a Data Engineering Lead to play a pivotal role in operating and delivering the organisation’s data products. This position holds significant responsibility within the data leadership team, ensuring the data solutions and business processes are fully aligned and contribute to the vision and strategic direction of the organisation. This is an exciting to time to join the organisation as they are in the early stages of a major programme of work More ❯