26 to 50 of 566 Data Pipeline Jobs in the UK excluding London

being the dedicated point of contact . You will: Lead and mentor a team of 6+ Tech Leads overseeing product engineering squads delivering data-centric products Provide strategic guidance , coaching, and professional development opportunities for engineering managers to empower their teams and deliver results Establish and maintain a … industry trends and emerging technologies, continually improving data engineering capabilities Metrics-Driven Impact: Develop and track success metrics, including data pipeline reliability, availability, and time-to-insight, to evaluate and continuously improve team performance Communicate the impact of data engineering initiatives through clear … excellence through the implementation of efficient data engineering workflows, processes, and tools Drive the adoption of best practices for data pipeline development, continuous integration/continuous deployment (CI/CD), and data monitoring Identify and implement opportunities for automation and optimization, improving operational More ❯

Data Engineer | London Market Broker | London/Hybrid | £50 - 55,000 (doe) Are you passionate about designing and optimizing data infrastructures? Do you have a flair for working with large datasets and cloud technologies? We are seeking a highly skilled Data Engineer to join … our client, who are a boutique London market broker. As a Data Engineer, you will play a vital role in developing scalable data pipelines, ensuring data quality, and enabling efficient data processing to support business intelligence and advanced analytics. You will also … be involved in their Cloud migration project. Some key responsibilities include: Design, develop, and maintain scalable and reliable data pipelines. Build and optimize data architectures, data lakes, and data warehouses. Develop ETL/ELT processes to extract, transform, and load data More ❯

Role: Data Lead Location: Knutsford Contract Role Job Description: AWS Services: Glue, Lambda, IAM, Service Catalogue, Cloud Formation, Lake Formation, SNS, SQS, Event Bridge Language & Scripting: Python and Spark ETL: DBT Good to Have: Airflow, Snowflake, Big Data (Hadoop), and Teradata Responsibilities: Serve as the primary … point of contact for all AWS related data initiatives and projects. Responsible for leading a team of data engineers and analysts to design, implement, and maintain data solutions on the AWS platform. Gather and analyze business requirements to develop scalable and efficient data … data lakes. In-depth knowledge of AWS services such as EMR, Glue, Kinesis, and Redshift. Hands-on experience with data pipeline development, ETL processes, and data modeling on AWS. Strong leadership and project management skills with the ability to effectively lead a team More ❯

is diverse and equitable, building a culture of collaboration and inclusion. Position Overview Ithaca Energy is accepting applications for the position of Senior Data Engineer located in our Aberdeen Office. Reporting to the Analytics and Integration Lead, the Senior Data Engineer will play a pivotal role in shaping the future of the company's data analytics capabilities. Responsibilities Provision of pipeline engineering support across all development projects within the company's portfolio. Supporting Data Platform Program: Collaborate with cross-functional teams to maintain … and enhance our modern data platform, leveraging expertise in Synapse and data engineering techniques. Stay up to date with innovation: Understand best practices in data engineering, application of emerging technologies, and stay current with developments in the data space. Analyse, Model and More ❯

Build and maintain the configuration of the data stack within the DevOps framework. • Develop data objects and write code in and around the data stack. • Interact with upstream and downstream systems and API for data ingestion and egestion. • Build ETL pipelines and … data framework for monitoring the pipeline. • Ensure performance, quality, and consistency in the data and processes. • Champion good data design practices and promote data quality. • Collaborate and contribute with data architecture, DBA's, and other team members. • Review use cases … data demand, envision future demands to develop data services to support Business needs. • Explore new ways of improving data utilization/consumption, discovery, and lineage. • Develop and champion data principles and define/lead efforts for adoption. • Develop tools and functions for More ❯

Senior Data Engineer - Data Infrastructure and Architecture: C-4 Analytics C-4 Analytics is a fast-growing, private, full-service digital marketing company that excels at helping automotive dealerships increase sales, increase market share, and lower cost per acquisition. We are currently hiring for a Senior … Data Engineer as we look to expand our team and support our growing roster of local and national clients. If you are unable to complete this application due to a disability, contact this employer to ask for accommodation or an alternative application process. Who We're Looking For … growing AI team, you'll play a critical role in the orchestration of Intelligent Systems. Working with AI related orchestration and data pipeline technologies to turn information into insights using multiple platforms. We're not just processing data-we're transforming it into organizational intelligence. More ❯

services we help our clients connect and communicate better with their customers. As we continue to grow, we are seeking a talented Martech Data Engineer to join our team, focusing on implementing and optimizing a fully integrated Martech stack for an international client. In this role, you'll … to define and deliver technical solutions that support business goals and enhance decision-making on a global scale. The role: As a Martech Data Engineer, you will play a crucial role in implementing and deploying the client's Martech stack. You'll work closely with their marketing, analytics … -driven insights. Key Responsibilities: Martech Architecture: Develop and manage a scalable data architecture using Azure and Snowflake. Data Pipeline Management: Implement and maintain data ingestion and integration from platforms like HubSpot and Shopify. Client Collaboration: Work within the client project team More ❯

of technology and build a more sustainable, more inclusive world. Your Role We are seeking a highly skilled and experienced Senior Cloud Platform Data Engineer (SME) to join our dynamic Payment Gateway team in Fleet UK for a Full time Hybrid role. As an SME you will serve … expert providing technical leadership guidance and best practices across the team. You will play a critical role in designing developing and implementing complex data solutions on cloud platforms (primarily AWS) ensuring they meet the highest standards of quality scalability and performance. Serve as a subject matter expert in … cloud data engineering providing technical guidance and mentorship to the team. Drive the design development and implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda AWS S3 AWS Redshift AWS EMR). Develop and maintain data More ❯

or Manchester Salary: £60,000 - £65,000 depending on experience Department: Finance We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! Are you passionate about driving data excellence within finance? Do you thrive on enhancing data functionality that supports business success? If so, we'd love to hear from … and Technology teams to define, capture, and document data requirements. Ensure smooth integration between finance systems and the wider data pipeline, including key logic and calculations. Help shape and evolve the Data Roadmap for Finance, aligning with strategic priorities and business needs. Collaborate More ❯

or Manchester Salary: £60,000 - £65,000 depending on experience Department: Finance We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! Are you passionate about driving data excellence within finance? Do you thrive on enhancing data functionality that supports business success? If so, we'd love to hear from … and Technology teams to define, capture, and document data requirements. Ensure smooth integration between finance systems and the wider data pipeline, including key logic and calculations. Help shape and evolve the Data Roadmap for Finance, aligning with strategic priorities and business needs. Collaborate More ❯

AWS Data Engineer S3 Data Centre of Excellence AWS Data Engineer S3 Data Centre of Excellence Country: United Kingdom Interested in part-time, job-share or flexible working? We want to talk to you! Join our community. We have an exciting opportunity … to join our Data Centre of Excellence as an AWS Data Engineer. The AWS Data Engineer will work within a team of analysts to create the data and insights which support the functional areas of the bank. You'll use a variety … of skills, excellent communication, functional awareness and an extensive analytical capability in understanding the types of models and data frameworks that can support the business strategies around our data assets. If you're someone who's performed a similar role already, this is the perfect opportunity More ❯

Job Title: Data Engineer Location: Glasgow ( Hybrid 2 days on-site) Salary: £40,000 – 50,000 D.O.E About the Company: Our client, a prominent manufacturing firm based in Glasgow, is committed to innovation and excellence in their field. They are currently seeking a skilled Data Engineer … to join their team and help drive data-driven decision-making processes to enhance their manufacturing operations. Job Description: As a Data Engineer, you will be instrumental in designing, developing, and maintaining the data infrastructure. You will work closely with data analysts … data pipelines. Integrate data from multiple sources into a unified data warehouse. Monitor and troubleshoot data pipeline performance. Implement data quality checks and validation processes. Collaborate with data analysts to support their data needs. Maintain More ❯

Join IFS. Job Description Are you ready to make waves in the world of AI? We're on the hunt for a Principal Data Engineer to join our dynamic global R&D organization. We're looking for someone who brings the heat, fosters seamless collaboration, and is always … the ground up. From framing problems and experimenting with new data sources and tools to the grand finale of data pipeline implementation and deployment. You will ensure scalability and top-tier performance. Locking arms with ML Engineers, Data Scientists, Architects, and Product/… data processing with Spark or Dask. Strong in Python, Scala, C# or Java, cloud SDKs and APIs. AI/ML expertise for pipeline efficiency, familiar with TensorFlow, PyTorch, AutoML, Python/R, and MLOps (MLflow, Kubeflow). Solid in DevOps, CI/CD automation with Bitbucket Pipelines More ❯

Transform Healthcare with Cutting-Edge Tech! ???? Position: Data Engineer (Python/Databricks) Location: Remote Salary: Up to £80,000 + Benefits Are you driven by a passion for health tech and innovation? Do you dream of revolutionizing clinical research through advanced technology? If so, we have an incredible … opportunity for you! Join our trailblazing team as a Data Engineer and play a pivotal role in building secure, scalable microservices that power clinical research applications. This is your chance to make a significant impact on healthcare while working with the latest advancements in data engineering. … About Us We are a pioneering health tech company committed to transforming clinical research through innovative data solutions. Our collaborative team, which includes Frontend Developers, QA Engineers, and DevOps Engineers, creates high-performance data pipelines and REST APIs that drive AI applications and external data More ❯

Job Title: Data Engineer Location: Newcastle (Hybrid 3 days on-site) Salary: £45,000 – 55,000 D.O.E About the Company: Our client, a leading utilities company based in Newcastle, is dedicated to providing reliable and sustainable utility services to the community. They are currently seeking a talented Data Engineer to join their dynamic team and contribute to their mission of leveraging data to enhance operations and services. Job Description: As a Data Engineer, you will play a crucial role in designing, developing, and maintaining the data infrastructure. You will collaborate … data pipelines. Integrate data from multiple sources into a unified data warehouse. Monitor and troubleshoot data pipeline performance. Implement data quality checks and validation processes. Collaborate with data analysts to support their data needs. Maintain More ❯

Job Description: Data Modeler (Offshore) Location: India (Remote) Experience: 10+ years About Client A leading multinational IT services and consulting company specializing in digital transformation, cloud solutions, and AI-driven innovation. With a strong global presence, the company partners with enterprises across various industries to deliver cutting-edge … technology solutions. Must Have Skills: Solid expertise in data modeling, with considerable experience in database technologies, particularly Azure Databricks, Azure Synapse, and Azure Data Factory, to support business intelligence, analytics, and reporting initiatives. Strong understanding of best practices in data modeling to ensure that … experience, with strong domain knowledge in Clinical Research Organizations and Biopharmaceutical services preferred. Proven track record of designing, developing, and maintaining complex logical data models in multiple subject areas. Proficiency in data modeling tools such as ER/Studio, ERwin, or PowerDesigner. Strong proficiency in SQL More ❯

Data Engineer London (hybrid) Salary up to £80,000 per annum An exciting opportunity has arisen to join a well established organisation in the insurance space, in a challenging Data Engineer role. There will be a lot of stakeholder engagement, so the ideal candidate will have … both hands on and business facing experience. Preferably in the insurance sector. Key responsibilities: Design Data Lake and Data Warehouse solutions. Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and efficient batch data pipelines and … streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial and Finance, to help with their data More ❯

We're currently seeking a Data Engineer to join one of the leading organisations responsible for coordinating the financing activities for one of the largest car manufacturer groups in the world! Ready to fuel your career? Drive your ambition with incredible car scheme perks, a fantastic bonus, and … data storage systems to ensure seamless data flow. Define and support the creation and maintenance of optimal data pipeline architecture, enabling faster and safer solution delivery. Consolidate and optimise large, complex data sets from diverse sources that meet both functional and … solutions. Solid understanding of data warehousing concepts , facilitating the creation of efficient and reliable warehouse solutions. Experience with data pipeline development and optimisation, ensuring streamlined data flows and enhanced performance. What’s In It For You? Location: Buckinghamshire (Hybrid) Work type: Permanent More ❯

About the role Reporting into the Data Systems Manager, the Data Systems Executive is a key position within the Operations arm of the Moorepay marketing team. The role will work with key stakeholders within the wider Data Operations team to enable and maintain the … Moorepay Data Platform' (MDP). This includes managing data quality as well as administration and maintenance of the ETL Engine and the Data Lakehouse, enabling the business to build value-adding data products at scale to support core business objectives. In particular … literate with strong data language expertise - SQL and Python primarily - for data manipulation and end-to-end data pipeline management Familiar with data-as-code methodology, specifically around version control and documentation/change controls Knowledge of working within GDPR and More ❯

Role: Data & Migration Workstream Lead Location: London (Oxford Circus) Hybrid: 1-2 days per week in the office About Monument Technology Limited In building its core UK banking business, Monument has developed an open, scalable, cloud native and world-leading banking technology platform, the third pillar of the … innovate at a fraction of the cost. From front end mobile apps, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole (“bank in a box”) or in part as required. Our technology stack has gained positive attention … co ordinate technical delivery teams and cross-functional contributors including the ability to effectively engage with non-technical audiences. Skilled in data pipeline development and reporting implementation. Experience of data governance and data quality frameworks. Basic familiarity with cloud hosted online data More ❯

Data Engineering Lead (Snowflake & AWS Environment) Hybrid working: 3 days in TW6, Middlesex offices & 2 days home/remote Salary: Negotiable to £70,000 DOE plus 40 % bonus potential Job Ref: J12869 Please note we can only accept applications from those with current UK working rights for this … role, this client cannot offer visa sponsorship. An exciting opportunity has arisen within a FTSE 100 company for a Data Engineering Lead to play a pivotal role in operating and delivering the organisation’s data products. This position holds significant responsibility within the data leadership team, ensuring the data solutions and business processes are fully aligned and contribute to the vision and strategic direction of the organisation. This is an exciting to time to join the organisation as they are in the early stages of a major programme of work More ❯

Role Overview Data Engineer & Analyst to join our ambitious data team delivering data engineering and innovative data solutions. Projects we work on include Microsoft Fabric data pipeline implementation, advanced analytics, location analytics, LLM agent management and many other projects spanning data engineering, data science and data analytics. GAIL’s delivers craft baking at scale, striving for sustainable ways of delivering fresh, tasty food every day. We use data and technology to help our teams make better decisions so that they can focus on producing quality food and delivering a great customer experience. More ❯

Role: Senior Data Engineer and Data Manager Salary: £45,974 to £54,430 Location: Cardiff (hybrid) The Opportunity Yolk Recruitment are excited to be working with an innovation-driven civil service organisation as they journey through some incredible projects whilst prioritising forward thinking and excellent digital … practices. Role Overview: This is chance to work in an organisation that uses data extensively to directly inform its work. As a key part of the data team, you will be supporting the organisation in that evidence based decision-making and working with colleagues who value … ensure integration projects account for data governance, quality, and versioning. Document all integrations and maintain up-to-date records. Data Pipeline Development & Management Build and maintain data pipelines for ingestion from internal and external sources. Automate data processes to support scalable More ❯

About the Machine Learning Engineer for CDAO Europe CDAO Europe is looking for a machine learning engineer to build efficient, data-driven AI systems that advance our predictive automation capabilities. The candidate should be highly skilled in statistics and programming, with the ability to confidently assess, analyze, and … reviewing use cases from around the business, and play a key role in Vanguard's model governance processes. Core Responsibilities Leverages data pipeline designs and supports the development of data pipelines to support model development. Proficient with software tools that develop data pipelines … a distributed computing environment (PySpark, GlueETL). Supports integration of model pipelines in a production environment. Develops understanding of SDLC for model production. Reviews pipeline designs, makes data model design changes as needed. Documents and reviews design changes with data science teams. Supports data More ❯

Job Title: Data Architect Location: Birmingham/Sheffield/Edinburgh (3 days per week in the office) Salary/Rate: Up to £431 per day INSIDE IR35 Start Date: 06/05/2025 Job Type: Contract Company Introduction We have an exciting opportunity now available with one … of our sector-leading financial services clients! They are currently looking for a skilled Data Architect to join their team for a contract until the end of November. Job Responsibilities/Objectives You will be a technical lead aligned to our Storage & Data Protection Services infrastructure … wide variety of data sources using API's, SQL and 'big data' technologies. Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement internal process improvements: automating More ❯