226 to 250 of 1,108 Data Pipeline Jobs in the UK

Moody's Insurance Solutions Graduate Program, you'll work with the people, teams, and companies leading the way in the use of models, data, analytics, and technology to derive relevant insights across the insurance lifecycle. Our insurance customers use our models, data, analytics, and technology to … are crucial to our future, and we are committed to supporting yours as well. Skills and Competencies: Applied experience collecting, processing, and using data to solve a problem or answer a question. Working knowledge of a computer programming language (examples include SQL, R/tidyverse, Python, Microsoft Excel … domain/catastrophe modeling, Database management/working with relational databases (SQL), Moody's RMS products (e.g. RiskLink, Risk Modeler, Intelligent Risk Platform), Data engineering, data analytics, data science, using a programming language, Collaborative code development using version control software (e.g., GitHub), Kubernetes. Education More ❯

systems and tools to identify and reduce supply chain defects in our systems and inputs, while driving operational leverage and scaling. As a Data Engineer, you will analyze large-scale business data, solve real-world problems, and develop metrics and business cases to delight our customers … worldwide. You will work closely with Scientists, Engineers, and Product Managers to build scalable, high-impact products, architect data pipelines, and transform data into actionable insights to manage business at scale. We are looking for people who are motivated by thinking big, moving fast, and exploring … tech teams and build robust and scalable data integration (ETL) pipelines using SQL, Python and Spark. Monitor and improve data pipeline performance, ensuring low latency and high availability. Automate repetitive data engineering tasks to streamline workflows and improve efficiency. About the team Supply More ❯

power Superbowl-worthy commercials and award-winning cinematic experiences. Our inaugural, cutting-edge HD model, Marey, is built on exclusively licensed and owned data for professional use in Hollywood and enterprise applications. Our team is an unprecedented convergence of talent across industries. Our elite AI scientists from Deepmind … mission of training models exclusively on clean, high-quality data . You will lead the design of data ingestion pipelines, data annotations, and high-throughput, distributed systems that support large-scale data processing and curation. You'll work closely with researchers, engineers … and infrastructure teams to ensure that our data pipeline is not just performant, but trusted, traceable, and aligned with our goal of building the world's cleanest generative video foundation model. What you'll do: Design and lead scalable, high-throughput data pipelines optimized for More ❯

Senior Data Engineer Hybrid working (3 days per week onsite in London) 6 Month contract initially, with good scope for extension Market rates (Umbrella-PAYE) One of our blue chip clients is looking for a Senior Data Engineer to join the team on a long-term … programme of work. Key Responsibilities: Develop, optimize, and maintain ETL pipelines for efficient data extraction, transformation, and loading from various sources, ensuring high data quality. Monitor and troubleshoot production data pipelines to ensure performance and reliability. Mentor junior engineers and lead technical discussions to … promote best practices and innovation. Stay updated with the latest data engineering trends and technologies, recommending improvements for data processing capabilities. Write and optimize SQL queries to ensure data integrity, performance, and scalability. Implement a flexible Data Vault model in Snowflake to More ❯

Data Production Engineer Location: London, United Kingdom Salary: Competitive + Excellent Benefits Our client, a leading global trading firm, is seeking a talented Data Production Engineer to join their highly collaborative Data team. Data is central to their success, powering one of … the unique opportunity to work directly with live trading teams, automate processes, explore vast datasets, and engage with key external stakeholders such as data vendors, brokers, and exchanges. You'll play a hands-on role in acquiring, validating, and preparing data that feeds cutting-edge quantitative … Comfortable using the Linux command line for file manipulation, automation, and system monitoring. Experience with financial datasets (e.g. Refinitiv, S&P, Bloomberg) and ETL pipeline management is highly desirable. Prior exposure to supporting systems in a production trading environment is a strong advantage. Why Apply? You'll join a More ❯

Data Production Engineer Location: London, United Kingdom Salary: Competitive + Excellent Benefits Our client, a leading global trading firm, is seeking a talented Data Production Engineer to join their highly collaborative Data team. Data is central to their success, powering one of … the unique opportunity to work directly with live trading teams, automate processes, explore vast datasets, and engage with key external stakeholders such as data vendors, brokers, and exchanges. You'll play a hands-on role in acquiring, validating, and preparing data that feeds cutting-edge quantitative … Comfortable using the Linux command line for file manipulation, automation, and system monitoring. Experience with financial datasets (e.g. Refinitiv, S&P, Bloomberg) and ETL pipeline management is highly desirable. Prior exposure to supporting systems in a production trading environment is a strong advantage. Why Apply? You'll join a More ❯

Director of Data Engineering Location: Hybrid – London, Blackfriars Join us at Merlin Entertainments as we transform the future of digital guest experiences across our iconic global attractions. We're seeking an experienced Director of Data Engineering to lead the design, development, and implementation of Merlin's … enterprise data architecture and engineering strategy. You'll oversee the data engineering and platform function, with a key focus on building a high-performing team and driving excellence across Databricks-based data platforms. About the Role A key focus will be managing the development … and operational management of the data platform using Databricks. The successful candidate will also lead a high-performing team of data engineers and platform specialists, fostering collaboration across technical and business teams to deliver innovative solutions that drive value and support data-driven decision More ❯

Director of Data Engineering Location: Hybrid – London, Blackfriars Join us at Merlin Entertainments as we transform the future of digital guest experiences across our iconic global attractions. We're seeking an experienced Director of Data Engineering to lead the design, development, and implementation of Merlin's … enterprise data architecture and engineering strategy. You'll oversee the data engineering and platform function, with a key focus on building a high-performing team and driving excellence across Databricks-based data platforms. About the Role A key focus will be managing the development … and operational management of the data platform using Databricks. The successful candidate will also lead a high-performing team of data engineers and platform specialists, fostering collaboration across technical and business teams to deliver innovative solutions that drive value and support data-driven decision More ❯

Data Engineer - Leading Fashion Company - London (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) We’re recruiting on behalf of a leading fashion brand based in London that’s recognised for combining creativity with cutting-edge technology. They’re … on the lookout for a talented Data Engineer to join their growing data team. This is a fantastic opportunity to work with a household name and play a key role in shaping data-driven decisions across the business. The Role As a Data Engineer, you’ll be responsible for building and maintaining scalable, efficient, and reliable data pipelines. You’ll work across a modern tech stack with a strong focus on Google Cloud Platform (GCP) and collaborate with various teams to ensure data flows securely and accurately More ❯

Data Engineer - Leading Fashion Company - London (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) We’re recruiting on behalf of a leading fashion brand based in London that’s recognised for combining creativity with cutting-edge technology. They’re … on the lookout for a talented Data Engineer to join their growing data team. This is a fantastic opportunity to work with a household name and play a key role in shaping data-driven decisions across the business. The Role As a Data Engineer, you’ll be responsible for building and maintaining scalable, efficient, and reliable data pipelines. You’ll work across a modern tech stack with a strong focus on Google Cloud Platform (GCP) and collaborate with various teams to ensure data flows securely and accurately More ❯

Data Engineer - Join One of the UK's Most Exciting Tech Start-ups Location: London (Hybrid) Salary: £40,000-£65,000 + Equity Our client, one of the UK's fastest-growing and most exciting tech start-ups, is looking for a talented Data Engineer to … align data strategies with app development Work with internal stakeholders to shape and meet business data needs Maintain documentation, monitor pipeline performance, and resolve issues as they arise About You Strong problem-solving skills, demonstrated through academic or professional experience In-depth understanding of data … processing frameworks such as Airflow, TensorFlow, or Spark is advantageous Willingness to gain working knowledge of backend development (e.g., Python with Django) for pipeline integration Familiarity with data versioning, quality management, and CI/CD pipelines Experience with cloud platforms (e.g., AWS or Azure) and data More ❯

network-enhancing the customer experience through faster delivery promises and enabling cost-efficient fulfillment planning and execution. Partnering with Fulfillment Center Operations and data teams, you will develop analytics dashboards, deep-dive tools, and influence product roadmaps using data insights and AWS services. We are open … of the following locations: Luxembourg, Barcelona, and UK. Key job responsibilities Manage Customer Requests: Collaborate with business partners to gather requirements and deliver data-driven solutions, including dashboards, tools, and scalable pipelines. Design and Implement Solutions: Develop and prioritize technical solutions using robust design principles to address business …/BI space. PREFERRED QUALIFICATIONS Master's degree, or Advanced technical degree. Knowledge of data modeling and data pipeline design. Experience with statistical analysis, co-relation analysis. Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central More ❯

London should be possible for everyone in our team. The role We are looking for a Machine Learning Engineer with a spike in data engineering and maintaining real-time data pipelines. You will work with our Product & Engineering team along the end-to-end algorithm lifecycle … to advance the Trudenty Trust Network. A bit more on what you'll do: Data Engineering Develop and maintain real-time data pipelines for processing large-scale data Ensure data quality and integrity in all stages of the data lifecycle … Develop and maintain ETL processes for data ingestion and processing Algorithm Development, Model Training and Optimisation Design, develop, and implement advanced machine learning algorithms for fraud prevention and user personalization Train and fine-tune machine learning models using relevant datasets to achieve optimal performance Implement strategies for continuous More ❯

Role: Senior Data Engineer Location: Blackburn, BB1 2FA Contract: Full-Time/Permanent Salary: £65,000 - £75,000 (Dependant on Experience) + Bonus Scheme Company: EG Group About the Role: EG Group are excited to announce a vacancy for a Senior Data Engineer to join our … Data and Analytics team! The Senior Data Engineer is responsible for designing, developing, and maintaining robust data pipelines and architectures that support business intelligence, analytics, and data science initiatives. This role requires a proactive individual with a strong technical background in data engineering, a deep understanding of modern data platforms, and the ability to work collaboratively with cross-functional teams. The ideal candidate will have extensive experience with big data technologies, cloud platforms, and database systems, ensuring the efficient, reliable, and secure flow of data More ❯

Experience function hiring in: United Kingdom Work Preference Option(s): Hybrid model Work from Office Join Ascent and help shape the future of data solutions by becoming a valued team member where your skills matter, your impact is significant, and your career can reach new heights. About Us … and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data science, IoT solutions, machine learning, DevOps optimization, and modernization of applications, data, and platforms. We work with incredible clients in all types of industries such as smart home devices, space exploration, beer manufacturing, finance, ecology, and logistics. We work with some of the sharpest minds in More ❯

Experience function hiring in: United Kingdom Work Preference Option(s): Hybrid model Work from Office Join Ascent and help shape the future of data solutions by becoming a valued team member where your skills matter, your impact is significant, and your career can reach new heights. About Us … and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data science, IoT solutions, machine learning, DevOps optimization, and modernization of applications, data, and platforms. We work with incredible clients in all types of industries such as smart home devices, space exploration, beer manufacturing, finance, ecology, and logistics. We work with some of the sharpest minds in More ❯

products and solutions, both for today and for a new era of building. To support our progress, we are currently recruiting for a Data Engineer (Databricks & BI) to come and join our team at Ibstock Head Office, LE67 6HS. (Applicants must have Right to work in the UK … We are unable to provide sponsorship for this role) Job Purpose: The Data Engineer/BI Developer will play a critical role in developing and refining our modern data lakehouse platform, with a primary focus on Databricks for data engineering, transformation, and analytics. The … role will involve designing, developing, and maintaining scalable data solutions to support business intelligence and reporting needs. This platform integrates Databricks, Power BI, and on-premises JDE systems to provide near real-time insights for decision-making. Key Accountabilities: Ensure the existing design, development, and expansion of a More ❯

time: 35 hours per week Fixed term: 24 months 2 vacancies The School of Informatics, University of Edinburgh invites applications for two Biomedical Data Scientists to support our newly established Biomedical Data Intelligence Hub. The Opportunity: The Biomedical Data Intelligence Hub will support our … biotechnology, drug discovery, medical imaging, and signal processing. The Hub is designed to augment and catalyse the Centre's ongoing projects with advanced data science skills and compute capabilities. In this role, you will develop data solutions as part of a team of Data Scientists and a Software Engineer using a combination of AI, Machine Learning, and other data science techniques, with dedicated access to our new GPU server with state-of-the-art compute. Projects will typically involve implementation of statistical models, data analysis pipelines, or deep More ❯

to us, get regular status updates, and receive the results, without resorting to manual processes. Thats why were looking for a Head of Data and Analytics , to support our data journey, and drive a culture of data driven decision making. You will report into … our Chief Technology Officer, and guide and support our current team of data professionals. We have a Business Objects data warehouse that receives information from our patient administration systems. It exports reports to NHS England and other regulators as well as support operational management. It does … not consume data from other sources, for instance, incidents, people, and finance data. We have a data team skilled in their tools and NHS data, but we are looking for further experience with the next generation of data, e.g. data More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

opportunity to spread your wings and develop your skill set to keep up with the ever-growing demands of the digital landscape. Our Data Services Group team helps apply cutting edge technology and techniques to bring solutions to our clients. As part of that, you'll sit side … recognised organisations. Your key responsibilities Participate in presentations and proposals for medium complex projects or elements of highly complex projects Logical and physical data modelling - Design, develop, and maintain data pipelines and models Assists in data modelling and design reviews, striving for improved usability … and efficiency Implements code for data extraction and basic transformations Validates data quality and maintains source control and versioning Contributes to data tool development and platform monitoring Writing SQL scripts and stored procedures, optimize and tune SQL queries for performance and efficiency Design, implement More ❯