426 to 450 of 920 Data Pipeline Jobs in the UK

real impact. If you're ready to shape the future, let's talk. We are seeking an experienced Site Reliability Engineer (SRE) with deep subject-matter expertise in data processing and reporting. In this role, you will own the reliability, performance, and operational excellence of our real-time and batch data pipelines built on AWS, Apache … Flink, Kafka, and Python. You'll act as the first line of defense for data-related … incidents , rapidly diagnose root causes, and implement resilient solutions that keep critical reporting systems up and running. Incident Management & Triage Serve as on-call escalation for data pipeline incidents, including real-time stream failures and batch job errors. Rapidly analyze logs, metrics, and trace data to pinpoint failure points across AWS, Flink, Kafka, and Python More ❯

We're helping to grow a diverse cross-functional Digital Experience team within one of the world's largest retailers. This is a new business unit comprised of Data Science & Analytics, Product, Engineering, Design, Operations, & Strategy teams. This Digital Experience team functions like a startup within the business, advising executive teams on all things related to their consumer … Design experiments to quantify performance of models and product. Work with big data, using data science techniques and alongside engineers to define data pipeline needs. We would like you to have Experience with Personalisation and Experimentation solutions is essential, preferably in a retail, ecommerce or multi-channel environment. The ability to understand stakeholder … and setting performance KPIs that develop a robust plan for customer personalisation and recommendations. Understanding of Next Best Action models and solutions, and a broad understanding of how Data Science integrates into the wider tech stack. Experience in digital customer experience or digital marketing. Knowledge of A/B testing best practices, including processes, capabilities and tools. An More ❯

Data Engineer (AI-Driven SaaS plaform) (Python, Snowflake, Data Modelling, ETL/ELT, Apache Airflow, Kafka, AWS) Large-scale data environment Up to £70,000 plus benefits FULLY REMOTE UK Are you a Data Engineering enthusiast who thrives from designing and implementing robust ETL processes, highly scalable data structures and … data pipelines within a truly enterprise-scale data processing environment? Do you want to work on an AI-Driven SaaS platform that's utilised by some of the biggest brands in the world? If so - look no further. This is your chance to help my client build their new Data Infrastructure and essentially help … them to leverage the power of data, working on large-scale data processing systems. They have an award-winning, enterprise-scale SaaS platform that was without a doubt, revolutionized its industry and is being utilised by some of the biggest companies and brand names in the WORLD. They have grown quickly and have truly made an More ❯

Job Title: Data Engineer Location: London Employment Type: Permanent Salary: up to £80,000 + bonus and benefits The Company Our client, a major player in the reinsurance sector is looking to hire a skilled and driven Data Engineer to support the evolution of its internal data solutions. This position offers the opportunity to … own and enhance core data flows that underpin critical business applications.You’ll play a central role in maintaining data quality, integrating systems, and ensuring data is accessible for analytics and decision-making across the business. The role involves close collaboration with stakeholders and offers the chance to contribute to both operational processes and strategic … projects. Key Responsibilities: Take ownership of a central data integration tool and lead its ongoing development and optimisation. Finalise and improve data pipelines to deliver clean, structured datasets across business functions. Design and apply monitoring processes to maintain data quality and integrity. Produce clear and well-documented code and data flows to More ❯

who use AI-powered tools and proactive clinical coaching to improve health outcomes, reduce health inequalities, and create a more personalised care experience. We’re looking for a Data Engineer to support the development and maintenance of healthcare data pipelines and platforms, with a strong emphasis on building robust ETL processes and scalable data architectures. Key responsibilities: Design and implement ETL pipelines for healthcare data using Python, SQL, and cloud-based tools Develop and maintain data infrastructure on Azure including data lakes, warehouses, and processing frameworks Create robust data transformation processes ensuring data quality, consistency, and security Implement orchestration to automate manual … workflows such that they are reliable, repeatable, secure and robust Collaborate with Data Science and Clinical teams to understand data requirements and deliver actionable insights Apply security-first practices in all data processing solutions to protect sensitive patient information Contribute to team knowledge through documentation and sharing of data engineering best practices More ❯

Principal Data Engineer/Architect (Snowflake AWS SQL Python) London/WFH to £140k Opportunity to progress your career in an impactful Principal Data Engineer role at a growing technology company as they scale their UK presence. As a Principal Data Engineer you will lead the architecture and design of the Data Platform using Snowflake and AWS. Collaborating with product and engineering colleagues as well as internal business stakeholders on the product backlog for the Data Platform, you'll ensure solutions are secure and scalable and promote best practices in CI/CD, IaC and DataOps. Location/WFH: You'll be bale to work from home most … of the time, meeting up with colleagues in the London office once or twice a week. About you: You are a highly technical Data Engineer/Architect with experience of designing data lakes, data pipelines and meta data management You have strong Snowflake and AWS data services experience You have More ❯

Principal Data Engineer/Architect (Snowflake AWS SQL Python) London/WFH to £140k Opportunity to progress your career in an impactful Principal Data Engineer role at a growing technology company as they scale their UK presence. As a Principal Data Engineer you will lead the architecture and design of the Data Platform using Snowflake and AWS. Collaborating with product and engineering colleagues as well as internal business stakeholders on the product backlog for the Data Platform, you'll ensure solutions are secure and scalable and promote best practices in CI/CD, IaC and DataOps. Location/WFH: You'll be bale to work from home most … of the time, meeting up with colleagues in the London office once or twice a week. About you: You are a highly technical Data Engineer/Architect with experience of designing data lakes, data pipelines and meta data management You have strong Snowflake and AWS data services experience You have More ❯

AWS and Azure Cloud usage VMWare usage Technical Leadership & Design DevSecOps tooling and practices Application Security Testing SAFe (scaled agile) Processes Data Integration Focused: Data Pipeline Orchestration and ELT tooling such as Apache Airflow, Apache NiFi, Airbyte, and Singer Message Brokers and streaming data processors like Apache Kafka Object Storage solutions such as … S3, MinIO, LakeFS CI/CD Pipeline and Integration, ideally with Azure DevOps Python scripting API Management Solutions Automation Key Skills: Design, Configuration, and Usage of Low-code Platforms such as Power Platform, Appian, UiPath, Blue Prism RPA and Automation solutions Business Process Analysis Software, Applications, APIs Apps Design and Integration Key Skills: Software, API, Web Design and Development … Database Design and Data Modelling Architectural Patterns such as OO, Cloud-native, and Microservices Automated Test tooling, ideally Selenium or Robot Framework DevSecOps Key Skills: CI/CD Pipelines, ideally Azure DevOps IaC tooling, including Terraform, Ansible, Harbor SCA/IAST/DAST tooling, e.g., Black Duck, Coverity, JFrog, Snyk Automated Test tooling, ideally Selenium or Robot Framework More ❯

you'll help build a fairer credit system. Role and Responsibilities Join our Analytics team to deliver cutting edge solutions. Support business and operation teams on making better data driven decisions by ingesting new data sources, creating intuitive dashboards and producing data insights Build new data processing workflows to extract data from core systems for analytic products Maintain and improve existing data processing workflows. Contribute to optimizing and maintaining the production data pipelines, including system and process improvements Contribute to the development of analytical products and dashboards with integration of internal and third-party data sources/APIs Contribute to cataloguing and documentation … of data Bachelor's degree in mathematics, statistics, computer science or related field 2-5 years experience working in data engineering/analyst and related fields Advanced analytical framework and experience relating data insight with business problems and creating appropriate dashboards Mandatory required high proficiency in ETL, SQL and database management Experience with AWS More ❯

customer service. Driven by our core values, we push boundaries, build with speed and intensity, and consistently deliver incredible value to our customers. What's the opportunity? The Data Infrastructure team builds distributed systems and tools supporting Intercom and empowering people with information. As the company grows, so does the volume and velocity of our data and the appetite for more-and-more sophisticated and specialized, often AI-assisted, data solutions. Our team builds, maintains, evolves, and extends the data platform, enabling our partners to self-serve by creating their own end-to-end data workflows, from ingestion through transforming data and evaluating experiments to analyzing … can be shipped daily. Implement systems to monitor our infrastructure, detect and surface data quality issues. Recent projects the team has delivered: Refactoring of our MySQL Ingestion pipeline for reduced latency and 10x scalability. Redshift -> Snowflake migration Unified Local Analytics Development Environment for Airflow and DBT Building our next generation company metrics framework, adding anomaly detection and More ❯

Analyst Location: London (SOHO Hybrid 1/2 days a week onsite) Salary: £35,000 - £50,000 DOE Role Profile We are seeking a strategic and commercially-minded Data Analyst to lead the data strategy, elevate our reporting capabilities, and deliver impactful insights that influence executive decision-making and drive performance across the organisation. This role … sits at the heart of our transformation journey - reporting directly to the Chief Executive Officer and working closely with C-suite leaders to ensure data is a key driver of operational and strategic success. Key Responsibilities Partner with the CEO, CFO, Head of Risk , providing strategic data and insight to support their decision-making. Design, build … and deliver group-wide reporting programmes , primarily using Power BI , aligned with leadership priorities and business strategy. Ensure data quality and governance , maintaining the accuracy, validation, and trustworthiness of insights used across the business. Provide executive-level analytics, including: Forecasting support to the CFO Strategic planning and hypothesis testing with the CEO Bespoke data support for More ❯

Staff Data Engineer Joining one of the best-known retail brands in the UK as a Staff Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and maintaining data pipelines and to collaborate with the … wider data teams. The Opportunity For this role as Staff Data Engineer, they are looking for this person to have extensive experience with data pipelines, data warehousing and to play a key role in driving high standards across the data function. You will support the team in building pipelines to … deliver insights enabling the company to be more data-driven with their decision-making. Within this role as a Staff Data Engineer, they'd also be looking for this person to support the wider team and act as a mentor to junior members. Skills and Experience Experience in Python Strong experience working with Azure Experience using More ❯

week to charitable causes, with bold ambitions to double their impact in the next decade. Why This Role? 🛠 You'll play a critical role in owning and optimising data and reporting pipelines, overseeing daily operations and release management, while being technical enough to dive into ETL, AWS, or BI issues as they arise. You’ll lead a small … offshore supplier team and ensure smooth, efficient delivery of BI data services across the business. What You’ll Be Doing: Monitor, troubleshoot, and manage daily Data Ops, including ETL workflows and Power BI releases Be the escalation point for Level 2/3 support, resolving issues hands-on across AWS (Airflow … S3, Redshift, Glue) Lead and coordinate with a team of 5–6 offshore data engineers and suppliers Support and automate Power BI deployments and data pipeline releases Own release communications and issue resolution across stakeholders Work closely with the BI Operations Manager and wider tech/data teams Tech Stack You’ll Use More ❯

Senior Application Developer - Data page is loaded Senior Application Developer - Data Bewerben locations London, United Kingdom time type Full time posted on Gestern ausgeschrieben job requisition id J-047731 IDEXX is looking for a Senior Data Engineer to join the Veterinary Software team in London! This is an exciting opportunity for a a data … their technical leadership skills and make an impact in a meaningful industry. This role will be hybrid 2 days onsite in our Wimbledon office, London. As a Senior Data Engineer, you will lead data migration strategies and implementation across hybrid cloud environments (primarily AWS), enabling smooth and secure movement of legacy and modern systems. As a … senior engineer, you'll design, develop, and optimise scalable and efficient data pipelines integrating PHP, and C applications using .NET framework backend services and React frontends. You'll utilise tools such as Terraform for infrastructure-as-code ( IaC ), AWS (Lambda, EC2, EKS, Step Functions, VPC etc.) for ETL, Airflow pipelines, Snowflake, and ensure architectural alignment with AI/ More ❯

Overview: A leading global trading firm is seeking a Data Engineer to join their London office, working closely with many of their trading teams. This role sits within a team that focuses on building and maintaining mission-critical data infrastructure that supports trading and research strategies across commodities and macro markets. What you'll be doing … You'll play a vital role in the data lifecycle, including: Designing and maintaining robust ETL/ELT pipelines for alternative and macroeconomic datasets Collaborating directly with traders and researchers to align data with trading strategies Building scalable and reliable data architectures Who you are: A data … engineer with at least 2 years of experience, preferably in trading environments Expert in Python development and comfortable in DevOps/Linux environments Deep experience with data pipeline tools and frameworks (ETL/ELT) What's on offer: Market-leading compensation Catered breakfasts and lunches Commuter and parking benefits Opportunity to contribute to a highly dynamic and More ❯

SQL Data Engineer – Cloud Architecture & Web App Focus Are you a SQL expert with a passion for cloud-based data systems and real-world impact? We're hiring a SQL Data Engineer to support the development of a modern, data-driven web application — and we’re looking for someone who thrives at … the intersection of cloud infrastructure and application data flows. This isn’t just about writing queries -it’s about building the right foundation for data to power a product. What we’re looking for: Strong SQL skills – you write clean, efficient queries and understand how to structure data for scale Cloud architecture experience – you … ve worked with cloud-first data environments (AWS, Azure, or GCP) Web application exposure – you understand how data integrates with live, user-facing applications and backend services Experience designing, building, and managing cloud-native data pipelines Comfortable collaborating with cross-functional teams (engineering, product, stakeholders) Nice to have: Familiarity with tools like dbt, Airflow More ❯

SQL Data Engineer – Cloud Architecture & Web App Focus Are you a SQL expert with a passion for cloud-based data systems and real-world impact? We're hiring a SQL Data Engineer to support the development of a modern, data-driven web application — and we’re looking for someone who thrives at … the intersection of cloud infrastructure and application data flows. This isn’t just about writing queries -it’s about building the right foundation for data to power a product. What we’re looking for: Strong SQL skills – you write clean, efficient queries and understand how to structure data for scale Cloud architecture experience – you … ve worked with cloud-first data environments (AWS, Azure, or GCP) Web application exposure – you understand how data integrates with live, user-facing applications and backend services Experience designing, building, and managing cloud-native data pipelines Comfortable collaborating with cross-functional teams (engineering, product, stakeholders) Nice to have: Familiarity with tools like dbt, Airflow More ❯

GCP Data Engineer I am working with a leading Lloyd's of London reinsurance broker that is expanding its cloud data capabilities and looking for a GCP Data Engineer to join their growing team. This is a fantastic opportunity to work on a major cloud migration project and help shape the future of their … data platform. As part of this role, you will be responsible for some of the following areas: Develop and maintain robust, scalable data pipelines and ETL workflows within Google Cloud Platform (GCP) Take ownership of a major cloud migration initiative from Azure to GCP, ensuring smooth data integration and minimal disruption Partner with data scientists, analysts, and business stakeholders to deliver impactful, data-driven solutions Consolidate data from multiple sources, ensuring high standards of data quality, consistency, and security Contribute to the implementation of emerging AI technologies across the data platform To be successful in the role you will have: Proven experience as a More ❯

GCP Data Engineer I am working with a leading Lloyd's of London reinsurance broker that is expanding its cloud data capabilities and looking for a GCP Data Engineer to join their growing team. This is a fantastic opportunity to work on a major cloud migration project and help shape the future of their … data platform. As part of this role, you will be responsible for some of the following areas: Develop and maintain robust, scalable data pipelines and ETL workflows within Google Cloud Platform (GCP) Take ownership of a major cloud migration initiative from Azure to GCP, ensuring smooth data integration and minimal disruption Partner with data scientists, analysts, and business stakeholders to deliver impactful, data-driven solutions Consolidate data from multiple sources, ensuring high standards of data quality, consistency, and security Contribute to the implementation of emerging AI technologies across the data platform To be successful in the role you will have: Proven experience as a More ❯

be joining a small, dynamic team developing a cutting-edge in-play football modelling and trading platform. We are building systems that process real-time match and market data to execute automated trading strategies with millisecond latency - think high-frequency financial trading meets sports analytics. This is an opportunity to work on challenging technical problems in a collaborative … environment where your contributions directly impact our platform's success. Key Responsibilities Design, develop, and optimize BigQuery-based solutions for real-time, low-latency data processing Implement and maintain API integrations with multiple trading platforms Enhance and refactor existing model and trading strategy implementations for improved performance Design and implement BigQuery schemas for both real-time data … techniques and experience building resilient systems with strict latency requirements, streaming data architectures and event-driven systems Data Engineering : Solid grasp of data pipeline design, ETL processes, and schema design for both transactional and analytical workloads Version Control & CI/CD : Proficiency with Git and modern deployment practices Benefits Salary depending on experience. More ❯

Mid-Level Data Scientist Up to 65,000 West London (Hybrid, 3 days onsite per week) Company: This data-first property tech startup empowers businesses to make smarter decisions by turning complex data into clear, actionable insights. Leveraging rich UK property data and advanced data science, they provide deep customer … insights, predict behaviour, and enable hyper-targeted marketing. Responsibilities: Collaborate to develop data science solutions and outputs supporting the organisation’s product offerings Recognise opportunities to use data science or ML to solve product problems Develop data pipelines to support data science experimentation Show an understanding of the organisation and the benefits … of data science Develop, deploy and support science models in live production products Confidently talk about the benefits of data science approaches to existing and potential customers Requirements: 2/3 years in data science or a related field, or a Master’s degree. Proficient in Python (core skill), with strong experience in SQL More ❯

Mid-Level Data Scientist Up to 65,000 West London (Hybrid, 3 days onsite per week) Company: This data-first property tech startup empowers businesses to make smarter decisions by turning complex data into clear, actionable insights. Leveraging rich UK property data and advanced data science, they provide deep customer … insights, predict behaviour, and enable hyper-targeted marketing. Responsibilities: Collaborate to develop data science solutions and outputs supporting the organisation’s product offerings Recognise opportunities to use data science or ML to solve product problems Develop data pipelines to support data science experimentation Show an understanding of the organisation and the benefits … of data science Develop, deploy and support science models in live production products Confidently talk about the benefits of data science approaches to existing and potential customers Requirements: 2/3 years in data science or a related field, or a Master’s degree. Proficient in Python (core skill), with strong experience in SQL More ❯

Channeling your inner grit will accelerate your growth, help us win as a team, and create unforgettable moments for our customers. The Crown Is Yours As a Senior Data Engineer, Games, you will help lead the design and implementation of reliable, scalable systems for transforming raw data into structured, usable formats that power data … and operational workflows. You'll operate across varied business domains and play a critical role in aligning technical solutions with business strategy. Your work will enable clean, performant data solutions that drive impact at scale. If you're excited about solving complex data challenges in a fast-paced, high-growth environment, come join us and grow … your career at DraftKings. Your work will create the next generation of immersive, data-powered gaming experiences that captivate audiences worldwide. What you'll do as a Senior Data Engineer Dive into the world of DraftKings to understand the systems and data structures that support our products Work with engineering, product, and business teams More ❯

Senior Data Engineer (3-Month Contract) Trailmix is an award-winning studio based in the heart of London, backed by mobile giants Supercell. We are actively growing the talented team behind our hit game Love & Pies , and setting up new titles with equally high ambition. If you want to shape the foundation of data in our … be the perfect role for you. About the role: This is a 3-month contract position reporting to the Engineering Lead . You will work alongside one other Data Engineer and collaborate closely with our Data Analytics , Product , Marketing , and Game teams. This role spans both live game support and the setup of data infrastructure for new games. You'll ensure we have robust pipelines and quality data for decision-making, and help scale systems to support complex event economies, growth loops, and game telemetry. We're looking for someone who can quickly contribute value by bringing practical solutions and modern best practices in data engineering - ideally with More ❯

BI Analyst Location: Bristol (Hybrid 2/3 days a week onsite) Salary: £35,000 - £45,000 DOE Role Profile We are seeking a strategic and commercially-minded Data Analyst to lead the data strategy, elevate our reporting capabilities, and deliver impactful insights that influence executive decision-making and drive performance across the organisation. This role … sits at the heart of our transformation journey - reporting directly to the Chief Purpose Officer and working closely with C-suite leaders to ensure data is a key driver of operational and strategic success. Key Responsibilities Partner with the CEO, CFO, Head of Risk, Group Sales Director , providing strategic data and insight to support their decision … making. Design, build, and deliver group-wide reporting programmes , primarily using Power BI , aligned with leadership priorities and business strategy. Ensure data quality and governance , maintaining the accuracy, validation, and trustworthiness of insights used across the business. Provide executive-level analytics, including: Forecasting support to the CFO Strategic planning and hypothesis testing with the CPO Bespoke data More ❯