526 to 550 of 1,014 Data Pipeline Jobs in the UK

Senior Data Scientist - Anti-Fraud & Quality Intelligence Reading GBP 50,000 - 75,000 Senior Data Scientist - Anti-Fraud & Quality Intelligence page is loaded Senior Data Scientist - Anti-Fraud & Quality Intelligence Apply locations Reading, King's Road time type Full time posted on Posted 2 Days Ago time left to apply End Date: July … days left to apply) job requisition id R095723 Senior Data Scientist - Anti-Fraud & Quality Intelligence page is loaded Senior Data Scientist - Anti-Fraud & Quality Intelligence Apply locations Reading, King's Road time type Full time posted on Posted 2 Days Ago time left to apply End Date: July 31, 2025 (25 days left to apply) job … requisition id R095723 We're the world's leading data, insights, and consulting company; we shape the brands of tomorrow by better understanding people everywhere. Kantar's Profiles division is home to the world's largest audience network. With access to 170m+ people in over 100 global markets, we offer unrivalled global reach with local relevancy. Validated by More ❯

Data Warehouse Engineer Location: Newark Salary: £35,000-£38,000 A well-established organisation in the Newark area is seeking a Data Warehouse Engineer to take ownership of its centralised data platform. With a current team member transitioning out at the end of July, this role is ideal for someone confident in SQL, data warehousing, and Power BI, who can hit the ground running in a collaborative, technically strong environment. You'll join a close-knit data team and work alongside a colleague focused on reporting to deliver meaningful insights and maintain a robust, scalable data infrastructure. This position offers exposure to a wide range of ERP systems … and an opportunity to shape the business's approach to data and reporting. Key Responsibilities: Manage and maintain the central data warehouse across multiple ERP platforms Develop and optimise SQL queries to support reporting and data access Build and maintain Power BI dashboards and visualisations Collaborate with internal teams to understand reporting needs and More ❯

The Role We are looking for a hands-on Azure Data Engineer who will lead the final phase of our Client's cloud migration and design the enterprise-grade data platform from the ground up. This is a hybrid role with a strong technical focusblending architecture, automation, and data engineeringto empower s next generation … across Europe, the US, and APAC. As they scale globally and accelerate their AI capabilities, they are completing their transition to the cloud and building a company-wide data platform to power insight-driven transformation for their consultants and clients Required Skills & Experience Must-Haves: 3+ years of hands-on Azure engineering experience (IaaS ? PaaS), including Infra as … Code. Strong SQL skills and proficiency in Python or PySpark . Built or maintained data lakes/warehouses using Synapse , Fabric , Databricks , Snowflake , or Redshift . Experience hardening cloud environments (NSGs, identity, Defender). Demonstrated automation of backups, CI/CD deployments, or DR workflows. Nice-to-Haves: Experience with Azure OpenAI , vector databases, or LLM integrations. Power More ❯

want to talk to you. What Are The Responsibilities? Architect and implement AI-powered features for threat detection, pattern recognition, and automated intelligence gathering Design and build scalable data pipelines that process billions of data points using AI/ML models for entity extraction and relationship mapping Lead the integration of Large Language Models (LLMs) for … natural language processing of intelligence data Develop robust APIs and microservices that handle real-time threat analysis at scale Implement computer vision systems for image and video analysis in OSINT investigations Build and optimize vector databases for semantic search across massive intelligence datasets Establish best practices for AI/ML model deployment, monitoring, and continuous improvement Mentor team … with MLOps practices and model deployment pipelines Proficient in cloud AI services (AWS SageMaker/Bedrock) Deep understanding of distributed systems and microservices architecture Expert in data pipeline platforms (Apache Kafka, Airflow, Spark) Proficient in both SQL (PostgreSQL, MySQL) and NoSQL (Elasticsearch, MongoDB) databases Strong containerization and orchestration skills (Docker, Kubernetes) Experience with infrastructure as code (Terraform More ❯

want to talk to you. What Are The Responsibilities? Architect and implement AI-powered features for threat detection, pattern recognition, and automated intelligence gathering Design and build scalable data pipelines that process billions of data points using AI/ML models for entity extraction and relationship mapping Lead the integration of Large Language Models (LLMs) for … natural language processing of intelligence data Develop robust APIs and microservices that handle real-time threat analysis at scale Implement computer vision systems for image and video analysis in OSINT investigations Build and optimize vector databases for semantic search across massive intelligence datasets Establish best practices for AI/ML model deployment, monitoring, and continuous improvement Mentor team … with MLOps practices and model deployment pipelines Proficient in cloud AI services (AWS SageMaker/Bedrock) Deep understanding of distributed systems and microservices architecture Expert in data pipeline platforms (Apache Kafka, Airflow, Spark) Proficient in both SQL (PostgreSQL, MySQL) and NoSQL (Elasticsearch, MongoDB) databases Strong containerization and orchestration skills (Docker, Kubernetes) Experience with infrastructure as code (Terraform More ❯

Overview: We're hiring a Product Manager to own our backend data platform-governed datasets, quality enforcement, platform tooling, and integrations with Azure and Databricks. You'll shape how data products are built, validated, and consumed across the enterprise. Key Responsibilities: -Define and manage governed data products across medallion architecture (Bronze, Silver, Gold). … Drive platform improvements in data quality, lineage, cataloging, and contract enforcement. -Collaborate with data engineers and architects to deliver scalable pipelines. -Own roadmap and tooling integration for Alation, Databricks, Azure Data Services, and Great Expectations. -Partner with Data Governance to support domain stewards and ensure enterprise alignment. Ideal Experience: -Product ownership of … data pipelines, platforms, or PaaS. -Familiarity with Azure, Databricks, and enterprise data governance. -Strong understanding of data contracts, DQ KPIs, and metadata standards. -Experience with modern data stacks and cross-functional teams. More ❯

Principal Data Engineer Department: Intel Employment Type: Permanent Location: Newcastle-upon-Tyne Reporting To: Head of Data Description We're looking for a Principal Data Engineer to join the team responsible for delivering trusted, high-quality data products that power decisions across Bede. Reporting to the Head of Data, you … ll be a respected technical authority, owning the design, integrity, and ongoing improvement of our data architecture. You'll set the standard for engineering excellence in your product area, guiding teams on best practices, system health, documentation, and long-term technical direction. This is a high-impact role suited to someone who thrives on solving complex problems, collaborating … across disciplines, and shaping scalable, resilient data platforms. This is a hybrid role that requires you to be in our Newcastle-upon-Tyne office two days a week. Please apply only if you're comfortable with this arrangement. What you'll be doing Core Responsibilities Own and evolve the technical roadmap for the data product area More ❯

of Engineering. You will oversee all aspects of the engineering lifecycle, from technology design and architecture through to implementation and optimisation. You'll work closely with cloud architects, data scientists, and risk officers to deliver a robust, scalable, and compliant platform that meets the bank's risk and regulatory needs. The role will shape the Lab vision, set … and demonstrate technical leadership across the lifecycle from idea to value realisation. About us Like the modern Britain we serve, we're evolving. Investing billions in our people, data and tech to transform how we meet the changing needs of our 26 million customers. We're growing with purpose. Join us on our journey and you will too … What you'll do Lead the engineering team responsible for end-to-end infrastructure and technology transformation, including legacy decommissioning and GCP-based data infrastructure. Provide technical direction and mentorship, fostering collaboration, innovation, and continuous improvement. Design scalable, high-performance cloud infrastructure on GCP, ensuring availability, resilience, security, and compliance. Implement Infrastructure-as-Code (IaC) using tools like More ❯

of Engineering. You will oversee all aspects of the engineering lifecycle, from technology design and architecture through to implementation and optimisation. You'll work closely with cloud architects, data scientists, and risk officers to deliver a robust, scalable, and compliant platform that meets the bank's risk and regulatory needs. The role will shape the Lab vision, set … and demonstrate technical leadership across the lifecycle from idea to value realisation. About us Like the modern Britain we serve, we're evolving. Investing billions in our people, data and tech to transform how we meet the changing needs of our 26 million customers. We're growing with purpose. Join us on our journey and you will too … What you'll do Lead the engineering team responsible for end-to-end infrastructure and technology transformation, including legacy decommissioning and GCP-based data infrastructure. Provide technical direction and mentorship, fostering collaboration, innovation, and continuous improvement. Design scalable, high-performance cloud infrastructure on GCP, ensuring availability, resilience, security, and compliance. Implement Infrastructure-as-Code (IaC) using tools like More ❯

The Role We are looking for a hands-on Azure Data Engineer who will lead the final phase of our Client's cloud migration and design the enterprise-grade data platform from the ground up. This is a hybrid role with a strong technical focus—blending architecture, automation, and data engineering—to empower s … across Europe, the US, and APAC. As they scale globally and accelerate their AI capabilities, they are completing their transition to the cloud and building a company-wide data platform to power insight-driven transformation for their consultants and clients Required Skills & Experience Must-Haves: 3+ years of hands-on Azure engineering experience (IaaS PaaS), including Infra as … Code. Strong SQL skills and proficiency in Python or PySpark . Built or maintained data lakes/warehouses using Synapse , Fabric , Databricks , Snowflake , or Redshift . Experience hardening cloud environments (NSGs, identity, Defender). Demonstrated automation of backups, CI/CD deployments, or DR workflows. Nice-to-Haves: Experience with Azure OpenAI , vector databases, or LLM integrations. Power More ❯

Outside IR35) London (3 days/week on-site) 6-month initial contract The Role A major logistics business is undergoing a full rebuild of its legacy, siloed data estate - and we're hiring an experienced Analytics Engineer to help drive the transformation. You'll join a newly formed data team under a new Head of … Data, working on a clean-slate Azure-based platform. The role bridges data engineering and analytics, focused on building scalable data models, automated pipelines, and enabling self-serve analytics across the organisation. Key Responsibilities Build and maintain scalable data pipelines using Azure Data Factory and Databricks Develop transformation workflows in … dbt, SQL, and Python Design dimensional models and semantic layers to support analytics use cases Implement automated data quality checks, monitoring, and alerting systems Create reusable data assets and documentation to support self-serve analytics via Power BI Work with analysts and business stakeholders to translate requirements into technical solutions Maintain clean, version-controlled codebases and More ❯

Data Products Engineer Aon is looking to welcome a Back End Engineer - Data APIs & Insights to our growing technology team. In this role, you'll help build and scale the data infrastructure and APIs that power our market intelligence products-serving high-value insights to clients across enterprise web applications. This is a hybrid … passionate about helping our colleagues and clients succeed. What the day will look like The main responsibilities will include: Design and develop modern APIs that serve both raw data and AI-generated insights to our suite of client-facing web applications. Build and optimise performant data pipelines using Polars, FastAPI, and Python, ensuring fast response times … building elegant, scalable, and performant back-end systems, with a track record of delivering robust APIs that enable dynamic React front ends and unlock the full value of data and AI-driven insights. Behind every insight we deliver is a fast, reliable, and intelligent API infrastructure-designed to serve curated data and machine-generated intelligence in More ❯

actively including and empowering our people. Above all, we are purpose-driven, committed to positively impacting our people, the planet, and our global communities. We are investing in data, technology and analytics as a strategic priority. The team brings together a number of capabilities that sit within different parts of Croud, into one unit that will drive cutting … edge development in a number of critical areas for the business. The role sits within the Data Engineering team and reports to the Head of Data Engineering. The team's remit is to drive innovation & revenue through the development & delivery of revenue-generating/client-facing data engineering solutions used across the agency. The … Data Engineer will be part of a growing team that delivers highly impactful data solutions across our extensive client portfolio and also the agency's own product offerings. We seek individuals who are proactive, self-starters with a meticulous eye for detail, and who can communicate clearly and effectively across our diverse internal and external stakeholders. More ❯

actively including and empowering our people. Above all, we are purpose-driven, committed to positively impacting our people, the planet, and our global communities. We are investing in data, technology and analytics as a strategic priority. The team brings together a number of capabilities that sit within different parts of Croud, into one unit that will drive cutting … edge development in a number of critical areas for the business. The role sits within the Data Engineering team and reports to the Head of Data Engineering. The team's remit is to drive innovation & revenue through the development & delivery of revenue-generating/client-facing data engineering solutions used across the agency. The … Data Engineer will be part of a growing team that delivers highly impactful data solutions across our extensive client portfolio and also the agency's own product offerings. We seek individuals who are proactive, self-starters with a meticulous eye for detail, and who can communicate clearly and effectively across our diverse internal and external stakeholders. More ❯

Job Title: Data Engineer/Software Engineer - AI/ML Research Location: London- UK (Hybrid role) Duration: Contract- Until Dec 25 with a possible extension About the Role We are seeking a Data Engineer/Software Engineer to support a pioneering project focused on LLM agents for research . You will play a key role in … results to original datasets, repackage them, and support re-ingestion workflows. Collaborate with cross-functional teams to ensure data readiness and quality. Contribute to system design and pipeline automation efforts. Build and maintain Python-based data pipelines. Engage in technical discussions with researchers and stakeholders. Execute data mitigation and filtering tasks with minimal … enable LLM agents to process and manage data automatically. Required Skills & Qualifications Solid background in data engineering or software engineering . Proficient in Python and pipeline development . Experience with data cleaning, transformation, and validation . Understanding of modern data storage systems and formats. Strong communication and collaboration skills. Prior work More ❯

manager of growing and building high-performing engineers, teams, and processes. Have good MarTech domain knowledge, with an understanding of the advertising ecosystem, including product catalogues, ad conversion data, targeting and measurement, as well as the changing privacy and compliance landscape. Have a data engineering background, or working experience with data technologies such as … and track record of delivery. You get huge satisfaction from tackling complex and ambitious problems, and delivering the highest quality features. Strong decision making skills, based on the data available in the face of ambiguous or changing priorities and goals, with preference towards simplicity and a strong bias towards delivery. Strong stakeholder management skills, able to collaborate with … points if: You are familiar with any one of the following technologies : Scala, Python Swift ( iOS), React or Typescript. You are familiar with observability, tracking and data pipeline tools and methodologies Additional Information Health + Mental Wellbeing PMI and cash plan healthcare access with Bupa Subsidised counselling and coaching with Self Space Cycle to Work scheme with More ❯

Eden Scott is recruiting a Senior Data Engineer for Amici to develop a cutting-edge platform. As the business looks to the future, we are now seeking an experienced Senior Data Engineer for our data team. This is a permanent, full-time position. You'll work in an agile, collaborative environment, leveraging modern technology … stacks to build and optimize a powerful data platform and search engine. With an opportunity to explore vector search, machine learning, and large-scale data processing using Apache Lucene, Solr, or Elasticsearch. What you'll be doing: Design, build, and optimize a high-performance data platform and search solution. Develop robust search capabilities using … Apache Lucene, Solr, or Elasticsearch. Engineer scalable data pipelines in Java or Python. Write high-quality, test-driven code using Agile methodologies. Collaborate with Business Analysts, Data Engineers, and UI Developers. Work across the full stack, from React/TypeScript front-end to Java-based search services. Leverage cloud technologies like Azure Data Factory More ❯

trends and their impact on utilities to support our GridOS deployments and connect customers with the respective products and solutions. As a "Services Engineer - GridOS", you will implement data models and configuration for electrical network systems, ensuring data accuracy and accessibility through collaboration with cross-functional teams. This role is expected to deliver, develop and tailor … GridOS modules to fit the customer needs. This role requires a good understanding of electrical network data structures, GIS technologies and SCADA/ADMS system. GridOS is a comprehensive software portfolio developed by GE Electrification Software to modernize and transform the electric grid into a smart and clean energy grid. It is an advanced and scalable energy management … system that transforms real-time data into actionable insights and provides utilities with advanced tools to manage the increasing complexity of energy systems. By integrating energy data, network modeling, and AI/ML-driven analytics, GridOS aims to enhance grid reliability, resilience, and efficiency, even in severe weather conditions. By integrating an Advanced Distribution Management System More ❯

Data Engineer Location: Burnley, Lancashire Contract: Permanent - 37.5 hours per week Hybrid (2 days a week in office) Salary: £50-55,000 + performance bonuses + great benefits Are you a passionate Data Engineer looking to work on meaningful projects that make a difference to the environment? Fancy joining a friendly, inclusive team where your ideas … and growing organisation thats been a pioneer in water network monitoring for over 20 years. As the sector steps up to meet new environmental challenges, the demand for data-driven solutions is growing fast - and this team is at the forefront of it all. If youre excited by working with large, complex datasets, building scalable data pipelines, and helping to solve real-world problems, wed love to hear from you. What youll be doing: Designing and building pipelines in the data platform, with automation, quality and resilience at the core. Supporting the development of a scalable data architecture and engineering roadmap. Helping colleagues across the business solve data More ❯

Role Overview: We are currently looking for a Data Team Lead to head our data operations and strategy.This is a hands-on leadership role responsible for managing a small but growing data team, ensuring the delivery of high-quality data infrastructure, reporting, and business intelligence tools to support cross-functional goals.The ideal … candidate will have a strong technical background, experience in team management, and the ability to align data processes with business objectives. Key Responsibilities: Lead and develop the internal data team, including hiring, mentoring, and performance management Build and maintain scalable data pipelines, storage solutions, and reporting dashboards Ensure data accuracy, quality, governance … and compliance with relevant standards Translate business needs into technical requirements and data-driven solutions Collaborate with marketing, product, and executive teams to support decision-making Monitor performance metrics and proactively identify areas for optimisation Own and refine the company's data strategy, aligned with broader business goals Requirements: Minimum 5 years of experience in data More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯