501 to 525 of 925 Data Pipeline Jobs in the UK

Outside IR35) London (3 days/week on-site) 6-month initial contract The Role A major logistics business is undergoing a full rebuild of its legacy, siloed data estate - and we're hiring an experienced Analytics Engineer to help drive the transformation. You'll join a newly formed data team under a new Head of … Data, working on a clean-slate Azure-based platform. The role bridges data engineering and analytics, focused on building scalable data models, automated pipelines, and enabling self-serve analytics across the organisation. Key Responsibilities Build and maintain scalable data pipelines using Azure Data Factory and Databricks Develop transformation workflows in … dbt, SQL, and Python Design dimensional models and semantic layers to support analytics use cases Implement automated data quality checks, monitoring, and alerting systems Create reusable data assets and documentation to support self-serve analytics via Power BI Work with analysts and business stakeholders to translate requirements into technical solutions Maintain clean, version-controlled codebases and More ❯

Data Products Engineer Aon is looking to welcome a Back End Engineer - Data APIs & Insights to our growing technology team. In this role, you'll help build and scale the data infrastructure and APIs that power our market intelligence products-serving high-value insights to clients across enterprise web applications. This is a hybrid … passionate about helping our colleagues and clients succeed. What the day will look like The main responsibilities will include: Design and develop modern APIs that serve both raw data and AI-generated insights to our suite of client-facing web applications. Build and optimise performant data pipelines using Polars, FastAPI, and Python, ensuring fast response times … building elegant, scalable, and performant back-end systems, with a track record of delivering robust APIs that enable dynamic React front ends and unlock the full value of data and AI-driven insights. Behind every insight we deliver is a fast, reliable, and intelligent API infrastructure-designed to serve curated data and machine-generated intelligence in More ❯

actively including and empowering our people. Above all, we are purpose-driven, committed to positively impacting our people, the planet, and our global communities. We are investing in data, technology and analytics as a strategic priority. The team brings together a number of capabilities that sit within different parts of Croud, into one unit that will drive cutting … edge development in a number of critical areas for the business. The role sits within the Data Engineering team and reports to the Head of Data Engineering. The team's remit is to drive innovation & revenue through the development & delivery of revenue-generating/client-facing data engineering solutions used across the agency. The … Data Engineer will be part of a growing team that delivers highly impactful data solutions across our extensive client portfolio and also the agency's own product offerings. We seek individuals who are proactive, self-starters with a meticulous eye for detail, and who can communicate clearly and effectively across our diverse internal and external stakeholders. More ❯

actively including and empowering our people. Above all, we are purpose-driven, committed to positively impacting our people, the planet, and our global communities. We are investing in data, technology and analytics as a strategic priority. The team brings together a number of capabilities that sit within different parts of Croud, into one unit that will drive cutting … edge development in a number of critical areas for the business. The role sits within the Data Engineering team and reports to the Head of Data Engineering. The team's remit is to drive innovation & revenue through the development & delivery of revenue-generating/client-facing data engineering solutions used across the agency. The … Data Engineer will be part of a growing team that delivers highly impactful data solutions across our extensive client portfolio and also the agency's own product offerings. We seek individuals who are proactive, self-starters with a meticulous eye for detail, and who can communicate clearly and effectively across our diverse internal and external stakeholders. More ❯

Job Title: Data Engineer/Software Engineer - AI/ML Research Location: London- UK (Hybrid role) Duration: Contract- Until Dec 25 with a possible extension About the Role We are seeking a Data Engineer/Software Engineer to support a pioneering project focused on LLM agents for research . You will play a key role in … results to original datasets, repackage them, and support re-ingestion workflows. Collaborate with cross-functional teams to ensure data readiness and quality. Contribute to system design and pipeline automation efforts. Build and maintain Python-based data pipelines. Engage in technical discussions with researchers and stakeholders. Execute data mitigation and filtering tasks with minimal … enable LLM agents to process and manage data automatically. Required Skills & Qualifications Solid background in data engineering or software engineering . Proficient in Python and pipeline development . Experience with data cleaning, transformation, and validation . Understanding of modern data storage systems and formats. Strong communication and collaboration skills. Prior work More ❯

manager of growing and building high-performing engineers, teams, and processes. Have good MarTech domain knowledge, with an understanding of the advertising ecosystem, including product catalogues, ad conversion data, targeting and measurement, as well as the changing privacy and compliance landscape. Have a data engineering background, or working experience with data technologies such as … and track record of delivery. You get huge satisfaction from tackling complex and ambitious problems, and delivering the highest quality features. Strong decision making skills, based on the data available in the face of ambiguous or changing priorities and goals, with preference towards simplicity and a strong bias towards delivery. Strong stakeholder management skills, able to collaborate with … points if: You are familiar with any one of the following technologies : Scala, Python Swift ( iOS), React or Typescript. You are familiar with observability, tracking and data pipeline tools and methodologies Additional Information Health + Mental Wellbeing PMI and cash plan healthcare access with Bupa Subsidised counselling and coaching with Self Space Cycle to Work scheme with More ❯

Eden Scott is recruiting a Senior Data Engineer for Amici to develop a cutting-edge platform. As the business looks to the future, we are now seeking an experienced Senior Data Engineer for our data team. This is a permanent, full-time position. You'll work in an agile, collaborative environment, leveraging modern technology … stacks to build and optimize a powerful data platform and search engine. With an opportunity to explore vector search, machine learning, and large-scale data processing using Apache Lucene, Solr, or Elasticsearch. What you'll be doing: Design, build, and optimize a high-performance data platform and search solution. Develop robust search capabilities using … Apache Lucene, Solr, or Elasticsearch. Engineer scalable data pipelines in Java or Python. Write high-quality, test-driven code using Agile methodologies. Collaborate with Business Analysts, Data Engineers, and UI Developers. Work across the full stack, from React/TypeScript front-end to Java-based search services. Leverage cloud technologies like Azure Data Factory More ❯

trends and their impact on utilities to support our GridOS deployments and connect customers with the respective products and solutions. As a "Services Engineer - GridOS", you will implement data models and configuration for electrical network systems, ensuring data accuracy and accessibility through collaboration with cross-functional teams. This role is expected to deliver, develop and tailor … GridOS modules to fit the customer needs. This role requires a good understanding of electrical network data structures, GIS technologies and SCADA/ADMS system. GridOS is a comprehensive software portfolio developed by GE Electrification Software to modernize and transform the electric grid into a smart and clean energy grid. It is an advanced and scalable energy management … system that transforms real-time data into actionable insights and provides utilities with advanced tools to manage the increasing complexity of energy systems. By integrating energy data, network modeling, and AI/ML-driven analytics, GridOS aims to enhance grid reliability, resilience, and efficiency, even in severe weather conditions. By integrating an Advanced Distribution Management System More ❯

Data Engineer Location: Burnley, Lancashire Contract: Permanent - 37.5 hours per week Hybrid (2 days a week in office) Salary: £50-55,000 + performance bonuses + great benefits Are you a passionate Data Engineer looking to work on meaningful projects that make a difference to the environment? Fancy joining a friendly, inclusive team where your ideas … and growing organisation thats been a pioneer in water network monitoring for over 20 years. As the sector steps up to meet new environmental challenges, the demand for data-driven solutions is growing fast - and this team is at the forefront of it all. If youre excited by working with large, complex datasets, building scalable data pipelines, and helping to solve real-world problems, wed love to hear from you. What youll be doing: Designing and building pipelines in the data platform, with automation, quality and resilience at the core. Supporting the development of a scalable data architecture and engineering roadmap. Helping colleagues across the business solve data More ❯

Role Overview: We are currently looking for a Data Team Lead to head our data operations and strategy.This is a hands-on leadership role responsible for managing a small but growing data team, ensuring the delivery of high-quality data infrastructure, reporting, and business intelligence tools to support cross-functional goals.The ideal … candidate will have a strong technical background, experience in team management, and the ability to align data processes with business objectives. Key Responsibilities: Lead and develop the internal data team, including hiring, mentoring, and performance management Build and maintain scalable data pipelines, storage solutions, and reporting dashboards Ensure data accuracy, quality, governance … and compliance with relevant standards Translate business needs into technical requirements and data-driven solutions Collaborate with marketing, product, and executive teams to support decision-making Monitor performance metrics and proactively identify areas for optimisation Own and refine the company's data strategy, aligned with broader business goals Requirements: Minimum 5 years of experience in data More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

Our client, within the education sector in central London, is seeking an experienced Head of Data to join their IT leadership team. In this pivotal role, you will oversee the day-to-day management and advancement of the data function, driving the development and operation of a comprehensive suite of dashboards and reports. You’ll also … help define the technical strategy for data and analytics, crafting a compelling transformational roadmap and storytelling to secure buy-in from stakeholders. Key Responsibilities Lead and mentor a team of data professionals responsible for dashboards, reports, and data pipelines Oversee the end-to-end development, deployment, and maintenance of data dashboards and … Manage all statutory external returns processes ensuring accuracy and timeliness Collaborate with academic, administrative, and executive stakeholders to translate requirements into actionable insights Drive technical strategic thinking around data architecture, platforms, and governance Develop and present a transformational roadmap for the data function, securing buy-in through clear business storytelling Champion best practices in data More ❯

Regional Business Intelligence Manager, DCSS Communities Job ID: Amazon Data Services Ireland Limited Our team is looking for a Regional Business Intelligence Manager to work with various stakeholder groups to procure data center capacity, support long term scaling strategies for AWS's infrastructure regions, and manage a portfolio of critical infrastructure agreements. As the Regional Business … Intelligence Manager, you will research and manage all areas of transaction deal flow related to data center procurement projects in the region, for both Colocation and Real Estate. Our Business Intelligence Managers are: • strategically oriented individuals with strong data analysis and communication skills • working within an ambiguous environment • possess a strong sense of ownership, • adept at … taking calculated risks in order to act quickly, • organized and have program and project management skills • data driven with a passion for continuous improvement. • directly connecting with senior leaders and key vendors Key job responsibilities • Leverage advantage data science skills to prepare transaction business case, forecast project costs and partner with internal teams to submit business More ❯

McDonald's is on an exciting journey to revolutionize our observability and AIOps capabilities. Our mission is to transform data into actionable insights and drive operational excellence across our organization. We are seeking a dedicated team member who will play a pivotal role in bridging the gap between our technology stakeholders and the observability and AIOps teams. In … to enhance the efficiency of IT operations. Monitoring and Maintenance : Utilize AIOps tools to monitor systems, detect anomalies, and predict potential issues before they impact operations. Data Pipeline Management : Develop and maintain ETL pipelines within Cribl to ensure data collection and processing. Collaboration : Work closely with development, operations, and observability teams to integrate AI solutions More ❯

give senior leaders and service managers the insight they need to manage performance and track delivery against key metrics. Experience working with SEND, Education or Children's Services data in Local Government is highly desirable. Key Responsibilities: Design and build interactive Power BI dashboards and reports Translate performance and reporting needs into clear technical solutions Connect and integrate … data from multiple sources (Capita, SQL Server, Excel, SharePoint, APIs) Build efficient, scalable data models (e.g. star schema) Define and embed KPIs in collaboration with the Data Group, SEND Business Analyst, and Head of Service Schedule data refreshes and manage gateway configurations Ensure consistency, accuracy, and security of data across … reports Document data sources, transformation logic, and report structures Support and train end-users in using Power BI reports Work with the data and IT teams to improve data pipelines and infrastructure Requirements: Essential: Significant experience developing dashboards and reports using Power BI Strong SQL skills and experience with relational data sources More ❯

to amplify the capabilities of drivers, foster happiness, and elevate well-being. TEAM Our London team is working on accelerating autonomous driving by providing access to petabytes of data collected by our fleet of autonomous and non-autonomous vehicles. Efficient, fast and cost-effective access to data at large scale is key to tackle the hardest … models for perception and prediction of human driving patterns, to increasing the sophistication of our validation and simulation by identifying rare and interesting real-world driving situations. The data ecosystem developed by the London team is a key building block for developing and testing modern AD/ADAS products … that will impact millions of customers. Our ML and Data pipelines are built on-top of the open-source Flyte orchestration framework and are deployed to AWS. Pipeline code is written in Python. We use SQS and Kafka to automate data connections and leverage BigQuery and Elasticsearch for data storage. We believe strongly More ❯

Adobe Real-Time CDP Product Management is part of the Martech function within the Enterprise Marketing Strategy & Demand Generation Centre of Excellence, reporting to the Director of Marketing Data Enablement & Automation. This is a business-facing role embedded in the Marketing organization, and requires close coordination with Corporate Technology counterparts who oversee Martech, Automation, Analytics, Data Architecture, Integrations, and Governance. The CDP product lead partners with campaign teams, analytics, data ops, and IT to operationalize audience-centric marketing through Adobe Experience Platform (AEP), ensuring a unified customer view and activating data across channels. Responsibilities: Lead the strategy, roadmap, and hands-on implementation of Adobe Experience Platform (AEP) Real-Time CDP. … next-generation marketing stack built on first-party data and advanced analytics. Enterprise Visibility: Directly influence how S&P Global uses customer data to drive pipeline, personalization, and compliance. Return to Work: Have you taken time out for caring responsibilities and are now looking to return to work? As part of our Return to Work More ❯

Job Description Role Title: Manager - GenAI Content Supply Chain CL: 7 Practice: Data & AI Location: UK London, Manchester, Birmingham, Edinburgh Reports to: Data & AI Leadership We Are: Accenture Song accelerates growth and value for our clients through sustained customer relevance. Our capabilities span ideation to execution: growth, product and experience design; technology and experience platforms; creative … relationships and deep industry expertise, we help our clients operate at the speed of life through the unlimited potential of imagination, technology and intelligence. Visit us at: The Data & AI team is: The Data and AI revolution is changing everything. It's everywhere - transforming how we work and play. Join Accenture and help transform leading organisations … and communities around the world. Accenture Data and AI is driving these exciting changes and bringing them to life across 40 industries in more than 120 countries. The sheer scale of our capabilities and client engagements and the way we collaborate with the ecosystem, operate and deliver value provides an unparalleled opportunity to grow and advance. Accenture's More ❯

to drive best-in-class instrumentation, analytics enablement, and data integrity across ME+EM’s digital ecosystem. This hybrid role blends frontend engineering (Next.js) with data pipeline integration and management of GTM, ensuring our business can make fast, confident, and data-informed decisions. You are responsible for building and maintaining our digital analytics architecture … Next.js website. Build and standardise event tracking frameworks and reusable utilities within the codebase. Collaborate with Software Engineers to ensure seamless event instrumentation across the entire customer journey. Data Layer & Tag Management: Own and evolve the dataLayer schema to support consistent, scalable tracking across analytics platforms. Align data structure with stakeholder needs across product, engineering, and … marketing, while supporting business-wide measurement frameworks. Maintain and troubleshoot data flows across Google Tag Manager (GTM) and the ME+EM codebase. Identify and resolve tracking issues using browser dev tools, proxy software, and automated validation tools. Platform Integration: Integrate and configure analytics SDKs (GA4, Meta Pixel, Segment, etc.) via code and tag management systems. Contribute to the development More ❯

to drive best-in-class instrumentation, analytics enablement, and data integrity across ME+EM’s digital ecosystem. This hybrid role blends frontend engineering (Next.js) with data pipeline integration and management of GTM, ensuring our business can make fast, confident, and data-informed decisions. You are responsible for building and maintaining our digital analytics architecture … Next.js website. Build and standardise event tracking frameworks and reusable utilities within the codebase. Collaborate with Software Engineers to ensure seamless event instrumentation across the entire customer journey. Data Layer & Tag Management: Own and evolve the dataLayer schema to support consistent, scalable tracking across analytics platforms. Align data structure with stakeholder needs across product, engineering, and … marketing, while supporting business-wide measurement frameworks. Maintain and troubleshoot data flows across Google Tag Manager (GTM) and the ME+EM codebase. Identify and resolve tracking issues using browser dev tools, proxy software, and automated validation tools. Platform Integration: Integrate and configure analytics SDKs (GA4, Meta Pixel, Segment, etc.) via code and tag management systems. Contribute to the development More ❯