1,026 to 1,050 of 2,562 Data Pipeline Jobs in the UK

ready to shape the future of data? Matillion is the company behind Maia, the AI Data Automation platform. In the AI economy, demand for data is exploding. Manual data engineering can’t keep up. Maia fixes that by combining 15 years … data expertise with agentic AI to eliminate the manual work that slows data teams down. Organisations like Cisco, DocuSign, and Slack are already using it to deliver real business impact, faster. We started in Manchester and now we’re global - with teams across ...

client is looking for a talented Graduate Data & Platform Engineer to join their IT Data & Platform team, where you'll play a key role in designing, developing and maintaining cutting-edge data solutions within Microsoft Fabric. You'll build and optimise data pipelines, lakehouses and data warehouses, using PySpark, Python, T-SQL and DAX to deliver scalable, high-performing solutions that drive business intelligence and analytics. Working closely with stakeholders across the business, you'll develop robust, secure and well-documented data platforms while embracing ...

client is looking for a talented Graduate Data & Platform Engineer to join their IT Data & Platform team, where you'll play a key role in designing, developing and maintaining cutting-edge data solutions within Microsoft Fabric. You'll build and optimise data pipelines, lakehouses and data warehouses, using PySpark, Python, T-SQL and DAX to deliver scalable, high-performing solutions that drive business intelligence and analytics. Working closely with stakeholders across the business, you'll develop robust, secure and well-documented data platforms while embracing ...

Woven by Toyota is seeking an experienced Autonomy Data Manager to lead a team of data scientists, data engineers and ML engineers. You will shape data strategy, drive data models and ensure production-quality data pipelines ...

Location: London (Hybrid) with occasional client travel Salary: Up to £60,000 We're recruiting for a Data Engineer to join a growing consultancy, delivering production-grade data platforms for some of the UK's leading organisations. This is a client-facing role where … design and build scalable cloud-based data solutions, working with modern technologies including AWS, Databricks and Agentic AI . You'll benefit from structured training, clear career progression and the opportunity to work on complex, enterprise-scale projects. Key Responsibilities Design, build and maintain scalable ETL/ ...

Location: London (Hybrid) with occasional client travel Salary: Up to £60,000 We're recruiting for a Data Engineer to join a growing consultancy, delivering production-grade data platforms for some of the UK's leading organisations. This is a client-facing role where … design and build scalable cloud-based data solutions, working with modern technologies including AWS, Databricks and Agentic AI . You'll benefit from structured training, clear career progression and the opportunity to work on complex, enterprise-scale projects. Key Responsibilities Design, build and maintain scalable ETL/ ...

Project description This is a strategic data engineering engagement with our client to architect and plan the migration of their entire data processing and ETL estate from Matillion to AWS Glue — a foundational shift in how one of the world's largest financial market infrastructure companies … handles its data pipelines. During this Mobilisation Phase, you'll work jointly with engineering teams to reverse-engineer the existing landscape, design the target-state architecture across every layer (infrastructure, data processing, workflows, dependencies, and operating model), and build the detailed delivery blueprint that will greenlight ...

currently seeking a Data Engineer to build, maintain, and optimise robust data pipelines. This role develops efficient ETL/ELT workflows using both Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics. Role Requirements Strong proficiency … handling Delta Lake formats Hands-on experience building production pipelines inside Databricks workspaces and Fabric capacities Practical knowledge of structural data formats including Parquet, JSON, and CSV Experience with orchestration tools, scheduling dependencies, and error handling in a cloud environment Familiarity with unit testing data pipelines ...

Design, build and enhance modern data engineering and AI solutions for clients, focusing on hands-on delivery across Azure, Microsoft Fabric and related Microsoft data platform services Develop data pipelines, transformations, semantic models and reporting solutions using SQL, Python, Power BI and Fabric Ensure … handover Follow agreed standards for quality, security and maintainability Work with clients and internal colleagues to understand requirements and translate business needs into data and AI solutions Communicate technical decisions and trade-offs clearly Prepare and maintain technical documentation, design artefacts and delivery updates Support implementation, governance ...

seeking an inquisitive and impact-driven Data Scientist to join our Analytics team. In this role, you won't just build models—you will translate complex, unstructured data into actionable strategic directions that drive our core business forward. You will partner closely with Product, Engineering, Marketing … Learning: Build, validate, and maintain scalable predictive models (e.g., churn, forecasting, customer lifetime value (CLV) and user segmentation) to guide business decisions. Exploratory Data Analysis: Deep dive into large, complex datasets to identify trends, user behavioral patterns, operational bottlenecks, and unexpected growth opportunities. Features Definition & Measurement: Establish ...

Location: Hybrid – London As a Senior Forward Deployed Engineering - Architect you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks platform. You will own the architecture, lead design decisions, and implement end-to-end systems spanning data engineering … will have: Production Solution Delivery: Lead impactful customer technical projects by delivering production-grade systems, designing and building reference architectures, custom applications and data ingestion and ML/AI model integration Transformational Impact: Guide strategic customers as they implement transformational big data projects including ...

make an impactBuild systems for training, deploying and monitoring machine learning models used in our Disputes platform, at scaleBuild and optimize data pipelines and backend services to process dispute and payment data in real timeBuild and scale our feature store for use-cases both online … complete ownership of delivering comprehensive, end-to-end features within a startup-like setting, driving the entire lifecycle from requirement refinement, data pipeline construction and model training to troubleshooting and production deploymentTurn raw data into production-ready features that feed our dispute systemsCollaborate with platform ...

Please note: This is not a live vacancy. We are hiring ahead of demand and building a talent pipeline for upcoming client engagements. By applying, you're expressing interest in future opportunities, and we'll be in touch as soon as a matching role becomes available. About the role … team Hands-on delivery engineers working under the Architect to execute data migrations. Responsible for building and fixing data pipelines, resolving technical debt, and getting platforms to a stable, production-ready state. What you'll be doing Design, build, and optimise data pipelines ...

performance, keeping teams in sync and workflows on track to maximise throughput. Simultaneously our computer vision and AI capabilities capture real-time data and detect surgical events – improving quality of data outputs. The result: ORs are optimised like never before – with predictive analytics and automated notifications … Engineering Own the architecture, quality, and scalability of Proximie’s data platform. Lead the team building and maintaining ETL/ELT pipelines, data warehousing, and analytics infrastructure. Set engineering standards, tooling decisions, and technical direction across the data stack (Python ...

looking for an RL Environment Data Engineer/Researcher to design, build, and refine reinforcement learning training environments across different domains. This role will focus on data collection, task definition, reward design, evaluation criteria, anti-reward-hacking mechanisms, and post-training validation of environment data effectiveness. Responsibilities - Design and improve RL training environments across various task domains. - Collect, clean, structure, and evaluate data used for RL environment construction and model post-training. - Define task objectives, reward functions, and evaluation standards to ensure reliable and reproducible training signals. - Develop technical approaches ...

Help build the platform at the heart of Retail Insight's data strategy We're looking for a Senior Platform Engineer to join our Data & Engineering team and play a key role in the development and evolution of our Databricks platform. This is a senior, hands … engineering role where you'll design, build and optimise the data platform that powers our products and services. Working alongside Platform, Data and Product teams, you'll help deliver scalable, secure and high-performance data solutions that enable analytics, machine learning and AI across ...

Software Engineer - Finance and Regulatory Reporting Location: London Experience: Junior/Mid Role We're looking for a software engineer to build the data pipelines behind our finance and regulatory reporting. You'll own the flow of trade and position data from our platform through … Linux. Careful, methodical approach to data accuracy. Excellent written and verbal communications skills. Nice to have Experience with data pipeline or workflow orchestration tools. Exposure to financial or regulatory reporting. Familiarity with cloud providers (e.g. AWS, GCP, Azure). Firm Mirae Asset Securities Co., Ltd. ...

Principal Data & AI Consultant – Waracle is a digital technology consultancy. This Hybrid role is based at Dundee, London, or Glasgow , with around 2 days per week in office. Key Aspects of the Role Include Architecture & Vision: Designing, developing, and maintaining robust data pipelines using batch … streaming processing, championing data governance, security, privacy, and legislatory compliance. Acting as a Trusted Advisor: Translating complex business challenges into clear technical roadmaps, communicating with executive stakeholders and non-technical peers. Enabling Innovation: Designing usable data models and building reliable foundations that empower advanced analytics, LLMs ...

made intelligent through a single platform. 1,000s of developers and AI labs build on Terra today. we process 15+ billion health data events per year. and we are just getting started. the health OS health data is fragmented. every device, every app, every sensor speaks … different language. we built the health OS to solve that — a full-stack platform that turns raw, messy, siloed health data into something developers and AIs can reason over, build on, and ship with. Terra was founded in 2021 and operates from London, San Francisco, and South Korea. ...

looking for an experienced Data Platform Architect to own the architecture, design, and evolution of enterprise data platforms. This role combines hands-on technical leadership with system design, architectural governance, and vendor oversight. The ideal candidate would have extensive hands-on experience with modern cloud-native … architecture (AWS preferred); and event-driven paradigms (Kafka). You will define scalable, secure, and resilient data platform architectures, guide implementation by internal teams and external partners, and ensure solutions meet the needs of the business while complying with regulatory and security requirements. Experience operating in regulated industries ...

days a week in the office Duration: 6 months initially You must have strong expertise in designing, architecting, and delivering enterprise-scale data platforms on Google Cloud Platform (GCP). The ideal candidate will have extensive experience with BigQuery, cloud data migration, data warehousing … while working closely with client stakeholders to define architecture and drive successful delivery. Key Responsibilities Design and implement scalable, secure, and high-performance data architectures on GCP, with BigQuery as the core data warehouse. Define end-to-end data architecture, including ingestion, transformation, storage ...

days a week in the office Duration: 6 months initially You must have strong expertise in designing, architecting, and delivering enterprise-scale data platforms on Google Cloud Platform (GCP). The ideal candidate will have extensive experience with BigQuery, cloud data migration, data warehousing … while working closely with client stakeholders to define architecture and drive successful delivery. Key Responsibilities Design and implement scalable, secure, and high-performance data architectures on GCP, with BigQuery as the core data warehouse. Define end-to-end data architecture, including ingestion, transformation, storage ...

IDAs a Forward Deployed Engineer (FDE) you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks platform. You will own the architecture, lead design decisions, and implement end-to-end systems spanning data engineering, AI, and application development. … will have: Production Solution Delivery: Lead impactful customer technical projects by delivering production-grade systems, designing and building reference architectures, custom applications and data ingestion and ML/AI model integrationTransformational Impact: Guide strategic customers as they implement transformational big data projects including ...

Goldman Sachs is seeking an Associate in Data Strategy and Analytics (DSA) for the Internal Audit function. You will design and implement production-grade data pipelines and data products, using Python (Pandas, Polars, PySpark), SQL, and modern data-lake architectures to support … third-line risks. You will collaborate with audit teams and data owners to source, transform and curate data, ensure data quality, and deliver reusable solutions with clear documentation and governance across Snowflake, #J-18808-Ljbffr ...

households, putting us in a unique position to drive the transformation of the household services sector. We harness cutting‐edge tech and data to help consumers manage their homes more effectively, and we provide some of the UK’s biggest companies with unparalleled insight into what customers need … Experience/Familiarity with AWS Multi Accounts system designs, tools like Crossplane and Control Tower. Familiarity with Argo Workflows or similar data pipeline as a service tools. Familiarity working with a variety of Cloud Native projects. Familiarity with Github Action. Familiarity with OpenTelemetry. More about ...