526 to 550 of 1,617 Data Pipeline Jobs in the UK

Data Engineer - Databricks - Oxfordshire (Hybrid) - Azure - Python - SQL - Up to £60,000 We're partnering with a growing professional services organisation that plays a critical role in delivering large-scale infrastructure, engineering and environmental projects across the UK. As the business continues to invest heavily in technology … innovation, data is becoming increasingly central to how decisions are made and services are delivered. This is an exciting opportunity to join a developing Data & Innovation function where you'll have genuine influence over the evolution of the company's data platform. Rather than ...

This role is a strategic leadership position responsible for transforming vendor management into a data‐driven, digitally enabled function. The Senior Manager will own the design and execution of automation, data architecture, and advanced analytics initiatives to enhance commercial visibility, operational scalability and decision‐making across … vendor ecosystem. The position requires a combination of vendor management domain expertise, strong data and systems capability, and the ability to lead cross‐functional digital transformation initiatives at a regional or global level. Key Responsibilities Digital Strategy and Transformation Leadership Define and execute the digital transformation roadmap ...

tool/context integration (including emerging protocols such as MCP) Define and enforce responsible AI, governance, and assurance frameworks - covering bias, safety, data privacy, and model risk - aligned to client and regulatory requirements Lead and mentor a team of AI engineers and architects, building technical capability and clear … sales support, and stakeholder management at senior client level Strong software engineering fundamentals: API design, cloud-native architecture, microservices, and data pipeline/data engineering experience Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent professional experience; an advanced degree ...

company queries directly. You\'ll lead the team that owns the project end-to-end — staging, intermediates, and marts — plus the CI/CD pipeline and Snowflake platform underneath it. This is a technical leadership role, not a heads-down modelling one — most of your time goes to architecture … business with high-cardinality partner/catalogue data. Experience building or supporting AI/LLM-facing data products — a chatbot, a RAG pipeline, an agent with database access. Experience with GitHub Actions-based CI/CD for data pipelines. Good To Know: TodayTix Group takes ...

LEAD DATA ENGINEER (Azure) Uo to £75,000 + Benefits London (Hybrid) This is a fantastic opportunity to join one of the UK's most recognisable cultural organisations as they embark on a major data transformation programme. You'll take ownership of building a modern data platform from the ground up, driving best practice across data engineering while helping the organisation unlock the full value of its data and AI ambitions. THE COMPANY: Part of a renowned charitable organisation that entertains millions across the UK, this is the largest publicly ...

Data Engineering Consultant | Knutsford (Hybrid) RED now has a new contract opportunity for an AWS Data Engineering Consultant to join one of our key partners on a strategic Cloud Data Platform & Analytics Programme. This contract is to start ASAP and will be hybrid, with … days per week onsite in Knutsford, UK. Specific skills/experience required: Strong hands-on experience with AWS data services including S3, Glue, Lambda, Redshift, Athena, EMR and DynamoDB Proven experience designing, implementing and troubleshooting enterprise-scale data pipelines Strong expertise in ETL/ELT frameworks ...

experienced Data Engineer looking for more than simply delivering another backlog of tickets, this could be an opportunity to have genuine influence over the technology, the solution and the direction of major National Security programmes. We’re working with a highly regarded specialist technology consultancy operating across Data … reputation for technical excellence and is winning significant programmes against much larger organisations. As part of continued growth, they are looking for experienced Data Engineer (with current UK security clearance) to play a key role in designing and delivering complex data solutions. Our client is open ...

Cyber Data Engineer | 6 Month Contract | (Inside IR35) | Hybrid, 2-3days pw Reading | Starting ASAP Day Rate: £600 About the role: This role will support the technical delivery of cyber metrics by establishing reliable data pipelines, transforming source data and enabling automated … repeatable reporting. The role will help ensure cyber metrics are based on trusted, accessible and well-managed data rather than manual collection and spreadsheet-based processes. You will: Identify, onboard and integrate cyber security data sources. Design, build and maintain automated data pipelines ...

Cyber Data Engineer | 6 Month Contract | (Inside IR35) | Hybrid, 2-3days pw Reading | Starting ASAP Day Rate: £600 About the role: This role will support the technical delivery of cyber metrics by establishing reliable data pipelines, transforming source data and enabling automated … repeatable reporting. The role will help ensure cyber metrics are based on trusted, accessible and well-managed data rather than manual collection and spreadsheet-based processes. You will: Identify, onboard and integrate cyber security data sources. Design, build and maintain automated data pipelines ...

Python & SQL experience Hands-on Azure Databricks, Delta Lake & Unity Catalog Strong GCP/BigQuery/GCS experience Apache Airflow/Cloud Composer for pipeline orchestration Experience building ELT/data pipelines and cross-cloud data transfers Understanding of IAM, RBAC, secrets management and data governance Experience with data quality, monitoring and pipeline observability Git and ideally Terraform/IaC Experience with knowledge graphs (e.g. Stardog, Amazon Neptune) and/or pharma/life sciences data environments would be highly desirable. This is a great opportunity to work ...

Arctal, a London-based startup, is seeking a full-time in-office data engineer to own data … wrangling end-to-end: ingestion, cleanup, storage, transformation and distribution of large financial datasets from PDFs. You'll architect a scalable data pipeline, integrate AI agents, and ensure data quality so that datasets inform millions of dollars in decisions. 3–5 years building data ...

Encord is the universal data layer for AI that helps 300+ AI teams train and run models on the right data. Our platform indexes, curates, annotates, and evaluates data across the full AI lifecycle, from development through production. Trusted by Woven by Toyota, AXA, UiPath, Zipline … Engineering, Solutions Architecture, or Technical Account Management Proficiency in Python, with the ability to write clean, production‐quality scripts for data ingestion, pipeline automation, API integrations, and custom tooling; experience with REST APIs and SDKs is strongly preferred Hands‐on experience with at least one major cloud ...

Senior Data Engineer (Snowflake) Permanent | Hybrid (London - 2 days a week in the office) Salary £70,000 to £90,000 + bonus We're supporting a leading UK Wealth Management organisation as they continue a significant transformation of their Data & AI capability. As part of this … journey, they're looking to hire two Senior Data Engineers to join a high-profile Portfolio Suitability programme, one of the most strategically important initiatives within the business over the next two years. This is a highly visible, regulatory-driven programme that will influence how the organisation serves ...

party data lands through Snowpark-deployed Python procedures. All infrastructure is defined in Terraform/Terragrunt. Python (Poetry, Pydantic, pytest) is our pipeline language; GitHub Actions runs CI/CD. Datadog gives us end-to-end pipeline observability. Key Responsibilities Event Pipeline Ownership: Build … without breaking downstream consumers. Infrastructure & Reliability Infrastructure as Code: Own and extend Terraform/Terragrunt modules for ingestion infrastructure across multiple environments. Pipeline Observability: Design Datadog monitors and alerting for Firehose, EventBridge, DLQs and Snowpipe; triage and resolve ingestion failures. Security & Compliance: Manage PII handling (hashing, secure ...

go. Join EY and help to build a better working world. We are looking for a seasoned product leader to build and scale data products that power differentiated insights across Strategy and Transactions (SaT). This role sits at the intersection of product management, data, and deal delivery—owning the end-to-end lifecycle of SaT data assets (benchmarks, KPIs, insights) from strategy through execution and adoption. You will transform fragmented engagement data into high-quality, reusable data products that drive better, faster, and more defensible client ...

Octopus Electric Vehicles we’ve built a data platform that provides data services to all areas of our business. Key Responsibilities Own and optimise our platform architecture (improve reliability, scalability, maintainability, etc) Shape the direction of our growing team and coach team members on best practices. … outputs and raising the technical bar of the organization without losing touch with hands-on engineering Interact with Senior Leadership to present your data projects back to them Build new data sources and data pipelines that deliver key data and insights ...

About Unifeye Unifeye is a delivery-led, Databricks first consultancy helping organisations unlock the full value of their data and AI. We're a lean, high growth team based in London, working at the intersection of data, technology and business strategy. We partner with enterprise organisations … across industries to solve complex data challenges through modern Lakehouse architectures on Databricks. Joining Unifeye means more than delivering projects. From day one, you'll be trusted to take ownership, challenge conventional thinking and make a genuine impact. With a high degree of autonomy, you'll help shape ...

massive impact Build and own the training framework responsible for large-scale LLM training Design distributed training abstractions (data/tensor/pipeline parallelism, FSDP/ZeRO strategies, memory management, checkpointing) Improve training throughput and stability on multi-node clusters (e.g., GB200/300, AMD, H200/… build tools and systems that directly accelerate research and model quality Sample Projects: Build a high-performance data loading and caching pipeline Implement performance profiling across the ML systems stack Develop internal metrics and monitoring for training runs Build reproducibility and regression testing infrastructure Develop a performant ...

accelerating chemical discovery to improve quality of life and extend the reach of humanity. The Role Everything Chemify does runs on the Unified Data Platform. When a molecule is designed, registered, sourced, synthesised by a robot, tested, and shipped, the platform is what carries it, one canonical identity … containerised workloads in a managed K8s environment. Experience orchestrating pipelines with Dagster, Airflow, Prefect, or similar. Solid grasp of ETL concepts and production‐grade pipeline design. Beneficial Skills Interest in chemistry, life sciences, robotics, or manufacturing. Hands‐on experience with scientific data, chemical, biological, or laboratory. Experience ...

streamers around the world while gaining meaningful experience across a variety of disciplines. What does the team work on? The Revenue Automation and Data team is a key part of Roku's Advertising organization, driving financial automation and data solutions that enable informed decision-making across … look ahead, we're investing in AI-powered capabilities to exponentially scale financial workflows and help non-technical stakeholders translate our diverse data assets into actionable outcomes. What is the role? We are seeking a highly skilled Senior Software Engineer for this hybrid position which bridges software ...

seeking a dedicated and experienced Business Intelligence & Data Engineer to join an established medium-sized business based in the Southampton/Portsmouth area, Hampshire. This is a hybrid role with at least 3 days per week in the office. This BI Engineer role offers an excellent opportunity … work within a forward-thinking environment, focusing on the development and optimisation of data solutions that drive strategic decision-making. The successful candidate will be instrumental in managing and enhancing business intelligence processes, leveraging their expertise to support key organisational insights through advanced data analysis ...

seeking a dedicated and experienced Business Intelligence & Data Engineer to join an established medium-sized business based in the Southampton/Portsmouth area, Hampshire. This is a hybrid role with at least 3 days per week in the office. This BI Engineer role offers an excellent opportunity … work within a forward-thinking environment, focusing on the development and optimisation of data solutions that drive strategic decision-making. The successful candidate will be instrumental in managing and enhancing business intelligence processes, leveraging their expertise to support key organisational insights through advanced data analysis ...

Sydney. About WPP WPP is the trusted growth partner for the world’s leading brands. We unite cutting-edge media intelligence and data solutions, world-class creativity, next-generation production, transformative enterprise solutions and expert strategic counsel in a single company – powered by exceptional talent and our agentic … platform, WPP Open, to help our clients navigate change, capture opportunity and deliver transformational growth. For more information, visit WPP.com. Job Title : Senior Data Platform Enablement Lead Location : London Department : Data Intelligence/Open Intelligence Product & Engineering Role Overview As we scale the rollout of Open ...

monitoring the commercial performance of our algorithmically underwritten insurance business in real time. We’re upgrading the foundation that captures algorithm decision data, moving from database logging to a versioned event stream with purpose-built views for each customer use case. This will unlock faster, more reliable insights … released, as well as stress-test changing market conditions. You’ll have the chance to dive deep into insurance domain modelling problems alongside data engineering. You’ll work in an agile, cross-functional squad close to the people who consume what we build, helping us shape our engineering ...

Senior Azure Data Engineer/Developer Would you like to work for a company making a real difference in the automotive industry? We're looking for a Senior Data Engineer/Developer with strong Python experience to join our Enterprise Data team. … develop and maintain scalable data integrations, pipelines and cloud solutions supporting BI, research and wider business analytics. What you'll be doing Build and maintain Python-based data pipelines, ETL/ELT and integrations Design scalable data solutions using Azure and cloud technologies Develop ...