151 to 175 of 920 Data Pipeline Jobs in the UK

Staff Data Engineer | AWS | PySpark | Data Modernisation | London | Contract | Inside IR35 We're supporting a global, technology‐led organisation undertaking a large‐scale cloud data transformation programme. This is not a traditional data engineering role. The organisation is modernising hundreds of complex … Python and PySpark Experience with AWS Glue, Apache Spark and Apache Airflow Cloud‐native data engineering architectures Large‐scale data pipeline modernisation Building reusable engineering patterns within enterprise environments Data testing, validation and observability AI‐assisted software development using modern coding assistants Experience ...

working with a consulting client who are looking to grow their Data capability. The client is seeking candidates who have experience with pipeline development, architecture and deployment. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java, plus … exposure to Python, Flink, Kafka, or Spark. Develop and support real-time streaming pipelines and event-driven integrations. Integrate data from multiple sources using AWS managed services Data Architecture & Standards Contribute to data modelling, data architecture best practices, and modern patterns Ensure ...

working with a consulting client who are looking to grow their Data capability. The client is seeking candidates who have experience with pipeline development, architecture and deployment. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java, plus … exposure to Python, Flink, Kafka, or Spark. Develop and support real-time streaming pipelines and event-driven integrations. Integrate data from multiple sources using AWS managed services Data Architecture & Standards Contribute to data modelling, data architecture best practices, and modern patterns Ensure ...

Data Engineer needed in Lincoln Paying £27.95 per hr ref 376144 Full time hours on a temporary basis Key Responsibilities Design, develop, and maintain scalable data pipelines and data integration solutions. Build and optimise ETL/ELT processes to extract data from … various source systems. Develop and maintain data warehouses, data lakes, and cloud-based data platforms. Ensure data quality, accuracy, integrity, and consistency across all data assets. Monitor and troubleshoot data pipelines, resolving performance and reliability issues. Collaborate with ...

Palantir Data Engineer London | Bristol | Manchester | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised as one of Fortune’s World’s Most Admired Companies , delivering some of the most complex and ambitious transformation programmes across Defence, Security, and critical national infrastructure. As investment … data‐driven decision making continues to grow across the Defence and Security sector, the organisation is expanding its Palantir capability to help clients turn complex data into actionable insight at scale. This opportunity is ideally suited to a Palantir Data Engineer with experience across ...

exciting opportunity has arisen for a Data Engineer to join a growing data team and contribute to the development of a modern cloud-based data platform. You'll be responsible for developing scalable data pipelines, integrating multiple data sources … delivering reliable datasets that support analytics, reporting, and operational decision-making across the organisation. Working alongside data engineers, BI specialists, and business stakeholders, you'll play a key role in the ongoing evolution of the company's Azure-based data estate. Key Responsibilities Build and maintain ...

bring your ambition to work every day, which is why, at British Airways the sky is never the limit. The role: Principal Data Engineer You'll be part of either our Data & AI Delivery team or the Commercial data team, acting as a technical … leader for data engineering across the organisation. These teams play a critical role in enabling secure, scalable and high performing data products that underpin data driven decision making across British Airways. What you'll do: Act as a technical leader for data ...

Select how often (in days) to receive an alert: Create Alert Are you ready to define the data architecture that will transform how Novo Nordisk discovers, develops, and delivers life-changing medicines? We are looking for a visionary Lead Data Architect who can define the data foundation that powers AI-driven drug discovery for thousands of R&D professionals and a pipeline touching millions of patients. Your new role As a Lead Data Architect within Research & Development, you will design and implement the data ...

Title: Data Solution Architect Location: Paddington Duration: 6 months possible extension Our client is leveraging the power of data and AI to solve business problems, improve customer experience, and drive commercial value. This is an architecture-led role within the Data Architecture & Design team … helping shape how data solutions are designed, governed, and made supportable across multiple business areas. What you'll be doing: * Provide architecture and design guidance across a portfolio of data projects, ensuring solutions align with platform strategy and future changes * Guide functional design for data ...

right time. The Opportunity Every interaction on Grip's platform — a scan, a meeting, a session attendance, a lead capture, a message — generates data with real commercial value to organisers, exhibitors and attendees. We're at an inflection point where AI makes it possible to turn that … signals) in a privacy-compliant, lawful-basis-aware way Build observability into data systems — structured logging, freshness and quality monitoring, SLOs, and pipeline health dashboards Champion high-quality technical communication: proposals, specifications, and documentation that other teams can build on Mentor engineers across the organisation on data ...

LinkedIn Ads Improve the reliability, scalability and performance of existing data infrastructure Own data quality, monitoring, alerting, documentation and pipeline governance Reduce technical debt and establish engineering best practices that will support future growth Work closely with analytics, marketing and business stakeholders to ensure data … batch data pipelines from scratch Experience integrating APIs from marketing and CRM platforms Strong understanding of data modelling, pipeline reliability and data quality Experience implementing monitoring, alerting and documentation standards Comfortable working as a senior individual contributor in a lean team Someone ...

Title: Snowflake Data Architect Salary: Paying up to £90,000 per annum Location: Wembley London - 5 days on-site Our client, a well-established and diversified multinational organisation, is seeking a Snowflake/Data Architect to join their team. Skills Solid experience in Data … data connectivity. AI Readiness : Practical experience architecting data infrastructure for AI/ML consumption - vector databases, embedding stores, and RAG pipeline integration. Soft Skills: Strong interpersonal skills; ability to translate complex data architecture into clear language for Business Analysts and non-technical stakeholders. ...

Microsoft Fabric Data Engineer IR35: inside, 600pd Location: Remote, occasional travel to client site. Length: 3 months initial, scope for extensions. Are you an experienced Microsoft Data Engineer with experience in Microsoft Fabric? We are seeking a proactive and skilled Microsoft Fabric Data Engineer … PySpark for data manipulation, analysis, and automation, alongside advanced T‐SQL. Performance Optimisation: Experience of monitoring, troubleshooting, and optimising data pipeline and storage performance within Microsoft Fabric. Team Collaboration: Ability to communicate technical concepts clearly and collaborate effectively within a team to ensure data ...

platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Accepting applications until: 7 August 2026 Job Description Your role: Data Engineer A hands-on role building scalable data infrastructure … that powers AI-driven products and audience intelligence. As a Data Engineer at Global, you will: Key Responsibilities • Data Platform & Pipeline Engineering (60%) : Design, build and maintain scalable batch and near real-time pipelines across ingestion, transformation and serving layers. Develop reusable data ...

Business Analytics Lead Drive Data-Driven Manufacturing Excellence We are looking for a Business Analytics Lead to play a pivotal role in transforming operational data into actionable business insight across our Paper Division. Leading a small but highly capable data engineering team, you will … build and develop the OT-to-business data infrastructure that underpins operational analytics, advanced analytics, and strategic decision-making. By connecting manufacturing systems with business platforms, you'll help unlock performance improvements, optimise asset utilisation, and support critical 80/20 business priorities. This is an exciting opportunity ...

Shape the Future with AI & Data We are looking for talented AI/Data Engineers to join a growing technology consultancy delivering innovative data, analytics and AI solutions for enterprise clients. This is an exciting opportunity to work with modern cloud, data and AI technologies, helping organisations unlock value from their data and accelerate digital transformation.Whether your background is in Data Engineering, AI Engineering, or both, you'll have the opportunity to design and build scalable solutions that deliver real business impact. ...

more liquid world. The more we share, the more we all gain. About the role Sharegain is looking for an experienced and driven Data Team Lead to join our R&D organization. In this role, you will lead a team of data engineers while taking hands … ownership of data infrastructure, pipelines, and quality standards. You will play a key role in shaping how data is built, used, and trusted across the company - from our core platform through to analytics and AI-native applications. This is both a technical leadership and people management ...

successful multinational technology business is looking for a Data Reliability Engineer to join its growing data team in Central London. This role is hybrid youll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. Youll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. Youll take ownership of data reliability end-to-end, designing and implementing ...

Staff Data Engineer | AWS | PySpark | Data Modernisation | London | Contract | Inside IR35 We're supporting a global, technology-led organisation undertaking a large-scale cloud data transformation programme. This isn't a traditional Data Engineering role. The organisation is modernising hundreds of complex … roles Python and expert-level PySpark AWS Glue Apache Spark Apache Airflow Cloud-native Data Engineering architectures Large-scale data pipeline modernisation Building reusable engineering patterns within enterprise environments Data testing, validation and observability AI-assisted software development using modern coding assistants Working ...

Contract Data Integration Engineers (Datastage & Azure Data Factory) Remote-first with occasional UK office visits £(Apply online only)/day Outside IR35 6-12 Months Contract We are supporting a major UK organisation undergoing a significant transformation of its data and integration landscape. … part of a large-scale programme of integration projects and future cloud migration initiatives, we are seeking experienced Data Integration Engineers with expertise in either IBM Datastage or Azure Data Factory (ADF) . We currently have five contract opportunities available: 3 x Datastage Engineers ...

Lead Data Engineer £80,000 - £85,000 + Benefits Hampshire | Hybrid (1-2 days per week onsite) I'm working with a well-established, technology-led UK business that's investing heavily in its data platform and analytics capability. This isn't a role where … spend your time moving data around low-code tooling or simply maintaining existing pipelines. They're looking for someone who enjoys building robust engineering solutions, improving platforms and setting the technical direction for how data is delivered across the business. You'll join ...

hiring a hands-on BI Architect to support the evolution of a cloud-based data platform, with a strong focus on data warehousing, analytics, and reporting. You'll work closely with BI Developers to design, build, and optimise end-to-end data solutions across … well-established UK-based international investment organisation with a global footprint, delivering impactful programmes across multiple regions. Description Design and enhance Enterprise Data Warehouse and data hub architectures Build and support end-to-end data pipelines (ingestion transformation reporting) using Azure services Work hands ...

hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership Who Are We? Our client is a trusted and growing supplier … delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework ...

leading B2B technology & managed service providers, offering a full range of business-grade communications products and services, spanning internet access, data, voice and network infrastructure. For over 30 years, we’ve served businesses of every size – from national retailers to small and medium-sized enterprises – with future-proof … deliver excellence, we would love to hear from you. Apply today and help us shape the future of business connectivity. The Role The Data Engineer role develops and maintains trusted, high-quality data pipelines, warehouse structures and analytics-ready datasets to support reporting, insights, decision-making ...

Title: Senior Data Engineer Location: Leeds - Hybrid Salary: Up to £80,000 Why Apply? This is a rare opportunity to join a growing technology business at a pivotal stage in its journey. As the first Senior Data Engineer in the business, you'll have the chance … shape the foundations of its data capability, influence technical decisions from day one, and play a key role in how data engineering evolves as the company continues to grow. You'll remain hands on, designing and building modern cloud-based data platforms, developing scalable ...