1 to 25 of 2,187 Data Pipeline Jobs in the UK

pipelines using Azure Data Factory and Snowflake. Improve data quality, consistency and reliability across the organisation. Monitor, troubleshoot and optimise pipeline performance. Work with large and complex datasets across reservation, hotel inspection and operational data. Develop and improve existing static Tableau reports. Translate business requirements … Strategy, AI Strategy, Business Intelligence, BI, Analytics, Reporting, ETL, ELT, Data Integration, Data Modelling, Data Migration, Pipeline Development, Data Platform, Data Infrastructure, Data Engineer London, Data Analyst London, Senior Data Engineer ...

Remote/Hybrid: for London (4 days WFO, 1-day WFH mandatory) Experience 15+ years About the Role We are seeking a senior Data Architect to join the engineering organisation as part of Project Compass. This programme is delivering next-generation capabilities across Accounts (Real-Time Ledger), Payments … Engine, and Foreign Exchange – all of which generate, consume, and depend on high-quality, well-governed data at scale. The Data Architect will own the end-to-end data architecture across spanning Snowflake as the enterprise data warehouse and a landscape ...

## Data Solution ArchitectApply: UK - London, White City: Full time: Posted Yesterday: JR100167**Work with us** Our team are passionate in the pursuit of excellence and in pushing the boundaries of cancer therapy and Autoimmune disease to deliver life-changing treatments to patients.Whilst working at Autolus you will … highly active T cell therapies designed to better recognize cancer cells, break down their defence mechanisms, and eliminate these cells. Autolus has a pipeline of product candidates in development for the treatment of haematological malignancies, solid tumours, and autoimmune diseases.**Why Autolus**Our team is passionate in the pursuit ...

digital transformation consultancy working exclusively with higher education institutions across the UK. We help universities solve complex challenges across strategy, student records, data,changeand delivery. Our work often sits at the heart of major institutional transformation, helping partners improve the student journey, modernise operations and deliver change more … information, finance, HR, CRM, learning or other enterprise platforms. Experience with Azure DevOps, CI/CD, infrastructure as code and automated data pipeline deployment. Experience of data mesh, data products, advanced analytics or AI enablement. Experience in consultancy or transformation environments. #J ...

digital transformation consultancy working exclusively with higher education institutions across the UK. We help universities solve complex challenges across strategy, student records, data,changeand delivery. Our work often sits at the heart of major institutional transformation, helping partners improve the student journey, modernise operations and deliver change more … information, finance, HR, CRM, learning or other enterprise platforms. Experience with Azure DevOps, CI/CD, infrastructure as code and automated data pipeline deployment. Experience of data mesh, data products, advanced analytics or AI enablement. Experience in consultancy or transformation environments. #J ...

Senior Data Manager Location: Remote, UK Working pattern: Full-time, flexible working Salary: £50k - £64k Are you an experienced Data Management leader who wants the freedom to shape and deliver an enterprise-wide data transformation? This is an opportunity to take genuine ownership … will also support the development of a modern unified data platform, ensuring governance and data quality are built into pipelines, data structures and technical controls rather than treated as separate policy exercises. Key responsibilities Own and deliver the enterprise data management strategy ...

Data & AI Consulting – Public Sector Cognizant’s Data & AI Consulting practice partners with government agencies and public sector organizations to modernize data ecosystems, establish trusted data foundations, and accelerate digital transformation through cloud-based data platforms, analytics, and AI solutions. … teams help clients move beyond fragmented data landscapes by creating scalable, governed, and reusable data capabilities that enable enterprise-wide decision-making. This role offers an opportunity to shape one of the most significant public sector data modernization programs in the UK, establishing ...

Team Leader - Data Engineering & Integration - Commodities Data Location London Business Area Data Ref # 10052628 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint the whole picture for our clients, around … Finance, or related business/STEM fieldExperience leading or materially improving a data manufacturing, data operations, data pipeline, workflow engineering, or integration environment in a commodities, market data, financial data, or similarly complex domain. Solid understanding of commodities data ...

Databricks ML and Azure ML to develop predictive models and drive business insights.* Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage … Minimum 10+ years of experience as a Data Engineer or similar role.* Proven expertise in the technologies below, and data pipeline development and strong understanding of data warehousing concepts and practices.* Excellent problem-solving and analytical skills and strong communication and teamwork skills.Security ...

summary We are seeking an experienced Senior Data Engineer to provide technical leadership and hands-on expertise within the Southwest Secure Data Environment (SWSDE). SWSDE enables secure use of health and care data for research, innovation, service improvement and transformation. Working with … processing activities. Strong problem-solving skills and ability to work effectively in complex, ambiguous and rapidly changing environments. Desirable Experience analysing platform performance, pipeline performance, data quality metrics or cloud based engineering workloads. Experience applying analytical techniques to support data validation, optimisation and continuous ...

Description Responsible for designing and building the ingestion and transformation of data pipelines and maintain optimal data pipeline processes for the Smiths Group. Maintain the ingestion framework processes of data, apply security and governance of data as well as modelling … loading of data from a wide variety of data sources. Build analytics models that utilise the data pipeline to provide actionable insights into customer needs, operational efficiency and other key business performance metrics. Assemble large, complex data sets that meet functional ...

configure and support Microsoft Fabric solutions for our clients across public and private sector environments. This role will support the delivery of modern data platforms, analytics services and integrated data solutions, helping customers make better use of their data through Microsoft Fabric, Power … Support governance and catalogue integration, including alignment with Microsoft Purview where required. Establish monitoring, logging and operational support processes for Fabric workloads. Troubleshoot platform, pipeline, data modelling, refresh, connectivity and performance issues. Support testing, release management and transition into live service. Contribute to technical assurance reviews, identifying ...

data‐enabled products. Establish and champion engineering best practices, including CI/CD, automated testing, version control, monitoring and alerting on pipeline failures. Work closely with Data Architects to implement target‐state data models and modern data engineering principles. Partner with … Factory Azure Synapse Analytics Microsoft Fabric Azure Data Lake Advanced SQL development skills. Proficiency in Python and modern data pipeline orchestration tools, including their monitoring and automation. Track record of building reliable, monitored production‐grade data pipelines. Experience integrating data ...

Role AI Engineer-AI Solutions Architect Experience (In Years) 9-12 Job Description EXL (NASDAQ: EXLS) is a global data and artificial intelligence ("AI") company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power … experience architecting solutions on at least one major cloud data platform (e.g., AWS, Azure, GCP, Databricks, Snowflake), including data pipeline and integration design. Strong data modelling capability across conceptual, logical and physical models, with practical experience of data quality, metadata ...

Entity: Technology Job Family Group: IT&S Group Job Description: Role Summary We are seeking an experienced Senior Data Engineer to design, build and operate scalable data platforms, pipelines and products that enable data-driven decision making across Finance. This role combines strong software … engineering practices with modern cloud data technologies to deliver trusted, secure and high-quality data products. The successful candidate will work closely with business partners, product teams, architects, data managers and analytics specialists to transform complex business requirements into robust data solutions. ...

data-enabled products. Establish and champion engineering best practices, including CI/CD, automated testing, version control, monitoring and alerting on pipeline failures. Work closely with Data Architects to implement target-state data models and modern data engineering principles. Partner with … Factory Azure Synapse Analytics Microsoft Fabric Azure Data Lake Advanced SQL development skills. Proficiency in Python and modern data pipeline orchestration tools, including their monitoring and automation. Track record of building reliable, monitored production-grade data pipelines. Experience integrating data ...

Entity:TechnologyJob Family Group:IT&S GroupJob Description:Role SummaryWe are seeking an experienced Senior Data Engineer to design, build and operate scalable data platforms, pipelines and products that enable data-driven decision making across Finance. This role combines strong software engineering practices with … modern cloud data technologies to deliver trusted, secure and high-quality data products.The successful candidate will work closely with business partners, product teams, architects, data managers and analytics specialists to transform complex business requirements into robust data solutions. They will lead technical ...

this vacancy early if we receive a high volume of suitable applications. Interviews will take place as and when suitable candidates are identified. Data Engineer Company: United Welsh Salary: £46,710 Hours: Full-time Location: Caerphilly, CF83 2AX Job type: Permanent Posting date: 6 Aug 2026 Closing date … Sept 2026 Purpose of Role The Data Engineer will play a key role in developing, maintaining and continually improving United Welsh's modern data platform. Working as part of the Data & Insights team, the role will help build reliable, scalable and secure data ...

growing world. We leverage cutting-edge technology to optimize operations, enhance customer experience, and drive business growth. We are seeking a Senior Data Engineer to join our team and play a pivotal role. About The Role At Maersk, we are redefining global logistics through data, platform … data ecosystems Operational Excellence Ensure data solutions are reliable, scalable, performant, secure, and production‐ready Monitor, troubleshoot, and continuously improve pipeline performance, data quality, and platform stability Drive automation, observability, and supportability across data, analytics, and AI/ML solutions ...

Implementation : Implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions. Pipeline Development : Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data … data integrity. Azure Services Utilise Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer. Ensure the scalability and reliability of data solutions using Azure ...

Data and AI - Data Architect or Engineer Full-time Be part of a global consulting powerhouse, partnering with clients on their most critical strategic transformations. We are Wavestone. Energetic, solution-driven experts who focus as much on people as on performance and growth. Hand in hand … client-facing roles, or equivalent industry experience delivering data engineering and architecture solutions. Strong understanding of data engineering principles, including pipeline design, ETL/ELT, ingestion patterns, orchestration, and integration approaches. Experience designing or governing modern data architectures (lakehouse, warehouse, data ...

Methods is recruiting for a permanent Mid/Senior Data Engineer to join the Data and AI Capability Centre. This role will be mainly remote but require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol. You will support complex … reused as part of an enduring data governance model. Experience implementing and advocating for test‐driven development methodologies in data pipeline workflows, including unit testing, integration testing, and data quality validation frameworks Proven experience leading technical aspects of data projects Strong ...

could mean reducing a data preparation process from hours to minutes; eliminating repetitive analyst intervention; improving data quality or pipeline reliability; increasing reuse of curated datasets and common transformation logic; reducing compute consumption; shortening the time required to develop analytical products; or releasing analytical capacity … solutions that demonstrably release capacity and accelerate analytical delivery. Provide senior technical leadership and engineering assurance set and champion standards for architecture, code, pipelines, data models, testing, documentation and engineering practices, constructively challenging solutions where greater rigour or efficiency is required. Establish modern engineering and deployment practices embed ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … experience with SQL and at least one programming language such as Python, Scala, or Java ETL/ELT design and data pipeline orchestration Streaming and event-driven data architectures Agile and DevOps delivery methodologies applied to data platforms (DataOps) Expertise in data ...

Data Engineering Manager, you will lead delivery of AI-powered data engineering programmes — owning the full journey from pipeline design and build through to the data products that serve our clients’ AI, analytics and business needs. We operate in an AI-augmented delivery … model where AI-assisted pipeline development, automated data quality and agentic data operations are current practice, and our managers are expected to lead teams in adopting and embedding these approaches as standard. You’ll learn, grow and advance in an innovative culture that thrives ...