1 to 25 of 2,060 Data Pipeline Jobs in the UK

pipelines using Azure Data Factory and Snowflake. Improve data quality, consistency and reliability across the organisation. Monitor, troubleshoot and optimise pipeline performance. Work with large and complex datasets across reservation, hotel inspection and operational data. Develop and improve existing static Tableau reports. Translate business requirements … Strategy, AI Strategy, Business Intelligence, BI, Analytics, Reporting, ETL, ELT, Data Integration, Data Modelling, Data Migration, Pipeline Development, Data Platform, Data Infrastructure, Data Engineer London, Data Analyst London, Senior Data Engineer ...

Remote/Hybrid: for London (4 days WFO, 1-day WFH mandatory) Experience 15+ years About the Role We are seeking a senior Data Architect to join the engineering organisation as part of Project Compass. This programme is delivering next-generation capabilities across Accounts (Real-Time Ledger), Payments … Engine, and Foreign Exchange – all of which generate, consume, and depend on high-quality, well-governed data at scale. The Data Architect will own the end-to-end data architecture across spanning Snowflake as the enterprise data warehouse and a landscape ...

Title Data Solution Architect Reporting To Senior Director, IT Department IT Hours Core office hours Location White City, London (hybrid) About Autolus Autolus is a biopharmaceutical company, advancing innovative therapies at both clinical and commercial stages of development, focused on next-generation, programmed T cell therapies … highly active T cell therapies designed to better recognize cancer cells, break down their defence mechanisms, and eliminate these cells. Autolus has a pipeline of product candidates in development for the treatment of haematological malignancies, solid tumours, and autoimmune diseases. Why Autolus Our team is passionate in the pursuit ...

digital transformation consultancy working exclusively with higher education institutions across the UK. We help universities solve complex challenges across strategy, student records, data,changeand delivery. Our work often sits at the heart of major institutional transformation, helping partners improve the student journey, modernise operations and deliver change more … information, finance, HR, CRM, learning or other enterprise platforms. Experience with Azure DevOps, CI/CD, infrastructure as code and automated data pipeline deployment. Experience of data mesh, data products, advanced analytics or AI enablement. Experience in consultancy or transformation environments. #J ...

digital transformation consultancy working exclusively with higher education institutions across the UK. We help universities solve complex challenges across strategy, student records, data,changeand delivery. Our work often sits at the heart of major institutional transformation, helping partners improve the student journey, modernise operations and deliver change more … information, finance, HR, CRM, learning or other enterprise platforms. Experience with Azure DevOps, CI/CD, infrastructure as code and automated data pipeline deployment. Experience of data mesh, data products, advanced analytics or AI enablement. Experience in consultancy or transformation environments. #J ...

Data & AI Consulting – Public Sector Cognizant’s Data & AI Consulting practice partners with government agencies and public sector organizations to modernize data ecosystems, establish trusted data foundations, and accelerate digital transformation through cloud-based data platforms, analytics, and AI solutions. … teams help clients move beyond fragmented data landscapes by creating scalable, governed, and reusable data capabilities that enable enterprise-wide decision-making. This role offers an opportunity to shape one of the most significant public sector data modernization programs in the UK, establishing ...

Team Leader - Data Engineering & Integration - Commodities Data Location London Business Area Data Ref # 10052628 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint the whole picture for our clients, around … Finance, or related business/STEM fieldExperience leading or materially improving a data manufacturing, data operations, data pipeline, workflow engineering, or integration environment in a commodities, market data, financial data, or similarly complex domain. Solid understanding of commodities data ...

Databricks ML and Azure ML to develop predictive models and drive business insights.* Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage … Minimum 10+ years of experience as a Data Engineer or similar role.* Proven expertise in the technologies below, and data pipeline development and strong understanding of data warehousing concepts and practices.* Excellent problem-solving and analytical skills and strong communication and teamwork skills.Security ...

Data Pipeline Engineer/Data Pipeline Architect 3-month contract (initially) Remote Working (UK-based) Market Rates Outside IR35 The Opportunity: We are supporting a central government client who are seeking an experienced Data Pipeline Engineer and Architect to help design … will processed following successful interviews (5-7 days). Applications: To learn more about this newly created opportunity consulting as a Data Pipeline Engineer/Data Pipeline Architect on an initial 3-month engagement, operating on a remote-working basis for a prominent ...

summary We are seeking an experienced Senior Data Engineer to provide technical leadership and hands-on expertise within the Southwest Secure Data Environment (SWSDE). SWSDE enables secure use of health and care data for research, innovation, service improvement and transformation. Working with … processing activities. Strong problem-solving skills and ability to work effectively in complex, ambiguous and rapidly changing environments. Desirable Experience analysing platform performance, pipeline performance, data quality metrics or cloud based engineering workloads. Experience applying analytical techniques to support data validation, optimisation and continuous ...

Description Responsible for designing and building the ingestion and transformation of data pipelines and maintain optimal data pipeline processes for the Smiths Group. Maintain the ingestion framework processes of data, apply security and governance of data as well as modelling … loading of data from a wide variety of data sources. Build analytics models that utilise the data pipeline to provide actionable insights into customer needs, operational efficiency and other key business performance metrics. Assemble large, complex data sets that meet functional ...

configure and support Microsoft Fabric solutions for our clients across public and private sector environments. This role will support the delivery of modern data platforms, analytics services and integrated data solutions, helping customers make better use of their data through Microsoft Fabric, Power … Support governance and catalogue integration, including alignment with Microsoft Purview where required. Establish monitoring, logging and operational support processes for Fabric workloads. Troubleshoot platform, pipeline, data modelling, refresh, connectivity and performance issues. Support testing, release management and transition into live service. Contribute to technical assurance reviews, identifying ...

data‐enabled products. Establish and champion engineering best practices, including CI/CD, automated testing, version control, monitoring and alerting on pipeline failures. Work closely with Data Architects to implement target‐state data models and modern data engineering principles. Partner with … Factory Azure Synapse Analytics Microsoft Fabric Azure Data Lake Advanced SQL development skills. Proficiency in Python and modern data pipeline orchestration tools, including their monitoring and automation. Track record of building reliable, monitored production‐grade data pipelines. Experience integrating data ...

Role AI Engineer-AI Solutions Architect Experience (In Years) 9-12 Job Description EXL (NASDAQ: EXLS) is a global data and artificial intelligence ("AI") company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power … experience architecting solutions on at least one major cloud data platform (e.g., AWS, Azure, GCP, Databricks, Snowflake), including data pipeline and integration design. Strong data modelling capability across conceptual, logical and physical models, with practical experience of data quality, metadata ...

Entity: Technology Job Family Group: IT&S Group Job Description: Role Summary We are seeking an experienced Senior Data Engineer to design, build and operate scalable data platforms, pipelines and products that enable data-driven decision making across Finance. This role combines strong software … engineering practices with modern cloud data technologies to deliver trusted, secure and high-quality data products. The successful candidate will work closely with business partners, product teams, architects, data managers and analytics specialists to transform complex business requirements into robust data solutions. ...

data-enabled products. Establish and champion engineering best practices, including CI/CD, automated testing, version control, monitoring and alerting on pipeline failures. Work closely with Data Architects to implement target-state data models and modern data engineering principles. Partner with … Factory Azure Synapse Analytics Microsoft Fabric Azure Data Lake Advanced SQL development skills. Proficiency in Python and modern data pipeline orchestration tools, including their monitoring and automation. Track record of building reliable, monitored production-grade data pipelines. Experience integrating data ...

Entity:TechnologyJob Family Group:IT&S GroupJob Description:Role SummaryWe are seeking an experienced Senior Data Engineer to design, build and operate scalable data platforms, pipelines and products that enable data-driven decision making across Finance. This role combines strong software engineering practices with … modern cloud data technologies to deliver trusted, secure and high-quality data products.The successful candidate will work closely with business partners, product teams, architects, data managers and analytics specialists to transform complex business requirements into robust data solutions. They will lead technical ...

this vacancy early if we receive a high volume of suitable applications. Interviews will take place as and when suitable candidates are identified. Data Engineer Company: United Welsh Salary: £46,710 Hours: Full-time Location: Caerphilly, CF83 2AX Job type: Permanent Posting date: 6 Aug 2026 Closing date … Sept 2026 Purpose of Role The Data Engineer will play a key role in developing, maintaining and continually improving United Welsh's modern data platform. Working as part of the Data & Insights team, the role will help build reliable, scalable and secure data ...

growing world. We leverage cutting-edge technology to optimize operations, enhance customer experience, and drive business growth. We are seeking a Senior Data Engineer to join our team and play a pivotal role. About The Role At Maersk, we are redefining global logistics through data, platform … data ecosystems Operational Excellence Ensure data solutions are reliable, scalable, performant, secure, and production‐ready Monitor, troubleshoot, and continuously improve pipeline performance, data quality, and platform stability Drive automation, observability, and supportability across data, analytics, and AI/ML solutions ...

Implementation : Implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions. Pipeline Development : Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data … data integrity. Azure Services Utilise Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer. Ensure the scalability and reliability of data solutions using Azure ...

Senior Data Engineer - Dudley Senior Data Engineer with excellent experience in Microsoft Fabric, Data lakes, data engineering, data development, data integrations, SQL, data warehousing, & Azure data platforms is required by a leading company near … Dudley. The role can be mostly remote, with 1 days in the office. As part of an ongoing investment in data and analytics capabilities, they are seeking a Data Engineer to join a growing data team and help shape the future of their data ...

Methods is recruiting for a permanent Mid/Senior Data Engineer to join the Data and AI Capability Centre. This role will be mainly remote but require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol. You will support complex … reused as part of an enduring data governance model. Experience implementing and advocating for test‐driven development methodologies in data pipeline workflows, including unit testing, integration testing, and data quality validation frameworks Proven experience leading technical aspects of data projects Strong ...

Data and AI - Data Architect or Engineer Full-time Be part of a global consulting powerhouse, partnering with clients on their most critical strategic transformations. We are Wavestone. Energetic, solution-driven experts who focus as much on people as on performance and growth. Hand in hand … client-facing roles, or equivalent industry experience delivering data engineering and architecture solutions. Strong understanding of data engineering principles, including pipeline design, ETL/ELT, ingestion patterns, orchestration, and integration approaches. Experience designing or governing modern data architectures (lakehouse, warehouse, data ...

business stakeholders to understand data requirements and deliver solutions that meet their needs. Automation & CI/CD: Automate data pipeline deployments, testing, and monitoring using CI/CD principles and tools. Documentation: Maintain clear and comprehensive documentation for data pipelines, models, and processes. … Troubleshooting: Investigate and resolve data pipeline failures, performance bottlenecks, and data quality issues. On-call Support: This role requires to be available for out-of-office on-call support on a rotation. Required Qualifications: Experience: 7+ years of professional experience in data engineering ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise in data ...