1 to 25 of 2,290 Data Pipeline Jobs in the UK

Director of Data Governance & Enablement Platforms Make your mark at one of the biggest names in payments. We’re looking for a leader who can build a unified, trusted and governed data foundation to create reusable, domain driven data products that power analytics … AI. The Head of Data Governance & Enablement Platforms is responsible for the strategy, engineering, operation, and adoption of the enterprise platforms that enable trusted, governed, and discoverable data at scale. Reporting to the Head of Data Platforms, this leader owns the portfolio of governance ...

cloud. IT Full Time IT London Job Description Putney, London | Hybrid £85,000+ Bonus + Excellent Benefits | Permanent Are you an experienced Azure Data Platform Manager, Azure Data Architect or Data Platform Lead with a strong background designing and delivering enterprise-scale Azure data platforms? We're looking for an experienced Azure Data Platform Manager to lead the design, development and optimisation of a modern Azure Data Platform within a complex, multi-market technology environment. Azure Data Platform design experience is critical for this position. ...

digital media, we'd love to meet you. As Cafeyn continues to grow, the Group is accelerating its transformation towards a truly data-driven organization, leveraging Customer Data and Artificial Intelligence to improve business performance, enhance product innovation and develop new revenue streams. As Director … Customer Data & Data Science, you will define and lead Cafeyn Group's Customer Data strategy, transforming data into a strategic asset that drives business decisions, product development and revenue growth. Reporting into the Group's leadership structure, you will ...

engineering team across London and India. You will own how we ingest, transform, and deliver data. You will be moving us from fragmented, pipeline-by-pipeline delivery to a modern, governed architecture built around data products. This is a data engineering leadership role … Tables and Snowpark Azure, with Databricks exposure an advantage. Advanced SQL and Python Data transformation frameworks such as dbt. Data pipeline orchestration and DataOps/CI/CD for data. Advanced SQL, Python and data transformation frameworks. Streaming, CDC and event-driven integration ...

Title Data Solution Architect Reporting To Senior Director, IT Department IT Hours Core office hours Location White City, London (hybrid) About Autolus Autolus is a biopharmaceutical company, advancing innovative therapies at both clinical and commercial stages of development, focused on next-generation, programmed T cell therapies … highly active T cell therapies designed to better recognize cancer cells, break down their defence mechanisms, and eliminate these cells. Autolus has a pipeline of product candidates in development for the treatment of haematological malignancies, solid tumours, and autoimmune diseases. Why Autolus Our team is passionate in the pursuit ...

deep Databricks capability while contributing practical experience of Azure Synapse and Python during a significant period of platform modernisation. **Key Responsibilities****Data Pipeline and Data Product Engineering**• Design, build, test and maintain scalable data pipelines and data products using Databricks, Python … into engineering solutions.• Follow DataOps, CI/CD, source-control and deployment practices, contributing to their continued improvement.• Investigate and resolve data pipeline failures, quality issues and performance problems, including appropriate operational support for production data services.• Identify technical debt and manual processes and contribute ...

MEANS OF INDEFINITE LEAVE TO REMAIN OR BE A BRITISH CITIZEN FOR US TO CONSIDER YOUR APPLICATION. Key Responsibilities Data Pipeline and Data Product Engineering Design, build, test and maintain scalable data pipelines and data products using Databricks, Python … into engineering solutions. Follow DataOps, CI/CD, source-control and deployment practices, contributing to their continued improvement. Investigate and resolve data pipeline failures, quality issues and performance problems, including appropriate operational support for production data services. Identify technical debt and manual processes and contribute ...

Engineering. Engineer governed, trusted data products Build data quality checks, lineage, cataloguing and data observability into every pipeline and data product from the start, rather than adding them after delivery. Implement data contracts, metadata and certification standards … Tables and Snowpark Azure, with Databricks exposure an advantage Advanced SQL and Python Data transformation frameworks such as dbt Data pipeline orchestration, Git-based CI/CD and DataOps Streaming, CDC and event-driven integration API, data sharing and consumption patterns Performance tuning ...

Databricks ML and Azure ML to develop predictive models and drive business insights.* Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage … Minimum 10+ years of experience as a Data Engineer or similar role.* Proven expertise in the technologies below, and data pipeline development and strong understanding of data warehousing concepts and practices.* Excellent problem-solving and analytical skills and strong communication and teamwork skills.Security ...

capability migrated to it. The role will include the following. Understanding of business and data requirements and translation to data pipeline and systems design. Implementation of agreed designs. Mentoring and guiding other members of the team through collaboration and peer review. Building production quality components. … data solutions from ingestion to consumption. Strong experience with Azure data PaaS services and data pipeline delivery on the Azure platform with Databricks. Experience delivering data platforms with C#, Python, JSON, XML, APIs, and message bus technology. Or similar technologies. Strong ...

Senior Data Engineer £72,000 GBP Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent The Opportunity A leading technology and digital intelligence organisation is seeking an experienced Senior Data Engineer to design, develop and maintain data engineering solutions supporting complex client … requirements, including work within the National Security and public sector environments. The successful candidate will combine strong technical data engineering expertise with the ability to lead engineering teams, engage with stakeholders and translate business requirements into effective, scalable data solutions. Working alongside data architects ...

Work with us Reporting to the Data Platform Manager, the Data Engineer will ingest data from a range of sources and transform it for downstream use, contributing to data modelling, analysis, and the broader development of the data platform such … that the enterprise is provided with a trusted and reliable data platform. The Data Engineer will join a team establishing a new Data Platform for ETEL, working with other parts of the business to migrate data from legacy systems and establishing pipelines ...

work environment. Here’s what you’ll get: Key Accountabilities As a Data Engineer, your key responsibilities will include: Data Pipeline Development : Collaborate with cross-functional teams to design and build robust data pipelines that collect, transform, and load data from … databases and data storage solutions, ensuring data availability, performance, and security. Technical Problem Solving : Identify and troubleshoot data pipeline and ETL issues in collaboration with the technical support team, minimizing downtime and maintaining data quality. Data Governance and Compliance ...

Entity: Technology Job Family Group: IT&S Group Job Description: RQ116502 Senior data engineer Role Summary We are seeking an experienced Senior Data Engineer to design, build and operate scalable data platforms, pipelines and products that enable data-driven decision making across … Finance. This role combines strong software engineering practices with modern cloud data technologies to deliver trusted, secure and high-quality data products. The successful candidate will work closely with business partners, product teams, architects, data managers and analytics specialists to transform complex business requirements ...

UBDS, we help organisations transform through cloud, cyber security, AI and digital innovation. We are looking for an experienced Data Architect to support the design and delivery of modern, scalable data platforms and solutions across complex Government and Defence environments. This is a hands-on architecture … equivalent distributed data processing technologies. Experience designing event-driven architectures and data processing workflows. Strong understanding of data pipeline orchestration, performance optimisation and parallel processing. Experience integrating cloud-based platforms with on-premises data sources. Hands-on knowledge of AWS services ...

Description Responsible for designing and building the ingestion and transformation of data pipelines and maintain optimal data pipeline processes for the Smiths Group. Maintain the ingestion framework processes of data, apply security and governance of data as well as modelling … loading of data from a wide variety of data sources. Build analytics models that utilise the data pipeline to provide actionable insights into customer needs, operational efficiency and other key business performance metrics. Assemble large, complex data sets that meet functional ...

configure and support Microsoft Fabric solutions for our clients across public and private sector environments. This role will support the delivery of modern data platforms, analytics services and integrated data solutions, helping customers make better use of their data through Microsoft Fabric, Power … Support governance and catalogue integration, including alignment with Microsoft Purview where required. Establish monitoring, logging and operational support processes for Fabric workloads. Troubleshoot platform, pipeline, data modelling, refresh, connectivity and performance issues. Support testing, release management and transition into live service. Contribute to technical assurance reviews, identifying ...

data‐enabled products. Establish and champion engineering best practices, including CI/CD, automated testing, version control, monitoring and alerting on pipeline failures. Work closely with Data Architects to implement target‐state data models and modern data engineering principles. Partner with … Factory Azure Synapse Analytics Microsoft Fabric Azure Data Lake Advanced SQL development skills. Proficiency in Python and modern data pipeline orchestration tools, including their monitoring and automation. Track record of building reliable, monitored production‐grade data pipelines. Experience integrating data ...

Role AI Engineer-AI Solutions Architect Experience (In Years) 9-12 Job Description EXL (NASDAQ: EXLS) is a global data and artificial intelligence ("AI") company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power … experience architecting solutions on at least one major cloud data platform (e.g., AWS, Azure, GCP, Databricks, Snowflake), including data pipeline and integration design. Strong data modelling capability across conceptual, logical and physical models, with practical experience of data quality, metadata ...

epilepsy, and a growing portfolio of cancer treatments. Our patient-focused and science-driven approach powers pioneering research and development advancements across our robust pipeline of innovative therapeutics in oncology and neuroscience. Jazz is headquartered in Dublin, Ireland with research and development laboratories, manufacturing facilities and employees in multiple … countries committed to serving patients worldwide. Please visit for more information.Job DescriptionBrief Description:The Statistical Programming Data Strategy and Governance (DSG) group is accountable for data standards, data governance, and the enablement of transformative clinical trial data initiatives within the Data ...

data-enabled products. Establish and champion engineering best practices, including CI/CD, automated testing, version control, monitoring and alerting on pipeline failures. Work closely with Data Architects to implement target-state data models and modern data engineering principles. Partner with … Factory Azure Synapse Analytics Microsoft Fabric Azure Data Lake Advanced SQL development skills. Proficiency in Python and modern data pipeline orchestration tools, including their monitoring and automation. Track record of building reliable, monitored production-grade data pipelines. Experience integrating data ...

accelerating our impact and working with patients, doctors, scientists, government and industry to improve genomic testing, and help researchers access the health data and technology they need to make new medical discoveries and create more effective, targeted medicines for everybody. Behind the Healthcare and Research outcomes, Genomics England … prospect of genomics becoming the fabric of everyday healthcare through the lifetime - from birth to old age. Job Description Are you an experienced Data Engineer who enjoys working at scale, solving complex data challenges and building reliable data solutions? Do you want to apply ...

Lead Data Engineer/Senior Data Engineer - AWS, Snowflake, CI/CD Location: Heathrow - 1-2 days per week onsite Contract: Immediate start until December 2026, likely extension into 2027 Rate: Up to £630 per day all-inclusive - Inside IR35/PAYE Lead Data … cloud data warehousing and modern data platform delivery. AWS data services, cloud-native architecture and data pipeline orchestration. DataOps, automated deployment, Infrastructure as Code and release automation. Agile software development, code reviews, test-driven development and engineering quality assurance. AI-assisted ...

This leading commercial retailer are looking for an experienced Data Engineer to join them as part of their continued data build & enablement strategy. As a Data Engineer, you will be responsible for developing and maintaining data pipelines, optimising databases, creating ETL processes … Engineer or similar role Full UK Driving Licence required Strong SQL skills with relational and NoSQL databases Demonstrated experience with data pipeline and ETL tools (e.g. Azure Data Factory, Azure Logic Apps, Databricks, API's) Understanding of different data environments (Data ...

Data and AI - Data Architect or Engineer Full-time Be part of a global consulting powerhouse, partnering with clients on their most critical strategic transformations. We are Wavestone. Energetic, solution-driven experts who focus as much on people as on performance and growth. Hand in hand … client-facing roles, or equivalent industry experience delivering data engineering and architecture solutions. Strong understanding of data engineering principles, including pipeline design, ETL/ELT, ingestion patterns, orchestration, and integration approaches. Experience designing or governing modern data architectures (lakehouse, warehouse, data ...