476 to 500 of 2,467 Data Pipeline Jobs in the UK

remote, with monthly travel to Leeds/Bradford Type: Permanent | Full-time The Opportunity A forward-thinking organisation undergoing significant investment in its data and technology capabilities is seeking an experienced Data Engineer to join its growing team. This is an excellent opportunity to play … role in the evolution of a modern Azure-based data platform, supporting reporting, analytics, business intelligence, and emerging AI initiatives. You'll work closely with analysts, architects, engineers, and business stakeholders to deliver scalable, secure, and high-quality data solutions. Key Responsibilities Design, develop and maintain ...

Senior Data Engineer Location: London|Hybrid Salary: £75K – £85K Data Idols are working with a leading organisation that is continuing to invest heavily in its data and technology capabilities. They are looking for a Senior Data Engineer to join a growing data function and help build the platforms and solutions behind high-impact Data Science and analytics products. This is an opportunity to work in a modern data environment, solving complex engineering challenges and building solutions that will be used at significant scale. The Opportunity ...

Senior Scientist, Research Informatics & Data Science Bioinformatics, In Silico Sciences & Automation (BIX) Biologics Engineering (BE) Location: Cambridge, UK Introduction to the Role: We areseekingan experienced and highly motivated informatics and data science professional to accelerate the digital transformation of Biologics Engineering by building the data, software, and automation foundations that enable next-generation scientific workflows. This role sits at the intersection of bioinformatics, software engineering, data science, laboratory automation, and AI. The successful candidate will partner closely with scientists, automation engineers,data scientists, and IT teams to develop robust ...

design solutions that work. Passion: we are passionate about - and dedicated to - public services and improving people’s lives. THE ROLE The Senior Data Engineer – Microsoft Fabric & Azure is a senior, hands-on role within Agilisys’ Data & AI Practice. You will take engineering ownership of modern … data-platform workstreams from approved design through build, testing, production deployment and handover, with Microsoft Fabric and the Azure Data Platform at the core. Working closely with architects, analysts, delivery teams and client stakeholders, you will help turn architecture into secure, scalable and supportable solutions. ...

Shape how hundreds of thousands of UK investors use data to make confident, informed investment decisions. Join a team building modern, cloud-native data platforms that enable analytics, regulatory reporting, and data-driven products at scale. You'll work with contemporary lakehouse and streaming … improvement. This role offers meaningful scope to influence platform standards and mentor others while growing your technical and leadership impact. As a Lead Data Engineer at JPMorgan Chase within Personal Investing, you will design, build, and operate a robust cloud-native data platform and pipelines that ...

someone who enjoys solving complex data challenges, setting technical direction, and helping others grow along the way. You take pride in building scalable, reliable data platforms, not just delivering solutions for today, but creating foundations that support future growth. At Ground Control, we're investing heavily … data capabilities and Microsoft Fabric platform. This is an opportunity to become the technical authority for our data estate, influencing architecture, engineering standards and long-term strategy. You'll have the autonomy to make key technical decisions, the opportunity to mentor and develop engineers ...

Title : Senior Data Engineer Target Start Date: 20th June 2026 Contract Type: Permanent, Part Time, Full Time, Job Share option available Salary Range: £70,000 - £85,000 Location: Eastleigh and Reigate Senior Data Engineer: We are currently recruiting for a Senior Data Engineer … join our innovative Data team. You will join a collaborative team of data and AI engineers, scientists, developers, analysts, and architects. Together, you will design and build modern machine learning and AI services that support analytics and improve products across the business. Main Responsibilities ...

reliable secure and cost optimized solutions that scale with future growth needs. Implement robust data processing workflows using AWS Data Pipeline and related services to ensure timely accurate and resilient data movement across diverse enterprise systems. Configure and maintain Amazon ECR repositories … hybrid model with day shift schedules. Qualifications Demonstrate solid experience designing and implementing AWS architectures that make extensive use of AWS Data Pipeline Amazon ECR AWS EKS and AWS Systems Manager in production environments. Exhibit strong capability working with AWS Shield AWS Certificate Manager and AWS Networking ...

looking for our first dedicated data engineer to define and build the shared data foundation for a complex, high-value scientific estate. Tropic has built a decade of proprietary scientific evidence spanning gene-editing outcomes, field trials, genotyping, phenotyping and product decisions. This role will make … Bioinformatics, IT and business data owners, you will recommend the data engineering stack to support AI programmes across science, commercial, pipeline and supply. Within your first year, you will launch the first connected scientific data layer and operationalise the shared architecture supporting Tropic ...

well-established SaaS company based in Huddersfield is looking for a hands-on Senior Data Engineer to join its growing technology team. This is a great opportunity to join a successful, tech-first business where data sits at the heart of the products they deliver. … take ownership of the data pipelines, models and reporting that underpin the platform, while helping shape the future data architecture. The role would suit a Senior Data Engineer who enjoys end-to-end ownership, solving complex data problems and working across ...

award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data ...

Title: Senior Data Engineer Target Start Date: 20th June 2026 Contract Type: Permanent, Part Time, Full Time, Job Share option available Salary Range: £54,000 - £81,000 Location: Reigate and Eastleigh Work Level: WL4 Closing Date for applications: 18th April Hiring Manager: Lee Matthews Senior Data Engineer: We are currently recruiting for a Senior Data Engineer tojoin our innovative Data team. You will join a collaborative team of data andAI engineers, scientists, developers, analysts, and architects. Together, youwill design and build modern machine learning and AI services that ...

best advice and insights to our clients. To learn more about PJT Partners, please visit our website at . Role Overview: The Data and Applications team builds analytics, AI-powered tools and data infrastructure that connect data, technology and decision-making across the firm. … Team members combine finance and business expertise with technical skills in data engineering, full-stack lifecycle development, system integration and data analytics to deliver technology solutions across corporate functions and client advisory. PJT Partners is seeking a highly motivated Data Platform Engineer ...

founded in 1997 and started by ensuring the reliability and performance of mission‐critical databases. We quickly earned a reputation for solving tough data challenges. We were there when the industry moved from on‐premises to cloud environments, and as enterprises sought more from their data … empower organizations to embrace transformation and leverage advanced technologies, including AI, to stay competitive. We deliver innovative solutions that meet each client’s data goals and have built strong partnerships with Google Cloud, AWS, Microsoft, Oracle, SAP, and Snowflake. The powerful combination of our extensive expertise in data ...

platform infrastructure on Azure for a public sector client. You'll work with a reasonable degree of autonomy, contributing to infrastructure automation, pipeline reliability, and platform improvements, while collaborating closely with senior engineers, data engineers, and the wider delivery team. Key Responsibilities Support the build … platforms Work with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake to support data pipeline infrastructure and platform reliability Develop and maintain infrastructure-as-code using Terraform Build and maintain CI/CD pipelines using GitLab, supporting automated build ...

manager-provided sources, validates it through rigorous data-quality and portfolio quality-assessment processes, and continuously automates the data pipeline to improve accuracy, timeliness and coverage. AI tools and internally built applications are used extensively across every stage of this work, and the team … from diverse public sources and directly from fund managers, ensuring complete and well-documented coverage. Ensure the accuracy, reliability and integrity of collected data through rigorous, repeatable validation and quality-assurance processes. Apply, maintain and improve data-quality frameworks, validation rules and outlier-detection methodologies ...

industrialisation of Li-ion batteries and cells. Reporting to the Head of Product Engineering this position will support the capture and analysis of data generated from the production and test of UKBIC baseline and customer products. The purpose of this role is to deliver data insights … enable successful scale-up to quality. The company has recently deployed a Manufacturing Execution System (MES) to capture equipment, process and quality data across its facilities and is developing the associated data pipelines into Siemens Insights Hub. This role will act as the Product Engineering owner ...

platforms. Lead the development of transformation workflows using dbt, with a strong emphasis on testing, documentation, and data quality. Architect and manage pipeline orchestration via Apache Airflow, ensuring reliability and observability at every stage. Monitor and optimise pipeline performance for low-latency, high-throughput use cases. … working across cloud platforms (AWS, GCP, or Azure) for data ingestion, storage, and processing. Proficiency in Python or a similar language for pipeline development and automation. Strong data modelling instincts you think carefully about how data is structured, named, and consumed downstream. ...

currently working with a well-known charity looking to hire an Azure Data Engineer to join their data and technology team during a significant transformation programme. The organisation is moving towards a Microsoft-based technology stack and is looking for someone who can help develop … more integrated, efficient and scalable data environment. The role will work across the full data journey, with a particular focus on integration and data warehousing. You'll help bring data from external sources into the organisation's Azure environment and operational systems ...

team is building the foundational infrastructure that powers Flo’s next generation of personalised healthcare experiences. Our mission is to integrate diverse health data sources, from clinical systems and external vendors to user-reported data, including data from wearables directly or via Health Connect …/HealthKit into a unified, reliable, and actionable health record. This foundation will enable a new Virtual Clinics direction, delivering personalised, data-driven care journeys at scale. While this is a deeply technical and data-heavy area, we believe that the true value of health data ...

Senior Data Engineer (Databricks) - London (Hybrid) - Up to £85,000 Databricks - Apache Spark - Delta Lake - Python - SQL - Azure We're partnering with a fast-growing technology business that's investing heavily in its data platform and engineering capability. This is an opportunity to join a highly … processing and data modelling. Cloud platform experience across Azure, AWS, or GCP. Experience implementing data quality frameworks and pipeline monitoring. Excellent communication and stakeholder engagement skills. Desirable Experience Databricks certification. Unity Catalog and Databricks Asset Bundles. Terraform or Bicep. dbt or similar transformation ...

Senior Software Engineer (Data) Department: Engineering Employment Type: Full Time Location: London Description Hybrid: 2 days per week in our Tower Bridge office (Tuesdays & Thursdays) Uswitch At Uswitch, our goal is to be the UK’s favourite way to choose and manage home-life essentials – from broadband … warehouses from a variety of data sources using data modelling techniques Experience in Building Extract Transform and Load (ETL) pipeline (streaming/batch) using MPP frameworks (Spark, Beam, or other) Experience in orchestrating complex pipelines using Airflow, Dagster or other Proficiency ...

Azure Data Support Engineer Location: Newcastle or London preferredJob Type: Full-time | Permanent (On-Call Requirement)Security Clearance RequirementThis role is suitable for candidates who already hold UK Government Security Clearance (SC), or who are eligible and willing to undergo the SC vetting process (eligibility criteria apply). … looking for a versatile Azure Data & ML Support Engineer with strong expertise in Azure cloud services, DevOps, SQL, and data warehousing to support and optimize ongoing operations in a Managed Services environment. This role is responsible for ensuring the stability, performance, and reliability of enterprise-scale ...

description Purpose of the job The Microsoft Fabric Architect will provide strategic and technical leadership for the council’s enterprise data and analytics platform. The role will review, validate and enhance the council’s Microsoft Fabric architecture, governance framework and operating model. Working closely with the Data … council’s wider technology and digital ambitions. This is a senior architecture and governance role requiring a holistic view across platform architecture, data design, security, governance, service operation and organisational adoption. It is not primarily a data engineering or report development position. Principal accountabilities Responsibilities: Lead ...

Product Manager - Data Salary From:£64,000 Salary To:£70,000 Region:UK Wide Location:Hybrid London/Shipley/Glasgow Advertised Job Category:Technology Department:Internal Products Job type:Permanent Closing Date:23 September 2026 Product Manager - Data Permanent Full time (34.5 hours … Range £64000 - £70000 - benefits and recognition About us Macmillan Cancer Support exists to do whatever it takes to support people living with cancer. Data plays a vital role in helping us understand the people we support, make better decisions and ensure our resources have the greatest possible impact. ...