501 to 525 of 934 Data Pipeline Jobs in the UK excluding London

senior Python engineer who wants to work at the intersection of data platforms and applied AI? This is your opportunity to join a small, high-impact team building something new from the ground up — where your decisions shape the architecture, not just the backlog. At JPMorganChase, we invest … curious, pragmatic, and ready to grow into emerging technology stacks. As a Senior Lead Software Engineer at JPMorganChase within the Corporate Technology Data and Analytics Services team, you will be a founding contributor to the Context Plane — a greenfield platform that connects the firm's data ...

Scott Logic is a UK data engineering partner delivering bespoke software and data platforms. You will design and implement data pipelines, build data lakes/warehouses, and transform datasets for analytics, ML, and reporting. You’ll work hands-on with modern tools ...

ENGINEER LONDON/HYBRID UP TO £80,000 This is an exciting opportunity for an Analytics Engineer to take ownership of the full data lifecycle within a growing, data-driven business. You'll work across analytics engineering, data engineering, and business intelligence, helping shape … data powers decision-making, product development, and commercial growth. ROLES AND RESPONSIBILITIES: The Analytics Engineer will: Design, build, and maintain end-to-end data pipelines from source systems through to analytics-ready datasets Develop scalable and well-documented transformation pipelines using dbt and BigQuery Write ...

This is an opportunity for a Data Operations Manager to join a research and analytics business focused on improving data delivery, automation, and operational processes. You'll work across a range of data projects, helping to drive efficiency and support the continued development … data function. The Company They are an established insights and research organisation that works with clients across multiple sectors. The business is investing in technology, automation, and operational improvement to support future growth. You will join a collaborative team where data and technology play ...

team, the post holder will act as a trusted analytical partner, helping stakeholders understand their information requirements and translating these into high-quality data products, dashboards, reports, and insights. Main duties of the job The role combines advanced analytical and technical expertise with strong stakeholder engagement skills, requiring … post holder to build and maintain effective relationships across multiple organisations. They will lead on the development of complex datasets, reporting solutions, data pipelines, and automation processes, while ensuring high standards of data quality, governance, and information security. About us Here is a not-for-profit ...

exciting opportunity for a Data & ML Engineer to join a thriving technology and innovation hub where talented engineers, data specialists and industry experts come together to build solutions that make a real difference. Working across a diverse range of projects, youll have the opportunity to work … with cutting-edge technologies, solve challenging data problems and develop your expertise across the rapidly evolving world of AI. You will have the opportunity to: Design and implement robust data pipelines and ML workflows using Python, SQL, Spark and Databricks. Develop and deploy machine learning models ...

Lorien is seeking a data engineer to support the technical delivery of cyber metrics by establishing reliable data pipelines, transforming source data and enabling automated reporting. You will identify, onboard and integrate cyber security data sources, design automated workflows, develop data models and ensure data quality to boost dashboard reliability. This role emphasizes scalable analytics using Power BI and Databricks to drive security insights. #J-18808-Ljbffr ...

Hippo is seeking a Senior Azure Data Engineer to join our Managed Services Team in the Manchester area. You will lead production data pipelines, collaborate with internal and client teams, and drive platform reliability and data-driven decision making. You’ll apply expertise … Python, Microsoft Fabric, and Azure Data Factory to deliver scalable, automated data solutions, with on-call commitments within a dynamic consultancy environment. #J-18808-Ljbffr ...

Engineering responsibilities: Design and implement scalable Databricks Lakehouse platforms on AWS and/or Azure aligned to client requirements Architect end-to-end data platforms including ingestion, storage (Delta Lake), processing, and consumption layers Build and configure cloud infrastructure using infrastructure-as-code (e.g. Terraform & Declarative Automation Bundles … Establish secure, compliant environments including networking (VNet/VPC, Private Link), identity (IAM/Entra ID), data governance (Unity Catalog), and access controls Define environment strategies (dev/test/prod), CI/CD pipelines, and release processes for Databricks deployments Implement monitoring, logging, cost optimisation, and performance ...

Sword Group is seeking a Data Engineer in the United Kingdom (Glasgow area) to design, build, and optimize scalable data pipelines using Azure Data Factory, Synapse, Fabric, and Databricks. You will collaborate with clients and cross-functional teams to translate business needs into robust … data solutions. Ideal candidates will have hands-on experience with Fabric, data governance, and advanced transformations in SQL, Python, and Spark, with opportunities to mentor junior engineers and grow #J-18808-Ljbffr ...

LangGraph, LangChain, Haystack or similar frameworks. Proven ability to deploy AI/ML systems into production environments. Strong knowledge of inference, latency, performance, data pipelines, memory and tool/function calling. Experience with large‐scale search and retrieval, including embeddings, indexing and querying multi‐modal datasets. Confident with ...

Tech. In this role, you will be directly responsible for leading the technical design, development, and optimization of our regulatory reporting framework and data pipelines, with a strong focus on onboarding new regulations. This is an active engineering leadership position where you will guide a team of developers … write clean, production-grade code, design system components, and troubleshoot complex data processing issues. You will work closely within an Agile team, collaborating with business analysts and other engineers to translate regulatory requirements into reliable, scalable software solutions. Lead and Mentor: Guide and support a team of software ...

About Prophecy The leader in AI-native data preparation and analysis, Prophecy is revolutionizing how the world’s top enterprises turn data chaos into reliable insights. We introduce the AI-native data lifecycle (generate, refine, deploy) where our industry leading AI agents and humans … work hand-in-hand in visual and document interfaces to analyze, transform and prepare data, to ship trusted insights at enterprise scale. To learn more, visit us on LinkedIn. About the Role As a Forward Deployed Solution Engineer, you will be a critical part ...

5+ years. Here are some things we've worked on recently that give a sense of the work we do: Building a data analytics tool using a Neo4J graph database. A DevOps platform to support 3000 users. Processing digital forensic data to enable search and insight … system backed by an Elasticsearch cluster. A custom workflow tool with a React/TS front-endAn AI assurance capabilityOrchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. About the Role: As a Senior Software Engineer ...

Data & Insight Analyst Location: Chertsey (Hybrid – 2 days onsite) At Foodbuy, we’re driving transformation through data. As the procurement and supply chain division of Compass Group UK & Ireland, we sit at the heart of a £2.6bn spend network—delivering insight-led solutions to some of the most … recognisable organisations across healthcare, education, hospitality and business. We’re now looking for a Data & Insight Analyst to join our growing Analytics team, playing a key role in shaping how data and insight drive decision-making across the business. The Role This is a hands ...

5+ years. Here are some things we’ve worked on recently that give a sense of the work we do: Building a data analytics tool using a Neo4J graph database. A DevOps platform to support 3000 users. Processing digital forensic data to enable search and insight … Elasticsearch cluster. A custom workflow tool with a React/TS front‐end. An AI assurance capability. Orchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. About the Role As a Senior Software Engineer, you will lead ...

senior Python engineer who wants to work at the intersection of data platforms and applied AI? This is your opportunity to join a small, high-impact team building something new from the ground up - where your decisions shape the architecture, not just the backlog. At JPMorganChase, we invest … curious, pragmatic, and ready to grow into emerging technology stacks. As a Senior Lead Software Engineer at JPMorganChase within the Corporate Technology Data and Analytics Services team, you will be a founding contributor to the Context Plane - a greenfield platform that connects the firm's data ...

5+ years. Here are some things we've worked on recently that give a sense of the work we do: Building a data analytics tool using a Neo4J graph database. A DevOps platform to support 3000 users. Processing digital forensic data to enable search and insight … ElasticSearch cluster. A custom workflow tool using Camunda, with a React/TS front-endAn AI assurance capabilityOrchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. About the Role: As a Senior Software Engineer, you will lead ...

required in Python, SQL, Spark, Databricks and Customer Consultancy We're working with a fast-growing, high-performing technical consultancy seeking an experienced Data Engineer to join a team specialising in data, AI and software solutions across Defence and financial services. Headquartered in Newcastle, the business … working on cutting-edge technology for Defence and National Security. The Role You'll play a key role in you'll building the data foundations that Defence programmes depend on, working across projects ranging from production data pipelines and applications to POCs and making sensitive ...

RoleWe are seeking a talented Senior Software Engineer to help build and run the data services and platform behind Datalex's dynamic pricing and offer optimisation. This is a Python-first, backend and infrastructure-focused role: you will work on end-to-end solutions — from robust application code … data pipelines through to APIs, infrastructure-as-code, and production monitoring. You will design and maintain the services that turn large volumes of pricing and offer data into fast, reliable, production-grade functionality, and you will help integrate machine learning and optimisation models into that pipeline. ...

Airports Group) is hiring a Lead Data Engineer to shape Cavu's data platform. You will lead a team of Data Engineers while building scalable, cloud-based data pipelines and supporting analytics, forecasting and ML. Reporting to Head of Data Engineering, you will define strategy, drive best practices, partner with data scientists and analysts, and ensure data governance, security and quality across data lakehouse and streaming architectures. #J-18808-Ljbffr ...

Data Engineer London - 4-5 Days per Week in Office £70,000-£90,000 + Equity + Benefits We're working with a rapidly growing, YC-backed healthcare AI startup building a market-leading data platform used by pharmaceutical, biotech and healthcare organisations. The Opportunity This … users or founders to shape solutions Shipped products that generated real business value The successful candidate will help build and scale the core data infrastructure powering the company's platform, taking ownership of projects from raw data acquisition all the way through to production-ready products. ...

Scrumconnect Consulting is seeking an experienced Software Developer to join our engineering team, focusing on data engineering and platform solutions. You will design, build, and maintain data pipelines and infrastructure to support secure, reliable, and scalable public sector services. You will work with AWS, Terraform, Spark ...

Software and Data Engineer Location: West Midlands, office based Salary: £45,000 to £50,000 Contract: Permanent Hours: Monday to Thursday, 8am to 5pm. Friday, 8am to 1pm. I am working with an established manufacturing business that is investing in its internal technology capability. They are looking … Software and Data Engineer to take ownership of business critical applications, data pipelines and systems integrations. This is a varied, hands on role where you will solve live technical issues while delivering longer term improvements across the business. The role You will: * Develop and improve applications ...

development, automation, and general software engineering. The successful candidate will play a key role in building and deploying machine learning features and data-driven applications. You will work on end-to-end solutions – from writing robust code and unit tests to developing APIs and integrating machine learning models …/CD and automation tools; experience using Git for version control and platforms like Bitbucket for code collaboration; knowledge of build tools and pipeline configuration (Jenkins) to automate testing and deployment. Strong problem‐solving and analytical skills. Presentation and teamwork skills. Understanding of both Waterfall and Agile methodologies. #J ...