476 to 500 of 901 Data Pipeline Jobs in the UK excluding London

client, a leading global SaaS organisation is looking for a Senior Data Analyst to work on exciting AI/ML user experience projects for a 12 month contract. Hybrid with 3 days on site. Responsibilities; Providing data sources that help build the AI/ML user … experience Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow. Provide observability and monitoring using Monte Carlo and Looker as well as operational tools such as NewRelic and Splunk, driving reliability, data quality, data quality and robustness. Scope and plan ...

Were looking for a proactive, solution-focused end to end developer to join a multidisciplinary reporting team within the National Data and Analytics (NDA) department. In this role, you will be responsible for designing, developing, and delivering high-quality national reporting solutions across one or more business areas. … Youll work alongside fellow developers and data engineers to create reporting products that empower decision-making and drive strategic outcomes. As an NDA developer, youll report directly to the NDA Executive Manager and play a key role in the full delivery lifecyclefrom understanding gathered requirements, data ...

Lead Data Engineer Location: Solihull (Hybrid, 3 days onsite) Salary: Up to £110,000 + Bonus + Benefits This is an opportunity for a Lead Data Engineer to drive the design, development, and optimisation of a modern cloud-based data platform. This … hands‐on leadership role, combining technical architecture, delivery, and team mentorship. Key Skills: Strong experience in a Lead/Senior Data Engineering role Expertise with GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Airflow) Advanced Python and SQL Experience building scalable batch and real-time data ...

Goldman Sachs seeks an Associate in Internal Audit - Data Engineering to design and implement robust data pipelines and analytics. You will work with Python, Pandas, Polars and PySpark to deliver scalable data products and AI-ready insights for audit teams. You will collaborate with … data owners, develop data models, and ensure data quality, lineage and governance across Snowflake, DB2 and PostgreSQL environments in a secure enterprise setting. #J-18808-Ljbffr ...

Data Science ManagerAre you an experienced Data Science leader with a passion for building and scaling AI/ML products? Lead a team of exceptional Data Scientists and ML Engineers building next-generation AI solutions for financial markets. Drive innovation using LLMs, Generative … world business impact. If you're passionate about shaping the future of AI, we'd love to talk to you. ROLE SUMMARYAs a Data Science Manager, you will lead a high-performing team of Data Scientists delivering AI-powered products that create measurable business value ...

5+ years. Here are some things we've worked on recently that give a sense of the work we do: Building a data analytics tool using a Neo4J graph database. A DevOps platform to support 3000 users. Processing digital forensic data to enable search and insight … ElasticSearch cluster. A custom workflow tool using Camunda, with a React/TS front-endAn AI assurance capabilityOrchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. About the Role: As a Platform Engineer at Naimuri, you will ...

seeking a Senior Databricks Architect to design, implement, and optimize enterprise-scale data platforms using the Databricks Lakehouse Platform . The ideal candidate will have deep expertise in Databricks architecture, Apache Spark, Delta Lake, data engineering, cloud platforms, and enterprise data solutions. Key Responsibilities … Design and architect Databricks Lakehouse solutions for large-scaleenterprise data platforms. Lead end-to-end Databricks implementation, including architecture, development, deployment, and optimization. Define Databricks workspace architecture, clusterstrategies, security models, and operational standards. Design and developscalable data pipelinesusing Databricks, Apache Spark, PySpark, SQL, andDelta Lake . ...

Scott Logic is a UK data engineering partner delivering bespoke software and data platforms. You will design and implement data pipelines, build data lakes/warehouses, and transform datasets for analytics, ML, and reporting. You’ll work hands-on with modern tools ...

ENGINEER LONDON/HYBRID UP TO £80,000 This is an exciting opportunity for an Analytics Engineer to take ownership of the full data lifecycle within a growing, data-driven business. You'll work across analytics engineering, data engineering, and business intelligence, helping shape … data powers decision-making, product development, and commercial growth. ROLES AND RESPONSIBILITIES: The Analytics Engineer will: Design, build, and maintain end-to-end data pipelines from source systems through to analytics-ready datasets Develop scalable and well-documented transformation pipelines using dbt and BigQuery Write ...

This is an opportunity for a Data Operations Manager to join a research and analytics business focused on improving data delivery, automation, and operational processes. You'll work across a range of data projects, helping to drive efficiency and support the continued development … data function. The Company They are an established insights and research organisation that works with clients across multiple sectors. The business is investing in technology, automation, and operational improvement to support future growth. You will join a collaborative team where data and technology play ...

team, the post holder will act as a trusted analytical partner, helping stakeholders understand their information requirements and translating these into high-quality data products, dashboards, reports, and insights. Main duties of the job The role combines advanced analytical and technical expertise with strong stakeholder engagement skills, requiring … post holder to build and maintain effective relationships across multiple organisations. They will lead on the development of complex datasets, reporting solutions, data pipelines, and automation processes, while ensuring high standards of data quality, governance, and information security. About us Here is a not-for-profit ...

exciting opportunity for a Data & ML Engineer to join a thriving technology and innovation hub where talented engineers, data specialists and industry experts come together to build solutions that make a real difference. Working across a diverse range of projects, youll have the opportunity to work … with cutting-edge technologies, solve challenging data problems and develop your expertise across the rapidly evolving world of AI. You will have the opportunity to: Design and implement robust data pipelines and ML workflows using Python, SQL, Spark and Databricks. Develop and deploy machine learning models ...

Lorien is seeking a data engineer to support the technical delivery of cyber metrics by establishing reliable data pipelines, transforming source data and enabling automated reporting. You will identify, onboard and integrate cyber security data sources, design automated workflows, develop data models and ensure data quality to boost dashboard reliability. This role emphasizes scalable analytics using Power BI and Databricks to drive security insights. #J-18808-Ljbffr ...

Hippo is seeking a Senior Azure Data Engineer to join our Managed Services Team in the Manchester area. You will lead production data pipelines, collaborate with internal and client teams, and drive platform reliability and data-driven decision making. You’ll apply expertise … Python, Microsoft Fabric, and Azure Data Factory to deliver scalable, automated data solutions, with on-call commitments within a dynamic consultancy environment. #J-18808-Ljbffr ...

Engineering responsibilities: Design and implement scalable Databricks Lakehouse platforms on AWS and/or Azure aligned to client requirements Architect end-to-end data platforms including ingestion, storage (Delta Lake), processing, and consumption layers Build and configure cloud infrastructure using infrastructure-as-code (e.g. Terraform & Declarative Automation Bundles … Establish secure, compliant environments including networking (VNet/VPC, Private Link), identity (IAM/Entra ID), data governance (Unity Catalog), and access controls Define environment strategies (dev/test/prod), CI/CD pipelines, and release processes for Databricks deployments Implement monitoring, logging, cost optimisation, and performance ...

Sword Group is seeking a Data Engineer in the United Kingdom (Glasgow area) to design, build, and optimize scalable data pipelines using Azure Data Factory, Synapse, Fabric, and Databricks. You will collaborate with clients and cross-functional teams to translate business needs into robust … data solutions. Ideal candidates will have hands-on experience with Fabric, data governance, and advanced transformations in SQL, Python, and Spark, with opportunities to mentor junior engineers and grow #J-18808-Ljbffr ...

LangGraph, LangChain, Haystack or similar frameworks. Proven ability to deploy AI/ML systems into production environments. Strong knowledge of inference, latency, performance, data pipelines, memory and tool/function calling. Experience with large‐scale search and retrieval, including embeddings, indexing and querying multi‐modal datasets. Confident with ...

Tech. In this role, you will be directly responsible for leading the technical design, development, and optimization of our regulatory reporting framework and data pipelines, with a strong focus on onboarding new regulations. This is an active engineering leadership position where you will guide a team of developers … write clean, production-grade code, design system components, and troubleshoot complex data processing issues. You will work closely within an Agile team, collaborating with business analysts and other engineers to translate regulatory requirements into reliable, scalable software solutions. Lead and Mentor: Guide and support a team of software ...

About Prophecy The leader in AI-native data preparation and analysis, Prophecy is revolutionizing how the world’s top enterprises turn data chaos into reliable insights. We introduce the AI-native data lifecycle (generate, refine, deploy) where our industry leading AI agents and humans … work hand-in-hand in visual and document interfaces to analyze, transform and prepare data, to ship trusted insights at enterprise scale. To learn more, visit us on LinkedIn. About the Role As a Forward Deployed Solution Engineer, you will be a critical part ...

5+ years. Here are some things we've worked on recently that give a sense of the work we do: Building a data analytics tool using a Neo4J graph database. A DevOps platform to support 3000 users. Processing digital forensic data to enable search and insight … system backed by an Elasticsearch cluster. A custom workflow tool with a React/TS front-endAn AI assurance capabilityOrchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. About the Role: As a Senior Software Engineer ...

Data & Insight Analyst Location: Chertsey (Hybrid – 2 days onsite) At Foodbuy, we’re driving transformation through data. As the procurement and supply chain division of Compass Group UK & Ireland, we sit at the heart of a £2.6bn spend network—delivering insight-led solutions to some of the most … recognisable organisations across healthcare, education, hospitality and business. We’re now looking for a Data & Insight Analyst to join our growing Analytics team, playing a key role in shaping how data and insight drive decision-making across the business. The Role This is a hands ...

5+ years. Here are some things we’ve worked on recently that give a sense of the work we do: Building a data analytics tool using a Neo4J graph database. A DevOps platform to support 3000 users. Processing digital forensic data to enable search and insight … Elasticsearch cluster. A custom workflow tool with a React/TS front‐end. An AI assurance capability. Orchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. About the Role As a Senior Software Engineer, you will lead ...

senior Python engineer who wants to work at the intersection of data platforms and applied AI? This is your opportunity to join a small, high-impact team building something new from the ground up - where your decisions shape the architecture, not just the backlog. At JPMorganChase, we invest … curious, pragmatic, and ready to grow into emerging technology stacks. As a Senior Lead Software Engineer at JPMorganChase within the Corporate Technology Data and Analytics Services team, you will be a founding contributor to the Context Plane - a greenfield platform that connects the firm's data ...

5+ years. Here are some things we've worked on recently that give a sense of the work we do: Building a data analytics tool using a Neo4J graph database. A DevOps platform to support 3000 users. Processing digital forensic data to enable search and insight … ElasticSearch cluster. A custom workflow tool using Camunda, with a React/TS front-endAn AI assurance capabilityOrchestrating a data pipeline and designing specialist metrics for the evaluation of the performance of LLMs in different contexts. About the Role: As a Senior Software Engineer, you will lead ...

required in Python, SQL, Spark, Databricks and Customer Consultancy We're working with a fast-growing, high-performing technical consultancy seeking an experienced Data Engineer to join a team specialising in data, AI and software solutions across Defence and financial services. Headquartered in Newcastle, the business … working on cutting-edge technology for Defence and National Security. The Role You'll play a key role in you'll building the data foundations that Defence programmes depend on, working across projects ranging from production data pipelines and applications to POCs and making sensitive ...