726 to 750 of 1,184 Data Pipeline Jobs in the UK excluding London

Key Responsibilities: Design, develop, and maintain scalable data pipelines for ingestion, transformation, and delivery of structured and unstructured data. Collaborate directly with traders, quantitative analysts, and portfolio managers to understand data needs and deliver actionable insights. Integrate and manage real-time market data feeds (e.g., Bloomberg, ICE, CME) and internal trading systems. Build and … optimize data models for pricing, risk, and PnL analytics. Ensure high availability and performance of data infrastructure in a low-latency trading environment . Implement data quality checks , monitoring, and alerting systems. Work closely with DevOps and infrastructure teams to deploy solutions in cloud and on-prem environments. Required Skills & Experience Strong proficiency in … Python , including libraries such as Pandas, NumPy, and PySpark. Experience with data engineering tools (e.g., Airflow, Kafka, SQL, Parquet). Solid understanding of commodities markets , trading workflows, and financial instruments. Familiarity with cloud platforms (AWS, Azure, or GCP) and containerization (Docker, Kubernetes). Proven ability to work in fast-paced, high-pressure environments with direct exposure to the More ❯

Key Responsibilities: Design, develop, and maintain scalable data pipelines for ingestion, transformation, and delivery of structured and unstructured data. Collaborate directly with traders, quantitative analysts, and portfolio managers to understand data needs and deliver actionable insights. Integrate and manage real-time market data feeds (e.g., Bloomberg, ICE, CME) and internal trading systems. Build and … optimize data models for pricing, risk, and PnL analytics. Ensure high availability and performance of data infrastructure in a low-latency trading environment . Implement data quality checks , monitoring, and alerting systems. Work closely with DevOps and infrastructure teams to deploy solutions in cloud and on-prem environments. Required Skills & Experience Strong proficiency in … Python , including libraries such as Pandas, NumPy, and PySpark. Experience with data engineering tools (e.g., Airflow, Kafka, SQL, Parquet). Solid understanding of commodities markets , trading workflows, and financial instruments. Familiarity with cloud platforms (AWS, Azure, or GCP) and containerization (Docker, Kubernetes). Proven ability to work in fast-paced, high-pressure environments with direct exposure to the More ❯

Sr. Databricks Engineer Location: Glasgow Duration: 31/12/2026 Days on site: 2-3 MUST BE PAYE THROUGH UMBRELLA Role Description: We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on designing … building, and optimizing scalable data solutions using the Databricks platform. Key Responsibilities: • Lead the migration of existing AWS-based data pipelines to Databricks. • Design and implement scalable data engineering solutions using Apache Spark on Databricks. • Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. • Optimize performance … and cost-efficiency of Databricks workloads. • Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools. • Ensure data quality and reliability through robust unit testing and validation frameworks. • Implement best practices for data governance, security, and access control within Databricks. • Provide technical mentorship and guidance to junior engineers. Must-Have Skills: • Strong More ❯

Sr. Databricks Engineer Location: Glasgow Duration: 31/12/2026 Days on site: 2-3 MUST BE PAYE THROUGH UMBRELLA Role Description: We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on designing … building, and optimizing scalable data solutions using the Databricks platform. Key Responsibilities: • Lead the migration of existing AWS-based data pipelines to Databricks. • Design and implement scalable data engineering solutions using Apache Spark on Databricks. • Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. • Optimize performance … and cost-efficiency of Databricks workloads. • Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools. • Ensure data quality and reliability through robust unit testing and validation frameworks. • Implement best practices for data governance, security, and access control within Databricks. • Provide technical mentorship and guidance to junior engineers. Must-Have Skills: • Strong More ❯

Sr. Databricks Engineer Location: Glasgow Duration: 31/12/2026 Days on site: 2-3 MUST BE PAYE THROUGH UMBRELLA Role Description: We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on designing … building, and optimizing scalable data solutions using the Databricks platform. Key Responsibilities: • Lead the migration of existing AWS-based data pipelines to Databricks. • Design and implement scalable data engineering solutions using Apache Spark on Databricks. • Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. • Optimize performance … and cost-efficiency of Databricks workloads. • Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools. • Ensure data quality and reliability through robust unit testing and validation frameworks. • Implement best practices for data governance, security, and access control within Databricks. • Provide technical mentorship and guidance to junior engineers. Must-Have Skills: • Strong More ❯

Mid & Senior Data Engineers (Databricks) | London | up to £85k + Bonus Multiple roles Are you a Databricks expert ready to make a real impact? Join our high-growth consultancy and help shape the future of data platforms for some of the UK’s most asset-intensive industries. 📍 Location: London (Hybrid – 2 days/week onsite) 📄 Role … base + up to 20% bonus (based on performance & commercial impact) 🔍 What’s the Opportunity? We’re on the lookout for a Mid/Senior Data Engineer to take a leading role in our expanding Databricks practice . With two senior team members moving on and demand growing fast, this is your chance to step into a high … and DevOps ✅ What You Bring Must-Haves: 5+ years in data engineering Deep hands-on experience with Databricks Strong grasp of medallion architecture & DLT Proven experience in pipeline migration & optimization Excellent communication skills—technical and non-technical audiences Comfortable in fast-paced, client-facing environments Nice-to-Haves: Unity Catalog experience Certifications (Databricks, Azure, AWS) Industry experience More ❯

Mid & Senior Data Engineers (Databricks) | London | up to £85k + Bonus Multiple roles Are you a Databricks expert ready to make a real impact? Join our high-growth consultancy and help shape the future of data platforms for some of the UK’s most asset-intensive industries. 📍 Location: London (Hybrid – 2 days/week onsite) 📄 Role … base + up to 20% bonus (based on performance & commercial impact) 🔍 What’s the Opportunity? We’re on the lookout for a Mid/Senior Data Engineer to take a leading role in our expanding Databricks practice . With two senior team members moving on and demand growing fast, this is your chance to step into a high … and DevOps ✅ What You Bring Must-Haves: 5+ years in data engineering Deep hands-on experience with Databricks Strong grasp of medallion architecture & DLT Proven experience in pipeline migration & optimization Excellent communication skills—technical and non-technical audiences Comfortable in fast-paced, client-facing environments Nice-to-Haves: Unity Catalog experience Certifications (Databricks, Azure, AWS) Industry experience More ❯

Mid & Senior Data Engineers (Databricks) | London | up to £85k + Bonus Multiple roles Are you a Databricks expert ready to make a real impact? Join our high-growth consultancy and help shape the future of data platforms for some of the UK’s most asset-intensive industries. 📍 Location: London (Hybrid – 2 days/week onsite) 📄 Role … base + up to 20% bonus (based on performance & commercial impact) 🔍 What’s the Opportunity? We’re on the lookout for a Mid/Senior Data Engineer to take a leading role in our expanding Databricks practice . With two senior team members moving on and demand growing fast, this is your chance to step into a high … and DevOps ✅ What You Bring Must-Haves: 5+ years in data engineering Deep hands-on experience with Databricks Strong grasp of medallion architecture & DLT Proven experience in pipeline migration & optimization Excellent communication skills—technical and non-technical audiences Comfortable in fast-paced, client-facing environments Nice-to-Haves: Unity Catalog experience Certifications (Databricks, Azure, AWS) Industry experience More ❯

CD pipelines and container orchestration at scale Modernising Linux-based deployment and runtime systems used by trading and quant teams Automating everything - from developer tooling to monitoring and data pipelines Collaborating directly with traders, quants, and developers in a fast-paced, low-latency environment What we’re looking for: 5+ years’ experience in DevOps, Systems, or Platform Engineering More ❯

CD pipelines and container orchestration at scale Modernising Linux-based deployment and runtime systems used by trading and quant teams Automating everything - from developer tooling to monitoring and data pipelines Collaborating directly with traders, quants, and developers in a fast-paced, low-latency environment What we’re looking for: 5+ years’ experience in DevOps, Systems, or Platform Engineering More ❯

CD pipelines and container orchestration at scale Modernising Linux-based deployment and runtime systems used by trading and quant teams Automating everything - from developer tooling to monitoring and data pipelines Collaborating directly with traders, quants, and developers in a fast-paced, low-latency environment What we’re looking for: 5+ years’ experience in DevOps, Systems, or Platform Engineering More ❯

ll be doing: Leading small, less experienced client teams Supporting collaborative delivery across tech and business stakeholders Documenting processes and presenting solutions clearly Working with GenAI, LLMs and data pipelines in a secure, on-prem environment Required Skillset: 5+ years DevOps experience Strong communication & presentation skills Proven leadership in client-facing roles Team-oriented mindset with mentoring ability More ❯

ll be doing: Leading small, less experienced client teams Supporting collaborative delivery across tech and business stakeholders Documenting processes and presenting solutions clearly Working with GenAI, LLMs and data pipelines in a secure, on-prem environment Required Skillset: 5+ years DevOps experience Strong communication & presentation skills Proven leadership in client-facing roles Team-oriented mindset with mentoring ability More ❯

ll be doing: Leading small, less experienced client teams Supporting collaborative delivery across tech and business stakeholders Documenting processes and presenting solutions clearly Working with GenAI, LLMs and data pipelines in a secure, on-prem environment Required Skillset: 5+ years DevOps experience Strong communication & presentation skills Proven leadership in client-facing roles Team-oriented mindset with mentoring ability More ❯

and development approach, with a strong emphasis on team collaboration. This is a stimulating environment where systems must operate in real-time, requiring robust event-driven architectures, streaming data pipelines, and reactive programming. You’ll tackle complex scalability challenges across distributed systems, ensuring speed and reliability under heavy user loads. Security and compliance are central to the platform More ❯

and development approach, with a strong emphasis on team collaboration. This is a stimulating environment where systems must operate in real-time, requiring robust event-driven architectures, streaming data pipelines, and reactive programming. You’ll tackle complex scalability challenges across distributed systems, ensuring speed and reliability under heavy user loads. Security and compliance are central to the platform More ❯

and development approach, with a strong emphasis on team collaboration. This is a stimulating environment where systems must operate in real-time, requiring robust event-driven architectures, streaming data pipelines, and reactive programming. You’ll tackle complex scalability challenges across distributed systems, ensuring speed and reliability under heavy user loads. Security and compliance are central to the platform More ❯

and development approach, with a strong emphasis on team collaboration. This is a stimulating environment where systems must operate in real-time, requiring robust event-driven architectures, streaming data pipelines, and reactive programming. You ll tackle complex scalability challenges across distributed systems, ensuring speed and reliability under heavy user loads. Security and compliance are central to the platform More ❯

and development approach, with a strong emphasis on team collaboration. This is a stimulating environment where systems must operate in real-time, requiring robust event-driven architectures, streaming data pipelines, and reactive programming. You'll tackle complex scalability challenges across distributed systems, ensuring speed and reliability under heavy user loads. Security and compliance are central to the platform More ❯

Python, LLMs, RAG, and LangChain or similar frameworks Deep understanding of GCP services: Vertex AI, BigQuery, Cloud Functions, Pub/Sub, etc. Experience with batch and real-time data pipelines Familiarity with AI assurance, governance, or ethical AI is a bonus Ability to work independently and collaboratively in fast-paced environments Role- 6 months (potential to extend) Outside More ❯

technology and desire to mentor a team. You will hold proven experience of architecting solutions using Python (FastAPI/FlasK) and will lead the technical designs for APIs, data pipelines, cloud infrastructure and backend orchestration. You will also have experience with AWS, while familiarity with MongoDB would be advantageous to your application. In this role of significant responsibility More ❯

and development approach, with a strong emphasis on team collaboration. This is a stimulating environment where systems must operate in real-time, requiring robust event-driven architectures, streaming data pipelines, and reactive programming. You’ll tackle complex scalability challenges across distributed systems, ensuring speed and reliability under heavy user loads. Security and compliance are central to the platform More ❯

and development approach, with a strong emphasis on team collaboration. This is a stimulating environment where systems must operate in real-time, requiring robust event-driven architectures, streaming data pipelines, and reactive programming. You’ll tackle complex scalability challenges across distributed systems, ensuring speed and reliability under heavy user loads. Security and compliance are central to the platform More ❯

and development approach, with a strong emphasis on team collaboration. This is a stimulating environment where systems must operate in real-time, requiring robust event-driven architectures, streaming data pipelines, and reactive programming. You’ll tackle complex scalability challenges across distributed systems, ensuring speed and reliability under heavy user loads. Security and compliance are central to the platform More ❯

and development approach, with a strong emphasis on team collaboration. This is a stimulating environment where systems must operate in real-time, requiring robust event-driven architectures, streaming data pipelines, and reactive programming. You'll tackle complex scalability challenges across distributed systems, ensuring speed and reliability under heavy user loads. Security and compliance are central to the platform More ❯