201 to 225 of 294 Data Pipeline Jobs in the UK excluding London

Role * Design testing strategies for AI and LLM-powered applications * Build automated evaluation frameworks and test suites * Validate complex integrations, APIs and data pipelines * Work closely with AI Solutions Engineers throughout the delivery lifecycle * Integrate testing into CI/CD pipelines and development workflows * Define QA standards ...

Senior/Principal Palantir Engineer UK (Hybrid) | Permanent | Data & AI Platform About the Role: Highly reputable organisation currently building a high-impact Data & AI capability and are looking for a Senior/Principal Palantir Engineer to help shape and scale their platform from the ground up. … Exciting opportunity to work at the intersection of data engineering, AI, and operational systems, designing solutions that directly drive business decisions and real-world outcomes. You will play a key role in delivering enterprise platforms using Palantir Foundry and AIP, working closely with stakeholders across engineering, operations ...

Manchester, this permanent full-time role plays a key part in supporting football decision-making across City Football Group (CFG) through advanced data engineering and analytics solutions. Working within the Football Intelligence team, you will help build and maintain scalable, reliable and well-governed data systems … will help ensure large volumes of football data are accurately ingested, transformed and integrated into reliable systems and user-facing solutions. Alongside pipeline development and quality assurance, you will support the productionisation of machine learning and statistical models, helping to ensure analytics solutions are scalable, efficient ...

call support rota. Essential Skills Experience in DevOps, Cloud Operations, Application Support, or Production Support. AWS cloud experience. CI/CD pipeline management. Infrastructure as Code (Terraform, CloudFormation, Ansible, etc.). Scripting skills (Python, PowerShell, Bash). Database experience (SQL Server, Oracle, or MySQL). Strong troubleshooting, incident management … capabilities. Desirable Skills Docker and Kubernetes. Jenkins, Bamboo, CircleCI, or similar tools. Networking knowledge (DNS, SSL, Load Balancing). ETL or data pipeline experience. Telecoms, contact centre, or customer experience platform exposure . About You You'll be a proactive problem-solver with a strong sense ...

Data Engineer Location: Belfast (Hybrid) Eligibility: UK work authorisation required We're working with a highly regarded technology consultancy delivering complex data solutions for global financial markets clients. Due to continued growth, they're looking for a Data Engineer to join their Belfast team … work on large scale, data intensive platforms within a fast paced engineering environment. This is a strong opportunity for an engineer who enjoys building robust data pipelines, working with modern tooling, and solving real world technical challenges alongside experienced data and software professionals. ...

Engineering responsibilities: Design and implement scalable Databricks Lakehouse platforms on AWS and/or Azure aligned to client requirements Architect end-to-end data platforms including ingestion, storage (Delta Lake), processing, and consumption layers Build and configure cloud infrastructure using infrastructure-as-code (e.g. Terraform & Declarative Automation Bundles … Establish secure, compliant environments including networking (VNet/VPC, Private Link), identity (IAM/Entra ID), data governance (Unity Catalog), and access controls Define environment strategies (dev/test/prod), CI/CD pipelines, and release processes for Databricks deployments Implement monitoring, logging, cost optimisation, and performance ...

Junior Data Engineer FTC (Azure) up to £45,000 + Benefits Remote (UK - occasional office visits) This is a great opportunity to join a high-growth organisation where you can take ownership of building and supporting modern data pipelines within a rapidly evolving data platform team. THE COMPANY: This is within the legal industry and is with a client who are significantly investing in its data and technology function, creating exciting opportunities for engineers looking to grow in a forward-thinking environment. THE ROLE: You will take ownership of supporting ...

Junior Data Engineer FTC (Azure) up to £45,000 + Benefits Remote (UK - occasional office visits) This is a great opportunity to join a high-growth organisation where you can take ownership of building and supporting modern data pipelines within a rapidly evolving data platform team. THE COMPANY: This is within the legal industry and is with a client who are significantly investing in its data and technology function, creating exciting opportunities for engineers looking to grow in a forward-thinking environment. THE ROLE: You will take ownership of supporting ...

STAFF AI ENGINEER £200,000 LONDON This is a rare opportunity to join a rapidly scaling, PE-backed data platform business and take ownership of building a next-generation AI-native data layer. Working directly with the Group CTO, you'll play a pivotal role … shaping both the technical direction and the future of their global data products. THE COMPANY This organisation is a global leader in B2B data and business intelligence, operating across 200+ countries and supporting industries such as fintech, compliance, and fraud prevention. Backed by private equity ...

HEAD OF AI ENGINEERING £200,000 LONDON This is a rare opportunity to join a rapidly scaling, PE-backed data platform business and take ownership of building a next-generation AI-native data layer. Working directly with the Group CTO, you'll play a pivotal role … shaping both the technical direction and the future of their global data products. THE COMPANY This organisation is a global leader in B2B data and business intelligence, operating across 200+ countries and supporting industries such as fintech, compliance, and fraud prevention. Backed by private equity ...

exciting opportunity for a Data Engineer (GCP) to join a fast-growing business in London is looking for a hands-on engineer to support and evolve their data platform. Based in London 2 days a week in the office 3 months initially Start date: ASAP … Outside Ir35 The Job As the Data Engineer (GCP), your responsibilities will include: Managing and optimising data pipelines and workflows within Google Cloud Platform Working extensively with BigQuery to process large-scale datasets Integrating and managing data from Google Analytics and Google Ad Manager ...

Analytics Engineer Farringdon, London/HYBRID UP TO £60,000 Overview This is a standout opportunity to join a growing data function at an organisation where data is becoming central to how the business operates. You will step into a highly visible role with real influence … owning end to end delivery across data pipelines, modelling, and reporting while helping to shape standards and ways of working from an early stage. The Company They are a globally operating design and professional services organisation delivering complex projects across a wide range of sectors. Headquartered in London ...

Design scalable, secure, and high-performance AI/ML solutions Translate business requirements into end-to-end AI architectures Lead the design of data pipelines, model training environments, and deployment frameworks Implement best practices for MLOps, CI/CD, and model life cycle management Evaluate and recommend … tools, platforms, and frameworks Ensure alignment with data governance, security, and regulatory requirements (e.g. GDPR) Collaborate with key stakeholders across data, engineering, and business teams Provide technical leadership and architectural oversight across AI initiatives Experience Required Extensive experience (typically 8-12+ years) in technology, with ...

Role: Senior Azure DevOps Engineer (Kafka) Location: Remote (UK) Salary: £75k + 10% Bonus Key Skills: Azure Terraform Kubernetes Kafka Data platforms Overview We're partnering with a fast-growing SaaS organisation building a modern, data-driven platform that powers better insight into behaviour, performance … They're scaling their platform capability and are now looking for a Platform Engineer to help design, build, and evolve their cloud and data infrastructure. This is a hands-on role spanning cloud infrastructure, DevOps, and data platform engineering. The Role You'll work across Azure ...

deployment environments. Experience with frontend technologies such as React, Next.js, TypeScript, or similar frameworks. Familiarity with vector databases, graph databases, semantic search, structured data pipelines, or knowledge graph tooling. Someone who thinks beyond prompt engineering. Should be experienced in the architecture of reasoning systems: how agents decide what ...

architecture, including model strategy, orchestration frameworks, APIs, and integration standards. Establish architectural patterns for Generative AI, agentic systems, retrieval-augmented generation, and data pipelines at scale. Lead the selection and optimisation of the AI technology stack, balancing capability, cost, risk, and vendor considerations. Drive the adoption of shared ...

Data Engineer - Hybrid (East Yorkshire - 1 day/week on-site) - £70,000 with great benefits We're looking for a Data Engineer to join a fast-growing technology business that builds and runs the data platforms behind a global operation supporting thousands … customers. This is a genuine opportunity to get hands-on with a modern Azure and Snowflake-based stack, working alongside a collaborative data team that's actively investing in better tooling, cleaner pipelines, and smarter ways of turning data into decisions. You'll be involved ...

This is a hands-on technical and analytical role where your work will directly support commercial pricing decisions through the development of robust data pipelines, workflow automation and production-ready model deployment. You'll work closely with pricing analysts and stakeholders across the business to ensure pricing models … data processes are scalable, accurate and operationally effective. We're looking for someone who enjoys solving complex technical challenges, working with data and building automated solutions that drive real commercial value within a fast-paced pricing environment. Responsibilities include: Support the successful delivery of Consumer pricing ...

possible to track and then present KPIs effectively across the Group. Main responsibilities Support the implementation and development of the Group Microsoft Fabric data environment Design and maintain data ingestion pipelines from multiple source systems Develop and maintain data models to support reporting … interactive dashboards. Ensuring the dashboard, reporting and design process uses the most appropriate formats to gain maximum user engagement and insight. Ensuring the data integrity of all reports, dashboards, and analysis. Assist in the governance and documentation of BI solutions, including data dictionaries and report inventories. ...

days onsite, London) Position Type: Permanent Salary: £50,000 - £60,000 per annum + Benefits Experience Required: 6-8 years in Data Integration/ETL About the Role Are you a seasoned Data Integration specialist with deep expertise in cloud ecosystems? We are seeking a Senior … modern data warehouses like Snowflake or Databricks . Performance Tuning: Act as the senior technical lead for debugging, advanced error handling, and pipeline optimization to ensure high scalability and performance. Collaboration: Partner closely with Solution Architects and Business Analysts to translate complex requirements into technical realities, ensuring ...

Voila, Power BI, GitHub, Vue, Nuxt AEC Platforms & Standards: Revit, Revit API, pyRevit, Rhino, Grasshopper, IES VE (and it’s Python API), BIM data standards (IFC, COBie) Cloud & Infrastructure: AWS/Azure, Git, Ansible Extract, Transform and Load (ETL) Responsibilities Key responsibilities of the roleIn addition … plugins that integrate with AEC platforms (e.g. Revit, Rhino, IES). To support the Director responsible in developing the technical strategy for data and software initiatives aligned with the practice’s digital transformation goals. Designing and implementing data pipelines and analytics dashboards to support project performance ...

Azure AI Foundry, Azure OpenAI, AI Search, agents and RAG patterns. Strong practical knowledge of databases, including SQL and NoSQL platforms, schema design, data access patterns, query performance and secure data handling. Ability to design, build and review maintainable code while following agreed coding standards, architectural …/CD workflows, branching strategies, pull requests and automated testing using tools such as Playwright. Experience with Microsoft Fabric, Lakehouse architecture, data pipelines or analytics engineering would be beneficial, especially where data needs to be prepared for reporting, automation or AI use cases. Role Build ...

helping organisations transform and deliver high-quality, scalable solutions that truly matter. Overview: We are looking for a highly skilled AWS DevOps/Data Engineer to design, build, and maintain scalable, resilient, and high-performing cloud-based data solutions. The ideal candidate will have strong DevOps … expertise combined with data engineering capabilities, working across modern cloud technologies and automation frameworks. Key Responsibilities: Translate technical requirements into effective DevOps toolchains to enable product delivery Design and implement resilient, scalable, and highly available services Automate infrastructure, deployments, and testing using Infrastructure as Code (IaC) Ensure deployment ...

Data Scientist London £450 - £500 Per Day Outside IR35 Immediate Start 3 Days In Office The Company They are a data-driven organisation operating at scale, with a strong focus on leveraging analytics to improve performance and customer outcomes. Their teams bring together expertise across data … modern tools and encourages continuous learning. The Role and Deliverables Build, validate, and deploy machine learning models to solve business problems Translate complex data into actionable insights for non-technical stakeholders Work with structured and unstructured datasets to uncover trends and opportunities Collaborate with data engineers ...

etc.) with libraries/frameworks such as PyTorch, TensorFlow etc.) * Experience with RAG and LLM-based solutions * Solid understanding of AI architectures and data pipelines * Knowledge of security, compliance, and governance principles from a development perspective * Proven mentoring and team development capabilities * Excellent communication and stakeholder management skills ...