426 to 450 of 583 Data Pipeline Jobs in the UK

implement scalable, reliable, and performant backend systems. Develop and maintain microservices, containerized applications, and supporting infrastructure. Solve complex problems with practical solutions and data-driven approaches. Contribute to architecture discussions, code reviews, and testing strategies. Identify performance or reliability bottlenecks and propose improvements. Required Qualifications & Experience Strong experience … system design and desire to build elegant, maintainable solutions. General understanding of supporting infrastructure: git, microservices, containers, etc. Comfortable working with numbers and data, with or without prior trading/finance experience. Experience with writing unit and integration tests and maintaining CI/CD pipelines. Preferred Qualifications & Experience ...

analytics, launched out of Y Combinator's W20 cohort . We've since shipped more than a dozen products , including: A built-in data warehouse , so users can query product and customer data together using custom SQL insights. A customer data platform , so they … send their data wherever they need with ease. PostHog AI , an AI-powered analyst that answers product questions, helps users find useful session recordings, and writes custom SQL queries. Next on the roadmap are CRM, workflow, revenue analytics, and support products. When we say every product that companies ...

Description We are partnering with a leading business in the West Midlands to recruit a Senior Data Engineer for a newly created permanent position. The role offers a salary of up to £75,000 plus a bonus of up to 15%. This is a hybrid role, requiring … attendance in the office on average twice per month, with flexibility to come in as needed. The Role We are for Senior Data Engineers with strong Databricks experience to join a newly established data function wihin a global organisation. You will play a key role ...

required for this role. Our client are seeking a Software Developer to contribute to the ongoing operation and evolution of a large-scale data platform supporting complex analytical use cases. The platform consolidates event data from a wide range of user-facing systems, processing and publishing … Distributed data processing using Apache Spark. Workflow scheduling and orchestration with Apache Airflow. Containerisation and environment management using Docker. CI/CD pipeline implementation and maintenance using GitLab. Awareness of and experience with security scanning and vulnerability tooling (e.g. Trivy, Trend Micro, Wiz or similar). ...

required for this role. Our client are seeking a Software Developer to contribute to the ongoing operation and evolution of a large-scale data platform supporting complex analytical use cases. The platform consolidates event data from a wide range of user-facing systems, processing and publishing … Distributed data processing using Apache Spark. Workflow scheduling and orchestration with Apache Airflow. Containerisation and environment management using Docker. CI/CD pipeline implementation and maintenance using GitLab. Awareness of and experience with security scanning and vulnerability tooling (e.g. Trivy, Trend Micro, Wiz or similar). ...

next phase. You’ll take ownership of a full-stack AI platform, working across: Backend APIs and core platform (Python/FastAPI) Data pipelines and processing workflows Cloud infrastructure and deployments (Azure, Docker, Kubernetes) Frontend features (React/TypeScript) Key Responsibilities Build and maintain backend services and APIs … Backend: Python, FastAPI Frontend: React, TypeScript Cloud: Azure (or AWS/GCP equivalent) DevOps: Docker, Kubernetes, CI/CD Data: ETL pipelines, data processing What We’re Looking For Strong Python engineering experience Experience building APIs/backend services Hands-on with cloud + containerisation (Azure ...

event-driven architectures and background processing pipelines (e.g. Celery, Redis Streams, Kafka) to enable scalable async workloads, retries, and fault-tolerant integrations. Design data models and optimise relational databases (PostgreSQL) for performance, partitioning, and horizontal scale. Introduce caching, rate limiting, and queuing to meet performance budgets and latency … including streaming responses, async inference jobs, and robust error/retry semantics. Palantir Foundry Integration Work with Palantir Foundry to build and maintain data pipelines, ontologies, and integrations that connect backend services to Foundry-based analytics and workflows. Leverage Foundry's APIs and tooling to support data ...

Title: Senior Engineering Lead – Azure Cloud Data Platform Work Location: Cardiff, UK (Hybrid - once a week working from office) Job Description: Key Responsibilities Provide strategic guidance and technical leadership to the Nucleus product team, ensuring alignment with business objectives and cloud best practices. Support, develop and evolve … Event Grid. Experience with Azure messaging and integration services, particularly Azure Service Bus, Event Hubs, and API Management. Demonstrable expertise in Azure data services including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure Data Lake Storage. Familiarity with Azure SQL, Cosmos ...

worry if the skill set is not an exact match I would still like to hear from you! Job Title: GCP Data Engineer (DBT, Cloud Composer, Python, Terraform) Location: Edinburgh (hybrid/2 days a week) Circa: 575 GBP/Day inside IR35 - no VISA sponsorship available Duration … months initially (TBC) Start: ASAP Role Overview We are seeking an experienced GCP Data Engineer with strong expertise in DBT, Cloud Composer, Python, and Terraform. This role will focus on migrating legacy data platforms and regulatory use cases (e.g., risk, finance, RWA) to GCP, while actively ...

Socure is seeking a Senior Data Scientist in the United Kingdom to enhance identity verification and fraud risk management. This role involves building scalable data pipelines, leveraging advanced AI techniques, and collaborating cross-functionally. Candidates should have at least 5 years' experience in data ...

analytics, launched out of Y Combinator's W20 cohort . We've since shipped more than a dozen products , including: A built-in data warehouse , so users can query product and customer data together using custom SQL insights. A customer data platform , so they … send their data wherever they need with ease. PostHog AI , an AI-powered analyst that answers product questions, helps users find useful session recordings, and writes custom SQL queries. Next on the roadmap are CRM, messaging, revenue analytics, and support products. When we say every product that companies ...

business impact. This one sits right in the middle. We’re hiring a Solutions/Forward Deployed Engineer for a fast-growing B2B data SaaS company transforming how sales teams define and target their markets. TL;DR Location: London (hybrid) Setup: 2-3 days in office Language: English … Focus: Data modelling, integrations, customer delivery Stack: CRM (Salesforce/HubSpot), APIs, JSON, data warehouse Comp: ~£65-75k base + bonus Growth: 315% YoY The role You’ll work directly with customers and commercial teams to build and deliver custom datasets that drive real revenue ...

models, and scalable API platforms. Key Responsibilities Own the technical strategy and execution across the company’s core products, including real-time APIs, data pipelines, and LLM-powered analytics. Collaborate closely with Product and Data Science to deliver a forward-thinking technology roadmap. Lead, mentor … high-performing engineering team (currently ~10), nurturing a culture of ownership, speed, and technical excellence. Make key architectural decisions, ensuring system scalability and data infrastructure performance. Maintain high engineering standards while remaining close to critical technical choices. Recruit top talent and build a strong, inclusive team culture. Oversee ...

Database Data Engineer | London (3 days a week onsite) | up to £100,000 Peaple Talent have partnered with a forward-thinking financial services organisation transforming access to credit across the UK. With a strong reputation for customer trust and innovation, they’re now looking for a Data Engineer with deep database expertise to play a critical role in modernising and scaling their data platforms. 💻 The Role This is a database-heavy Data Engineer position where you’ll take ownership of designing, optimising and evolving production-critical systems across AWS. Particularly using ...

just coding - you're solving some of the most exciting challenges and problem solving in enterprise AI rollout, spanning enterprise data pipelines, multi-agent orchestration/workflows and RAG/SLM finetuning. Responsibilities Lead the technical solution design and implementation of large-scale Agentic and Knowledge AI solutions … tuning techniques, security/guardrails and broader landscape of Enterprise & Agentic AI. Qualifications Undergraduate, master’s degree or Phd in Computer Science or Data Science 6–10+ years of experience in engineering, with 2+ years in customer-facing or field roles. Proven success building and deploying AI/ ...

most ambitious and well‐known brands. Key Responsibilities Shape and own enterprise-level customer engagement and NBA strategies that connect marketing, data, and technology to deliver business growth and customer value. Set the strategic direction for client maturity progression - architecting the roadmap from campaign-based engagement to fully … autonomous, real-time decisioning ecosystems. Define the vision and guardrails for the use of AI, adaptive models, and contextual data - ensuring responsible, value-driven application of advanced NBA capabilities. Oversee translation of business strategy into decisioning blueprints, prioritised use cases, and measurable success outcomes across multiple channels ...

role are required to hold an active DV security clearance, or SC clearance with eligibility for DV. Hexegic are looking for technically minded data and software engineers to work on an intriguing and exciting project, building and maintaining data pipelines and platforms for our customers … with similar languages API awareness for data retrieval and integration into processing pipelines Experience of stakeholder management and requirements capture Understanding of pipeline scheduling and health checks What’s in it for you? Base salary of £50,000-£70,000 £5000 a year professional development budget Wellness ...

scalability, and security best practices Collaborate cross-functionally with Product, Design, and Frontend teams Contribute to architectural decisions and mentor other engineers Develop data-driven backend services and pipelines Support production systems and deployments within a small, high-performing team Qualifications 5+ years of professional software engineering experience … Experience with LLM APIs (e.g., OpenAI, Anthropic, Gemini) and LangChain Background in AI/ML (e.g., generative models, GANs, diffusion, regression) Experience building data pipelines and data-driven systems Familiarity with workflow orchestration tools (e.g., Temporal, Prefect) Why Join Be part of a fast-growing company ...

Marketing Data Analyst/Scientist (SQL) London/WFH to £80k 13 month FTC - July start Do you have expertise with analysing marketing data combined with excellent stakeholder management and communication skills? You could be progressing your career in an impactful Marketing Data Analyst … global FinTech/CFD trading company that has been consistently voted as one of the UKs top employers. As a Marketing Data Analyst/Scientist you will analyse marketing campaign performance across digital channels to drive insights, optimise campaigns and improve marketing effectiveness, collaborating with Product Managers ...

Description Data Engineer (Denodo) - SC ClearedSanderson Government & Defence Sanderson Government & Defence is supporting a major UK public sector programme and is seeking an experienced Data Engineer with strong Denodo expertise to join a high-performing delivery team. This is a client-facing role within a dynamic … data services environment, requiring excellent communication skills, a proactive mindset, and strong commercial awareness. You will play a key role in delivering data integration solutions across multiple connected systems, supporting large-scale migration and transformation initiatives. Key Responsibilities Work within a client-facing team to deliver ...

Role We are partnering with a global tech and media giant to hire a Senior Data Engineer. You will build and scale the massive data pipelines that track how millions of users interact with the platform across smart TVs, gaming consoles, and major social media apps. … What You'll Do Architect, build, and maintain complex, high-volume data pipelines. Act as a technical leader to set engineering standards and best practices. Partner with Product Managers and Data Scientists to turn business requests into reliable data models. Mentor junior engineers ...

with skilled interim and temporary professionals, fostering workplaces where everyone can contribute and succeed. On behalf of Computershare, we are looking for a Data & Automation Engineer (Python/SQL) for a 12 Months contract based in London (Hybrid - 3 Times per week in the office) Join … Data & Automation Engineer (Python/SQL) We're looking for a Data & Automation Engineer to join a high-performing team supporting critical back-office processes and data operations. You'll design and deliver Python and SQL-based solutions to automate workflows and respond ...

Description The RoleWe are partnering with a global tech and media giant to hire a Senior Data Engineer. You will build and scale the massive data pipelines that track how millions of users interact with the platform across smart TVs, gaming consoles, and major social media … apps. What You'll Do Architect, build, and maintain complex, high-volume data pipelines. Act as a technical leader to set engineering standards and best practices. Partner with Product Managers and Data Scientists to turn business requests into reliable data models. Mentor junior engineers ...

Security (NatSec) domain. This is a hands-on leadership role combining architecture, software engineering, and team leadership, with a focus on Software, AI, data platforms, and cloud-native systems. Key Responsibilities Lead and mentor Agile engineering teams, driving high-quality, rapid delivery (DevSecOps) Own solution architecture, designing … secure and constrained environments. Lead the implementation of the "underpinning tech" for AI, including data pipelines. Act as a trusted advisor to UK Government stakeholders. Define technical roadmaps and support cloud transformation (AWS/Azure) Core Skills Background in UK National Security/Defence/Government. Strong leadership ...

join a growing advanced analytics and AI capability. This is a hands-on engineering role building and deploying ML solutions in highly secure, data-rich environments , where work directly contributes to national-level outcomes. Why this role? This is an opportunity to work on real-world, high-impact … environments Working with large, complex datasets in secure infrastructures Supporting the development of AI-driven capabilities for mission-critical systems Collaborating with engineers, data scientists, and security specialists Contributing to the full ML lifecycle from data prep to deployment What you'll be doing Develop ...