451 to 475 of 657 Data Pipeline Jobs in the UK

with 20+ years of experience , combining deep hands‐on engineering capability with strategic advisory skills. You will sit at the intersection of AI, data, product, and business , translating ambiguous commercial objectives into deployable, production‐grade solutions that directly support transaction strategy, value creation, and post‐merger integration. … cases Translate complex business and transaction challenges into concrete technical and architectural solutions Forward Deployment & Solution Delivery Lead forward deployment of AI, data, and analytics solutions directly within client environments Design and implement end‐to‐end solutions covering data ingestion, modeling, orchestration, and deployment Rapidly prototype ...

Developer to help build connected digital services that link industrial systems with cloud analytics. This role focuses on turning real-world device data into usable insights for operations, maintenance, and performance improvement. You’ll work across IoT devices, cloud platforms, and software systems, building scalable data pipelines and applications. What you’ll do Build and maintain IoT data pipelines from edge devices to cloud systems Work with industrial protocols such as CAN, Modbus, and Ethernet Develop Python-based tools for data ingestion, automation, and processing Design and manage Azure cloud ...

groups, and neurodivergent candidates. We offer reasonable adjustments throughout the hiring process and are dedicated to creating a supportive, accessible environment for everyone. Data Engineer (Snowflake) Location Erskine, Newcastle, Farnborough or London Candidates must be eligible for clearance and be a sole UK national Were looking … passionate Data Engineer whos excited to grow, collaborate, and shape meaningful data solutions. If you enjoy solving problems, learning new technologies, and working in a supportive environment where diverse perspectives are valued, wed love to meet you. Key Responsibilities Partner with the team to coordinate ...

Senior Site Reliability Engineer (SRE) - Data & AI Platforms Location: Glasgow, Scotland (Hybrid - 3 days onsite, non-negotiable) Duration: 6 months with extensions likely Day rate: PAYE circa £430 We are seeking an experienced Senior Site Reliability Engineer to support a strategic, data- and AI-driven platform … delivering operational intelligence at scale. This role sits at the intersection of software engineering, platform operations, and data infrastructure, with a strong focus on reliability, automation, and continuous improvement. Key Responsibilities: Own reliability, availability, and performance across DEV, QA, and PROD environments Apply SRE principles (SLIs/SLOs ...

Lead Data Engineer | London (5 days onsite) | £110k-£130k + equity Lead Data Engineer wanted for a high-growth AI company building a platform that is transforming how operational workflows are managed within the property sector. Their product is already live with customers and handling real … take full ownership of the data foundations that the entire platform will be built on. The role 0 1 build: pipelines, data infrastructure, ML/AI workflows Work directly with founders and shape technical direction High ownership, real impact from day one What they're looking ...

scratch. The Role You will work directly with the technical co-founders to bring structure, scalability, and best practices across their ML and data setup, ensuring it is ready to support multiple enterprise deployments. Key responsibilities: * Audit current ML architecture, pipelines, and MLOps practices * Identify gaps in documentation … clear structure across model development, versioning, and deployment * Improve training and retraining workflows * Strengthen model monitoring, evaluation, and performance tracking * Support productionisation and inference pipeline improvements * Ensure systems are maintainable for future hires * Provide a clear, pragmatic path from pilot to production You will also contribute to ongoing analytical ...

technical roadmap and improving the Software Development Life Cycle (SDLC). Key Responsibilities: Design, develop, and maintain high-performance backend services for complex data processing systems Architect scalable solutions for high-volume calculations and data pipelines Optimize database schemas, write efficient SQL queries, and improve database …/CD pipelines and version control systems Experience with Python is a plus Qualifications & Experience: Bachelors or Masters degree in Computer Science, Data Science, Information Technology, Electrical Engineering, or a related field (or equivalent practical experience) Experience in a regulated industry, preferably within banking or financial services Proactive ...

well contribute to the overall technical road-map and the SDLC. Key Responsibilities: • Develop and maintain high-performance backend services for complex data processing workloads • Design scalable architectures for large-volume calculations and data pipelines • Optimize database tables, write SQL queries and optimize existing database architecture …/CD pipelines and version control • Experience with Python, a plus Qualifications & Experience: • Bachelor’s or Master's degree in Computer Science, Data Science, Information Technology, Electrical Engineering, or a related field, or equivalent experience, essential • Experience working in a regulated industry, preferably banking or finance • Proactive approach ...

technical roadmap and improving the Software Development Life Cycle (SDLC). Key Responsibilities: Design, develop, and maintain high-performance backend services for complex data processing systems Architect scalable solutions for high-volume calculations and data pipelines Optimize database schemas, write efficient SQL queries, and improve database … pipelines and version control systems Experience with Python is a plus Qualifications & Experience: Bachelor’s or Master’s degree in Computer Science, Data Science, Information Technology, Electrical Engineering, or a related field (must have) Experience in a regulated industry, preferably within banking or financial services Proactive mindset with ...

work on cutting‐edge AI initiatives as organisations accelerate their adoption of artificial intelligence across industries. You will collaborate with experienced engineers and data scientists, leveraging modern AI, machine learning, and Generative AI technologies to build scalable, production‐ready solutions while continuously learning and experimenting with emerging tools … approaches. Your responsibilities: Assist in designing, building, and maintaining scalable data pipelines for structured and unstructured data. Develop, train, and evaluate machine learning and deep learning models, including neural networks. Work with Large Language Models (LLMs) for tasks such as text generation, summarisation, and semantic analysis. Contribute ...

totaled $13.8 billion. Experience : Minimum 10+ Years Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Specialization in designing and implementing large-scale data pipelines, ETL processes, and distributed systems Should be able to work independenty with minimal help/guidance Good Understanding of Airflow,Data Fusion … Data Flow Strong Background and experience in Data Ingestions,Transformation,Modeling and Performance tuning. One migration Experience from Cornerstone to GCP will be added advantage Suppport the design and development of BigData echosystem Experience in building complex SQL Queries Strong Communication Skills ...

partnering with a leading business in the West Midlands to recruit a Senior Data Engineer for a newly created permanent position. The role offers a salary of up to £75,000 plus a bonus of up to 15%. This is a hybrid role, requiring attendance … office on average twice per month, with flexibility to come in as needed. The Role We are for Senior Data Engineers with strong Databricks experience to join a newly established data function wihin a global organisation. You will play a key role in the implementation ...

implement scalable, reliable, and performant backend systems. Develop and maintain microservices, containerized applications, and supporting infrastructure. Solve complex problems with practical solutions and data-driven approaches. Contribute to architecture discussions, code reviews, and testing strategies. Identify performance or reliability bottlenecks and propose improvements. Required Qualifications & Experience Strong experience … system design and desire to build elegant, maintainable solutions. General understanding of supporting infrastructure: git, microservices, containers, etc. Comfortable working with numbers and data, with or without prior trading/finance experience. Experience with writing unit and integration tests and maintaining CI/CD pipelines. Preferred Qualifications & Experience ...

ensure solutions work in real-world environments. Key Responsibilities: Deploy and configure software solutions in client environments Integrate systems across cloud, APIs, and data pipelines Troubleshoot and resolve technical issues on-site or remotely Collaborate with product and engineering teams to improve deployments Support rollout projects and large … system integration, and microservices Client-facing experience or delivery-focused roles Strong problem-solving and communication skills Desirable: Exposure to AI, ML, or data platforms DevOps, CI/CD, or infrastructure as code experience Consulting or technical delivery background Location: UK Hybrid, with occasional client visits ...

systems (LangGraph or similar) Defining best practices across DevOps, CI/CD, and engineering standards Integrating Power Platform tools with enterprise systems and data sources Shaping technical roadmaps, architecture patterns, and reusable frameworks Driving observability, performance, and continuous improvement Collaborating with cross-functional teams including product … experience with GenAI/LLMs and machine learning Experience building AI agents/multi-agent systems Knowledge of APIs, event-driven systems, data pipelines, and security best practices Exposure to Power Platform (Power Apps, Power Automate, Power BI) is a plus Strong stakeholder management and ability to work ...

Data Scientist | Fully Remote | Health and Wellbeing We’re hiring an Data Scientist to help build and ship ML and LLM features in a regulated environment with sensitive data. You’ll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn … Python for data science and ML Practical experience with LLM frameworks (e.g. LangChain) Familiar with Spark/Kafka and End-to-end pipeline experience Databricks, MLflow, Docker, Kubernetes Clear communication with technical and non-technical stakeholders If you are interested apply below or email me directly mmatysik ...

looking for a talented and versatile developer to join us and manage our technology stack end to end — from custom development and data engineering through to platform management across our SaaS ecosystem. We are based in Bath and meet once/twice a week in the office, working … Role description We are looking for a well-rounded technologist who thrives on variety and can move fluidly between writing code, digging into data and managing our wider platform ecosystem. You must be all over the latest in AI opportunities, including the adoption of AI-supported code editors ...

event-driven architectures and background processing pipelines (e.g. Celery, Redis Streams, Kafka) to enable scalable async workloads, retries, and fault-tolerant integrations. Design data models and optimise relational databases (PostgreSQL) for performance, partitioning, and horizontal scale. Introduce caching, rate limiting, and queuing to meet performance budgets and latency … including streaming responses, async inference jobs, and robust error/retry semantics. Palantir Foundry Integration Work with Palantir Foundry to build and maintain data pipelines, ontologies, and integrations that connect backend services to Foundry-based analytics and workflows. Leverage Foundry's APIs and tooling to support data ...

Your Responsibilities: Design and maintain scalable data pipelines using PySpark, Python, and distributed computing frameworks to support high‐volume data processing. Architect and optimize AWS-based data and AI infrastructure, ensuring secure, performant, and cost‐efficient ingestion, transformation, and storage. Develop, finetune, benchmark … prompt management, evaluation, and GenAI operations. Collaborate with cross-functional teams to integrate GenAI capabilities into production systems and ensure high-quality data, governance, and operational reliability Your Profile: Strong experience with PySpark, distributed data processing, and largescale ETL/ELT pipelines. Strong SQL expertise including ...

Title: Data Engineer Clearance required: Active SC (SC Clearance with any governing body) Location: Telford- requires attendance for occasional workshops (typically a couple of days per month) Job Description: We are looking for an experienced Data Engineer - Talend and Unix Expert to join our team … help deliver database and ETL solutions. You will: Design and implement robust, secure and performant data integration solutions. Build, operate and improve data pipelines (ingestion, transformation, curation) with monitoring, alerting and SLAs. Collaborate with product teams and client stakeholders to refine requirements and align decisions ...

Clearance Required Overview This is a hands-on leadership role combining architecture, software engineering, and team leadership, with a focus on Software, AI, data platforms, and cloud-native systems. Key Responsibilities Lead and mentor Agile engineering teams, driving high-quality, rapid delivery (DevSecOps) Own solution architecture, designing … secure and constrained environments. Lead the implementation of the "underpinning tech" for AI, including data pipelines. Act as a trusted advisor to UK Government stakeholders. Define technical roadmaps and support cloud transformation (AWS/Azure) Core Skills Background in UK National Security/Defence/Government. Strong leadership ...

responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor … products and services Design solutions for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs ...

Socure is seeking a Senior Data Scientist in the United Kingdom to enhance identity verification and fraud risk management. This role involves building scalable data pipelines, leveraging advanced AI techniques, and collaborating cross-functionally. Candidates should have at least 5 years' experience in data ...

actual business impact. This one sits right in the middle. We’re hiring a Forward Deployed Engineer for a fast-growing B2B data SaaS company transforming how sales teams define and target their markets. TL;DR Location: London (hybrid) Setup: 2-3 days in office Language: English Focus … Data modelling, integrations, customer delivery Stack: CRM (Salesforce/HubSpot), APIs, JSON, data warehouse Comp: ~£65-75k base + bonus Growth: 315% YoY The role You’ll work directly with customers and commercial teams to build and deliver custom datasets that drive real revenue outcomes. ...

models, and scalable API platforms. Key Responsibilities Own the technical strategy and execution across the company’s core products, including real-time APIs, data pipelines, and LLM-powered analytics. Collaborate closely with Product and Data Science to deliver a forward-thinking technology roadmap. Lead, mentor … high-performing engineering team (currently ~10), nurturing a culture of ownership, speed, and technical excellence. Make key architectural decisions, ensuring system scalability and data infrastructure performance. Maintain high engineering standards while remaining close to critical technical choices. Recruit top talent and build a strong, inclusive team culture. Oversee ...