1,226 to 1,250 of 2,483 Data Pipeline Jobs in the UK

ready to lead cutting-edge data solutions that drive smarter pricing, market analysis, and investment strategies? Join a leader in its field, working alongside a passionate, highly skilled team with sustainability at the core of everything they do. What You'll Do: Take ownership … design and development of scalable, cloud-based data infrastructure, with a primary focus on Google Cloud Platform (GCP).Lead, mentor, and develop the existing team of two data engineersBuild and optimise robust data pipelines with Python, Snowflake, and Databricks, ensuring seamless integration into business ...

that supports how our engineering teams build and operate complex systems at scale. Take the next step in your career. As a Security Data and Platform Engineer, you will combine broad security engineering expertise with deep knowledge of security data pipelines and Elastic Security. … organisation’s Security Data SME, you will own the onboarding, tuning, stabilisation and evolution of security telemetry across cloud, hybrid and corporate environments. Alongside this specialist focus, you will contribute as a well‐rounded Security Engineer, applying software engineering, automation and platform thinking to solve a broad range ...

third‐party tools. Work with message brokers (RabbitMQ) to design event‐driven and asynchronous integration patterns. Collaborate with stakeholders to ensure seamless data flow across interconnected systems. Design, develop, and maintain background ETL processes for data ingestion, transformation, and loading. … Build and optimize data pipelines that support analytics, reporting, and operational workflows. Ensure data integrity, reliability, and traceability across all pipeline stages. Contribute to and lead discussions on system architecture, ensuring solutions are robust, scalable, and maintainable. Define technical standards and patterns for backend services ...

Morson is seeking a Senior Data Engineer – Customer Data in London (Waterloo) on a hybrid basis. This six-month contract role pays £650–£700 per day Inside IR35 and focuses on building reliable, production-grade data ingestion and transformation pipelines for customer data capabilities. You will design and operate scalable data pipelines, support Customer 360 initiatives, and collaborate with senior engineers to drive data solutions in a modern software engineering environment. #J-18808-Ljbffr ...

AtkinsRéalis is seeking Data Architects to join the Solution Design team and help shape our customers' digital journeys. You will design and communicate data-centric solutions, lead data architecture initiatives, and contribute to enterprise data strategy within a government/defense oriented … context. The role requires experience across data modelling, governance, data pipelines, and modern platforms on cloud and on‐prem environments, with a strong stakeholder engagement and a pragmatic, #J-18808-Ljbffr ...

supports how our engineering teams build and operate complex systems at scale. Take the next step in your career. The roleAs a Security Data and Platform Engineer, you will combine broad security engineering expertise with deep knowledge of security data pipelines and Elastic Security. … organisation's Security Data SME, you will own the onboarding, tuning, stabilisation and evolution of security telemetry across cloud, hybrid and corporate environments. Alongside this specialist focus, you will contribute as a well-rounded Security Engineer, applying software engineering, automation and platform thinking to solve a broad range ...

Disputes ML team and help build our new ML-driven dispute optimisation suite. You will work on end-to-end features from data pipelines to model deployment, collaborating with platform and backend engineers to scale production systems. Applicants should have 5+ years in ML/MLOps, strong Python ...

automation solutions on the Microsoft Fabric/Power Platform stack, while driving adoption through training and stakeholder engagement. Responsibilities include developing AI/data pipelines, applying LLMs to consulting workflows, building IDP capabilities, and delivering executive-ready Power BI #J-18808-Ljbffr ...

hands-on software engineer to design and implement scalable AI deployment workflows, integrating client systems with our platform. You will contribute to data pipelines, build APIs, and optimize end-to-end AI production readiness. Requirements include 2+ years in software engineering, strong Python/Go skills, cloud experience ...

senior Full-Stack Developer to design, build and deploy scalable software for UK government projects. You will work across frontend, backend and data pipelines, balancing hands-on engineering with technical leadership. The role uses Python, TypeScript, SQL with Azure and GCP, Docker and Linux; you’ll mentor engineers ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … approach, you’re comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. The Role: We are seeking an AI Data Scientist to help build intelligent, data-driven products. You will design, develop, and deploy machine learning models, working across data ...

Data Scientist Consultant Fully Remote (Need right to work in UK) Inside IR35 £500 - £640 Per Day Start Immediately The Company They are a well-established organisation with a strong focus on data-driven innovation within financial services and credit analytics. Their teams develop sophisticated modelling … solutions, risk products, and decisioning tools powered by extensive commercial data assets. With continued investment in cloud technologies and advanced analytics, they are building the next generation of AI and machine learning capabilities. You will join a collaborative environment that values technical excellence, innovation, and commercial impact. ...

Functions, and serverless architectures. Hands‐on experience with Python development for automation, API integrations, scripting, and cloud‐native application development. Experience building AI data pipelines, including document ingestion, preprocessing, metadata enrichment, chunking, embedding generation, vector indexing, and retrieval workflows. Familiarity with AI prompt development, prompt tuning, prompt templates ...

Develop and deploy AI-powered features in production , including RAG (Retrieval-Augmented Generation) systems, multi-agent infrastructure, and evaluation frameworks (Evals) . Create data pipelines for AI model training, evaluation, and continuous improvement. Mentor junior developers and promote engineering best practices. Required Qualifications 5+ years of professional software ...

What You’ll Do Design & Build robust software systems – develop scalable backend services and APIs that power our AI-driven applications. Develop & Optimise data pipelines – implement efficient, reliable systems for ingesting, processing, and serving financial data. Engineer Cloud-Native Solutions on AWS (Lambda, ECS/EKS, S3, Redshift ...

Develop and deploy AI-powered features in production , including RAG (Retrieval-Augmented Generation) systems, multi-agent infrastructure, and evaluation frameworks (Evals) . Create data pipelines for AI model training, evaluation, and continuous improvement. Mentor junior developers and promote engineering best practices. What you can expect ...

Have: Experience building or integrating LLM-powered features in production (RAG pipelines, agent workflows, evaluation frameworks) Familiarity with sports tech, real-time data pipelines, or performance-sensitive consumer applications Experience with infrastructure-as-code or deployment automation Location Candidate can be located in London Ontario with occasional travel ...

systems and CI/CD pipelines. REST API Services: Proficient in designing and consuming RESTful web services. Kafka: Skilled in implementing real‐time data pipelines and messaging systems. Splunk: Expertise in monitoring, logging, and troubleshooting application performance. Team Leadership: Proven experience in leading, mentoring, and managing development teams. ...

experience or strong demonstrable ability considered). Desirable (but not required) Experience with Kubernetes or container orchestration. Exposure to ML/AI projects, data pipelines, or research-driven engineering. Experience with observability tooling, CI/CD, and testing best practices. Degree in Computer Science, Engineering, or related technical ...

technologies Designing solutions across AWS and GCP Building AI services using AWS Bedrock Evaluating and integrating foundation models and LLM platforms Building APIs, data pipelines and integrations between AI services and existing enterprise systems Leading technical decisions around scalability, performance, security and AI governance Taking AI prototypes ...

Responsibilities Design, train, and evaluate deep learning models for computer vision tasks (e.g., classification, detection, segmentation, tracking, retrieval...). Build and maintain scalable data pipelines for training and evaluation. Optimize model architectures for performance, accuracy, and efficiency (e.g., pruning, quantization, distributed training). Contribute to research and prototyping ...

team, the post holder will act as a trusted analytical partner, helping stakeholders understand their information requirements and translating these into high-quality data products, dashboards, reports, and insights. The role combines advanced analytical and technical expertise with strong stakeholder engagement skills, requiring the post holder to build … maintain effective relationships across multiple organisations. They will lead on the development of complex datasets, reporting solutions, data pipelines, and automation processes, while ensuring high standards of data quality, governance, and information security. PRINCIPAL DUTIES & RESPONSIBILITIES Leadership Coaching/mentoring more junior Information Analysts within ...

Searchability NS&D in Gloucester is seeking a Data Engineer for a permanent role with active Enhanced DV clearance. Hybrid working when possible, on-site in Gloucester when required. You will design and manage data pipelines, ETL processes, and data integration for National Security … clients using Apache tools including NiFi, Kafka, and SQL/NoSQL databases like MongoDB. Proficiency in Groovy, Python or Java for ETL, data modeling, and data governance is essential. #J-18808-Ljbffr ...

Understand defence and security users' needs in situational awareness and force protection, then scope solutions Design, build, and deploy Palantir Foundry data pipelines, ontology models, and operator-facing applications Integrate live intelligence into existing workflows, common operating pictures, and command-and-control tooling Build and tune custom widgets … Highest-signal resume keywords Palantir Foundry Development Python Programming Docker Containerization Kubernetes Orchestration Solutions Engineering Experience ATS Optimization Keywords Hard Skills Data Pipeline Development Ontology Modeling Application Development SQL Programming Java Programming TypeScript Programming JavaScript Programming Bash Scripting Go Programming Networking Fundamentals Soft Skills Stakeholder Communication Problem ...

Hybrid working pattern - 2 days per week from London Bridge Office Hometrack is seeking an experienced Senior Data Engineer to join our product team to help us deliver Hometrack's Data Services ambitions. By building the best property data sets available, which back … open the door to helping all our customers make the decisions that matter to them - to buy, to lend, to build. The Data Services team works with 100s of customers across the property sector ranging from mortgage lenders, house builders, investors, fin & proptech, insurers, telco, retail and utilities ...