426 to 450 of 499 Data Pipeline Jobs in the UK

Data Platform Architect Our client now requires a talented Data Architect for long-term well-known client of theirs. They are a growing consultancy that has a vast number of long-term projects with major brands. The role needs a seasoned Data Platform architect … Streaming/Messaging: Hands-on experience with Kafka . Programming Language: Proficiency in Python . Domain: Platform Engineering is highly desired over standard data pipelining. They are building the platform foundation, not data pipelines/lakes. The ideal candidate will be able to execute highly technical ...

Data Platform Architect Our client now requires a talented Data Architect for long-term well-known client of theirs. They are a growing consultancy that has a vast number of long-term projects with major brands. The role needs a seasoned Data Platform architect … Streaming/Messaging: Hands-on experience with Kafka . Programming Language: Proficiency in Python . Domain: Platform Engineering is highly desired over standard data pipelining. They are building the platform foundation, not data pipelines/lakes. The ideal candidate will be able to execute highly technical ...

work within a large-scale environment, helping to connect systems, partners, and ecommerce platforms through robust, scalable integrations. If you enjoy solving complex data challenges and building reliable integration solutions using Microsoft technologies, this role offers the chance to make a real impact. What You'll Be Doing … Build and enhance integrations that connect systems, platforms, and partners Develop reliable data pipelines to support seamless data flow across the business Work with APIs and modern integration technologies Troubleshoot issues and collaborate with cross-functional teams to deliver scalable solutions What You'll Bring Strong ...

Description: Role: AWS Site Reliability Engineer (SRE) - Data Platform Location: Remote (UK-based) Contract Length: Initial 3 months (with potential for extension) IR35 Status: Inside IR35 Clearance: SC Clearance preferred About the Role We are looking for an experienced AWS Site Reliability Engineer (SRE) to join our team … month contract. You will be embedded within a high-impact team dedicated to ensuring the reliability, scalability, and performance of our AWS-hosted Data Platform. If you live and breathe observability, love tearing down operational toil through automation, and know how to keep complex cloud ecosystems running smoothly ...

focus areas: Building scalable data pipelines using Apache Spark & Airflow Working within a cloud-based, containerised environment (Kubernetes) Contributing to a wider data platform modernisation programme Supporting both batch and streaming workloads Tech: Python, Java, Spark, Airflow, SQL, Cloud (AWS/Azure), Kubernetes (Kafka/streaming … month contract 3 days onsite - City of London They're looking for a strong, hands-on engineer (5+ years) with experience in big data/distributed systems and modern data platforms. Please click here to find out more about our Key Information Documents. Please note that ...

home. What you’ll be doing Building and evolving customer-facing platforms, internal tools, and operational systems Working across APIs, services, frontends, and data pipelines Pairing, reviewing code, and solving problems as a team Shipping fast, learning quickly, and improving continuously What we’re looking … Cloud-native – AWS or Azure in real production environments Polyglot engineer – comfortable picking up and switching languages Full-stack capability – frontend, backend, APIs, data Hands-on builder – scripts, CLIs, background workers, not just web apps Modern architecture – serverless, event-driven systems, or breaking apart monoliths Data ...

with the dev team to guide the provision of Software Development for an exciting new AI product. Key Responsibilities:- Architect and build scalable data pipelines and infrastructure Design and maintain data ingestion, transformation, and storage architectures for operational and AI workloads. Develop and manage batch … Real Time data pipelines. Build and optimize systems for vector search, retrieval, and ML data pipelines. Ensure data reliability, security, and governance across the platform. Collaborate with AI and Back End engineering teams to support training, inference, and product features. Implement monitoring, observability ...

opportunity to work at the heart of a fast-paced trading environment, partnering directly with traders, analysts, and business stakeholders to deliver critical data and technology solutions that drive commercial decision-making. You'll join a high-calibre engineering team building and enhancing the systems, data … solutions supporting Front Office trading activities Work closely with traders and business users to understand requirements and deliver scalable solutions Design and enhance data pipelines, reporting solutions, and operational tooling Support and improve critical business applications and databases Contribute to performance tuning, automation, and continuous improvement initiatives Collaborate ...

proofs of concept, leveraging AI/Gen AI tooling to accelerate delivery ("vibe coding"). Build and integrate AI, Generative AI and Data-driven features into products. Work within an Agile environment, contributing to sprint planning, stand-ups and iterative delivery. Collaborate closely with product, design and data … DynamoDB, etc.). Demonstrable experience in rapid prototyping and AI-assisted/"vibe coding" workflows. Exposure to AI, Generative AI and/or Data projects and tooling. Experience working in Agile delivery environments. Excellent communication skills and proven stakeholder management ability. Ability to work hybrid from Bristol. Desirable ...

systems using modern cloud-native and streaming technologies. Key Responsibilities Develop event-driven integrations and backend services Build connectors, event-processing services, and data pipelines Design scalable integration patterns, schemas, and event flows Develop CDC pipelines and resilient messaging solutions Improve observability through logging, metrics, and tracing Deploy … streaming technologies Enterprise system integrations and API design Agile development experience Strong communication and collaboration skills Desirable Skills Go and/or Python CDC pipeline development Azure cloud experience Observability tooling (Prometheus, Grafana, OpenTelemetry) Experience within regulated environments What's on Offer Hybrid working - 2 days per week ...

directly by Product Owners, Business Analysts, and Scrum Masters. Specifically, our core engineering focus sits at the intersection of trade booking architectures, static data management, and real-time connectivity workflows. This team is responsible for managing the continuous, asynchronous transaction data pipelines that ingest live trade ...

systems using Python? Do you thrive on solving complex engineering challenges? About the team: You will join an Agile squad within Elsevier's Data Engineering. The squad builds and operates multiple systems that support many internal-facing systems and customer-facing workflows. Our focus is on building scalable … reliable services and data pipelines that improve productivity for authors, users, and customers About the role: We are looking for a motivated and skilled Software Engineer III to build and maintain software systems in a distributed environment. You will contribute to technical delivery across multiple components, collaborate with ...

real-time production environments. You'll design and build scalable systems using Node.js and TypeScript, working across REST APIs, event-driven architecture, data pipelines, and distributed systems, ensuring performance, reliability, and scalability as the platform grows. This is a hands-on leadership role where you'll set technical … direction, mentor/manage engineers, and contribute to engineering culture, while collaborating closely with AI engineers, data teams, and product stakeholders to translate complex workflows into robust, production-grade systems. You'll be responsible for building and maintaining scalable backend services, APIs, and integrations, designing microservices and event ...

will facilitate research and development within the healthcare sector! This company's diagnostics visualisation platform allows medical researchers to visualise and analyse clinical data in order to develop new treatments that will massively improve the lives of patients. Key to this is the creation of secure multi-tenant … multi-region storage solution that allows swift and secure access to various types of data. Data security and integrity is of paramount importance, and the solution needs to be compliant with healthcare industry software standards. This role calls for strong AWS skills, rapid application development, and software development ...

incidents and investigations Implement platform-level changes to support incident response and remediation Support detection engineering including rule deployment, tuning, and validation Resolve data quality, alerting, and detection gaps impacting operational effectiveness Support automation and SOAR initiatives (e.g. Sentinel, Logic Apps) Collaborate with SOC providers to maintain SIEM … understanding of SIEM, XDR, and security platform integrations Experience in hybrid (on-prem and cloud) environments Strong troubleshooting skills across platforms, integrations, and data pipelines Experience with scripting/automation (PowerShell, Python or similar) Strong understanding of networking, cloud, and infrastructure fundamentals Experience in regulated environments (e.g. financial ...

that will help us ship new products and features quickly while keeping risk and cost low. This will involve working closely with Product, Data Science, Fraud Prevention Analysts and our Fraud agents to strike the right balance between scaling quickly and mitigating risk efficiently. What do you need … growth mindset and focus on delivering user and business value. Nice to Have: Understanding of basic machine learning concepts and experience building data pipelines. Mentorship experience, helping team members grow and contributing to a culture of continuous learning. What do we offer: Starting salary ...

that will help us ship new products and features quickly while keeping risk and cost low. This will involve working closely with Product, Data Science, Fraud Prevention Analysts and our Fraud agents to strike the right balance between scaling quickly and mitigating risk efficiently. What do you need … growth mindset and focus on delivering user and business value. Nice to Have Understanding of basic machine learning concepts and experience building data pipelines. Mentorship experience, helping team members grow and contributing to a culture of continuous learning. What do we offer Starting salary ...

that will help us ship new products and features quickly while keeping risk and cost low. This will involve working closely with Product, Data Science, Fraud Prevention Analysts and our Fraud agents to strike the right balance between scaling quickly and mitigating risk efficiently. What do you need … growth mindset and focus on delivering user and business value. Nice to Have: Understanding of basic machine learning concepts and experience building data pipelines. Mentorship experience, helping team members grow and contributing to a culture of continuous learning. Qualifications Additional Information Interested? Find out more: How we work ...

will have significant autonomy to shape how we build, what technologies we adopt, and how we scale our systems to handle the data volumes and performance demands of a world‐class trading operation. You'll lead a team of talented engineers while staying deeply hands‐on with … best practices. Drive technical strategy and roadmap alongside product leadership, translating business requirements into robust, scalable technical solutions. Architect systems that handle high data volumes, real‐time streaming, and low‐latency interactions — the kind of challenges you’d find on a trading platform processing millions of events ...

that's doing something genuinely different: not another reporting dashboard, but an ontology-driven intelligence layer that transforms fragmented ERP, CRM, and HR data into a clear, unified picture of profit, cost, and operational performance. Early-stage but well-funded, with a strong engineering culture and direct access … using Cloud Run, BigQuery, and Pub/Sub Contribute to the productionisation of financial intelligence models into API-driven services Implement robust data pipelines using batch/streaming architectures Work closely with data scientists and senior engineers to translate model outputs into platform features Write clean ...

complex multi-platform environment. Reporting directly to the CEO, you will act as the organisation's trusted technical voice, connecting systems, improving data integrity, strengthening vendor accountability, and helping create a scalable technology foundation for future growth. This is a hands-on role suited to someone who enjoys … build, test, and support integrations across Microsoft Dynamics CRM, Business Central, SaaS platforms, and other business systems. Develop and maintain API-based integrations, data pipelines, webhooks, and automated workflows. Troubleshoot integration issues, data discrepancies, and system connectivity challenges. Support platform upgrades, system enhancements, and data ...

complex multi-platform environment. Reporting directly to the CEO, you will act as the organisation's trusted technical voice, connecting systems, improving data integrity, strengthening vendor accountability, and helping create a scalable technology foundation for future growth. This is a hands-on role suited to someone who enjoys … build, test, and support integrations across Microsoft Dynamics CRM, Business Central, SaaS platforms, and other business systems. Develop and maintain API-based integrations, data pipelines, webhooks, and automated workflows. Troubleshoot integration issues, data discrepancies, and system connectivity challenges. Support platform upgrades, system enhancements, and data ...

London. This is a hands-on platform engineering role, focused on owning the software, tooling, web UI, and infrastructure layer used by data operators, ML engineers, and robotics engineers. You will be responsible for building and improving the internal applications and orchestration tooling that support robot data … collection, dataset workflows, model training infrastructure, and on-robot deployment. The Role You will: * Own and extend internal web applications used for robot data collection, review, QA, and dataset publishing* Build and maintain FastAPI backends, vanilla JavaScript frontends, CLI tooling, and supporting services* Improve recording workflows, state machines ...

Experis - ManpowerGroup is seeking an experienced Finance Data Design Lead for a critical insurance transformation programme in London. The role bridges architecture and engineering to implement finance and actuarial data solutions. The ideal candidate will design finance data models, define data pipelines ...

doing You’ll play a key role in maintaining and evolving our core engineering platforms, including: Backstage and internal developer portal capabilities Engineering data platforms, including ELT workflows, DBT and SQL-based data pipelines Observability and monitoring Grafana platforms Internal automation and workflow platforms that support … Supporting integration across internal platforms and tooling Improving the developer experience through self-service tooling, templates and golden paths Using engineering insights and data to drive continuous improvement Providing technical guidance and support to engineering teams Driving adoption of modern platform tools and practices Mentoring Platform Engineers ...