326 to 350 of 500 Data Pipeline Jobs in the UK

helping organisations transform and deliver high-quality, scalable solutions that truly matter. Overview: We are looking for a highly skilled AWS DevOps/Data Engineer to design, build, and maintain scalable, resilient, and high-performing cloud-based data solutions. The ideal candidate will have strong DevOps … expertise combined with data engineering capabilities, working across modern cloud technologies and automation frameworks. Key Responsibilities: Translate technical requirements into effective DevOps toolchains to enable product delivery Design and implement resilient, scalable, and highly available services Automate infrastructure, deployments, and testing using Infrastructure as Code (IaC) Ensure deployment ...

Principal AI Engineer****Are** **you excited about building intelligent systems powered by innovative AI technologies? Do you enjoy creating solutions that turn complex data into impactful outcomes?** **About the team:**Embedded Innovation Teams are cross-functional squads embedded within our segments to rapidly turn internal AI experimentation into … deliver new ones.* Design and govern reusable agentic AI patterns (orchestration, tool use, memory, retrieval).* Ensure delivery meets architecture, security and data-governance standards; recommend infrastructure, hosting and data residency.* Codify validated solutions into patterns, reference implementations, and starter kits so they can be picked ...

Data Engineer - SC Cleared UK (Remote/Hybrid) | £490 per day | 6 Months | Inside IR35 We're seeking an experienced SC Cleared AWS Data Engineer to support a high-profile Central Government programme delivering critical data capabilities within a secure cloud environment. This … excellent opportunity to contribute to nationally significant work while leveraging modern AWS and data engineering technologies. Key Responsibilities Design, build, and optimise scalable cloud-based data pipelines on AWS Develop and maintain robust ETL processes to support complex data integration requirements Implement and manage ...

Data Scientist London £450 - £500 Per Day Outside IR35 Immediate Start 3 Days In Office The Company They are a data-driven organisation operating at scale, with a strong focus on leveraging analytics to improve performance and customer outcomes. Their teams bring together expertise across data … modern tools and encourages continuous learning. The Role and Deliverables Build, validate, and deploy machine learning models to solve business problems Translate complex data into actionable insights for non-technical stakeholders Work with structured and unstructured datasets to uncover trends and opportunities Collaborate with data engineers ...

across eBay Finance by building scalable solutions that improve decision-making and operational efficiency. The team works on complex, often undefined problems using data, AI, and automation. This role focuses on leading end-to-end transformation initiatives, from problem discovery through to production deployment. It involves working across … solution roadmaps Deliver end-to-end AI, machine learning, and automation solutions from concept to production, driving measurable business outcomes Build scalable, reusable data frameworks and pipelines that improve efficiency and enable future innovation Work with large, complex datasets to develop practical solutions that balance speed, accuracy ...

firm is seeking a talented backend engineer to develop the infrastructure for autonomous AI systems. You will work closely with founders to design data pipelines, architect backend services, and ensure optimal integration of various components. The ideal candidate has over 5 years of experience in production-grade Python ...

etc.) with libraries/frameworks such as PyTorch, TensorFlow etc.) * Experience with RAG and LLM-based solutions * Solid understanding of AI architectures and data pipelines * Knowledge of security, compliance, and governance principles from a development perspective * Proven mentoring and team development capabilities * Excellent communication and stakeholder management skills ...

myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Description We are seeking a Data Scientist with experience prototyping, building, and scaling AI applications to join WTW’s Data Science team within our Consulting practice. In this role … will help grow our AI and Data Science advisory capability, working alongside leading insurance market experts to design and deliver cutting edge machine learning and generative AI solutions for the world’s leading general insurers and intermediaries. The Role: As a data scientist, you will operate ...

Overview Principal AI Engineer – you will lead the design and delivery of AI solutions that turn complex data into impactful outcomes. You will serve as the technical lead for an embedded Innovation Squad, owning the entire technical lifecycle from discovery through to production. Role As the senior authority … stakeholders and end users. Your responsibilities include hardening prototypes, delivering new AI services, codifying reusable patterns, mentoring teammates, and ensuring solutions meet security, data‐governance, and architectural standards. Key Responsibilities Own technical execution from discovery to production; build, assess, and harden prototypes and proofs of concept. Design ...

start a career that is out of the ordinary, please apply... Job Details Why this job is important This role is about applying data science where it genuinely matters - in live, production environments that support large‐scale research operations around the world. As a Senior Data … Digital Twins team you'll work on advanced modelling and analytics that improve the quality, reliability and performance of high‐volume data systems. You'll partner closely with engineering, operational and commercial teams, taking ideas from hypothesis through to deployment, and ensuring models deliver real value once they ...

Data Scientist/Financial Intelligence Engineer Remote - Northern Ireland Salary negotiable DOE Full-time, Permanent At a Glance Data science role at a US FinTech scale-up doing something genuinely new Python-first (Pandas, Polars, NumPy) with GCP and LLM exposure Fully remote across Northern Ireland … understood. Rather than layering on more reporting, they've built an ontology-driven intelligence layer that transforms fragmented ERP, CRM, and HR data into a unified, structured picture of profit, cost distortion, and operational performance. Early-stage, well-funded, and building something with genuine intellectual depth. The Role ...

Data Engineer - Contract Rate: £500 per day (inside IR35) Location: Remote with 1 day per month in Leeds Duration: Until March 2027 with the possibility of extension Availability: 2 weeks' notice or less required Clearance: BPSS check required The Role We are working with a leading healthtech consultancy … joined-up system, underpinning services including the Electronic Prescription Service, GP Connect, and the national roll-out of Electronic Patient Records. As the Data Engineer, you will play a hands-on role in designing, building, and maintaining the data pipelines and platform infrastructure that underpin these ...

Data Engineer (Streaming) – Requirements Strong coding in Java (preferred) or Python Experience with Kafka, Flink, or Spark (Flink/Kafka ideal) Solid understanding of stream processing (event time, state, backpressure) Experience building ETL/ELT or real-time data pipelines Knowledge of microservices and distributed systems … with Databricks, Snowflake, or BigQuery Engineering Practices Strong in testing, CI/CD, Git Experience with Terraform, Docker, Kubernetes Experience 3+ years in data engineering Agile experience and strong communication skills Nice to Have Consulting/client-facing experience Real-time/low-latency systems Certifications or mentoring ...

deep technical engine behind their internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … storage supporting current and future AI deployments Troubleshoot integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft ...

deep technical engine behind their internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … storage supporting current and future AI deployments Troubleshoot integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft ...

deep technical engine behind their internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath — data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … storage supporting current and future AI deployments • Troubleshoot integration failures, data inconsistencies, and production issues Key Skills • Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft ...

Data Engineer Opportunity, DV-cleared only London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across defence and security programmes, building modern data platforms and production-grade pipelines that enable better decisions … Process large structured and unstructured datasets, integrating multiple sources Collaborate with stakeholders and delivery teams to drive outcomes Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant ...

role, 1-3 days per week in Farnborough is needed. Key skills required Backed development experience (Mid-senior level) Python Data Pipeline Creation and Management API Creation and Integration Database Creation and Integration Working with JSON If you have worked in a security cleared environment, have ...

Fargate, RDS, ElastiCache, and Lambda. Own the monitoring and observability stack using Datadog APM to reduce alert fatigue and lead incident response. Optimize data pipelines and performance, including Airbyte replication and PostgreSQL tuning for high-concurrency music streaming. The ideal candidate: Deep expertise in AWS (ECS/Fargate ...

Robert Half Technology are assisting a telecommunications business to recruit a Senior Data Platform Engineer on a 9-month contract basis. Hybrid working - Hampshire/London based. ASAP start. Role * The Senior Data Platform Engineer will take full ownership of the production data platform … including ingestion, orchestration, infrastructure, and observability. * Design, build, and deliver scalable data pipelines across CRM, ERP, and billing systems. * Lead platform readiness activities ahead of a critical NetSuite cutover, including hypercare support. * Build and maintain integrations across Salesforce/Ability (CRM), NetSuite/Sage X3 (ERP), and Billing ...

executing the migration to AWS Bedrock. Utilise your strong C# background to ensure AI agents integrate seamlessly with core enterprise systems, APIs, and data pipelines. Refine prompt engineering, agent autonomy, and guardrails to ensure high performance, security, and accuracy. Proven experience building Agentic AI systems (autonomous agents, multi ...

Robert Half Technology are assisting a leading telecommunications business to recruit a Senior Data Platform Engineer on a contract basis. Hybrid working - 2 days on-site in Hampshire every other week. Role * The Senior Data Platform Engineer will take ownership of the end-to-end production … data platform, including ingestion, orchestration, infrastructure, and observability. * Design, develop, and maintain scalable data pipelines across CRM, ERP, and billing systems. * Lead platform readiness activities ahead of a critical NetSuite cutover and provide support during hypercare phases. * Build and maintain integrations across Salesforce/Ability ...

account, partner with your cross-functional team to solve the most critical pain points they are facing, drive strategy and growth by providing data driven insights and recommendations. This would mean finding the right balance and friction to deflect bad actors whilst providing legitimate users with a good … on. For more information on our Analytics Career Map and levelling structure, click here. WHAT YOU’LL BE DOING: Derive actionable insights from data to inform product decisions, to help support and improve onboarding and access to Wise for new and existing customers Partnering with your product manager ...

everyone, everywhere. More about our mission and what we offer . We are looking for an Analyst to sit at the intersection of Data Analytics and Financial Reporting. You aren’t here to do traditional accounting; you are here to build the data infrastructure and automation … that ensures our financial statements are accurate, consistent, and audit-ready as we scale globally. What will you be working on? Metric Ownership & Data Logic: Define and own the logic for key performance metrics. You will ensure there is clear attribution for every line item that manifests ...

conscious, and built to support rapid experimentation and sustainable growth. As our MarTech Manager, you will work cross-functionally with Marketing, Engineering, Product, Data, Legal, and external vendors to build the infrastructure and operational processes that enable marketing at scale. From vendor sourcing and onboarding to integrations, data … evolve Feeld’s marketing technology ecosystem across acquisition, lifecycle, attribution, analytics, and automation platforms Build and maintain scalable integrations, workflows, APIs, and data pipelines that ensure reliable and actionable marketing data Partner closely with Engineering, Product, and Data teams to enable scalable marketing operations ...