226 to 250 of 294 Data Pipeline Jobs in the UK excluding London

start a career that is out of the ordinary, please apply... Job Details Why this job is important This role is about applying data science where it genuinely matters - in live, production environments that support large‐scale research operations around the world. As a Senior Data … Digital Twins team you'll work on advanced modelling and analytics that improve the quality, reliability and performance of high‐volume data systems. You'll partner closely with engineering, operational and commercial teams, taking ideas from hypothesis through to deployment, and ensuring models deliver real value once they ...

Data Scientist/Financial Intelligence Engineer Remote - Northern Ireland Salary negotiable DOE Full-time, Permanent At a Glance Data science role at a US FinTech scale-up doing something genuinely new Python-first (Pandas, Polars, NumPy) with GCP and LLM exposure Fully remote across Northern Ireland … understood. Rather than layering on more reporting, they've built an ontology-driven intelligence layer that transforms fragmented ERP, CRM, and HR data into a unified, structured picture of profit, cost distortion, and operational performance. Early-stage, well-funded, and building something with genuine intellectual depth. The Role ...

Data Engineer - Contract Rate: £500 per day (inside IR35) Location: Remote with 1 day per month in Leeds Duration: Until March 2027 with the possibility of extension Availability: 2 weeks' notice or less required Clearance: BPSS check required The Role We are working with a leading healthtech consultancy … joined-up system, underpinning services including the Electronic Prescription Service, GP Connect, and the national roll-out of Electronic Patient Records. As the Data Engineer, you will play a hands-on role in designing, building, and maintaining the data pipelines and platform infrastructure that underpin these ...

Data Engineer (Streaming) – Requirements Strong coding in Java (preferred) or Python Experience with Kafka, Flink, or Spark (Flink/Kafka ideal) Solid understanding of stream processing (event time, state, backpressure) Experience building ETL/ELT or real-time data pipelines Knowledge of microservices and distributed systems … with Databricks, Snowflake, or BigQuery Engineering Practices Strong in testing, CI/CD, Git Experience with Terraform, Docker, Kubernetes Experience 3+ years in data engineering Agile experience and strong communication skills Nice to Have Consulting/client-facing experience Real-time/low-latency systems Certifications or mentoring ...

deep technical engine behind their internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … storage supporting current and future AI deployments Troubleshoot integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft ...

deep technical engine behind their internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath — data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … storage supporting current and future AI deployments • Troubleshoot integration failures, data inconsistencies, and production issues Key Skills • Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft ...

Data Engineer Opportunity, DV-cleared only London Manchester Bristol A progressive, leading-edge UK consulting and technology organisation is hiring Data Engineers to deliver mission-critical work across defence and security programmes, building modern data platforms and production-grade pipelines that enable better decisions … Process large structured and unstructured datasets, integrating multiple sources Collaborate with stakeholders and delivery teams to drive outcomes Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant ...

role, 1-3 days per week in Farnborough is needed. Key skills required Backed development experience (Mid-senior level) Python Data Pipeline Creation and Management API Creation and Integration Database Creation and Integration Working with JSON If you have worked in a security cleared environment, have ...

Robert Half Technology are assisting a telecommunications business to recruit a Senior Data Platform Engineer on a 9-month contract basis. Hybrid working - Hampshire/London based. ASAP start. Role * The Senior Data Platform Engineer will take full ownership of the production data platform … including ingestion, orchestration, infrastructure, and observability. * Design, build, and deliver scalable data pipelines across CRM, ERP, and billing systems. * Lead platform readiness activities ahead of a critical NetSuite cutover, including hypercare support. * Build and maintain integrations across Salesforce/Ability (CRM), NetSuite/Sage X3 (ERP), and Billing ...

executing the migration to AWS Bedrock. Utilise your strong C# background to ensure AI agents integrate seamlessly with core enterprise systems, APIs, and data pipelines. Refine prompt engineering, agent autonomy, and guardrails to ensure high performance, security, and accuracy. Proven experience building Agentic AI systems (autonomous agents, multi ...

Robert Half Technology are assisting a leading telecommunications business to recruit a Senior Data Platform Engineer on a contract basis. Hybrid working - 2 days on-site in Hampshire every other week. Role * The Senior Data Platform Engineer will take ownership of the end-to-end production … data platform, including ingestion, orchestration, infrastructure, and observability. * Design, develop, and maintain scalable data pipelines across CRM, ERP, and billing systems. * Lead platform readiness activities ahead of a critical NetSuite cutover and provide support during hypercare phases. * Build and maintain integrations across Salesforce/Ability ...

Robert Half Technology are assisting UK's market leading telecommunications organisation to recruit a Data Engineer on a contract basis - Hybrid working - London/Hampshire based We are supporting a data transformation programme and are looking for a Senior Data/Platform Engineer … take full ownership of the production data platform. This role is critical to delivering a scalable, production-ready platform ahead of a mid-August NetSuite cutover, including responsibility for build, integration, and operational readiness. Role The Data Engineer will own the end-to-end data ...

NetSuite expert, owning the day-to-day administration, configuration, and continuous improvement of the system. You will work closely with Finance, Operations, and Data teams to ensure NetSuite delivers accurate, reliable data and supports efficient processes as the company scales. Duties Act as the key internal … regression testing) and coordinate system changes to ensure smooth deployment Drive continuous improvement of NetSuite configuration and processes to reduce inefficiencies Own data integrity within NetSuite, proactively identifying and resolving data quality issues Act as a key liaison between Finance, Operations, and Data teams ...

APIs, AI agents, and automation solutions across a Microsoft and Azure ecosystem. This includes integrating Microsoft 365 Copilot, Claude Cowork, and Azure-based data platforms with business-critical systems including practice management, CRM, and document management solutions. This is a developer-first role suited to someone who enjoys … Copilot Studio and Claude Cowork. Develop Retrieval-Augmented Generation (RAG) pipelines, document automation tools, and LLM-powered solutions. Contribute to Azure infrastructure, including data pipelines, storage, integrations, governance, and security. Collaborate with technical and business stakeholders to scope and deliver technology solutions. Produce clear technical documentation and support ...

Role * The AI Engineer will design, develop, and deploy scalable AI and machine learning solutions across digital sports media platforms. * Collaborate with product, data, and engineering teams to deliver AI-driven features and audience engagement tools. * Build and optimise LLM-powered applications, recommendation systems, and intelligent content workflows. … Develop and maintain robust data pipelines and model deployment infrastructure. * Implement monitoring, evaluation, and governance processes for AI systems to ensure reliability and performance. * Work with structured and unstructured datasets including video, social, audience, and editorial content. * Optimise AI models and inference pipelines for scalability, latency, and cost ...

event-driven architectures and background processing pipelines (e.g. Celery, Redis Streams, Kafka) to enable scalable async workloads, retries, and fault-tolerant integrations. Design data models and optimise relational databases (PostgreSQL) for performance, partitioning, and horizontal scale. Introduce caching, rate limiting, and queuing to meet performance budgets and latency … including streaming responses, async inference jobs, and robust error/retry semantics. Palantir Foundry Integration Work with Palantir Foundry to build and maintain data pipelines, ontologies, and integrations that connect backend services to Foundry-based analytics and workflows. Leverage Foundry's APIs and tooling to support data ...

Data Solution Architect - (Hybrid - 2-3 days onsite) Long Term Contract (Inside IR35) - Must have Telco experience Role Overview We are working with a global consultancy seeking an experienced AWS Data Solution Architect to design and deliver scalable, secure data platforms, supporting analytics …/ML initiatives. Key Skills Strong background in solution architecture with a focus on data platforms Extensive hands-on AWS experience across storage, databases, analytics, ML, integration, and security services Experience designing data lakes, lakehouse architectures, and end-to-end data pipelines Proven capability ...

future of energy exploration Join a well-funded start-up with strong backing and clear growth plans. Own and shape a modern data platform built on GCP and cutting-edge tools. Real opportunity to grow into a future leadership role. We’re working with an early-stage, well … company that’s tackling one of the biggest challenges in energy today. They’re building a new approach to natural exploration, using advanced data, geoscience, and cloud tech to drive smarter decisions. They’re now looking for a Senior Data Platform Engineer to take ownership ...

Join Our Dynamic Data Science Team! Are you a passionate Data Scientist ready to make a real impact in the retail industry? Our client is seeking a talented individual to join their vibrant team on a fixed-term contract. With a daily rate ranging from … play a crucial role in shaping the future of retail through data-driven insights and innovative solutions! About the Team:At our client's organization, the Data Science team tackles complex business challenges across various domains, including customer experience, supply chain, and technology. They leverage advanced ...

Senior Marketing Data Analyst London, Hybrid Salary up to £80,000 This is an opportunity to join a high-performing analytics function where marketing data drives genuine commercial impact. You will work on complex datasets, influence strategic decisions, and help shape the performance of large-scale … digital marketing initiatives within a globally recognised, data-driven environment. The Company They are a well-established, global fintech organisation operating at significant scale, with a strong presence across multiple international markets. The business combines innovation with deep industry expertise, providing a platform where data plays ...

mounted tables and Hive Metastore. You'll bring strong AWS knowledge, hands-on experience working with S3 via Python, a solid understanding of data storage formats, and practical Python development expertise. What you'll be doing Lead the migration of Databricks assets (notebooks, jobs, clusters) from DBFS … usage Optimise the Databricks environment for structure, access, and governance Automate infrastructure and deployments using Terraform and/or CloudFormation Build and maintain data pipelines using Python, SQL and Databricks APIs Monitor platform performance using tools such as CloudWatch, Grafana, and Kibana Collaborate with engineering teams, stakeholders ...

learning systems while ensuring alignment with enterprise quality, reliability, and scalability standards.You will lead end-to-end AI/ML solution development from data exploration and experimentation through to deployment, monitoring, and continuous optimisation.Working closely with cross-functional teams including data engineering, infrastructure, DevOps, and product … such as LangChain and Azure OpenAI. You must have experience in the development of enterprise-grade RAG systems, including context engineering and multimodal data pipelines. We also need candidates offering experience in the design and deployment of autonomous multi-agent systems using modern orchestration frameworks and evaluation approaches. ...

functional AI engineering team, providing technical and team leadership for enterprise AI development. Own the end-to-end AI architecture across agents, models, data flows and integrations, ensuring solutions are secure, scalable and aligned to a coherent enterprise ecosystem. Oversee design, build and production deployment of AI services … infrastructure, tooling and automated pipelines needed for efficient development, testing, deployment, monitoring and lifecycle management of AI models and agents. Deliver secure APIs, data pipelines and connectors so AI solutions integrate effectively with enterprise systems and business processes. Implement monitoring, incident management and continuous optimisation to ensure dependable ...

Space, Defence and Intelligence sector. As an AI Developer/Engineer, you will build and deploy intelligent applications that unlock the value of data, enhance decision-making, and drive operational impact. Working with cutting-edge technologies and expert teams, you will take ownership of complex challenges, contribute innovative … within secure, often disconnected environments. You will take ownership of developing machine learning and AI solutions, including large language models, retrieval systems and data pipelines, ensuring they are scalable, reliable and optimised for performance. Working closely with multidisciplinary teams, you will integrate AI capabilities into existing systems ...

chunking strategies, and advanced techniques such as HyDE Building and owning production AI applications: clean code, robust error handling, well-designed APIs, and data pipelines Crafting effective prompts and optimising across latency, cost, and quality dimensions for different model providers Working with clients and internal teams to translate … experience and cloud platform knowledge (AWS, GCP, or Azure) Solid grounding in distributed systems, CI/CD, testing frameworks, and deployment pipelines Strong data manipulation skills (pandas, SQL) and familiarity with evaluation strategies for LLM-based systems Comfortable working with ambiguity, able to optimise non-deterministic systems through ...