276 to 300 of 581 Data Pipeline Jobs in the UK

Opportunity: Test Lead – Data Platform Location: London (Hybrid, 2 days onsite) Employment: Contract Role (Outside IR35 considered) Duration: 6 months Start Date: ASAP We are seeking an experienced Test Lead to oversee quality assurance for a large-scale enterprise data platform. This role involves defining testing … strategy, managing offshore teams, and ensuring delivery of audit-ready, high-quality data solutions. About the Project: A strategic cloud-native data platform enabling governed ingestion, transformation, and analytics to support business insights, reporting, and regulatory compliance. Key Responsibilities Define and execute QA strategy across data ...

scale and quality from larger tech organisations. Hands-On Full Stack Skills: Proficiency in React/Typescript and/or Python (RESTful APIs, data pipelines), plus comfort with deploying and maintaining services on modern cloud platforms (GCP preferred, AWS or Azure also fine). Applied AI/ ...

where it drives measurable gains Manage AI infrastructure and tool integrations (API gateways, MCPs, external services) with appropriate governance and access controls Design data pipelines and system architecture to support AI workflows at scale, working with databases and vector search solutions Gather requirements, understand pain points ...

complex environments. Support and develop capability in Elastic Stack/Elastic Security, with training and upskilling provided as needed. Design, implement and maintain data pipelines, including log ingestion, enrichment and schema standardisation. Develop and tune security detection content, translating threat intelligence and TTPs aligned to MITRE … designing and optimising detection content, including MITRE ATT&CK-aligned use cases and alert tuning to reduce noise. Good understanding of data pipeline engineering, log enrichment, data quality and large-scale ingestion architectures. Strong knowledge of SPL; experience with KQL and EQL would be beneficial ...

Data Scientist – AI/Agentic AI London | Manchester | Edinburgh Long-Term Contract We’re currently hiring experienced Data Scientists for a major enterprise AI transformation programme focused on Generative AI, Agentic AI, Machine Learning, and advanced analytics. This is a long-term contract opportunity working … models Develop solutions using Generative AI and Agentic AI frameworks Analyse complex datasets to deliver actionable insights Work with structured and unstructured data sources Develop scalable data pipelines and AI workflows Collaborate with engineering, architecture, and business teams Support model deployment, optimisation, and monitoring in production ...

title: Data Engineer This role is paying up to £80,000 p/a and is hybrid working in London. **Must have insurance experience** Role overview We are looking for a Data Engineer with strong technical skills and experience in the insurance sector to join … fast-paced data team. Key Responsibilities Build and maintain scalable data pipelines (full ETL lifecycle) Perform data cleaning, transformation, and integration Work with Microsoft Fabric, Notebooks, Python, and PySpark Manage and develop solutions using SQL Server and Cosmos DB Handle multiple data ...

platform capabilities. Articulate complex technical concepts in simple, non‐technical language to senior business stakeholders (CMO, Head of Social, Customer Care, Digital, Data teams). Act as a trusted advisor on topics such as social data architecture, governance, workflow design, and integration strategy notably … solutions that leverage our core platform capabilities (publishing, engagement, listening, analytics, governance) and integrate with external systems (CRM, customer care platforms, marketing automation, data warehouses, BI tools, etc.). Translate complex integration requirements (APIs, webhooks, SSO, data sync, custom workflows) into user‐centric, value‐oriented solution ...

Data Engineer (Microsoft Fabric) - Permanent Location: Hybrid - Milton Keynes (majority remote) Type: Full-time, Permanent Start: ASAP Salary: £55,000 - £60,000 per annum The Opportunity. We're working with a growing organisation investing in its data platform, now looking to hire a Data … value from data. This is not a traditional role with fixed specifications. You will work in a partially built environment, helping shape how data is structured, delivered, and used across the business. Responsibilities Design and build end-to-end data solutions within Microsoft Fabric Develop ...

Description: Drive the Decisions Behind a Multi-Million-Pound Business Trade Mastermind & Valente Consulting are looking for an exceptional Senior Data Analyst/Data & Insights Manager to take ownership of the entire data and insights function across a rapidly scaling £25M+ education and business … times. Your key responsibilities will include: Building and managing executive-level dashboards using Power BI and Looker Studio Creating forecasting models for revenue, sales pipeline, cashflow, and performance Managing and optimising large-scale datasets and data pipelines Delivering actionable commercial insights that drive growth and efficiency Analysing ...

students passionate about AI who want to see their work make a real impact in a global business. You will contribute to live data and AI projects, help educate stakeholders on AI implementation, and bring fresh thinking to how we leverage emerging technologies. What You'll Be Doing … data engineering projects, working alongside senior engineers and analysts. Help build, test, and document AI-powered features or data pipeline enhancements. Translate AI concepts and project findings into clear language for non-technical business stakeholders. Showcase and explain your GitHub projects and prior AI work ...

Division: Group Technology Location: Glasgow, Liverpool or London Contract: Permanent Working pattern: Hybrid About the Role Be part of how Rathbones brings client data to life. As a Client Reporting Engineer, youll convert complex financial and valuation information into polished, visually engaging, client-ready reports that reflect … quality of our brand. This is a hands-on role blending technical expertise with attention to detail, where youll build robust data solutions, optimise performance, and deliver high-impact reporting to tight deadlines within a leading wealth management firm. What youll be responsible for Build and modify reporting ...

code, develop the capability to manage, maintain and write policies, Containerization & Kubernetes (GKE), Docker, Kubernetes, Helm/Kustomize, GKE Ops CI/CD engineering, pipeline authoring, artifacts management, testing automation, deployment strategy Data pipeline and DevOps (KAFKA/PubSub) - Kafka basics, schema registry, streaming infra … scanning, IAM and identity, network security, compliance Release engineering and governance, release ops, change management, documentation Regionalisation and compliance, regional deployments and failover, data residency, conditional access Soft Skills Strong problem-solving and troubleshooting capabilities. Ability to work collaboratively across security, engineering, and operations teams. Excellent communication ...

Data Engineers — Contract Multiple roles · Mid-level & Senior · Hybrid (UK) 📌 Rate: £450–£600 per day (Inside IR35, dependent on experience) 📌 Duration: 6-month SOW initially; longer-term programme (2–3 years overall) 📌 Location: Remote (UK-based) — occasional travel to the Midlands (up to 2 days/month) 📌 Clearance … eligible required (UK residency) Hanover are building two data engineering teams to support a large-scale, long-running programme within Central Government. This role centres around designing and building data pipelines in a modern cloud environment, embedded within multi-disciplinary Agile teams. There are both ...

Compliance in Transaction reporting ), is a market-leading solution for regulatory transaction reporting and reconciliation across global regimes. En:ACT automates reporting, reconciles data across systems, and maps errors directly to regulatory rules, helping firms remediate quickly, reduce risk, and meet regulatory obligations with confidence. Already trusted … technical users. Alongside our SaaS offering, our unique model delivers consulting services across Risk & Compliance (including Transaction Reporting and Operational Resilience), ESG, Strategy, Data, and Operations. Unlike larger consultancies, we embed ourselves within client teams to deliver both insight and execution, taking ownership of outcomes and driving measurable ...

just a traditional DBA role. It’s a chance to build on strong SQL Server experience and grow into a broader data platform engineering role . You’ll still work closely with databases day to day, but you’ll also get involved in automation, cloud platform work … data pipelines , helping shape how the organisation modernises its data platform over time. It’s a good fit for someone who wants to move beyond “keeping the lights on” and into building and improving systems at scale. There’s a clear path here to grow into ...

seeking a highly skilled Teradata Engineer for an initial 6 month contract, mainly remote. The role will see you building robust data pipelines, modernizing Legacy code, and ensuring data delivery, working closely with Data Architects, System Analysts, and QA Automation Engineers. Key Responsibilities; Build … maintain scalable data pipelines to migrate from Teradata to Amazon S3 Analyze and convert Legacy Teradata BTEQ scripts into modular, version-controlled, and highly performant dbt (data build tool) models for data transformation. Work alongside the QA team to configure and execute selected automated ...

Specsavers, we're on a mission to change lives through better sight and hearing—and data is at the heart of how we do it. We're looking for a Data Engineer to join our growing Data Product team, where you'll help build … data solutions that power everything from customer experiences to business decisions. This is your chance to work on meaningful, high-impact projects. You'll be part of a collaborative team that transforms business requirements into scalable, secure, and high-quality data products. Whether you're designing ...

Specsavers, we're on a mission to change lives through better sight and hearing—and data is at the heart of how we do it. We're looking for a Data Engineer to join our growing Data Product team, where you'll help build … data solutions that power everything from customer experiences to business decisions. This is your chance to work on meaningful, high-impact projects. You'll be part of a collaborative team that transforms business requirements into scalable, secure, and high-quality data products. Whether you're designing ...

Specsavers, we're on a mission to change lives through better sight and hearing—and data is at the heart of how we do it. We're looking for a Data Engineer to join our growing Data Product team, where you'll help build … data solutions that power everything from customer experiences to business decisions. This is your chance to work on meaningful, high-impact projects. You'll be part of a collaborative team that transforms business requirements into scalable, secure, and high-quality data products. Whether you're designing ...

Experience working with Red Hat OpenShift and Ceph storage platforms Programming experience (e.g. Python, JavaScript) Experience working with event streaming and data pipeline technologies (e.g. Kafka, Apache NiFi, Apache Spark) Experience delivering multi-system integration projects within defence, government, or highly regulated environments Experience implementing and configuring ...

Robert Half International (an S&P 500 global staffing provider) is supporting a global consulting firm in sourcing an interim DBT Data Engineer. This role will focus on designing, delivering and supporting a modern cloud data warehouse using Snowflake and dbt, building scalable ELT pipelines … high-quality data models to support business-wide analytics and reporting. Assignment Details Initial 6-month contract (extensions expected) Hybrid - 2 days per week on-site in the City of London £400-450 p/day + 12.07% hol pay (PAYE with employer's NI & Tax deducted ...

Provide technical skills to continuously improve engineering capability across all stages of the engineering lifecycle Develop infrastructure, coordinating with project management, geospatial engineers, data scientists and testers to ensure successful outcomes Promote and actively share best practices across teams to drive consistency and quality Operate and support … team Technical skills we're looking for Azure DevOps and Azure Cloud Services (Entra, Batch, ADLS) Azure Infrastructure as code Data Pipeline tooling (Databricks (with Unity Catalog/Airtable/Spark/ADF etc) experience Experience with Scala, Bicep, Python, PowerShell Location & Working Pattern We embrace ...

Contract GCP Data Engineer - £600-£700/day (Outside IR35) Rate: £600-£700 per day Contract Type: Outside IR35 Duration: Initial 4 weeks (high likelihood of extension) Location: Central London (on-site with client) Start: Immediate Overview We're supporting a well-established insurance broker in Central London … seeking a GCP Data Engineer for an initial short-term engagement, with strong potential for continued work. This role requires a hands-on contractor who can quickly integrate into an existing data function, take ownership of deliverables, and provide immediate impact within a fast-paced commercial ...

experience in the financial sector. Experience with CI/CD , microservices , and event-driven architectures is essential, and knowledge of Python (pyspark) for data-driven workflows is advantageous Key Responsibilities Design, develop, and maintain full stack applications using React JS , C#.NET Core , and supporting technologies. Build high-performance … stakeholders and risk, Regulatory Reporting and Finance domain experts to deliver solutions in these domains. Have a strong understanding of Power BI dashboards , data models, and analytical reports for business users. Work with DevSecOps to implement and optimize CI/CD pipelines , ensuring robust automated testing, deployment ...

experience in the financial sector. Experience with CI/CD , microservices , and event-driven architectures is essential, and knowledge of Python (pyspark) for data-driven workflows is advantageous Key Responsibilities Design, develop, and maintain full stack applications using React JS , C#.NET Core , and supporting technologies. Build high-performance … stakeholders and risk, Regulatory Reporting and Finance domain experts to deliver solutions in these domains. Have a strong understanding of Power BI dashboards , data models, and analytical reports for business users. Work with DevSecOps to implement and optimize CI/CD pipelines , ensuring robust automated testing, deployment ...