251 to 275 of 581 Data Pipeline Jobs in the UK

currently partnering with a forward-thinking, technology-driven organisation that has recently secured significant investment and is now looking to expand its data capability with the addition of a talented Data Engineer/Data Scientist. This is an excellent opportunity for either an experienced … level" Data Engineer with a few years under their belt, looking to step up into a more hands-on, impactful role. With elements of Data Science in the role too, you may be a Data Scientist, looking for a more hands on Data ...

Senior Data Engineer - Microsoft Fabric We're looking for a passionate and driven Senior Data Engineer to join a growing team, building a modern Microsoft Fabric data platform. This is a hands-on role designing and delivering scalable data pipelines, Lakehouse solutions … Training Platform + Certifications Remote first - Office once per two months Strong progression & development opportunities Opportunity to work on a modern, AI-enabled data platform Real ownership and influence in a growing, forward-thinking data team What You'll Do: Build and maintain ETL/ ...

glue' between the company's hardware and cloud intelligence, transforming raw telemetry into cost-saving insights and predictive maintenance through robust data engineering and modern software practices. The focus of this role is to integrate existing and open-source software and hardware to deliver these innovative services. This … includes building and maintaining automated data pipelines, managing cloud infrastructure and creating digital applications using modern analytics and software engineering practices. What We're Looking For Minimum 2 years' experience in Full Stack activities including but not limited to ingestion and storage of data, data ...

data models using DBT Orchestrate workflows using Apache Airflow Write clean, modular Python code for data engineering solutions Improve pipeline reliability, performance, and observability Introduce and embed CI/CD, testing, and deployment best practices (Azure DevOps) Define and implement clear data domains … with strong business logic and modelling capability Experience with DBT, Airflow, and Python Experience building modular, scalable solutions within Snowflake CI/CD pipeline experience, ideally using Azure DevOps Exposure to Docker and modern software engineering practices Strong understanding of software delivery lifecycles and engineering best practices Background ...

data models using DBT Orchestrate workflows using Apache Airflow Write clean, modular Python code for data engineering solutions Improve pipeline reliability, performance, and observability Introduce and embed CI/CD, testing, and deployment best practices (Azure DevOps) Define and implement clear data domains … with strong business logic and modelling capability Experience with DBT, Airflow, and Python Experience building modular, scalable solutions within Snowflake CI/CD pipeline experience, ideally using Azure DevOps Exposure to Docker and modern software engineering practices Strong understanding of software delivery lifecycles and engineering best practices Background ...

seeking a skilled and proactive Data Engineer to design, develop, and implement advanced data reporting and processing solutions. The successful candidate will combine strong technical expertise in data engineering, reporting, workflow automation, and database management with excellent communication and project coordination skills. Key Responsibilities … workflows using Python and Apache Airflow Manage and optimise SQL and Oracle database environments for performance, reliability, and scalability Lead end-to-end data and reporting initiatives from requirements gathering through deployment Collaborate with technical and non-technical stakeholders to ensure successful project delivery Ensure adherence to data ...

product and engineering culture. As a full-stack engineer, you'll work across the entire technology stack—from backend services and data pipelines to infrastructure and deployment. You'll collaborate closely with the engineering team to architect, build, and scale our micro-services based platform while maintaining high … oldest and least digitised sectors in the world. The core system ingests unstructured purchase orders and transforms them into structured materials data, integrating with a network of suppliers and logistics partners to automate quoting, sourcing, and fulfilment workflows. What We're Building We're building a sophisticated ...

Lead Data Engineer Industry: Risk Tech/SaaS Location: Central Manchester, hybrid, two days a week on-site Salary: £70,000 - £85,000 (maybe some wiggle room for the right person) We're working with one of our longest-standing clients, a fast-growing risk tech SaaS business … based in central Manchester. They build genuinely impressive products that combine data and AI to serve SMEs and risk teams, and right now they're looking for a Lead Data Engineer to own the backbone of their data platform. We've placed people here ...

project. Due to the nature of the work, candidates hold UKSV DV clearance. Key Skills & Experience Strong expertise in Python, Docker, Kubernetes, and Data Governance Experience working in air-gapped … environments, including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range ...

code, develop the capability to manage, maintain and write policies, Containerization & Kubernetes (GKE), Docker, Kubernetes, Helm/Kustomize, GKE Ops CI/CD engineering, pipeline authoring, artifacts management, testing automation, deployment strategy Data pipeline and DevOps (KAFKA/PubSub) – Kafka basics, schema registry, streaming infra … scanning, IAM and identity, network security, compliance Release engineering and governance, release ops, change management, documentation Regionalisation and compliance, regional deployments and failover, data residency, conditional access Soft Skills Strong problem-solving and troubleshooting capabilities. Ability to work collaboratively across security, engineering, and operations teams. Excellent communication ...

Data Engineer (Microsoft Fabric) - Permanent Location: Hybrid - Milton Keynes (majority remote) Type: Full-time, Permanent Start: ASAP Salary: £55,000 - £60,000 per annum The Opportunity. We're working with a growing organisation investing in its data platform, now looking to hire a Data … value from data. This is not a traditional role with fixed specifications. You will work in a partially built environment, helping shape how data is structured, delivered, and used across the business. Responsibilities Design and build end-to-end data solutions within Microsoft Fabric Develop ...

Automation Tester - Data Start date, 1st June - 6 months, scope to extend Inside IR35, £425 P/D Location: 2 days on site per month in Telford (Kit collection in London, Manchester or Bristol) Eligible for SC Automation Test Engineer focused on validating data pipelines … ensuring integrity of data across ETL processes. Key Responsibilities Design and execute automated tests across data pipelines Validate data transformations between source and target systems Build and maintain test frameworks for ETL validation Work closely with data engineers to ensure quality ...

product and engineering culture. As a full-stack engineer, you'll work across the entire technology stack—from backend services and data pipelines to infrastructure and deployment. You'll collaborate closely with the engineering team to architect, build, and scale our micro-services based platform while maintaining high … oldest and least digitised sectors in the world. The core system ingests unstructured purchase orders and transforms them into structured materials data, integrating with a network of suppliers and logistics partners to automate quoting, sourcing, and fulfilment workflows. What We're Building We're building a sophisticated ...

Blender-based platform to design, build, and execute scalable data pipelines tailored to partner needs. You’ll combine existing modules, develop new pipeline capabilities, and collaborate closely with stakeholders to ensure datasets are accurate, efficient, visually high quality, and aligned with real-world use cases. This role … sits at the intersection of synthetic data operations, Blender pipeline development, rendering workflows, and software engineering . Strong Blender experience is a mandatory requirement for this role. Candidates must have hands-on experience with Blender and the Blender Python API (bpy) in production or pipeline environments. ...

powered solutions. This role goes beyond traditional program management. You will operate as a technical leader, partnering closely with software engineers, architects, and data/AI teams to deliver scalable, high-impact systems. You will play a critical role in orchestrating large, multi-functional engineering initiatives, influencing system … mitigate risks related to scalability, performance, reliability, and security. AI & Software Delivery Excellence Drive programs involving AI/ML systems , including model integration, data pipelines, and inference services. Ensure alignment between software engineering practices and AI lifecycle needs (data, experimentation, deployment, monitoring) Coordinate delivery ...

days Contract: 3 months (likely extension) IR35: Outside Rate: £425-475 Start: ASAP Overview This is an internal-facing role focused on consolidating data from multiple business systems (e.g. Finance, HR, planning tools) into a centralised reporting layer. The goal is to build clear, commercially focused dashboards … stakeholders across the business. Role Focus/Milestones * Weeks 1-2: Engage stakeholders, gather requirements, and define approach * Month 1: Assess existing data warehouse and data structures * Month 2: Build and structure backend data pipelines/models * Month 3: Deliver stakeholder-facing dashboards ...

Senior Data Engineer – Google Cloud Platform (GCP) Role Overview We are seeking a highly skilled Senior Data Engineer – Google Cloud Platform (GCP) to design, build, and optimise scalable, secure, and high-performance data pipelines and analytics platforms on Google Cloud. This is a hands … engineering role requiring strong expertise in cloud-native data engineering, distributed processing, analytics platforms, and modern CI/CD practices . You will partner closely with product teams, analysts, platform engineers, and architects to translate business requirements into reliable, production-grade data solutions—while driving best ...

.Senior Principal Data Scientist page is loaded## Senior Principal Data Scientistlocations: UK - London (London Wall): Londontime type: Full timeposted on: Posted Todayjob requisition id: R107535**Senior Principal Data Scientist****About the Business**At Cirium our goal is to keep the world connected. … scale products that deliver meaningful value to customers. Our environment supports autonomy, learning, and inclusive collaboration.**About the Role**As a **Senior Principal Data Scientist**, you will contribute deep technical expertise while helping shape best practices across the data science community. This is a senior individual ...

Data Engineer Rate: £483 Clearance Required: SC - hold SC with HMRC or another governing body Duration: 6 months Telford with 2 days/week in office An engineer to initially be part of the DWIT project. This would be based on legacy technology, so Unix, SQL Developer, Informatica … would also benefit from experience in Jira/Confluence use, Business Objects & Informatica Join one of Capgemini's most exciting and fast-growing data teams, delivering secure, scalable and innovative data solutions that power smarter decisions, modern digital services and the adoption of AI and GenAI ...

help build the future of identity with a team that holds a high bar for itself — keep reading. About the Role The Big Data R&D team develops cutting‐edge big data and graph‐based solutions for entity search, entity resolution, and identity matching that power … Socure’s KYC and compliance products. As a Senior Data Scientist I, you will lead the design and deployment of advanced ML and graph algorithms on large-scale PII datasets, own end‐to‐end projects from problem definition through production validation, and serve as a key technical partner ...

Entry-level Data & AI Consultant role for individuals looking to build a career in data engineering and AI. You will work on real client projects, supporting the design and delivery of data pipelines, models, dashboards, and AI-driven solutions. This is not a passive … learning role, you will be expected to contribute quickly. Role Build and support data pipelines (ETL/ELT) Work with data across Bronze/Silver/Gold layers Transform and model data for reporting and analytics Support development of Power BI dashboards Assist ...

Data Engineer l Azure l Fabric l Pyspark l Greenfield l 6-Month Contract | £475-£500 per day | Outside IR35 l Hybrid 3 days in London We're partnering with a leading London-based organisation that's building a modern, enterprise-wide data platform on Microsoft … Fabric and is seeking a Senior Data Engineer to support its delivery. This is a hands-on role within a greenfield Fabric environment, working across finance, operations, and strategic decision-making. You'll design and build scalable data solutions end to end, collaborating closely with technical ...

Senior ML Engineer Design, build, and optimise machine learning models, including NLP, computer vision, and predictive analytics. Own the ML lifecycle from data preparation through training, evaluation, and deployment. Implement and maintain MLOps workflows for continuous integration and delivery of ML models. Collaborate with Data Engineers … DevOps teams to ensure production readiness and scalability. Contribute to architecture decisions for ML pipelines and data flows. Apply secure coding and configuration practices in line with compliance standards. Mentor junior engineers and share best practices across the team. Support innovation by researching emerging ML techniques and tools. ...

Contract AI & Data/Jr Forward Deployed Engineer | Up to £500.00 Outside IR35 | 3 months (rolling) | Hybrid Monthly (UK) A fast-growing UK-based FinTech scale-up is looking for 2x Contract AI & Data Engineers to join their financial analytics platform team. Haven't held … exposure to ML frameworks (e.g. scikit-learn, TensorFlow, or PyTorch) Background in data engineering, analytics engineering, or similar Desirables: ETL/ELT pipeline experience Microsoft Fabric/Data Lake knowledge BI tools (e.g. Power BI, Tableau) Financial services or payments experience On Offer: £500.00 ...

Senior Python Engineer | Full Stack | Real-time Data Platform 3 days onsite (nr Oxford) every 6 weeks This is a backend-led full stack role at an early stage technology company building … production grade SaaS platform for real-time data systems and analytics at scale. This is product engineering, not data pipeline work. You will be building customer facing software that runs in production and is used daily by real users. The team is growing fast ...