76 to 100 of 242 Data Pipeline Jobs in the UK excluding London

maintain feature stores, vector/embedding stores, and core data assets for ML. Develop and manage end-to-end traditional ML pipelines: data prep, training, validation, deployment, and monitoring. Implement data quality checks, drift detection, and automated retraining processes. Optimise cost, latency, and performance … computer science principes and statistical methods. Strong experience with cloud technology (AWS or Azure). Strong experience with creation of data ingestion pipeline and ET process. Strong knowledge of big data tool such as Spark, Databricks and Python. Strong understanding of common machine learning techniques ...

Administer Microsoft Fabric Lakehouse and Azure services Optimise performance across queries, datasets, and pipelines Apply data validation, cleansing, and standardisation rules Document pipeline logic and contribute to business-wide metadata catalogues Collaborate with BI, Change, and Product teams to align data outputs to needs Support … teams will be key to success in this role. You’ll be a technically strong data professional with hands-on experience in pipeline development, cloud-based data infrastructure, and performance optimisation. You will be at your best when working collaboratively in fast-paced environments ...

Master Data Management (MDM) Analyst - Manchester - Hybrid (3 days on-site) - Up to £50k Client Details: A data-driven recruitment organisation based in Manchester is looking for an MDM Analyst to support and improve its master data capability, with Tamr at the core … platform. The Role: Support day-to-day operation of the Tamr platform Ensure data quality, integrity and accurate mastering across key data domains Work closely with Finance, Operations and Analytics teams Contribute to data governance and stewardship initiatives Key Responsibilities: Monitor data ...

Data Engineer - London - Databricks - Azure - 75k + bonus + benefits I'm currently working with a company that continues to grow even after 60 years in operation. With more than 1,000 projects completed worldwide and a combined project value exceeding $150 billion, they've established themselves … near or far employees live. Tech Stack: Azure | Databricks | Power BI | Python They're looking to grow their team with a Data Engineer that thrives on innovation and cutting-edge technology. If you love solving complex data challenges and building scalable solutions, this is your chance ...

Data Engineer - FinTech Scale-Up Hybrid, London - £60,000 - £70,000 Company Our client is a fast-growing and innovative FinTech company at the forefront of analytics and technology. They have developed a proprietary, cutting-edge technology platform that integrates decision engines, databases, embedded modelling, analytics capabilities … third-party integrations. This organization is in full scale-up mode and is seeking top-tier talent to drive their data and engineering capabilities to the next level. The Role This is a fantastic opportunity for a skilled Data Engineer to take ownership of key aspects ...

title: AWS Data Engineer Location: Ipswich (Onsite- 5 days) Type of Employment- Permanent Job Overview: We are seeking an experienced AWS Data Engineer with strong expertise in ETL pipelines, Redshift, Iceberg, Athena, and S3 to support large-scale data processing and analytics initiatives … quality checks and validation across pipelines. 8. DevOps & CI/CD (Preferred) Use Git, CodePipeline, Terraform/CloudFormation for infrastructure and deployments. Automate pipeline deployment and monitoring. Required Skills 3 10 years experience in data engineering. Strong hands-on experience with: AWS S3, Athena, Glue, Redshift ...

take a strategic, high-level view of the data platform while still diving deep when needed. You will focus on observability, automation, pipeline performance, operational excellence, and cloud cost optimisation. You'll work cross-functionally with Data Engineering, DevOps, and FinOps teams, helping ensure that … Essential Strong experience working with Azure cloud platform Background in data engineering and building/maintaining data pipelines Experience with pipeline monitoring, observability, and incident troubleshooting Strong automation mindset and ability to build resilient, self-healing data workflows Nice to Have Knowledge ...

Data Engineer - 14-Week Contract (Outside IR35) Likely to Extend Start Date: 12th January Rate: £350 per day Location: Remote (UK-based) Interview: Immediate - Offer before Christmas We are seeking an experienced Data Engineer to join a 14-week project focused on building robust data … REST APIs , PIM systems, and potentially SAP. Ensure data quality, governance, and lineage tracking throughout the project. Required Skills ETL/ELT pipeline design and data validation frameworks. Advanced Python (pandas, numpy, boto3) and SQL (complex queries, optimisation). Experience with AWS Glue , Step Functions ...

looking for an experienced IT Project Manager to help stand up a new project management function within our expanding technology and data client This is a key role where you’ll shape delivery frameworks, implement best-practice standards, and oversee a portfolio of high-impact projects across … cloud, DevOps, and data. You will manage multiple concurrent projects, working closely with stakeholders across engineering, data, product, and business teams. Key Responsibilities: - Establish and mature a new project management function, including governance, reporting standards, and delivery frameworks. - Lead end-to-end delivery of a variety ...

Senior Analytics Engineer (SQL & DBT) Up to £75,000 + Bonus + Benefits Hybrid - London A global tech business is growing its data function and is looking for a Senior Analytics Engineer to help shape a scalable, modern data environment used across multiple international teams. This … high-impact role focused on building reliable data platforms, improving data quality, and enabling self-serve analytics across the organisation. The Role: Develop and maintain high-quality data pipelines using dbt , moving data from bronze to gold layers. Apply Kimball methodologies ...

have an exciting opportunity for a Senior DataOps Engineer to join the Group and take responsibility for inspiring and coaching our Data Engineering teams. The person in post will be working alongside domain-oriented, multi-disciplinary data product teams to design, develop, and test high-quality … data solutions that serve as the backbone of our decision-making and digital services. Driving automation and CI/CD practices across data pipelines and infrastructure, the Senior DataOps Engineer will build robust, scalable, and secure infrastructure that supports our data platform strategy. ...

role We have an exciting opportunity for a Senior DataOps Engineer to join the Group and take responsibility for inspiring and coaching our Data Engineering teams. The person in post will be working alongside domain-oriented, multi-disciplinary data product teams to design, develop, and test … high-quality data solutions that serve as the backbone of our decision-making and digital services. Driving automation and CI/CD practices across data pipelines and infrastructure, the Senior DataOps Engineer will build robust, scalable, and secure infrastructure that supports our data platform ...

Data Engineer - 2 month assignment Outside IR35 - £500-£600 per day - Hybrid with client visits to Southampton We're looking for an experienced contractor to support a key data project for an initial 2-month engagement, with strong potential to extend. This role is outside IR35 … onsite visits to our client's office in Southampton as required. You'll be working largely independently, taking ownership of marketing data pipeline and aactivities using DBT, Snowflake and AWS. Must have: Strong SQL experience Hands-on DBT experience, including DBT administration Strong Snowflake experience, including Snowflake ...

Data Engineer - AI (UK Remote) We're working with a mission-driven SaaS business. Their platform supports the full lifecycle of complex, data-intensive cases and plays a meaningful role in improving outcomes across a highly regulated sector. They're looking for a Data Engineer to design, build and maintain the data infrastructure underpinning their AI capabilities. You'll work closely with AI and MLOps engineers to enable secure, scalable and compliant data pipelines that support model training, evaluation and continuous improvement. What you'll be doing Building ...

Databricks Data Engineer - Leeds - Up to £70,000 Location: Leeds (Hybrid - 2 days per week onsite) Job Type: Permanent About the Company Our client is a rapidly growing data-driven consultancy helping enterprise-scale organisations modernise their data estates. With several major new projects … kicking off in early 2026, they are expanding their Leeds engineering hub and looking for a Databricks-focused Data Engineer to join their high-performing team. You will design, build, and optimise cloud-based data pipelines that feed analytics, AI, and real-time insights. ...

Data & Analytics Manager Sheffield – Hybrid (3 days in, 2 days home) £45,000 - £65,000 DEO + excellent benefits A prestigious Sheffield based organisation is looking for a confident and forward-thinking Data & Analytics Manager to bring clarity, insight and strategic impact to the way they … information across the business. If you love turning data into powerful stories, enjoy influencing decisions at every level and thrive in environments where you can shape how analytics is understood and used, this role offers an exciting opportunity to make a real mark. Working closely with teams across ...

Contract Data Engineer - Databricks & Azure (SC Cleared) Location: Newcastle (2-3 days onsite per week) Rate: £450 per day (Outside IR35) Duration: 6 months Clearance: Active SC clearance is mandatory Expenses: Not reimbursed - candidates must be based in or near Newcastle About the Role We are seeking … experienced Data Engineer with strong expertise in Databricks and Azure to join a high-profile Public Sector project. This is a 6-month contract, outside IR35, requiring Security Clearance (SC) and regular onsite presence in Newcastle. Key Responsibilities Design, develop, and maintain scalable data pipelines using ...

Start your career in data and technology with a leading Food Group offering real development and hands-on experience. We are seeking a motivated Apprentice Data Engineer to join the IT team and support the design and delivery of data solutions across the business. … This role provides structured training and practical exposure to modern data tools and cloud technologies, with opportunities to contribute to live projects from day one. Apprentice Data Engineer Responsibilities Support the development and maintenance of scalable data pipelines Learn to ingest, transform, and load ...

Data Platform Engineer DV Cleared £500 - £600 per day - Outside IR35 JOB DESCRIPTION This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data … based onsite role with the option of compressed hours. The role will include: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. ...

Role Title: Graduate Data Engineer Contract: 12 months Location: Marlow (hybrid) SRG are working with a leading pharmaceutical company based in Marlow. Our client develops and manufacture an impressive portfolio of aesthetics brands and products. Our client is committed to driving innovation and providing high-quality products … services. Role Overview As a Graduate Data Engineer, you will build and maintain scalable data pipelines in Palantir Foundry for advanced reporting and analytics while collaborating with cross-functional teams as part of the BTS Data & Analytics team. You will work closely with ...

Data Engineer - Generative AI Location: Stevenage or Bolton Salary: £45,000 to £55,000 depending on experience Contract: Permanent, Full Time, Hybrid Working Clearance: British citizenship required (SC clearance required)Are you an experienced Data Engineer with a passion for enabling AI innovation? This … exciting opportunity to join a growing international data and technology function where you'll shape the data foundations behind advanced generative AI capabilities.You will play a key role in evaluating, designing and maintaining high quality data sets for internal teams, ensuring data ...

Want to drive a top brand's Data team with 1m+ users? If you love Python, implementing robust data pipelines & driving best Data practices, you may be interested in a Staff Data Engineer role I have with a highly successful Tech driven … business, where you'd drive the Data function playing a key role optimising the acquisition & retention of users. Your work will serve millions of users a month, process thousands of requests a day, and enable hundreds of integrations with partners. Salary to £100k + 10% Bonus, pension ...

bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties … will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing ...

bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties … will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing ...

bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties … will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing ...