126 to 150 of 338 Data Pipeline Jobs in the UK excluding London

with a leading UK consumer goods brand, known nationwide for their products in the home & lifestyle space. With ongoing growth and digital transformation, they are investing heavily in data capabilities to improve business decision-making, customer insight, and operational efficiency. The organisation has already built out a small but capable data team, and they’re now … looking to appoint a BI Lead to accelerate their reporting, analytics, and automation strategy. This is a high-impact role where you’ll shape how data is delivered across the group, working with stakeholders across Finance, Operations, Marketing, and Commercial to enable smarter, faster decisions. The Role This newly created BI Lead role sits within a growing data … at Harnham via the Apply link on this page. Keywords BI Lead, Business Intelligence Lead, BI Developer, BI Specialist, Data Engineer, Power BI, Azure, Databricks, SQL, Pipelines, Data Visualisation, Self-Service Analytics, Reporting Platform, Consumer Goods, Lancashire, Preston, Burnley, North West, UK Jobs More ❯

About the job Data Engineer Location: Hybrid – Office (Wilmslow) and home Salary: Competitive We’re Citation Group. A group of businesses on a mission to make life easier for small and medium-sized companies. We get that running a business is tough. You’re spinning plates trying to keep your customers happy, stay on top of rules and … the stress off business owners so they can focus on what they do best. The role: Following recent investment, The Citation Group are looking to build out their data capabilities to be Best in Class. As such, a fantastic opportunity has arisen for a strong data engineer to work in the Finance projects team. This role … is instrumental in bridging financial systems, completing data migrations and engineering workflows to streamline data pipelines, ensure data integrity, and automate integrations. The ideal candidate will be responsible for designing, developing, and maintaining robust data migrations between internal systems (ERP, billing, CRM, etc.) and finance tools to support the successful integration of More ❯

About the job Data Engineer Location: Hybrid – Office (Wilmslow) and home Salary: Competitive We’re Citation Group. A group of businesses on a mission to make life easier for small and medium-sized companies. We get that running a business is tough. You’re spinning plates trying to keep your customers happy, stay on top of rules and … the stress off business owners so they can focus on what they do best. The role: Following recent investment, The Citation Group are looking to build out their data capabilities to be Best in Class. As such, a fantastic opportunity has arisen for a strong data engineer to work in the Finance projects team. This role … is instrumental in bridging financial systems, completing data migrations and engineering workflows to streamline data pipelines, ensure data integrity, and automate integrations. The ideal candidate will be responsible for designing, developing, and maintaining robust data migrations between internal systems (ERP, billing, CRM, etc.) and finance tools to support the successful integration of More ❯

months (Mid-December start - End of June) Security Clearance : SC Clearance required Overview We're looking for a talented Front-End Developer to join a newly formed Data Team within a public sector organisation. This role is central to building a unified, user-friendly interface - a "single pane of glass" - that consolidates dashboards, reports, and outputs from various … data roles into one cohesive experience. The interface will serve as the primary access point for stakeholders to explore data, monitor performance, and make informed decisions. Key Responsibilities Interface Development :Design and build a centralised front-end application that integrates outputs from dashboards, reports, models, and data pipelines into a single, intuitive view. Accessibility … 2.2 standards, promoting inclusive access for all users. Performance Optimisation :Deliver fast load times, responsive design, and smooth user interactions across devices. Cross-Functional Collaboration :Work closely with Data Analysts, Data Scientists, Engineers, Business Analysts, and User Researchers to understand data outputs and user needs. Data Visualisation :Implement dynamic visual components such More ❯

Data Engineer £45,000 - 55,000 GBP + Package Hybrid WORKING Location: Stevenage, Central London, Greater London - United Kingdom Type: Permanent Data Engineer - Generative AI Focus Location: Stevenage or Bolton (Stevenage preferred) Salary: £45,000 to £55,000 depending on experience Working Pattern: Hybrid, 2 to 3 days on-site per week Overview: A new opportunity … has opened for a Data Engineer to join a newly formed Generative AI delivery office. This role involves evaluating, designing, deploying, and supporting internal data sets, ensuring they are secure, resilient, and optimised for internal customer needs. Key Responsibilities: Build and maintain robust data pipelines and data sets Collaborate with internal stakeholders … to optimise data usage and security Ensure compliance with data governance and quality standards Contribute to the technology roadmap and deliver innovative solutions Stay current with emerging technologies in AI and data engineering Technical Skills Required: SQL technologies (e.g. MS SQL, Oracle) NoSQL technologies (e.g. MongoDB, InfluxDB, Neo4J) Data exchange and processing More ❯

Data Engineer - Azure Specialist London - 5 Days a Week £80,000 - £100,000 + 10% Bonus Company Our client is a well-established insurance group , recognised for its commitment to innovation and technology-driven transformation. They are seeking a skilled Data Engineer (Azure Specialist) to join their high-performing technology team. This is a fantastic opportunity … to work on mission-critical projects with visibility across the entire business, while shaping the group's data strategy and infrastructure for the future. Responsibilities Design, develop, and own robust, high-performance data pipelines and APIs. Build scalable data infrastructure using Azure technologies, SQL, and dbt. Assemble and manage large, complex datasets to meet … business requirements. Define and document cloud solution architectures, technical designs, and testing processes. Take ownership of data quality and drive opportunities for continuous improvement. Partner with stakeholders across the organisation to support business intelligence and data science initiatives. Troubleshoot and resolve data management issues while contributing to architectural decision-making. Experience Needed Bachelor's More ❯

Role: Data Engineer Location: Cardiff (Hybrid - 3 days WFH) Salary: Up to £62,000 + 10% Bonus + Excellent Benefits The Role CPS Group are partnering with a leading organisation to hire an experienced Data Engineer. You'll design, build, and optimise data pipelines and integrations, supporting ERP migration projects and shaping a centralised … enterprise data platform. This is a key role ensuring reliable, high-quality data for business intelligence and decision-making. Key Responsibilities: * Build and maintain scalable data pipelines (SQL/Azure). * Support ERP migration and system integrations. * Ensure data quality, validation, and performance. * Collaborate with BI and Data teams to … insights. * Apply DataOps best practices (version control, CI/CD, documentation). Skills & Experience: * Strong SQL development and optimisation skills. * Experience with MS SQL Server, Azure SQL, Azure Data Factory. * Proven track record in data engineering, ETL/ELT, and system migrations. * Knowledge of data modelling, governance, and quality assurance. * Excellent communication and problem More ❯

Data Engineer – Leeds – Hybrid - Azure An innovative fintech scale-up revolutionising how financial institutions leverage their data assets. Based in Leeds, they're building next-generation solutions that help banks, investment firms, and financial services companies unlock the true potential of their data to drive smarter investment decisions and enhance customer experiences. The Role … They need a talented Data Engineer to join their rapidly expanding engineering team in Leeds. You'll be architecting robust data systems that power critical financial analytics, working with modern cloud technologies whilst tackling real-world challenges in the fast-paced fintech sector. This is an excellent opportunity for someone ready to make their mark in … be brilliant Understanding of CI/CD processes for deploying data solutions Some exposure to big data technologies and distributed processing Nice to haves: ML pipeline experience Previous fintech or financial services exposure If you are on the market for a new role and are looking to join a business making real impact, APPLY NOW More ❯

Databricks Data Engineer - Newcastle (hybrid) - £450/pd Please note - this role will require you to attend the Newcastle-upon-tyne based office 2-3 days per week. To be eligible for this role you must have the unrestricted right to work in the UK - this organisation is not able to offer sponsorship. A leading construction organisation is … seeking an experienced Azure Databricks Data Engineer to support the ongoing development and optimisation of their cloud data platform. Key Responsibilities: Enhance and scale the existing Azure Databricks environment. Collaborate with data architects and analysts to deliver robust data pipelines. Implement best practices for data engineering, performance tuning, and security. … Work closely with stakeholders to understand data requirements and deliver solutions. Required experience: Strong hands-on experience with Azure Databricks and Spark. Solid understanding of Azure Data Lake, Data Factory, and Synapse. Proven track record in building scalable data pipelines and ETL processes. Experience working in hybrid environments and cross-functional teams. More ❯

FDM is a global business and technology consultancy seeking Data Engineers to work for our client within the IT consulting sector. This is initially a 6-month contract with the potential to extend and will be a fully remote role. Our client is looking for experienced Data Engineers to join their Customer Due Diligence (CDD) Insight … within one of the functions, leveraging cutting-edge technologies to deliver meaningful insights supporting Artificial Intelligence (AI) and Machine Learning (ML) driven solutions. Responsibilities Design, build, and optimize data pipelines using Apache Spark and Snowflake Collaborate with data scientists and analysts to support AI/ML model development and deployment Work closely with stakeholders to understand … business requirements and translate them into technical solutions Ensure data quality, integrity, and governance across all engineering processes Contribute to the development of scalable and reusable data engineering frameworks Support the team in delivering high-impact analytical solutions Manage data warehouses ensuring data organisation and optimisation Monitor data systems for More ❯

Contract Opportunity: Senior Data Platform Architect Our client is seeking a seasoned data leader to help evolve and scale a modern data ecosystem that supports advanced analytics and business intelligence across the organisation. This is a strategic and hands-on role, ideal for someone who thrives in complex environments and enjoys shaping technical direction … while mentoring others. You'll be instrumental in ensuring data is secure, compliant, and ready for decision-making across multiple teams. This role falls outside IR35 and will require some travel to client sites. The chosen candidate will have experience in AWS, Azure and a strong knowledge of Databricks (ideally with some fabric exposure too). Key Responsibilities … Lead the design and optimisation of scalable data architectures across cloud platforms. Drive the development of high-performance data pipelines and workflows. Champion data quality, governance, and compliance across the ecosystem. Collaborate with cross-functional teams to align data strategy with business goals. Act as a technical mentor and thought leader within More ❯

Job Title: Data Engineer Apprentice Location: Crawley, UK Contract: Apprenticeship Are you passionate about data and looking to launch your career in data engineering? This apprenticeship offers the opportunity to gain hands-on experience with leading cloud technologies while being mentored by experienced professionals in a global technology environment. The Role As a Data Engineer Apprentice, you'll play a key role in designing and maintaining data pipelines that make business insights possible. You'll work with a range of Microsoft Azure tools including Data Factory, Databricks, and SQL Server, as well as develop dashboards and KPIs using Power BI. Day-to-day, you'll: Support the design … build, and maintenance of data pipelines. Assist with data ingestion, transformation, and storage in Azure SQL Database and other cloud solutions. Collaborate with senior team members to translate business needs into technical solutions. Document workflows, processes, and best practices. Troubleshoot issues and suggest improvements. Take ownership of your learning journey while contributing to real projects. What More ❯

Job Title: Data Engineer Apprentice Location: Crawley, UK Contract: Apprenticeship Are you passionate about data and looking to launch your career in data engineering? This apprenticeship offers the opportunity to gain hands-on experience with leading cloud technologies while being mentored by experienced professionals in a global technology environment. The Role As a Data Engineer Apprentice, you'll play a key role in designing and maintaining data pipelines that make business insights possible. You'll work with a range of Microsoft Azure tools including Data Factory, Databricks, and SQL Server, as well as develop dashboards and KPIs using Power BI. Day-to-day, you'll: Support the design … build, and maintenance of data pipelines. Assist with data ingestion, transformation, and storage in Azure SQL Database and other cloud solutions. Collaborate with senior team members to translate business needs into technical solutions. Document workflows, processes, and best practices. Troubleshoot issues and suggest improvements. Take ownership of your learning journey while contributing to real projects. What More ❯

Job Title: Data Engineer Apprentice Location: Crawley, UK Contract: Apprenticeship Are you passionate about data and looking to launch your career in data engineering? This apprenticeship offers the opportunity to gain hands-on experience with leading cloud technologies while being mentored by experienced professionals in a global technology environment. The Role As a Data Engineer Apprentice, you'll play a key role in designing and maintaining data pipelines that make business insights possible. You'll work with a range of Microsoft Azure tools including Data Factory, Databricks, and SQL Server, as well as develop dashboards and KPIs using Power BI. Day-to-day, you'll: Support the design … build, and maintenance of data pipelines. Assist with data ingestion, transformation, and storage in Azure SQL Database and other cloud solutions. Collaborate with senior team members to translate business needs into technical solutions. Document workflows, processes, and best practices. Troubleshoot issues and suggest improvements. Take ownership of your learning journey while contributing to real projects. What More ❯

This is an exciting opportunity for a Senior Data Engineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector … transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior Data Engineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior Data Engineer will be responsible for, but not limited to: Design and maintain More ❯

Data Engineer - Generative AI & Secure Data Platforms Hybrid Working | UK-Based | SC Clearance Up to £60k + Paid Overtime + Bonus + Benefits Engineer the Future of Secure AI Innovation Are you ready to use your data engineering skills to build secure, intelligent platforms that power generative AI and national resilience? This is a … hands-on opportunity to join a high-impact, high-trust organisation working on next-gen data platforms. You'll be part of a collaborative international team, helping internal customers unlock the full potential of their data-securely and intelligently. What You'll Be Doing Design, deploy, and maintain resilient data pipelines across on-prem … and cloud environments Collaborate with internal teams to optimise and secure sensitive datasets Ensure compliance with strict data governance and quality standards Contribute to the technology roadmap with insights into emerging tools and platforms Work across SQL, NoSQL, Python, ETL, and big data ecosystems Support projects involving Generative AI, NLP, and OCR What You'll Bring More ❯

Your new company A Principal Data Engineer is required on a permanent basis for a forward-thinking organisation at the heart of Leeds. The Data Services team are on a mission to unlock the value of data by delivering high-quality, secure, and accessible data services. With a focus on modern cloud … based technologies and strong partnerships, they help colleagues navigate the complexities of a data-driven world. Your new role As a Principal Data Engineer, you will be instrumental in shaping the organisations strategic cloud data platform. You'll lead the design and implementation of scalable data pipelines, drive innovation in data … leadership role where you'll establish best practices, ensure compliance, and deliver smart, customer-focused solutions. What you'll need to succeed You'll bring extensive experience in data engineering within Azure environments, with a strong track record in modernisation and large-scale migration projects. You'll be confident designing metadata-driven frameworks and managing Databricks environments, with More ❯

Solutions Data Engineer (MC583) When registering to this job board you will be redirected to the online application form. Please ensure that this is completed in full in order that your application can be reviewed. The Original British Motorcycling Company. At Triumph, we are driven to make the best motorcycles in the world. Building iconic motorcycles that celebrate … our past whilst embracing the future - through bold design, original styling, purposeful engineering and a genuine passion for the ride. Triumph Motorcycles has developed a modern data management solution on Azure with a primary focus on Microsoft Azure Synapse and Fabric for data engineering, transformation, and analytics. The data engineering role is responsible for … integration and data analytics services which align to the IT roadmap. The successful candidate will have at least 4 years experience and have the capability to architect solutions. Company Benefits : A variety of competitive benefits, including an enhanced holiday scheme, employee benefits platform and a favourable life assurance scheme. Motorcycle, clothing and accessories are available to purchase at More ❯

Senior Data Engineer (AI & MLOps) - Software - Newcastle/Hybrid or Remote Day rate: £300 - £500 (Inside IR35) Duration: 6 months Start: ASAP My new client is looking for a Senior Data Engineer with expertise in AI, MLOps, and AWS architecture to design and deliver production-grade machine learning pipelines. The ideal candidate will be passionate about … Engineer, MLOps Engineer, or similar role. Strong background in data structures, algorithms, and software engineering principles. Advanced proficiency in Python for data wrangling, pipeline automation, and ML workflows. Expertise in AWS services, including databases (RDS, DynamoDB, Redshift) and machine learning/AI (SageMaker, AI/ML frameworks). Hands-on experience with ML … pipeline orchestration, CI/CD, and deployment automation. Deep understanding of ML Ops practices, including monitoring, scaling, and retraining strategies. Familiarity with AIOps concepts and tools for operational automation. Preferred Skills Experience with data science and machine learning model development. Knowledge of containerization (Docker, Kubernetes, EKS). Exposure to infrastructure-as-code (Terraform, CloudFormation). Strong problem More ❯

Senior Data Engineer UK Remote, £500/day, Outside IR35 A Senior Data Engineer is required by fast-growing HealthTech/Tech for Good start-up. This is a 3-month contract initially with scope for extension. In this role, you will design, build, and maintain robust data pipelines using streaming and batch processing … technologies and help to lead the modernization of their data lakehouse. You will implement and manage secure cloud infrastructure using AWS, championing a culture of data quality, security, and technical excellence. Key Responsibilities: Architect and maintain data pipelines (streaming & batch) Build and manage scalable data storage solutions (data lakehouse) Design … and maintain secure AWS cloud infrastructure Implement and manage CI/CD and DevOps pipelines Champion data quality, security, and best practices Collaborate with cross-functional teams Implement and manage MLOps capabilities Essential Skills: Advanced Python programming skills Expertise in data engineering tools and frameworks (Apache Flink) Hands-on AWS experience (Serverless, CloudFormation, CDK) Strong understanding More ❯

Your new company A Principal Data Engineer/Architect is required on a permanent basis for a forward-thinking organisation at the heart of Leeds. The Data Services team are on a mission to unlock the value of data by delivering high-quality, secure, and accessible data services. With a focus on … modern cloud-based technologies and strong partnerships, they help colleagues navigate the complexities of a data-driven world. Your new role As a Principal Data Engineer, you will be instrumental in shaping the organisations strategic cloud data platform. You'll lead the design and implementation of scalable data pipelines, drive innovation in … data-centric products, and champion automation and predictive analytics. This is a senior technical leadership role where you'll establish best practices, ensure compliance, and deliver smart, customer-focused solutions. What you'll need to succeed You'll bring extensive experience in data engineering within Azure environments, with a strong track record in modernisation and large More ❯

AI. We’re looking for a highly skilled Backend Engineer to help us make this vision a reality. The ideal candidate will have a track record of shipping data products derived from complex sources, responsible for the process from conceptual data pipelines to production scale. We have a commitment to quality, so the person in this … role will be able to use modern cloud tooling and techniques to deliver reliable data pipelines and continuously improve them. This role requires a passion for solving challenging problems aligned to exciting Artificial Intelligence and Machine Learning applications. Educational or professional background in the biological sciences is a plus but is not necessary; passion to help therapies for … as the wider team and product. Liaise with other technical staff and data engineers in the team and across allied teams, to build an end-to-end pipeline consuming other data products. Minimum Requirements 2+ years of data engineering experience with a Bachelors degree in a relevant field (including computational, numerate or life More ❯

AI. We’re looking for a highly skilled Backend Engineer to help us make this vision a reality. The ideal candidate will have a track record of shipping data products derived from complex sources, responsible for the process from conceptual data pipelines to production scale. We have a commitment to quality, so the person in this … role will be able to use modern cloud tooling and techniques to deliver reliable data pipelines and continuously improve them. This role requires a passion for solving challenging problems aligned to exciting Artificial Intelligence and Machine Learning applications. Educational or professional background in the biological sciences is a plus but is not necessary; passion to help therapies for … as the wider team and product. Liaise with other technical staff and data engineers in the team and across allied teams, to build an end-to-end pipeline consuming other data products. Minimum Requirements 2+ years of data engineering experience with a Bachelors degree in a relevant field (including computational, numerate or life More ❯

Lead Azure Data Consultant/Engineer Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that specialises in modern data platforms. You’ll … be working with well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Lead Data Engineer , you will be designing and delivering cutting-edge solutions across Azure Data services, Microsoft Fabric, and Databricks. This is a hands-on role where you’ll lead from … the front, working on enterprise projects that shape the future of data platforms. What you’ll be doing: Leading the design and implementation of modern data platform solutions for enterprise customers. Building and optimising data pipelines using Azure Data Factory , Microsoft Fabric, Synapse and Databricks . Guiding best practices in data More ❯

Lead Azure Data Consultant/Engineer Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that specialises in modern data platforms. You’ll … be working with well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Lead Data Engineer , you will be designing and delivering cutting-edge solutions across Azure Data services, Microsoft Fabric, and Databricks. This is a hands-on role where you’ll lead from … the front, working on enterprise projects that shape the future of data platforms. What you’ll be doing: Leading the design and implementation of modern data platform solutions for enterprise customers. Building and optimising data pipelines using Azure Data Factory , Microsoft Fabric, Synapse and Databricks . Guiding best practices in data More ❯