276 to 300 of 568 Data Pipeline Jobs in the UK excluding London

re on a mission to create a virtual sales agent that performs better than a human sales agent. We’re looking for a Data Engineering Manager to lead a small team in building a key part of our data infrastructure - evolving and scaling the ingestion of … internal systems. This role blends people management, individual contribution, and technology leadership. People Management: You will lead and mentor a small team of Data Engineers, fostering a high-performance culture by guiding their professional growth and ensuring effective communication within the team and with stakeholders. Your strong interpersonal … Python and Docker in our pipelines. You’ll need to be highly proficient in these or similar tools and comfortable navigating a modern data ecosystem. The person we’re looking for Passionate about designing and delivering solutions to complex problems Curious with a desire for continuous learning Friendly More ❯

Lead Data Engineer | Build and Lead a New Data Team I am looking for a Lead Data Engineer to establish and lead a new Data Engineering team. This is a unique opportunity to shape data architecture from the ground up … working with cutting-edge technology to drive business performance. The Role As the first Data Engineering hire, you will: Design and implement scalable data architectures for efficient storage and access. Build and maintain data pipelines handling terabyte-scale datasets. Work closely with data scientists, analysts, and stakeholders to optimize data solutions. Own the reliability, performance, and scalability of data infrastructure. Recruit and lead a growing team of data engineers. Tech Stack Python (3.10+), Pandas, NumPy PostgreSQL (TimescaleDB), SQL optimization RabbitMQ, ZeroMQ, Linux servers Prometheus, Grafana More ❯

JOB SUMMARY Senior Data Engineer DV Cleared £500 - £600 per day - Outside IR35 JOB DESCRIPTION This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure … data solutions, ensuring compliance with strict security standards and regulations. This is a UK based onsite role with the option of compressed hours. The role will include: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. … Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring More ❯

Data Engineer – Azure Location: Birmingham, UK Amtis is delighted to recruit for an exciting opportunity for a Data Engineer to join a brilliant company based in Birmingham. Key Responsibilities Collaborating with internal customers to document requirements. Integrating and modelling data from multiple sources for … analytics. Developing and testing complex BI apps. Creating data pipelines and migrating existing solutions to Microsoft Fabric. Supporting business users in self-service app development. Enhancing BI services with advanced data science capabilities. Providing routine BI service support and incident resolution. Ensuring data quality … and completeness. Adhering to governance requirements and handling ad-hoc requests. Required Skills Extensive experience in data analytics development. Proficiency in data engineering and complex data modelling using Fabric/Azure. Expertise in app/DWH development and support with Microsoft Azure/Power More ❯

Data Engineer – 12 MONTH FTC Opportunity for a Data Engineer to join a collaborative business operating in the Reproductive sector in Nottingham Salary up to £40,000 + some fantastic benefits including remote working, purchase additional holiday scheme, pension contribution, and more Apply online or contact … additional holidays Pension contribution Life Insurance Flexible working arrangements Employee discount – nursery benefit scheme And more… WHAT WILL YOU BE DOING? As a Data Engineer, you’ll be responsible for developing and maintaining robust data pipelines and integrations to support the organisation’s reporting and analytics … needs. You’ll design and manage ETL processes, ensuring seamless data extraction, transformation, and loading into reporting systems. Working with cloud-based platforms and relational databases, you’ll optimise data workflows for performance, scalability, and reliability. You’ll collaborate with IT and data teams More ❯

network of 20 offices nationally: www.kpmg88careers.co.uk/experienced-professional/#LeBlender.OfficeLocations There has never been a been a better time to join the Data & AI team at KPMG. Our clients and communities we act in embrace the opportunities provided by AI, and are looking for help deploying GenAI … in a fair, ethical and impactful way. The KPMG Data & AI team helps clients on their AI transformation journeys by leveraging advanced analytical techniques and industrial-scale AI platforms. Our projects span industries such as Financial Services, Retail, Public Sector, Healthcare, Energy, and Utilities, with a focus on … extracting data insights, building AI models, and delivering value through engaging, data-driven stories. Our approach is multi-disciplinary, so we are able to answer our clients’ most complex issues and have significant impact on their business results. KPMG UK is looking for a Generative AI More ❯

Data Scientist (Mid Level) - Maidenhead We are looking for a mid-level Data Scientist to join our client's growing team. You will use your skills in data analysis and machine learning to uncover insights, build predictive models, and support decision-making across various … projects. You’ll also work closely with engineers, product teams, and other stakeholders to deliver data-driven solutions. Benefits: Pension Health insurance Employees will be receiving a quarterly stipend to spend Employee Assistance programme – wellbeing 25 days holidays Group Life assurance scheme Long Term Disability Scheme Key Responsibilities … identify patterns and insights Build and improve machine learning models to solve business problems Design and analyze experiments (A/B testing, etc.) Data Engineering Support Work with data engineers to ensure clean, usable data Build and maintain data pipelines for model More ❯

Job Title: Data Engineer (senior/principal) 💰 Salary: ~£90-120k 📍 Location: Covent Garden (4 office days/week) 📱 Industry: Telecoms (challenger) This MVNO company is on a mission to disrupt the mobile network industry with highly innovative ideas and a revolutionary business model that truly places customers … latest technology, setting out to be a hub of creativity and pioneering ideas that will transform the industry. As a Senior/Principal Data Engineer, you will be an integral part of a data-driven organisation, responsible for the data infrastructure from data collection through to data service of analytics, you will provide self-servicing tools and access of data to support colleagues to make data-driven decision and drive results. ✅ Must have requirements: Python SQL expertise designing and maintaining ETL/data More ❯

JobDescription: Areyou passionate about Data and Analytics (D&A) and excited abouthow it can completely transform the way an enterprise works? Do youhave the strategic vision, technical expertise, and leadershipskills to drive data-driven solutions? Do you want to work in adynamic, fast-growing category? If … so, you might be the idealcandidate for the role in the Data and Analytics function forGlobal Pet Nutrition (PN) atMars. Pet Nutrition (PN) isthe most vibrant category in the FMCG sector. As we work totransform this exciting category, a new program, Digital First, hasbeen mobilized by the Mars … thought leadership, quality decisionmaking, deep technical know-how, and an ability to navigate complexbusiness challenges while building and leading a team of worldclass data and analyticsleaders. With Digital First,PN is moving to a Product based model to create business facingdigital capabilities. Develop and maintain robust data More ❯

Job Title: Data Engineer Location: Aberdeen (Hybrid 3 days on-site) Salary: £55,000 – 65,000 About Us: Join a dynamic and innovative team at one of the top oil and gas firms in Aberdeen. We are committed to leveraging cutting-edge technology to drive efficiency and sustainability … in the energy sector. Job Description: We are seeking a skilled Data Engineer to join our team. The ideal candidate will have a strong background in data management, analytics, and engineering, with a passion for solving complex problems and optimising data processes. Key Responsibilities … Design, develop, and maintain data pipelines and architectures. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Implement data integration and transformation processes. Ensure data quality and integrity across various platforms. Optimize data storage and retrieval systems More ❯

Job Title: Data Engineer Location: Aberdeen (Hybrid 3 days on-site) Salary: £55,000 – 65,000 About Us: Join a dynamic and innovative team at one of the top oil and gas firms in Aberdeen. We are committed to leveraging cutting-edge technology to drive efficiency and sustainability … in the energy sector. Job Description: We are seeking a skilled Data Engineer to join our team. The ideal candidate will have a strong background in data management, analytics, and engineering, with a passion for solving complex problems and optimising data processes. Key Responsibilities … Design, develop, and maintain data pipelines and architectures. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Implement data integration and transformation processes. Ensure data quality and integrity across various platforms. Optimize data storage and retrieval systems More ❯

About The Role We are seeking a Lead Fabric Engineer to drive the design, development, and delivery of modern data solutions, using Microsoft Fabric. This is a hands-on, technical leadership role requiring deep expertise in data engineering, Azure, and lakehouse architectures. The successful candidate will … play a critical role in shaping and implementing enterprise-scale data platforms that support advanced analytics, reporting, and data governance. Leading a team of talented engineers, you'll ensure that best practices, performance, and scalability are at the heart of everything we deliver. Key Responsibilities Leading … the end-to-end implementation of data solutions, using Microsoft Fabric (OneLake, Lakehouse, Dataflows, Pipelines, Notebooks, Semantic Models). Building and maintaining data pipelines using medallion architecture (bronze/silver/gold layers). Collaborating with stakeholders, architects, and analysts to understand data needs More ❯

Data Analyst Location: Leeds, United Kingdom Are you interested in building new data products that will be a value center as opposed to a cost center? Or creating new value and insights for customers with a new data platform and data products … worth $Billion+? If so, check out the below A leading Logistics & Supply chain organization is building a new data team to develop a new platform based on Snowflake that will help their customers get direct data insights that can impact their supply chains and enable informed … decisions. The role will report to the Head of Data. Managing Snowflake and data pipelines, and creating key visualizations in Snowflake or Power BI using SQL and Python (through Snowpark) alongside the Microsoft stack, managing data across cloud and legacy systems. You will be helping to More ❯

Role: Analytics Engineer/Data Analyst Duration: 3 Months Rolling Rate: £350-400/Day (Outside IR35) Location: Remote (Occasional London Office visits) We are seeking a highly skilled Analytic Engineer/Data Analyst for a 3-month contract position within the wellness industry. This is … a fully remote role with occasional office visits to London as required. The successful candidate will play a key role in a major data migration project focused on redesigning and optimising a Looker instance. This position offers a competitive daily rate of £350-£400 and operates outside IR35. … The ideal candidate will possess a strong background in data analytics, with particular expertise in business intelligence tools and data modelling. You will work closely with other data professionals to ensure a smooth migration and to maximise the performance and usability of the Looker More ❯

JobDescription: Areyou passionate about Data and Analytics (D&A) and excited abouthow it can completely transform the way an enterprise works? Do youhave the strategic vision, technical expertise, and leadershipskills to drive data-driven solutions? Do you want to work in adynamic, fast-growing category? If … timely andaccurate delivery of data products that meet business needs andqualitystandards. DataOpsand Optimisation: Implement DataOpspractices to streamline dataengineering workflows andimprove operationalefficiency. Automate datapipeline deployment and monitoring using CI/CDtools. TechnicalLeadership: Providetechnical leadership and guidance on data engineering bestpractices. Stay informedabout industry trends and emerging technologies … policies, procedures and standards.Implement best practices for data management, security, andcompliance. Promote data quality and integrity across all dataproducts. Monitor datapipeline performance and optimise for scalability, reliability, andspeed. StakeholderEngagement: Collaboratewith PN D&A leadership, PN product owners, and segment D&Aleadership to synchronise and formulate data More ❯

gen labour automation unit, providing highly efficient services across various use cases, starting with industrial applications. We are looking for Senior/Lead Data Engineer to join our team based in London, UK. Our Mission At Humanoid we strive to create the world’s leading, commercially scalable, safe … manage large datasets used for training humanoid robots — projected to reach hundreds of terabytes by 2025. Ensure the quality, accuracy, and consistency of data across multiple projects. Collaborate with machine learning teams to design data pipelines that support efficient training workflows. Develop and maintain data quality metrics reporting systems. Implement best practices for data management, including versioning, security, and compliance. Expertise Bachelor’s or Master’s degree in Data Science, Computer Science, or a related field. 5+ years of experience in data engineering and data More ❯

Data Scientist Remote (UK-Based) Up to £45,000 The Company This UK-based start-up has grown rapidly in just two years. With a team of ~30 people, they are scaling quickly, supported by recent funding and a strong growth pipeline. They specialise in predictive analytics, tracking … KPIs for a wide range of companies and industries. Their insights empower investors to make informed decisions by providing performance data ahead of public reports. The Role As a Data Scientist, you’ll play a pivotal role in developing and refining KPI prediction models, working with … real-world data to create actionable insights. Clean and process data to ensure accuracy and usability. Build and maintain linear regression models for KPI tracking. Access APIs and integrate software tools to enhance workflows. Collaborate with the revenue team to generate insightful reports. Support internal product More ❯

Location: London, Hybrid 💰 Rate: Up to £600 per day 📆 Contract: 6 months (Outside IR35, potential to go perm) 🛠 Tech Stack: Azure Data Factory, Synapse, Databricks, Delta Lake, PySpark, Python, SQL, Event Hub, Azure ML, MLflow We’ve partnered with a new AI-first professional services consultancy that’s … a founding team of contractors with the view to scale into permanent leadership as the business grows. They’re now hiring a Senior Data Engineer to build robust, scalable data solutions powering AI, analytics, and future client delivery. If you love creating high-performance data … clean, governed data layers for ML, analytics, and application use 🔹 Supporting LLM/AI data workflows through structured and unstructured pipeline design 🔹 Contributing to reusable data engineering components across client and internal use cases 🔹 Collaborating with data scientists, architects, and product More ❯

A fantastic opportunity has arisen for a Data Analyst to join a business in Pocklington. In this key role, you will be responsible for capturing, analysing, and reporting data to optimise supply chain efficiency, biological asset management, and commercial decision-making. This position offers the chance … to provide valuable insights that drive business performance and strategic growth. The Role Reporting to the Head of Optimisation, the Data Analyst will generate data-driven insights to enhance performance across the business. This is an excellent opportunity for a data professional to contribute … and exciting opportunities for career development within a dynamic, forward-thinking environment. You will be involved in cutting-edge data projects that are shaping the future of food production. Key Responsibilities: Ensure accurate and timely data capture across the entire supply chain. Develop and maintain automated More ❯

Select how often (in days) to receive an alert: VIE Data Scientist Databricks About Crown Crown Holdings, Inc. , is a world leader in the metal packaging production process. We design and manufacture a wide range of innovative and sustainable metal packaging solutions and products. Our clients are some … to our long-term future. About this opportunity Your work environment : Our European Information Systems and Services (EISS) department is looking for a Data Scientist Databricks Engineer on a VIE contract for 12-24 months based at Wantage (UK). With a good background in data engineering, you will support our IT Teams in the development and maintenance of data dashboards using Microsoft technologies (including Power BI, Azure Data Factory) and Databricks. The ideal candidate will be capable to learn or have a first experience in designing scalable data More ❯

compute solutions to enable efficient processing and real-time interactions. Event-Driven Architecture : Build and maintain systems that facilitate scalable and real-time data processing. Efficient Workflow Management : Implement solutions to streamline complex AI processes and facilitate automation. Real-Time Communication : Enhance … communication frameworks to improve user experience across our platforms. Document Management Solutions : Develop indexing and retrieval systems for efficient document handling. Data Pipeline Creation : Design ETL pipelines to collect and process data from a variety of sources. Infrastructure Decision-Making : Advocate for architectural decisions that … ensure scalability, reliability, and cost efficiency. Support for Research Teams : Provide infrastructure and tools that empower our AI and data research initiatives. Tech Stack: Full-Stack Development : TypeScript, React, Next.js, Tailwind, Prisma Database Management : PostgreSQL, MongoDB, Redis Cloud Solutions : AWS, Google Cloud, Serverless Architectures Data Pipelines More ❯

quality. With a strong focus on operational efficiency and digital transformation, we're looking for a Business Intelligence (BI) Analyst to help drive data-informed decisions across our shop floor and wider business operations. Role Overview As a BI Analyst, you will be responsible for developing, maintaining, and … optimizing data pipelines and reporting systems that deliver actionable insights to stakeholders across the business. A key part of your role will involve understanding the manufacturing process and shop floor activities in real-time, which requires full-time on-site presence and collaboration with production teams. Key Responsibilities … Design, build, and maintain data pipelines that integrate production, sales, and operational data. Develop and manage Power BI dashboards and reports tailored to shop floor and business needs. Translate raw data from systems like Navision/Business Central (Nav to BC) into meaningful insights. Support the More ❯

quality. With a strong focus on operational efficiency and digital transformation, we're looking for a Business Intelligence (BI) Analyst to help drive data-informed decisions across our shop floor and wider business operations. Role Overview As a BI Analyst, you will be responsible for developing, maintaining, and … optimizing data pipelines and reporting systems that deliver actionable insights to stakeholders across the business. A key part of your role will involve understanding the manufacturing process and shop floor activities in real-time, which requires full-time on-site presence and collaboration with production teams. Key Responsibilities … Design, build, and maintain data pipelines that integrate production, sales, and operational data. Develop and manage Power BI dashboards and reports tailored to shop floor and business needs. Translate raw data from systems like Navision/Business Central (Nav to BC) into meaningful insights. Support the More ❯

Prestigious opportunity with a Market Leading Global Retail organisation for a Senior Data Engineer to join our success story in Blackburn. Following a period of significant growth, we are expanding our team to further drive the business forward. You will be responsible for:- Designing, building and maintaining scalable … data pipelines using Python, MS SQL server and robust data pipelines to transform and store data. Managing the process of developing and implementing data models, schemas and architecture solutions. Working with stakeholders, data scientists and analysts to understand data requirements. … Providing insights into data trends and opportunities. Work on processes to improve efficiency, reduce latency and ensure high data availability. Monitoring, logging and alerting mechanisms to identify and resolve data-related issues. If you possess a combination of some of the following skills, then More ❯

Senior Data Engineer | Bristol | Permanent Full-Time | Hybrid Working Peaple Talent are pleased to be working with a returning client in Bristol looking to recruit for a Senior Data Engineer. This is a full-time permanent role, and would require hybrid working in Bristol. This Senior … growth by sharing knowledge and improving collective engineering practices. In-depth knowledge of data modelling best practices and common patterns used in pipeline architecture. Confident in version control with Git and familiar with setting up CI/CD workflows using platforms like Azure DevOps or similar tools. … Airflow for managing complex data workflows. Practical familiarity with low-code or no-code platforms such as Talend and SnapLogic for streamlined pipeline development. Strong experience working with cloud-based data services, especially within AWS environments, utilizing tools like Lambda, S3, Redshift, Glue, Athena and More ❯