Data Pipeline Jobs in the UK

251 to 275 of 688 Data Pipeline Jobs in the UK

Senior Data Engineer – Exciting Retail Brand

london (city of london), south east england, united kingdom
Datatech Analytics
Senior Data Engineer – Data Science & Engineering | Global Lifestyle Brand Hybrid – UK | London – Up to £75k DOE | 12-Month FTC | J12995 We’re thrilled to be partnering with one of the world’s most recognisable lifestyle brands at a defining moment in their data transformation journey. As they bring CRM and customer insight capability in … house and launch a new customer data platform, this role sits right at the intersection of Data Science and Engineering, shaping how data products are built, scaled, and delivered across global markets. You won’t be maintaining legacy systems, you’ll be building the foundation for what comes next. Working hand in hand with … Data Science and IT partners, you’ll help drive a culture of experimentation, innovation, and best practice in modern data engineering. The team is at the heart of the customer and insight function, harnessing predictive modelling and analytics to create truly personalised experiences across multiple brands and channels. What you’ll need: • Python, SQL, and data More ❯
Posted:

Senior Data Engineer – Exciting Retail Brand

slough, south east england, united kingdom
Datatech Analytics
Senior Data Engineer – Data Science & Engineering | Global Lifestyle Brand Hybrid – UK | London – Up to £75k DOE | 12-Month FTC | J12995 We’re thrilled to be partnering with one of the world’s most recognisable lifestyle brands at a defining moment in their data transformation journey. As they bring CRM and customer insight capability in … house and launch a new customer data platform, this role sits right at the intersection of Data Science and Engineering, shaping how data products are built, scaled, and delivered across global markets. You won’t be maintaining legacy systems, you’ll be building the foundation for what comes next. Working hand in hand with … Data Science and IT partners, you’ll help drive a culture of experimentation, innovation, and best practice in modern data engineering. The team is at the heart of the customer and insight function, harnessing predictive modelling and analytics to create truly personalised experiences across multiple brands and channels. What you’ll need: • Python, SQL, and data More ❯
Posted:

Data Engineer

Leeds, West Yorkshire, Yorkshire, United Kingdom
Fruition Group
Data Engineer Leeds (hybrid, minimum three days per week on-site) Competitive, plus bonus and benefits Why Apply? We're looking for a skilled Data Engineer to help shape the future of data within a leading organisation. This is an exciting opportunity to contribute to building a product led engineering team that delivers lasting … impact. This is not an analytics focused role, it's about engineering excellence, Python first development, and operating data platforms in a production environment. If you're motivated by solving complex engineering problems, driving best practice, and working in a business cultivating a robust in-house team, this role could be the next step for you. Data Engineer Responsibilities: Design, build, and optimise data pipelines in Python, PySpark, SparkSQL, and Databricks. Ingest, transform, and enrich structured, semi structured, and unstructured data. Operate and support production grade data systems with strong observability and monitoring. Enable real time and batch data processing for analytics and business applications. Collaborate with Product Managers More ❯
Employment Type: Permanent
Posted:

Senior Data Engineer

Bristol, Avon, South West, United Kingdom
IO Associates
Title: Data Engineer Salary: Up to £80,000 Location: Bristol (On-site) Are you a Data Engineer looking to work on complex, high-impact data problems in a fast-moving and innovative sector? I'm working with a market-leading trading firm at the heart of the UK's energy transition. They use advanced … the UK's decarbonisation efforts. This is a small, highly skilled team where technology and trading go hand in hand. You'll be building and optimising the internal data infrastructure that powers critical trading decisions. This is a hands-on role with real impact, and your work will be used daily by traders and data scientists. … What you'll be doing: Building and maintaining batch and real-time streaming data pipelines Acquiring and storing new UK and EU energy market data efficiently Auditing and optimising databases to improve performance Working closely with front-end and data science teams to deliver clean, reliable data Preparing datasets for advanced modelling More ❯
Employment Type: Permanent
Salary: £80,000
Posted:

Senior Data Engineer

newport, wales, united kingdom
IO Associates
Title: Data Engineer Salary: Up to £80,000 Location: Bristol (On-site) Are you a Data Engineer looking to work on complex, high-impact data problems in a fast-moving and innovative sector? I'm working with a market-leading trading firm at the heart of the UK's energy transition. They use advanced … the UK's decarbonisation efforts. This is a small, highly skilled team where technology and trading go hand in hand. You'll be building and optimising the internal data infrastructure that powers critical trading decisions. This is a hands-on role with real impact, and your work will be used daily by traders and data scientists. … What you'll be doing: Building and maintaining batch and real-time streaming data pipelines Acquiring and storing new UK and EU energy market data efficiently Auditing and optimising databases to improve performance Working closely with front-end and data science teams to deliver clean, reliable data Preparing datasets for advanced modelling More ❯
Posted:

Senior Data Engineer

bristol, south west england, united kingdom
IO Associates
Title: Data Engineer Salary: Up to £80,000 Location: Bristol (On-site) Are you a Data Engineer looking to work on complex, high-impact data problems in a fast-moving and innovative sector? I'm working with a market-leading trading firm at the heart of the UK's energy transition. They use advanced … the UK's decarbonisation efforts. This is a small, highly skilled team where technology and trading go hand in hand. You'll be building and optimising the internal data infrastructure that powers critical trading decisions. This is a hands-on role with real impact, and your work will be used daily by traders and data scientists. … What you'll be doing: Building and maintaining batch and real-time streaming data pipelines Acquiring and storing new UK and EU energy market data efficiently Auditing and optimising databases to improve performance Working closely with front-end and data science teams to deliver clean, reliable data Preparing datasets for advanced modelling More ❯
Posted:

Senior Data Engineer

bath, south west england, united kingdom
IO Associates
Title: Data Engineer Salary: Up to £80,000 Location: Bristol (On-site) Are you a Data Engineer looking to work on complex, high-impact data problems in a fast-moving and innovative sector? I'm working with a market-leading trading firm at the heart of the UK's energy transition. They use advanced … the UK's decarbonisation efforts. This is a small, highly skilled team where technology and trading go hand in hand. You'll be building and optimising the internal data infrastructure that powers critical trading decisions. This is a hands-on role with real impact, and your work will be used daily by traders and data scientists. … What you'll be doing: Building and maintaining batch and real-time streaming data pipelines Acquiring and storing new UK and EU energy market data efficiently Auditing and optimising databases to improve performance Working closely with front-end and data science teams to deliver clean, reliable data Preparing datasets for advanced modelling More ❯
Posted:

Senior Data Engineer

bradley stoke, south west england, united kingdom
IO Associates
Title: Data Engineer Salary: Up to £80,000 Location: Bristol (On-site) Are you a Data Engineer looking to work on complex, high-impact data problems in a fast-moving and innovative sector? I'm working with a market-leading trading firm at the heart of the UK's energy transition. They use advanced … the UK's decarbonisation efforts. This is a small, highly skilled team where technology and trading go hand in hand. You'll be building and optimising the internal data infrastructure that powers critical trading decisions. This is a hands-on role with real impact, and your work will be used daily by traders and data scientists. … What you'll be doing: Building and maintaining batch and real-time streaming data pipelines Acquiring and storing new UK and EU energy market data efficiently Auditing and optimising databases to improve performance Working closely with front-end and data science teams to deliver clean, reliable data Preparing datasets for advanced modelling More ❯
Posted:

Data Analyst / Engineer

Woodstock, Oxfordshire, South East, United Kingdom
Ridge & Partners LLP
What's the Opportunity Join our dynamic Digital Engineering team at Ridge as a Data Analyst/Engineer, where you'll play a pivotal role in transforming data into actionable insights that drive innovation across our projects. You'll work closely with multidisciplinary teams to develop and maintain robust data pipelines, implement advanced analytics … integration of digital tools that enhance design, delivery, and operational efficiency. This is a unique opportunity to contribute to cutting-edge engineering solutions while shaping the future of data-driven decision-making in the built environment. We operate an agile working policy, but please note this opportunity will require weekly attendance at a major project site on the … Bristol, Winchester, Reading, London, or Birmingham) subject to ability to travel to Oxford. What you need to do to be effective in this role Develop, maintain, and optimise data pipelines to support digital workflows across engineering and design projects. Collaborate with multidisciplinary teams to understand data requirements and deliver tailored analytical solutions. Clean, transform, and analyse More ❯
Employment Type: Permanent
Posted:

Data Engineer - Snowflake

Manchester, North West, United Kingdom
Chroma Recruitment Ltd
Data Engineer Snowflake 3 months + Remote (UK located) £400 per day Outside IR35 This is an excellent opportunity for someone keen to get involved in the early stages of strategic data projects and deliver robust data solutions. You must have experience working with Snowflake for this role. The company is a well-known … into a customer-centric, digitally driven business. Now is the perfect time to join them on this exciting journey as they look to drive forward innovation through meaningful data insights. As a Data Engineer you will join a newly established team as the embark on new business improvement projects. You will build scalable and reliable data pipelines to power analytics, reporting, and strategic decision making. As a Data Engineer you will have the opportunity to utilise cutting edge data tools to design and implement robust data solutions. Required Skills/Experience: At least 2 years' experience working with Snowflake At least 2 years experience working with Azure, AWS More ❯
Employment Type: Contract
Rate: £375 - £400 per day, Benefits Remote, outside IR35
Posted:

Data Analyst

London, South East, England, United Kingdom
Interquest
MI & Data Integration Analyst (Azure/Databricks) Hybrid - Central London | £43,000 pro rata | 3-month FTC (potential to extend) We're looking for a technically strong and commercially aware MI & Data Integration Analyst to join a leading UK retail and technology business on an initial 3-month fixed-term contract . This is a great … opportunity for someone who enjoys combining hands-on data analysis, reporting, and Azure integration work - helping build robust data foundations and self-serve reporting capability for an evolving business area. The Opportunity You'll be supporting a small, forward-thinking team to improve how they use data - helping them access accurate and timely MI … streamline processes, and migrate to a new Azure-based data environment. You'll take ownership of reporting improvements, work closely with third-party partners on offshoring data processes, and support the move of key datasets into the Unity Catalog environment. Key Responsibilities Produce and enhance accurate, timely, and insightful MI reports to support business decision-making. More ❯
Employment Type: Contractor
Rate: £40,000 - £45,000 per annum
Posted:

Senior Data Engineer

Leeds, West Yorkshire, England, United Kingdom
Hybrid / WFH Options
Oliver James
Senior Data Engineer - £65,000-£70,000 + Excellent Benefits Location: Leeds (Hybrid, 2 days on-site) Are you ready to take on large-scale data engineering challenges within a business that's investing heavily in cloud transformation, AI, and advanced analytics? This is a unique opportunity to join a rapidly growing, tech-driven organisation that … s modernising its entire data landscape and gearing up for a massive change and innovation portfolio in 2026. You'll play a pivotal role in designing and building scalable data platforms on AWS, supporting everything from cloud migrations and Salesforce integrations to AI-ready data pipelines and petabyte-scale projects. What You'll Be … Doing Designing and developing modern data architectures to support advanced analytics and automation. Leading end-to-end data migration projects from on-prem SQL Server to AWS cloud environments. Building and optimising data pipelines using Python, Lambda, and SQL, ensuring performance, quality, and scalability. Collaborating across DevOps, analytics, and engineering teams to deliver cloud More ❯
Employment Type: Full-Time
Salary: Salary negotiable
Posted:

Databricks Engineer

London, United Kingdom
Experis
on-site 6 Months + UMBRELLA only- Inside IR35 Key Responsibilities Design, develop, and maintain ETL/ELT pipelines using Airflow for orchestration and scheduling. Build and manage data transformation workflows in DBT running on Databricks . Optimize data models in Delta Lake for performance, scalability, and cost efficiency. Collaborate with analytics, BI, and data … governance standards. Manage and monitor Databricks clusters & SQL Warehouses to support workloads. Contribute to CI/CD practices for data pipelines (version control, testing, deployments). Troubleshoot pipeline failures, performance bottlenecks, and scaling challenges. Document workflows, transformations, and data models for knowledge sharing. Required Skills & Qualifications 3-6 years of experience as a Data … job clusters, SQL Warehouses). Strong SQL skills and understanding of data modeling (Kimball, Data Vault, or similar) . Proficiency in Python for scripting and pipeline development. Experience with CI/CD tools (e.g., GitHub Actions, GitLab CI, Azure DevOps). Familiarity with cloud platforms (AWS, Azure, or GCP). Strong problem-solving skills and More ❯
Employment Type: Contract
Rate: £425 - £430/day
Posted:

GCP Data Engineer

London, South East, England, United Kingdom
Harnham - Data & Analytics Recruitment
Data Engineer - GCP £750 - £800 per day 2 days in London We're working with a global healthcare and life sciences leader that's pioneering the use of AI and Machine Learning to develop advanced therapies for both existing and emerging diseases. Their mission is to make personalised treatments faster, more effective, and more accessible - and this role … is key to that vision. The team is building cutting-edge data infrastructure to power scientific and ML applications, and they're seeking a Data Engineer with strong experience developing scalable, high-quality data pipelines in the cloud. The Role You'll join a team of data scientists, bioinformaticians, and engineers working … at the intersection of healthcare and AI. Your focus will be on designing and maintaining the data pipelines that feed large-scale ML and research workflows. Day-to-day responsibilities include: Building and maintaining data pipelines using Python, SQL, Spark, and Google Cloud technologies (BigQuery, Cloud Storage). Ensuring pipelines are robust, reliable, and optimised for More ❯
Employment Type: Contractor
Rate: £750 - £800 per day
Posted:

Data Engineer

Stevenage, Hertfordshire, England, United Kingdom
Hybrid / WFH Options
MBDA
Stevenage As a data engineer specialising in generative AI ; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. Salary : Circa £45,000 - £55,000 depending on experience Dynamic (hybrid) working … treatments Facilities : Fantastic site facilities including subsidised meals, free car parking and much more... The opportunity: The MBDA IM GenAI delivery Office department is looking for an experienced data engineer able to evaluate design, deploy, improve and support MBDA data sets. You will ensure MBDA data pipelines are designed to be resilient, secure and … responsive. You will use your data engineering expertise to collaborate with different internal customers regarding their data, ensuring they are optimised and secured for their needs. You will provide your knowledge in data management and data quality to guarantee compliance to MBDA data governance. A key part of this role More ❯
Employment Type: Full-Time
Salary: £55,000 per annum
Posted:

AWS Data Engineer

Manchester, Lancashire, England, United Kingdom
Hybrid / WFH Options
Lorien
Data Engineer - Manchester (Hybrid) - £55,000 + Bonus The Opportunity: Lorien Global is proud to partner with a leading North West brand that's redefining its global strategy through data. Following a major migration project, the business is now investing heavily in cutting-edge data solutions to power smarter tech, innovative products, and world-class customer … experiences. The Role: We're on the lookout for a Data Engineer who's passionate about building scalable, cloud-native data platforms. You'll be a key player in a growing team, helping to shape the future of data infrastructure using AWS, PySpark, Iceberg, and more. From designing high-performance pipelines to supporting a … full-scale migration from SQL Server to AWS, this role offers the chance to work on real-time data solutions that drive impact across the business. You'll work with analysts, data scientists, and engineers to unlock automation, enable BI, and increase advanced analytics. What You'll Be Doing: Designing and building robust data More ❯
Employment Type: Full-Time
Salary: £45,000 - £55,000 per annum
Posted:

Microsoft Fabric Consultant

United Kingdom
Hybrid / WFH Options
Ingentive
We do this by providing client-side incubation support with ready-made out-of-the box capability supported by smart, execution-focussed practitioners. The Role Are you a data enthusiast with a passion for transforming raw information into meaningful insights? We’re looking for a talented Fabric/Data Consultant with expertise in Azure and Power … BI to join our dynamic team. This role is perfect for someone who enjoys working with cutting-edge technology, developing robust data architectures, and driving strategic business intelligence initiatives. If you're excited about helping organizations unlock the full potential of their data, we’d love to hear from you. Essential Expertise: Proven experience in data engineering with exposure to Azure Synapse or Azure Data Factory or Databricks. Familiarity with Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming with a focus on data manipulation and engineering. A genuine interest in data science and a drive to expand your skillset More ❯
Posted:

Assistant Vice President, Data Technical Lead

England, United Kingdom
MUFG Bank, Ltd
consumer finance, asset management, and leasing. MUFG offers stability in an ever-changing market, providing services to high-profile clients worldwide.You will be part of AMD-Architecture, Middleware, Data Management & Enterprise Service department. The AMD pillar of Technology has a department focused on Data Engineering & Business Intelligence (DEBI), who are responsible for designing & developing enterprise standard … technologies that support data integration, processing, warehousing, mining & reporting.Main Purpose of the Role : To architect, design and develop EDM and data solutions as part of multiple initiatives across International MUFG entities (MUFG Securities, MUFG Bank and MUMSS) To drive innovation and automation so that we can deliver the highest quality service to our business partners. To … in accordance with business requirement and architectural guidelines. To mentor and lead other EDM resources that augment the team.Key Responsibilities:In this role, you will be responsible for data across MUFG's banking arm and securities business under a dual-hat arrangement. Under this arrangement, you will act and make decisions on behalf of both the bank and More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Azure Data Engineer

Manchester, England, United Kingdom
iO Associates
Contract Data Engineer - Azure, Databricks, SQL, Python 6 Weeks | Outside IR35 | £500-£600 per day | Remote (occasional travel to Manchester or Glasgow) My client is delivering a high-impact data migration programme and is looking for a Data Engineer to join on a 6-week contract. This role will suit someone who thrives in … fast-moving delivery environments and has hands-on experience with modern data engineering tools. The Role Join a focused delivery team to execute a business-critical data migration Build, optimise and maintain data pipelines using Azure and Databricks Translate business requirements into technical solutions that ensure data accuracy, integrity and security Deliver … a strong focus on clean, reliable code and documentation Skills & Experience Required Advanced SQL skills for querying, modelling and migration tasks Ability to write production-quality Python for data engineering and automation Proven experience of data migration projects, ideally at enterprise scale Experience with Databricks and the wider Azure stack (Data Lake, Synapse, ADF More ❯
Posted:

Azure Data Engineer

Manchester, Lancashire, United Kingdom
iO Associates
Contract Data Engineer - Azure, Databricks, SQL, Python 6 Weeks Outside IR35 £500-£600 per day Remote (occasional travel to Manchester or Glasgow) My client is delivering a high-impact data migration programme and is looking for a Data Engineer to join on a 6-week contract. This role will suit someone who thrives in … fast-moving delivery environments and has hands-on experience with modern data engineering tools. The Role Join a focused delivery team to execute a business-critical data migration Build, optimise and maintain data pipelines using Azure and Databricks Translate business requirements into technical solutions that ensure data accuracy, integrity and security Deliver … a strong focus on clean, reliable code and documentation Skills & Experience Required Advanced SQL skills for querying, modelling and migration tasks Ability to write production-quality Python for data engineering and automation Proven experience of data migration projects, ideally at enterprise scale Experience with Databricks and the wider Azure stack (Data Lake, Synapse, ADF More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Principal Data Engineer/Architect

Leeds, West Yorkshire, Yorkshire, United Kingdom
Hays
Your new company A Principal Data Engineer/Architect is required on a permanent basis for a forward-thinking organisation at the heart of Leeds. The Data Services team are on a mission to unlock the value of data by delivering high-quality, secure, and accessible data services. With a focus on … modern cloud-based technologies and strong partnerships, they help colleagues navigate the complexities of a data-driven world. Your new role As a Principal Data Engineer, you will be instrumental in shaping the organisations strategic cloud data platform. You'll lead the design and implementation of scalable data pipelines, drive innovation in … data-centric products, and champion automation and predictive analytics. This is a senior technical leadership role where you'll establish best practices, ensure compliance, and deliver smart, customer-focused solutions. What you'll need to succeed You'll bring extensive experience in data engineering within Azure environments, with a strong track record in modernisation and large More ❯
Employment Type: Permanent
Salary: £90,000
Posted:

Data Analyst, Business Intelligence Data Analyst

London, United Kingdom
Experis
Job Title: Business Intelligence Data Analyst Location: Middlesex 12 Month Contract Salary up to £65k + Benefits Job Type: Full-time Department: Sales Operations/Business Analytics Job Overview Are you passionate about transforming data into strategic insights that drive business success? We are looking for a Business Intelligence Data Analyst to support our … Global Virtual Sales (GVS) team across EMEA. This role is essential to enabling data-driven decision-making that maximizes sales effectiveness and enhances operational efficiency. As part of a dynamic and collaborative environment, you'll work closely with cross-functional teams-including Sales, Finance, Operations, Strategy & Planning, and IT-to analyze complex datasets and deliver actionable insights. Your … work will directly influence how we execute our Sales Go-to-Market strategy and shape the future of virtual selling Key Responsibilities Enable and support data-driven decision-making across sales operations to enhance productivity and revenue growth. Conduct advanced analysis of complex datasets spanning sales, operations, marketing, and planning. Design and develop reports and dashboards to track More ❯
Employment Type: Contract
Rate: £60000 - £65000/annum Benefits
Posted:

Senior Software Engineer

United Kingdom
Hybrid / WFH Options
Aibidia
few. This role is based in Finland, and can be located at either our Helsinki or Tampere offices, or remotely from the UK. Key Responsibilities Designing and optimizing data solutions in a cloud environment Integrating data pipelines with external services through APIs Enforcing data security measures, including encryption and access controls Designing data solutions adhering to regulatory requirements (e.g., GDPR, HIPAA) and implementing metadata repositories for tracking data lineage and dependencies Building data solutions leveraging different data ingestion methods and technologies Skills, Knowledge and Expertise Must have: Experience with cloud-based technologies (such as Azure) Proficiency in designing and implementing complex system integrations Experience with … Python and .NET Experience in implementing data solutions adhering to regulatory requirements and security measures Experience with Python with libraries such as Pandas In-depth knowledge of various database system technologies (relational, document, columnar, etc.) Understanding and experience with relational databases and implementation of OLTP and OLAP systems Professional experience in data modeling and database optimisation More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer

Birmingham, West Midlands, England, United Kingdom
Hybrid / WFH Options
TXP
Job Title: Data Engineer Role Type: Permanent Location: Birmingham (Hybrid) Role Overview Our client is seeking a skilled Data Engineer to join their dynamic team. You'll play a key role in designing and maintaining data solutions that support business intelligence and analytics across the organisation. Key Responsibilities: Develop curated business models for accurate … decision-making. Build and optimize data pipelines using Azure Synapse and Data Factory. Design reporting solutions with SSRS, SSAS, and SSIS. Extract and integrate data from Dynamics into Synapse/Power BI. Ensure data security and compliance in Azure environments. Support cloud migration from on-premise technologies. Key Skills: Proficiency in Microsoft … BI stack (SSRS, SSAS, SSIS). Hands-on experience with Azure Synapse, Data Factory, and data lakes. Strong analytical skills and ability to derive insights from complex data. Effective communicator and team collaborator. Experience designing curated business models for reporting. If you are a skilled Lead/Senior Data Engineer, we would like to More ❯
Employment Type: Full-Time
Salary: £45,000 - £50,000 per annum
Posted:

Data Engineer DV Cleared

Herefordshire, England, United Kingdom
Sanderson
Position: Data EngineerLocation: HerefordshireSalary: £50,000 to £65,000 base salary (depending on seniority) Security Clearance: DV Clearance Required Are you a talented Data Engineer ready to take on exciting, customer-facing projects? Our client is expanding their data engineering team and is looking for a proactive, technically sharp individual to help build and … maintain bespoke data pipelines and applications using proprietary commercial software. This is a fantastic opportunity to work on end-to-end data solutions, collaborate with cross-functional teams, and contribute to rapid prototyping and delivery of data-driven products. The Role: As a Data Engineer, you'll be responsible for: Developing intuitive … skills (or similar programming language). Solid experience with relational databases. Familiarity with APIs for data retrieval and integration. Experience gathering requirements and managing stakeholders. Understanding of pipeline scheduling, health checks, and failure mitigation. Exposure to front-end design or development. Benefits Package: £5,000 annual professional development budget. Private healthcare + £100/month wellness fund. More ❯
Employment Type: Full-Time
Salary: £50,000 - £65,000 per annum
Posted:
Data Pipeline
10th Percentile
£45,000
25th Percentile
£54,125
Median
£70,000
75th Percentile
£87,500
90th Percentile
£115,000