126 to 150 of 582 Data Pipeline Jobs in the UK

location: Central London Hybrid role (2-3 days from client location) Job type: Permanent We are looking a highly skilled Data Architect- Technical with expertise in Databricks, PySpark, and modern data engineering practices. The ideal candidate will lead the design, development, and optimization of scalable data pipelines, while ensuring data accuracy, consistency … This role requires strong leadership, technical depth, and the ability to collaborate with cross-functional teams. Key Responsibilities Lead the design, development, and maintenance of scalable, high-performance data pipelines on Databricks . Architect and implement data ingestion, transformation, and integration workflows u sing PySpark, SQL, and Delta Lake . Guide the team in migrating Legacy … ETL processes to modern cloud-based data pipelines. Ensure data accuracy, schema consistency, row counts, and KPIs during migration and transformation. Collaborate with Data engineer, BI Engineers, and Security teams to define data standards, governance, and compliance. Optimize Spark jobs and Databricks clusters for performance and cost efficiency. Support Real Time and More ❯

Technology is at the heart of Disney's past, present, and future. Disney Entertainment and ESPN Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more - all working to build and advance the technological backbone for Disney's media business globally. The team marries technology with creativity to build world-class products … Disney's industry-leading ad technology and products - driving advertising performance, innovation, and value in Disney's sports, news, and entertainment content, across all media platforms. The Ads Data team is under Ad Platforms and its mission is to transform advertising and Disney's Ad platform with data and AI across TV and streaming video. We … every aspect of the advertising life cycle. At our core is a strong cross-domain team to deliver E2E solutions covering tech areas ranging from machine learning, big data, microservices to data visualization. Our team is seeking a senior software engineer who will be a core team member for our advertising data platform engineering More ❯

to achieve this for a 7th time across the coming period. Due to these increasing levels of high activity, they are generating more and more customer and performance data than ever before and are embarking on a key project to best manage & utilise this. An agile and robust data management and utilisation plan will be key … e.g., star/snowflake schemas) Administer Microsoft Fabric Lakehouse and Azure services Optimise performance across queries, datasets, and pipelines Apply data validation, cleansing, and standardisation rules Document pipeline logic and contribute to business-wide metadata catalogues Collaborate with BI, Change, and Product teams to align data outputs to needs Support groundwork for future data … requirements clearly across business teams will be key to success in this role. You’ll be a technically strong data professional with hands-on experience in pipeline development, cloud-based data infrastructure, and performance optimisation. You will be at your best when working collaboratively in fast-paced environments and when translating complex business needs More ❯

Data Engineer (Power BI) | 6 Month Contract | Outside IR35 We're seeking a Data Engineer with experience in Power BI to help build and optimise data pipelines and deliver high-quality datasets for business intelligence. You'll ensure that large, complex data flows seamlessly into the reporting layer, enabling analysts and stakeholders … to uncover insight. Location: London Contract: 6 Months (OIR35) Rate: £325-400 p/day Key Responsibilities: Designing and maintaining scalable ETL/ELT pipelines . Integrating data from multiple sources into a centralised warehouse (SQL Server, PostgreSQL, or Snowflake). Working with Azure Data Factory and cloud-native tooling for data orchestration. Structuring … data models to support Power BI dashboards and reports. Implementing data governance, quality frameworks, and security controls . Partnering with analysts and product owners to align engineering outputs with business requirements. Key Skills: Strong SQL skills and experience with relational databases. Hands-on experience with Azure (ADF, Synapse, Data Lake) or AWS/GCP More ❯

DV Cleared Data Engineers – Bristol – AWS or Azure – All levels We’re supporting a leading global consultancy with the expansion of their secure data engineering team, and we’re looking for DV Cleared Data Engineers to join major projects in Bristol. If you hold active DV clearance and want to work on cutting-edge … mission-critical programmes in a highly collaborative technical environment, this is an excellent opportunity. They are considering all levels from Junior Data Engineers to Principal - as long as you hold DV Clearance!! What You’ll Be Doing Designing and delivering secure, high-performance data pipelines and analytics platforms Working across AWS or Azure environments, building scalable … national infrastructure and security programmes with real impact What We’re Looking For Active DV clearance (essential) Strong background in data engineering, ETL, and data pipeline development Experience with AWS or Azure cloud technologies Excellent coding skills in Python, SQL, or Scala Understanding of data warehousing, modelling, and streaming technologies Confident working in More ❯

DV Cleared Data Engineers Wanted – London – AWS or Azure – Senior/Principal We’re supporting a leading global consultancy with the expansion of their secure data engineering team, and we’re looking for DV Cleared Data Engineers to join major projects in London. If you hold active DV clearance and want to work on … cutting-edge, mission-critical programmes in a highly collaborative technical environment, this is an excellent opportunity. What You’ll Be Doing Designing and delivering secure, high-performance data pipelines and analytics platforms Working across AWS or Azure environments, building scalable, reliable data solutions Collaborating with cross-functional teams including engineers, data scientists, and architects … national infrastructure and security programmes with real impact What We’re Looking For Active DV clearance (essential) Strong background in data engineering, ETL, and data pipeline development Experience with AWS or Azure cloud technologies Excellent coding skills in Python, SQL, or Scala Understanding of data warehousing, modelling, and streaming technologies Confident working in More ❯

About the Role Reporting to the Head of Data, Insights & Analytics you will lead a team of Data Engineers in the design, development and maintenance of Travel Counsellors’ data infrastructure. This role will be a high impact, multi-faceted working on data pipelines, our new strategic Data Platform and operationalising … our analytical/data science solutions. Principal Accountabilities Support the design and implementation of data pipelines to ensure accurate, consistent and timely data across our analytical and reporting needs Work closely with Data Scientists, Analysts and business SMEs to automate and scale our machine learning and AI capabilities Support the development of … our new cloud-based Data Platform, transforming systematic data into a business view for reporting and analytics Take ownership of our existing Microsoft technology (SQL Server, SSIS, SSAS, SSRS) whilst delivering on our migration plans to cloud-based technology Create and maintain comprehensive documentation for data processes and architectures. Provide training and support to More ❯

i am recruiting for a Data Engineer to work in Glasgow 3 days a week, 2 days remote. The role falls inside IR35 so you will have to work through an umbrella company. You will have several years of experience supporting Software Engineering, Data Engineering, or Data Analytics projects. You will have experience of … designing and implementing tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Experience in data development and solutions in highly complex data environments with large data volumes. SQL/PLSQL experience with the ability … to write ad-hoc and complex queries to perform data analysis. Databricks experience is essential. Experience developing data pipelines and data warehousing solutions using Python and libraries such as Pandas, NumPy, PySpark, etc. You will be able to develop solutions in a hybrid data environment (on-Prem and Cloud). You must More ❯

i am recruiting for a Data Engineer to work in Glasgow 3 days a week, 2 days remote. The role falls inside IR35 so you will have to work through an umbrella company. You will have several years of experience supporting Software Engineering, Data Engineering, or Data Analytics projects. You will have experience of … designing and implementing tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Experience in data development and solutions in highly complex data environments with large data volumes. SQL/PLSQL experience with the ability … to write ad-hoc and complex queries to perform data analysis. Databricks experience is essential. Experience developing data pipelines and data warehousing solutions using Python and libraries such as Pandas, NumPy, PySpark, etc. You will be able to develop solutions in a hybrid data environment (on-Prem and Cloud). You must More ❯

Data Engineer - Hybrid - Public Sector - Fixed-Term Contract Location: Bradford (Hybrid working model) Contract: 2-Year Fixed Term Salary: Up to £45,000 Work Type: Full-time Are you a skilled Data Engineer looking to make a meaningful impact in a purpose-driven organisation? This is a unique opportunity to contribute to life-saving decisions through … values innovation, collaboration, and integrity. You'll enjoy flexible working arrangements, including hybrid options, and a comprehensive benefits package. What You'll Be Doing: Designing and building scalable data pipelines using Microsoft Fabric and Azure Creating robust data models and architectures to support strategic decision-making Collaborating with analysts and data quality teams to … ensure clean, trusted data Integrating data from operational systems, APIs, and cloud platforms Championing data governance, security, and ethical data use What We're Looking For: Proven experience in data engineering (Microsoft Fabric, Azure, SQL, DAX or Python) Strong understanding of data modelling and performance optimisation Ability to More ❯

Data Engineer - Hybrid - Public Sector - Fixed-Term Contract Location: Bradford (Hybrid working model) Contract: 2-Year Fixed Term Salary: Up to £45,000 Work Type: Full-time Are you a skilled Data Engineer looking to make a meaningful impact in a purpose-driven organisation? This is a unique opportunity to contribute to life-saving decisions through … values innovation, collaboration, and integrity. You'll enjoy flexible working arrangements, including hybrid options, and a comprehensive benefits package. What You'll Be Doing: Designing and building scalable data pipelines using Microsoft Fabric and Azure Creating robust data models and architectures to support strategic decision-making Collaborating with analysts and data quality teams to … ensure clean, trusted data Integrating data from operational systems, APIs, and cloud platforms Championing data governance, security, and ethical data use What We're Looking For: Proven experience in data engineering (Microsoft Fabric, Azure, SQL, DAX or Python) Strong understanding of data modelling and performance optimisation Ability to More ❯

Data Engineer - Hybrid - Public Sector - Fixed-Term Contract Location: Bradford (Hybrid working model) Contract: 2-Year Fixed Term Salary: Up to £45,000 Work Type: Full-time Are you a skilled Data Engineer looking to make a meaningful impact in a purpose-driven organisation? This is a unique opportunity to contribute to life-saving decisions through … values innovation, collaboration, and integrity. You'll enjoy flexible working arrangements, including hybrid options, and a comprehensive benefits package. What You'll Be Doing: Designing and building scalable data pipelines using Microsoft Fabric and Azure Creating robust data models and architectures to support strategic decision-making Collaborating with analysts and data quality teams to … ensure clean, trusted data Integrating data from operational systems, APIs, and cloud platforms Championing data governance, security, and ethical data use What We're Looking For: Proven experience in data engineering (Microsoft Fabric, Azure, SQL, DAX or Python) Strong understanding of data modelling and performance optimisation Ability to More ❯

Data Engineer - Hybrid - Public Sector - Fixed-Term Contract Location: Bradford (Hybrid working model) Contract: 2-Year Fixed Term Salary: Up to £45,000 Work Type: Full-time Are you a skilled Data Engineer looking to make a meaningful impact in a purpose-driven organisation? This is a unique opportunity to contribute to life-saving decisions through … values innovation, collaboration, and integrity. You'll enjoy flexible working arrangements, including hybrid options, and a comprehensive benefits package. What You'll Be Doing: Designing and building scalable data pipelines using Microsoft Fabric and Azure Creating robust data models and architectures to support strategic decision-making Collaborating with analysts and data quality teams to … ensure clean, trusted data Integrating data from operational systems, APIs, and cloud platforms Championing data governance, security, and ethical data use What We're Looking For: Proven experience in data engineering (Microsoft Fabric, Azure, SQL, DAX or Python) Strong understanding of data modelling and performance optimisation Ability to More ❯

Data Engineer - Hybrid - Public Sector - Fixed-Term Contract Location: Bradford (Hybrid working model) Contract: 2-Year Fixed Term Salary: Up to £45,000 Work Type: Full-time Are you a skilled Data Engineer looking to make a meaningful impact in a purpose-driven organisation? This is a unique opportunity to contribute to life-saving decisions through … values innovation, collaboration, and integrity. You'll enjoy flexible working arrangements, including hybrid options, and a comprehensive benefits package. What You'll Be Doing: Designing and building scalable data pipelines using Microsoft Fabric and Azure Creating robust data models and architectures to support strategic decision-making Collaborating with analysts and data quality teams to … ensure clean, trusted data Integrating data from operational systems, APIs, and cloud platforms Championing data governance, security, and ethical data use What We're Looking For: Proven experience in data engineering (Microsoft Fabric, Azure, SQL, DAX or Python) Strong understanding of data modelling and performance optimisation Ability to More ❯

Data Engineer - Hybrid - Public Sector - Fixed-Term Contract Location: Bradford (Hybrid working model) Contract: 2-Year Fixed Term Salary: Up to £45,000 Work Type: Full-time Are you a skilled Data Engineer looking to make a meaningful impact in a purpose-driven organisation? This is a unique opportunity to contribute to life-saving decisions through … values innovation, collaboration, and integrity. You'll enjoy flexible working arrangements, including hybrid options, and a comprehensive benefits package. What You'll Be Doing: Designing and building scalable data pipelines using Microsoft Fabric and Azure Creating robust data models and architectures to support strategic decision-making Collaborating with analysts and data quality teams to … ensure clean, trusted data Integrating data from operational systems, APIs, and cloud platforms Championing data governance, security, and ethical data use What We're Looking For: Proven experience in data engineering (Microsoft Fabric, Azure, SQL, DAX or Python) Strong understanding of data modelling and performance optimisation Ability to More ❯

Data Engineer - Hybrid - Public Sector - Fixed-Term Contract Location: Bradford (Hybrid working model) Contract: 2-Year Fixed Term Salary: Up to £45,000 Work Type: Full-time Are you a skilled Data Engineer looking to make a meaningful impact in a purpose-driven organisation? This is a unique opportunity to contribute to life-saving decisions through … values innovation, collaboration, and integrity. You'll enjoy flexible working arrangements, including hybrid options, and a comprehensive benefits package. What You'll Be Doing: Designing and building scalable data pipelines using Microsoft Fabric and Azure Creating robust data models and architectures to support strategic decision-making Collaborating with analysts and data quality teams to … ensure clean, trusted data Integrating data from operational systems, APIs, and cloud platforms Championing data governance, security, and ethical data use What We're Looking For: Proven experience in data engineering (Microsoft Fabric, Azure, SQL, DAX or Python) Strong understanding of data modelling and performance optimisation Ability to More ❯

Data Engineer - Hybrid - Public Sector - Fixed-Term Contract Location: Bradford (Hybrid working model) Contract: 2-Year Fixed Term Salary: Up to £45,000 Work Type: Full-time Are you a skilled Data Engineer looking to make a meaningful impact in a purpose-driven organisation? This is a unique opportunity to contribute to life-saving decisions through … values innovation, collaboration, and integrity. You'll enjoy flexible working arrangements, including hybrid options, and a comprehensive benefits package. What You'll Be Doing: Designing and building scalable data pipelines using Microsoft Fabric and Azure Creating robust data models and architectures to support strategic decision-making Collaborating with analysts and data quality teams to … ensure clean, trusted data Integrating data from operational systems, APIs, and cloud platforms Championing data governance, security, and ethical data use What We're Looking For: Proven experience in data engineering (Microsoft Fabric, Azure, SQL, DAX or Python) Strong understanding of data modelling and performance optimisation Ability to More ❯

Data Engineer - Hybrid - Public Sector - Fixed-Term Contract Location: Bradford (Hybrid working model) Contract: 2-Year Fixed Term Salary: Up to £45,000 Work Type: Full-time Are you a skilled Data Engineer looking to make a meaningful impact in a purpose-driven organisation? This is a unique opportunity to contribute to life-saving decisions through … values innovation, collaboration, and integrity. You'll enjoy flexible working arrangements, including hybrid options, and a comprehensive benefits package. What You'll Be Doing: Designing and building scalable data pipelines using Microsoft Fabric and Azure Creating robust data models and architectures to support strategic decision-making Collaborating with analysts and data quality teams to … ensure clean, trusted data Integrating data from operational systems, APIs, and cloud platforms Championing data governance, security, and ethical data use What We're Looking For: Proven experience in data engineering (Microsoft Fabric, Azure, SQL, DAX or Python) Strong understanding of data modelling and performance optimisation Ability to More ❯

Lead Data Engineer - Overview: We're looking for a visionary data leader to shape the future of data for a leading bank. Join now if you want to spearhead the delivery of a next-generation data platform, built on a modern Azure-Databricks ecosystem, unlocking the full potential of advanced analytics, machine … learning and AI across the business. The Role: Are you a proven data engineer, looking to step into an exciting leadership position? Reporting directly into the head of data, this position will allow you to use your Azure experience throughout exciting transformation projects and to shape the journey of the bank. Your expertise will be used … learning & AI implementation - experience delivering machine learning and AI solutions, ideally within Databricks. Strong data governance knowledge- in-depth knowledge of data governance best practices. Pipeline engineering & monitoring expertise - skilled in building and orchestrating scalable data pipelines, with experience implementing using Azure-native tools. Exceptional stakeholder & communication skills - able to clearly articulate complex More ❯

Senior Data Engineer - AWS Location: London (Hybrid) | Practice Area : Technology & Engineering Type: Permanent Engineer future-ready data platforms that power financial transformation. The Role We're looking for a Senior Data Engineer with AWS to join our growing team of engineering experts driving next-gen transformation for Tier 1 financial services clients. You'll … play a pivotal role in designing, building, and deploying cloud-based data pipelines. Working across greenfield projects and enterprise-scale platforms, your work will directly impact the way data is ingested, transformed, and served at scale across the financial services industry. What You'll Do Design and build end-to-end data pipelines leveraging … AWS-native tools and modern data architectures. Collaborate with clients to gather requirements, define solutions, and deliver production-grade systems. Apply AWS Well-Architected Principles to ensure scalability, security, and resilience. Lead in the development of robust, tested, and fault-tolerant data engineering solutions. Support and mentor junior engineers, contributing to knowledge sharing across the team. More ❯

Data Analytics Engineer Permanent Basingstoke (Hybrid - x2 PW) Up to £70,000 + Excellent Package Overview We're looking for a skilled Data Analytics Engineer to help drive the evolution of our clients data platform. This role is ideal for someone who thrives on building scalable data solutions and is confident working … with modern tools such as Azure Databricks , Apache Kafka , and Spark . In this role, you'll play a key part in designing, delivering, and optimising data pipelines and architectures. Your focus will be on enabling robust data ingestion and transformation to support both operational and analytical use cases. If you're passionate about data engineering and want to make a meaningful impact in a collaborative, fast-paced environment, we want to hear from you !! Role and Responsibilities Designing and building scalable data pipelines using Apache Spark in Azure Databricks Developing real-time and batch data ingestion workflows, ideally using Apache Kafka Collaborating with data scientists, analysts, and More ❯

Data Engineer to join a growing data team. Youll work across servers and their central data lake, developing and maintaining pipelines that support reporting, analytics, and AI-driven initiatives. Key Responsibilities Build and maintain scalable data pipelines into the central data lake. Work with tools such as Alteryx to automate … and optimise workflows. Write efficient SQL queries for data extraction, transformation, and reporting. Develop in Python , including exposure to AI/ML libraries where appropriate. Collaborate with colleagues to improve data quality, governance, and availability. Support delivery of data to business users in a secure and efficient way. Requirements Strong experience with SQL (across … common RDBMS platforms). Solid knowledge of Python for data engineering tasks; interest in AI/ML. Hands-on experience with Alteryx or similar workflow/ETL tools. Experience with servers and managing data in a data lake environment. Good communication skills and ability to work with both technical and business users. Working Pattern More ❯

Location: London, England, United Kingdom Join Axon and be a Force for Good. Design, build, and maintain scalable, secure, and efficient data pipelines using modern data tools and cloud-native technologies Work with a variety of data sources-structured, semi-structured, unstructured-to support diverse analytics and operational workloads Ensure data quality … and consistency by incorporating automated testing, data validation, and monitoring mechanisms Drive best practices around data engineering, including testing, observability, security, and documentation Troubleshoot and resolve issues in production environments to ensure data integrity and platform reliability What you bring: 5+ years of professional experience in data engineering roles, preferably for a … customer facing data product Expertise in designing and implementing large-scale data processing systems with data tooling such as Spark, Kafka, Airflow, dbt, Snowflake, Databricks, or similar Strong programming skills in languages such as SQL, Python, Go or Scala Demonstrable use and an understanding of effective use of AI tooling in your development process More ❯

Senior Product Analyst Department: Data & Analytics Employment Type: Full Time Location: Cardiff Hybrid: 2 days per week in-office In 2002, we became the first insurance comparison site. Our purpose? To make the process of sorting your insurance, utilities or personal finances as easy as possible. We're part of RVU. A group of online brands that include … in touch today! About the role: As a Senior Product Analyst at you will be crucial in driving business impact and decision-making by bridging the gap between data and insight. In this role, we are looking for someone who will identify opportunities for deep analytics on customer behaviour and site performance by working closely with a variety … business requirements and ensure the data is structured appropriately for the required analytics Experience with data modelling, ETL process and/or data pipeline creation Comfortable managing multiple projects and stakeholders with competing deadlines and priorities, ensuring the highest value work gets prioritised and accomplished in a proactive and timely manner and ability More ❯

Data Architect Location: Manchester (Hybrid - Onsite Tuesdays) Salary: £85,000 - £90,000 + up to 25% Bonus A leading household name in the digital and e-commerce space, with over 16 million users on their app and £1 billion in annual revenue generated through digital channels, is embarking on a major 5-year data transformation strategy. … company-wide on-prem to Azure migration. What You'll Be Doing Lead the cloud architecture transformation (Azure focus) Work hands-on with SQL, Azure, and data pipeline development Engage with stakeholders across the business - educate, influence, and lead Collaborate with BI, Data Engineering, and Digital Analytics teams Design and deliver scalable architecture for massive … data sets and high-volume user bases What You'll Bring Minimum 2 years' experience in architecture (cloud/data focused) Strong hands-on technical background (SQL, Azure essential) Experience in on-prem to cloud migration (Azure preferred) Ability to work autonomously, with strong stakeholder management Experience working with large data volumes and customer More ❯