1 to 25 of 553 Data Pipeline Jobs in the UK

that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … re underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data … data engineering projects. You will work closely with cross-functional teams and contribute to the strategic direction of our data initiatives. RESPONSIBILITIES Data Pipeline Development: Lead the design, implement, and maintain scalable data pipelines for ingesting, processing, and transforming large volumes of data from various sources using tools such More ❯

best platform, people, and partners together to create limitless opportunities for growth. For more information, visit About Choreograph: A Leading WPP Media Brand Choreograph is WPP's global data products and technology company. We're on a mission to transform marketing by building the fastest, most connected data platform that bridges marketing strategy to scaled activation. … We work with agencies and clients to transform the value of data by bringing together technology, data and analytics capabilities. We deliver this through the Open Media Studio, an AI-enabled media and data platform for the next era of advertising. We're endlessly curious. Our team of thinkers, builders, creators and problem solvers … are over 1,000 strong, across 20 markets around the world. Role Summary and Impact We are seeking a meticulous and experienced Data Architect to play a crucial role in designing, documenting, and ensuring the quality of our next-generation media data lake on the Microsoft Azure platform. This role will focus on developing and upholding More ❯

Data Architect Location: Hybrid working (minimum 2 days a week in Staffordshire Head Office) Type: Full-time Salary: Up to £70,000 Are you a visionary Data Architect ready to shape the future of enterprise data and AI ? I have an amazing opportunity to join my national market leading client to lead the design … and delivery of scalable, secure, and high-performing data solutions that power transformation across a complex, data-rich organisation. What you'll be doing As a Data Architect, you'll be at the heart of enterprise-wide change programmes, working closely with the Lead Data Architect to: Design and deliver enterprise Data & AI architecture aligned with strategic goals. Develop conceptual, logical, and physical data models for both operational and analytical use cases. Define data architecture for solutions involving ETL , data integration, and migration. Establish and maintain data architecture assets, including standards, policies, and integration patterns. Collaborate with Data Stewards, Analysts More ❯

Key Responsibilities: Data Pipelines and … ETL Processes ETL Design: Design and implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions. Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data factory and engineering tools … recovery processes to maintain data integrity. Azure Services Utilise Azure Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer. Ensure the scalability and reliability of data solutions using Azure's suite of services. Collaboration More ❯

uniquely collaborative model across the firm and throughout all levels of the client organization, generating results that allow our clients to thrive. What You'll Do Join the Data Layer Team, a global portfolio transforming our organization into a data-driven enterprise! The Data Layer Team is a portfolio of 30 people who build … essential data platforms, products, and capabilities to empower our clients and colleagues with high-quality, actionable insights. Our focus is on creating scalable data solutions and advancing our data infrastructure to drive informed decision-making across the company. As Use Case Enablement Product Analyst within BCG's Data Layer Team, you will … collaborate with Use Case Enablement Product Owner and cross-functional teams to gather and analyze business and data requirements. Your role is critical to bridging the gap between business stakeholders and technical teams, ensuring that new GenAI use cases are well-scoped, feasible, and aligned with user needs. You will work with various Gen AI use cases and More ❯

Job summary The UKHSA Digital and Data Directorate strategically manages a suite of modern, secure data tools and platforms, ensuring access to high-quality data services. The DD&A team within the directorate comprises solution architects, data architects, and data modelers, and collaborates with organizational units throughout UKHSA. They provide … expertise in data modelling, flow design, and tooling, utilizing top-tier cloud and on-prem solutions to deliver insights for safeguarding public health. As a Senior Data Architect, you will lead data design programmes, collaborating with peers to analyse, design, and implement our evolving data and analytics estate. Main duties of the … job o Analyse and translate business need into sustainable data flows.o Evaluate, understand, and document existing data systems.o Assess the impact of change, and effectively communicate data design and change implications.o Collaborate with and guide multiple stakeholders on data-centric initiatives.o Maintain a broad knowledge of our existing and planned data More ❯

skills and experience, we're looking for people who are innovative, commercial and value the work that they do. Our London office is currently looking for a Senior Data Engineer. The Role The Senior Data Engineer will be responsible for designing, developing, and maintaining the infrastructure and systems required for data storage, processing, and … analysis. They play a crucial role in building and managing the data pipelines that enable efficient and reliable data integration, transformation, and delivery for all data users across the enterprise. Key Responsibilities Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and … load it into the appropriate data storage systems Collaborates with data scientists and analysts to optimize models and algorithms for data quality, security, and governance Integrates data from different sources, including databases, data warehouses, APIs, and external systems Ensures data consistency and integrity during the integration process, performing More ❯

Data Analyst Contract Length: 6 Months Initially (Extension Possible) Location: Hybrid Working (3 Days a Week Onsite - Maidenhead) IR35 Status: Inside IR35 Umbrella/PAYE Are you a data-driven problem solver with a passion for turning complex information into actionable insights? We're looking for a Data Analyst to join our clients dynamic … team and help shape the future of data innovation across our commercial enterprise. About the Role As a Data Analyst, you'll play a pivotal role in designing, specifying, and validating scalable data products that drive critical business thinking.You'll work closely with Data Engineers and Business Analysts to deliver robust, repeatable … complex and demanding Data & Analytics) environments. Proficiency in Python, PySpark, or other relevant programming languages. Understanding of data modelling, ETL processes, and data pipeline design. Experience with cloud platforms (e.g., AWS, Azure, GCP) and data warehousing tools. Exposure to BI tools such as Power BI, Tableau, or Qlik. Knowledge of version More ❯

Job summary The role holder is responsible for the leading the design, development, and ongoing enhancement of organisations data infrastructure and pipelines to support advanced data collection, storage, processing, and analysis. Main duties of the job The role holder is accountable for a team of data engineers, fostering a culture of technical excellence and … continuous improvement. The role holder will work collaboratively with cross-functional teams, including analysts, software engineers, and key stakeholders, to ensure that data solutions are robust, scalable, and aligned with the strategic goals of delivering high-quality care for our patients. About us Since 2012, CHEC has been working with the NHS to increase patient choice and provide … engineering solutions and provide comprehensive reports. Identify and address performance bottlenecks, optimise data processing and query performance for scalability. Implement monitoring frameworks to oversee data pipeline health, swiftly resolving issues to maintain system integrity. Conduct performance tuning to fulfil scalability and availability targets. Develop and enforce stringent data security measures, including access controls More ❯

SQL Developer or Senior Data Analyst or Data Engineer, SQL Azure V12, SQL, Relational databases, ETL, SSIS, SSMS, Analytical and problem solving softer skills. This role is 2 days a week in the office and 3 days remote working. You can either be based in Cambridge or Sheffield, so candidates commutable to either location is fine. … Lithium3 are working with our client exclusively to recruit a Senior Data Engineer (Who could also be a Senior Data Analyst or SQL Developer background) to join their established team who sit between the … main Enterprise Data Warehouse Build function and the visualisation team for reporting. This individual will be responsible for managing, maintaining expanding and optimising the data pipeline and architecture, and supporting end users through data and report delivery. This team is very much doing Projects , working with technical and non-technical stakeholders on business More ❯

SQL Developer or Senior Data Analyst or Data Engineer, SQL Azure V12, SQL, Relational databases, ETL, SSIS, SSMS, Analytical and problem solving softer skills. This role is 2 days a week in the office and 3 days remote working. You can either be based in Cambridge or Sheffield, so candidates commutable to either location is fine. … Lithium3 are working with our client exclusively to recruit a Senior Data Engineer (Who could also be a Senior Data Analyst or SQL Developer background) to join their established team who sit between the … main Enterprise Data Warehouse Build function and the visualisation team for reporting. This individual will be responsible for managing, maintaining expanding and optimising the data pipeline and architecture, and supporting end users through data and report delivery. This team is very much doing Projects , working with technical and non-technical stakeholders on business More ❯

SQL Developer or Senior Data Analyst or Data Engineer, SQL Azure V12, SQL, Relational databases, ETL, SSIS, SSMS, Analytical and problem solving softer skills. This role is 2 days a week in the office and 3 days remote working. You can either be based in Cambridge or Sheffield, so candidates commutable to either location is fine. … Lithium3 are working with our client exclusively to recruit a Senior Data Engineer (Who could also be a Senior Data Analyst or SQL Developer background) to join their established team who sit between the … main Enterprise Data Warehouse Build function and the visualisation team for reporting. This individual will be responsible for managing, maintaining expanding and optimising the data pipeline and architecture, and supporting end users through data and report delivery. This team is very much doing Projects , working with technical and non-technical stakeholders on business More ❯

SQL Developer or Senior Data Analyst or Data Engineer, SQL Azure V12, SQL, Relational databases, ETL, SSIS, SSMS, Analytical and problem solving softer skills. This role is 2 days a week in the office and 3 days remote working. You can either be based in Cambridge or Sheffield, so candidates commutable to either location is fine. … Lithium3 are working with our client exclusively to recruit a Senior Data Engineer (Who could also be a Senior Data Analyst or SQL Developer background) to join their established team who sit between the … main Enterprise Data Warehouse Build function and the visualisation team for reporting. This individual will be responsible for managing, maintaining expanding and optimising the data pipeline and architecture, and supporting end users through data and report delivery. This team is very much doing Projects , working with technical and non-technical stakeholders on business More ❯

Senior Data Engineer/Technical Lead Hybrid - London with 2/3 days WFH Circ £85,000 - £95,000 + Bonus An excellent opportunity is available for a Senior Data Engineer/Technical Lead looking to move into a Management/Leadership position. This is an exciting newly created hands-on Data Engineer Managers … post that will be responsible for leading and mentoring a small team of Data Engineers whilst overseeing data platform development and optimisation. Our client is a well-established and rapidly growing global ecommerce business with its headquarters based in London. Having implemented a new MS Fabric based Data platform, the need is now to … scale up to meet the demand to deliver data driven insights and strategies right across the business globally. The role will require someone that's happy to be hands-on (potentially up to 50% of the time) as you'll be troubleshooting, doing code reviews, steering the team through deployments, acting as an escalation point for technical issues More ❯

Senior Data Engineer/Technical Lead Hybrid - London with 2/3 days WFH Circ £85,000 - £95,000 + Bonus An excellent opportunity is available for a Senior Data Engineer/Technical Lead looking to move into a Management/Leadership position. This is an exciting newly created hands-on Data Engineer Managers … post that will be responsible for leading and mentoring a small team of Data Engineers whilst overseeing data platform development and optimisation. Our client is a well-established and rapidly growing global ecommerce business with its headquarters based in London. They've been expanding at pace and have ambitious plans to take the business even further. … Having implemented a new MS Fabric based Data platform, the need is now to scale up to meet the demand to deliver data driven insights and strategies right across the business globally. The role will require someone that's happy to be hands-on (potentially up to 50% of the time) as you'll be troubleshooting More ❯

This newly created Data Engineer Managers position is an excellent opportunity for a hands-on Senior Data Engineer/Technical Lead/Engineering Team Lead etc looking to move into a management position. The postholder will lead and mentor a team of 3 Data Engineers whilst overseeing data platform development and optimisation. … Our client is a well-established and rapidly growing global ecommerce business with its headquarters based in London. The Data Engineer Manager will play a pivotal role at the heart of our clients data & analytics operation. Having implemented a new MS Fabric based Data platform, the need is now to scale up and meet … the demand to deliver data driven insights and strategies right across the business globally. Therell be a hands-on element to the role as you'll be troubleshooting, doing code reviews, steering the team through deployments and acting as the escalation point for data engineering. This is a hybrid role based in Central/West London More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or … email WHO WE ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security … projects within UK Govt. Departments in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience More ❯

Job summary The post-holder will provide technical expertise and leadership in data engineering, ensuring that data solutions are designed, developed, and deployed in line with NHS and organisational best practices. They will work within the Business Intelligence team to support the delivery of scalable, efficient, and innovative data solutions. Main duties of the … job The Lead Data & Systems Architect will oversee the development and implementation of cloud-based data pipelines, ensuring data quality, accessibility, and security. They will also support the Head of Data Engineering in defining best practices, supporting team development, and fostering a culture of continuous improvement. The post-holder will collaborate with … internal and external stakeholders to align data engineering solutions with national and local data strategies. They will ensure that data solutions support operational and analytical needs, contributing to effective decision-making and service improvements across the organisation. About us We are a multi award-winning organisation that has achieved the prestigious Investors in People More ❯

Are you a Data Engineer, seeking a new challenge? Do you have passion for future vehicle development? If so, Expleo have an opportunity for you! Our client, a prestigious Automotive Manufacturer, is currently recruiting for a Data Engineer to join their Customer Relationship Centre team. As a Data Engineer you will play a key … Engineering, or a related field * Experience as a Data Engineer, ideally within a customer service or contact centre environment * Knowledge of SQL, Python, and data pipeline development * Skilled in Google Cloud Platform (GCP) and cloud data tools * Background in CRM systems and customer data structures * Understanding of data warehousing … concepts and cloud architecture * Experience with ETL tools and frameworks Airflow, Git, CI/CD pipeline * Data Insights reporting experience * Competent with real-time data processing and streaming technologies * Proficiency in Tableau or other data visualisation tools is desirable ** PLEASE NOTE ** To meet with current legislation, right to work checks will be carried More ❯

Are you a Data Engineer, seeking a new challenge? Do you have passion for future vehicle development? If so, Expleo have an opportunity for you! Our client, a prestigious Automotive Manufacturer, is currently recruiting for a Data Engineer to join their Customer Relationship Centre team. As a Data Engineer you will play a key … Engineering, or a related field Experience as a Data Engineer, ideally within a customer service or contact centre environment Knowledge of SQL, Python, and data pipeline development Skilled in Google Cloud Platform (GCP) and cloud data tools Background in CRM systems and customer data structures Understanding of data warehousing … concepts and cloud architecture Experience with ETL tools and frameworks Airflow, Git, CI/CD pipeline Data Insights reporting experience Competent with real-time data processing and streaming technologies Proficiency in Tableau or other data visualisation tools is desirable ** PLEASE NOTE ** To meet with current legislation, right to work checks will be carried More ❯

Join our rapidly expanding team as a hands-on Cloud Data Analytics Platform Engineer and play a pivotal role in shaping the future of data at Citi. We're building a cutting-edge, multi-cloud data analytics platform that empowers our users with secure, scalable, and efficient data insights. This role sits … at the intersection of infrastructure, data engineering, and architecture, offering a unique opportunity to work with the latest cloud-native technologies and influence our data strategy. This is a hands-on role requiring deep technical skills and a passion for building and optimizing data platforms. What You'll Do: Architect and Build: Design and … data zones. Familiarity with data governance tools and frameworks. IaC Proficiency: Solid experience with Terraform and preferably Harness, Tekton, or Lightspeed for CI/CD pipeline management. Kubernetes Mastery: Strong command of Kubernetes, especially in the context of data processing workloads. Security Focus: A firm grasp of cloud security principles and best practices. More ❯

Purpose of the Job: Design, build, and maintain robust data systems and pipelines that support data storage, processing, and analysis on the Cloud. Work with large datasets, ensuring data quality, scalability, and performance, while collaborating. closely with data scientists, analysts, and other engineering teams to understand their data needs and … provide them with high-quality, accessible data. They are responsible for ensuring that the underlying data infrastructure supports the organizations broader data and business goals, enabling more effective data-driven decision-making. Key Accountabilities: Design and implement scalable, efficient, and secure data architectures, ensuring optimal data flow across systems in … and process across the team along with BI lead. Influence the evolution of business and system requirements and contribute to the design of technical solutions to feed a delivery pipeline that increasingly employs Agile methods such as SCRUM and Kanban You will be required to develop unit tested code and then support test cycles including post implementation validation. You More ❯

Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units … solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Engineer will include: Understand the business/product strategy and … Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices Develop and maintain data models, schemas, and documentation Monitor and troubleshoot data pipeline issues, ensuring timely resolution Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as More ❯

Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units … solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Engineer will include: Understand the business/product strategy and … Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices Develop and maintain data models, schemas, and documentation Monitor and troubleshoot data pipeline issues, ensuring timely resolution Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as More ❯

Konexo, the consulting arm of Eversheds Sutherland, is adding to our specialist Data Bench. We want to connect with Data Scientists, Data Engineers and Data Analysts who have supported regulatory remediation and transformation programmes in financial services. About Konexo Financial Services Konexo Financial Services delivers regulatory remediation, compliance, risk and financial crime … project teams who deliver practical, outcomes-driven solutions. What we look for Experience on large scale remediation across AML, KYC, Sanctions, Conduct and Customer Outcomes Strong skills in data analysis, modelling and MI to support compliance and risk remediation Building and optimising data pipelines and governance frameworks Turning data into insight that strengthens regulatory … Proficiency with Python, SQL, R, Power BI and cloud platforms such as Azure, AWS or GCP Example interim roles we cover and are seeking to add to our Data bench Data Scientist Data Engineer Senior Data Analyst BI Developer/Power BI Specialist Data Quality Lead Data Governance More ❯