501 to 525 of 1,167 Data Pipeline Jobs in the UK

Are you looking to develop your Data Scientist career? Would you like to be part of a team that innovates using technology? About our Team: At LexisNexis Intellectual Property Solutions, our mission is to bring clarity to innovation by delivering better outcomes to the innovation community. Each and … results. We are proud to directly support and serve these innovators in their endeavors to better humankind. About the Role: As a Principal Data Scientist, you will be a key member of the LNIP Technology Team. Your primary responsibility will be to drive the strategic vision of Data … with schools, hosting events to inspire young females to consider and pursue careers in technology. Responsibilities: Lead the development and implementation of advanced data analytics and machine learning models to solve complex business problems. Collaborate with cross-functional teams to identify data-driven opportunities and provide More ❯

Lead/Senior Data Consultant - Leeds/Hybrid - £70,000-90,000 Darwin Recruitment have partnered with a Leeds-based Consultancy who are in a growth-phase, investing heavily in their technical teams. They are searching for a Lead/Senior Data Consultant to play a … environment Focus on new products and features. A clear path to Leadership. The Role You will lead on internal projects centred around developing data processing pipelines & GenAI applications within Cloud environments. … These projects are large-scale, complex and have a huge impact for their clients. Experience of Interest Python, FastAPI, Application Development. Data Pipeline Processing/Data Engineering Cloud expertise - AWS/GCP Terraform, Docker, Bash Github, CI/CD, Jira, Confluence Agile, Scrum, Kanban Previous More ❯

Databricks Engineer to join a renewable energy firm based in London. You'll play a hands-on role in developing and optimising modern data lakehouse solutions on Azure, while supporting critical analytics and data delivery systems. The environment encourages technical ownership, collaboration, and the chance to … tackle complex cloud-native engineering challenges. THE COMPANY This is a leading organisation within the renewable energy sector, dedicated to sustainable innovation and data-driven operations. The business is undergoing rapid digital transformation, investing in cloud-based technologies to optimise performance, forecasting, and environmental impact. With operations across … platforms on Microsoft Azure. Your work will directly support migration initiatives, analytics enablement, and platform reliability. You'll be responsible for data pipeline development, resource deployment, and ongoing optimisation of cloud-native systems. Your responsibilities will include: Designing and implementing scalable data lakehouse architectures using More ❯

Databricks Engineer to join a renewable energy firm based in London. You'll play a hands-on role in developing and optimising modern data lakehouse solutions on Azure, while supporting critical analytics and data delivery systems. The environment encourages technical ownership, collaboration, and the chance to … tackle complex cloud-native engineering challenges. THE COMPANY This is a leading organisation within the renewable energy sector, dedicated to sustainable innovation and data-driven operations. The business is undergoing rapid digital transformation, investing in cloud-based technologies to optimise performance, forecasting, and environmental impact. With operations across … platforms on Microsoft Azure. Your work will directly support migration initiatives, analytics enablement, and platform reliability. You'll be responsible for data pipeline development, resource deployment, and ongoing optimisation of cloud-native systems. Your responsibilities will include: Designing and implementing scalable data lakehouse architectures using More ❯

Senior Data Engineer - Runcorn - £80K A growing manufacturing business in Runcorn is looking for a Senior Data Engineer to join their team. You'll design and optimise data pipelines, ensuring efficient data flow across the business. Working closely with the wider business … you'll ensure their data warehouse efficiently delivers high-quality insights. The role also offers fantastic career progression, with the potential to move into a Head of Data Engineering role in the future What's in it for you? Salary up to £80,000 + bonus … and wellness benefits Hybrid working from Runcorn Company discount on their products + much more Key Responsibilities Develop and maintain ETL/ELT data pipelines using Python and SQL. Work with enterprise-level cloud platforms, ideally GCP (BigQuery, Airflow, Cloud Functions). Integrate APIs and process data More ❯

Data Engineer An exciting opportunity has arisen for a skilled Data Engineer to support a government department in transitioning a successful proof-of-concept (PoC) business intelligence and data warehousing solution into a fully operational, production-ready platform. Over a four-year period, a … options aligned with the departments long-term digital strategy. Through agile delivery and close collaboration, the organisation significantly improved its understanding of internal data assets and the Microsoft technology ecosystem, enhancing its reporting capabilities and data-driven decision-making. The next phase of this programme will … Factory (ADF): Incremental creation of data dimensions to optimise processing, reduce overheads, and improve cost efficiency across compute, storage, and networking. Enhancing pipeline security by replacing basic authentication with managed identities or service principals. Introducing parallelism into pipeline workflows to improve performance and scalability. Refactoring existing More ❯

Data Engineer An exciting opportunity has arisen for a skilled Data Engineer to support a government department in transitioning a successful proof-of-concept (PoC) business intelligence and data warehousing solution into a fully operational, production-ready platform. Over a four-year period, a … aligned with the department’s long-term digital strategy. Through agile delivery and close collaboration, the organisation significantly improved its understanding of internal data assets and the Microsoft technology ecosystem, enhancing its reporting capabilities and data-driven decision-making. The next phase of this programme will … Factory (ADF): Incremental creation of data dimensions to optimise processing, reduce overheads, and improve cost efficiency across compute, storage, and networking. Enhancing pipeline security by replacing basic authentication with managed identities or service principals. Introducing parallelism into pipeline workflows to improve performance and scalability. Refactoring existing More ❯

Company Insight This is the opportunity for an exceptional Senior Data Engineer to join one of Europe's best performing systematic quant trading businesses. Since its inception, this firm has cemented a formidable reputation within the systematic trading space, having been recognised as one of 2024's top … performing funds. This is an organisation that prides itself on it's innovative data and tech driven investment approach implemented within their trading strategies. Such an unparalleled scientific approach has allowed the firm to build next-generation, scalable and fault-tolerant multi-asset trading and backend systems, generating … outstanding returns in the process and experiencing exponential growth. Key Responsibilities Technical Ownership and Accountability building global and scalable Data Lakehouse solution used by multiple trading desks across the entire front-office. Contributing into software and infrastructure design and implementation in AWS cloud environment. Developing data More ❯

Company Insight This is the opportunity for an exceptional Senior Data Engineer to join one of Europe's best performing systematic quant trading businesses. Since its inception, this firm has cemented a formidable reputation within the systematic trading space, having been recognised as one of 2024's top … performing funds. This is an organisation that prides itself on it's innovative data and tech driven investment approach implemented within their trading strategies. Such an unparalleled scientific approach has allowed the firm to build next-generation, scalable and fault-tolerant multi-asset trading and backend systems, generating … outstanding returns in the process and experiencing exponential growth. Key Responsibilities Technical Ownership and Accountability building global and scalable Data Lakehouse solution used by multiple trading desks across the entire front-office. Contributing into software and infrastructure design and implementation in AWS cloud environment. Developing data More ❯

Head of Data Engineering Description of Role and Client: The Head of Data Engineering will lead the technical development and operational management of data engineering solutions for a prominent insurance organization. The client requires a data engineering expert capable of managing complex … environments and collaborating with senior technical teams. This role falls inside IR35. Responsibilities: Design, develop, and manage data pipelines, warehouses, and data lakes. Optimize and maintain enterprise data engineering platforms. Lead strategic management of data engineering solutions across cloud and hybrid environments. … Collaborate closely with Data Architects, CIO teams, and senior stakeholders. Continuously enhance the efficiency, reliability, and scalability of data engineering landscapes. Candidate Requirements/Profile: Extensive data engineering experience within insurance sectors. Proficiency with AWS, Azure, GCP, and hybrid data environments. Relevant More ❯

Head of Data Engineering Description of Role and Client: The Head of Data Engineering will lead the technical development and operational management of data engineering solutions for a prominent insurance organization. The client requires a data engineering expert capable of managing complex … environments and collaborating with senior technical teams. This role falls inside IR35. Responsibilities: Design, develop, and manage data pipelines, warehouses, and data lakes. Optimize and maintain enterprise data engineering platforms. Lead strategic management of data engineering solutions across cloud and hybrid environments. … Collaborate closely with Data Architects, CIO teams, and senior stakeholders. Continuously enhance the efficiency, reliability, and scalability of data engineering landscapes. Candidate Requirements/Profile: Extensive data engineering experience within insurance sectors. Proficiency with AWS, Azure, GCP, and hybrid data environments. Relevant More ❯

Senior Data Engineer | London, Hybrid | £70,000-£90,000 DOE My client is growing fast and looking for a skilled Data Engineer to help shape the backbone of their data capabilities. You’ll play a key role in refining infrastructure, ensuring seamless data access, and supporting a modern data platform built for scale. Working closely with teams across the business, you’ll help drive smarter decisions and long-term success through well-structured, reliable, and secure data systems. Key Responsibilities: Define and implement a modular data architecture designed to scale with business growth Develop and maintain a cloud-based data warehouse using AWS to manage high-volume data ingestion Design robust, high-throughput data pipelines that scale with increased demand. Automate ETL/ELT processes and integrate multiple More ❯

Senior Data Engineer | London, Hybrid | £70,000-£90,000 DOE My client is growing fast and looking for a skilled Data Engineer to help shape the backbone of their data capabilities. You’ll play a key role in refining infrastructure, ensuring seamless data access, and supporting a modern data platform built for scale. Working closely with teams across the business, you’ll help drive smarter decisions and long-term success through well-structured, reliable, and secure data systems. Key Responsibilities: Define and implement a modular data architecture designed to scale with business growth Develop and maintain a cloud-based data warehouse using AWS to manage high-volume data ingestion Design robust, high-throughput data pipelines that scale with increased demand. Automate ETL/ELT processes and integrate multiple More ❯

As the Director of Engineering for our Advanced Analytics business unit, you will lead the development of innovative tools and systems that power data-driven insights and analytics across the organisation. Your leadership will play a pivotal role in driving the next generation of advanced analytics capabilities, ensuring … role offers a broad scope of responsibility, where you'll influence the direction of our analytics solutions and shape the way we leverage data to optimise business outcomes. You will work closely with passionate and dedicated colleagues and clients, all committed to driving transformation in the digital media … years of experience in a leadership role with 5+ years of hands-on software engineering experience. Strong expertise in software architecture, data pipeline design, and scalable analytics systems. Proven experience with integrating and automating business workflows, including data-driven processes and system integrations. Familiarity with More ❯

As the Lead Enterprise Architect for our Advanced Analytics business unit, you will lead the development of innovative tools and systems that power data-driven insights and analytics across the organisation. Your leadership will play a pivotal role in driving the next generation of advanced analytics capabilities, ensuring … role offers a broad scope of responsibility, where you'll influence the direction of our analytics solutions and shape the way we leverage data to optimise business outcomes. You will work closely with passionate and dedicated colleagues and clients, all committed to driving transformation in the digital media … years of experience in a leadership role with 5+ years of hands-on software engineering experience. Strong expertise in software architecture, data pipeline design, and scalable analytics systems. Proven experience with integrating and automating business workflows, including data-driven processes and system integrations. Familiarity with More ❯

We are seeking a diligent and innovative Data Engineer to join our Analytics team, the successful Data Engineer with be able to demonstrate a strong business acumen. The ideal candidate will ideally worked with ETL processes, Snowflake, and Tableau, and will be instrumental in bridging the … gap between data engineering and business strategy. Client Details We are a global electronics and manufacturing company that operates in 100 countries. Our UK subsidiary is based in Manchester. We are on a journey to further develop our data first approach this role will play a … key part in bridging the gap between or data engineering team and the wider business. Description The successful Data Engineer will be responsible for but not limited to: Building robust, scalable data pipelines. Implement complex, large scale big data projects with a More ❯

Senior Data Engineer Location: London | Hybrid Tech Stack: Azure | Synapse | Databricks | Power BI Cloud Focus: Cloud-native + hybrid integration Salary: £80,000 - £100,000 + 20% bonus We’re hiring a Senior Data Engineer on behalf of a global financial services firm undergoing large-scale … and is critical to building scalable, secure data solutions using the Azure ecosystem. You’ll work across modern and hybrid environments, lead pipeline development, and play a hands-on role in shaping the firm’s data engineering framework — with real impact on decision-making, performance … and productivity. What You’ll Do Lead the design and build of end-to-end data pipelines on Azure Synapse and Databricks. Work with DevOps and Architecture teams to ensure seamless integration between cloud and legacy on-prem systems. Contribute to a cloud-native data engineering More ❯

Senior Data Engineer Location: London | Hybrid Tech Stack: Azure | Synapse | Databricks | Power BI Cloud Focus: Cloud-native + hybrid integration Salary: £80,000 - £100,000 + 20% bonus We’re hiring a Senior Data Engineer on behalf of a global financial services firm undergoing large-scale … and is critical to building scalable, secure data solutions using the Azure ecosystem. You’ll work across modern and hybrid environments, lead pipeline development, and play a hands-on role in shaping the firm’s data engineering framework — with real impact on decision-making, performance … and productivity. What You’ll Do Lead the design and build of end-to-end data pipelines on Azure Synapse and Databricks. Work with DevOps and Architecture teams to ensure seamless integration between cloud and legacy on-prem systems. Contribute to a cloud-native data engineering More ❯

Staff Software Engineer - Data Department: Engineering Employment Type: Full Time Location: Cardiff Description is the UK's first comparison platform for car insurance. We've been helping customers since 2002 by empowering them to make better decisions around insurance and financial services. Our mission is simple: take away … Autonomy: Authority over technical strategy, decisions and implementation approach, so you can deliver using practices that align with your preferred ways of working. Data Driven: Utilise rich logs, metrics, and data to monitor and improve system performance & reliability. Culture: Enhancing a diverse engineering culture by taking … around the business to build relationships and act as a multiplier. What we look for in you Understand, assess and effectively apply modern data architectures (dimensional model, data mesh, data lake). Experience in applying and using data observability methods effectively. Experience More ❯

engineering, and publishing in one role. This is a fantastic opportunity to join a growing, tech-forward quant research team. As a Senior Data Scientist, youll be joining a collaborative and innovation-focused environment where youll help solve complex problems using modern AI and machine learning techniques. Youll … work on designing intelligent systems that uncover hidden signals in data and influence how assets are allocated. What youll be doing: This role is ideal for someone whos motivated by research, enjoys working with large-scale data systems, and wants to contribute to real, measurable outcomes … unstructured or alternative sources) Strong coding ability in Python; familiarity with cloud environments and scalable data platforms Experience with data pipeline tools (e.g. Kafka, SQL, DevOps, microservices) Prior publications, patents or research contributions What youll get in return: A salary of between More ❯

are seeking an experienced Power BI Developer for a 6-month interim contract to support a fast-paced retail business in transforming financial data into actionable insights. This role focuses on designing and building finance-focused Power BI dashboards and reports, leveraging data extracted from Microsoft … Responsibilities: Design, develop, and maintain Power BI dashboards and reports tailored to finance and retail business needs. Extract and transform financial and transactional data from Dynamics 365 via Azure Data Lake/Synapse/Data Factory (as applicable). Collaborate with finance and IT … teams to understand data requirements and reporting goals. Ensure data models are optimised for performance and scalability. Implement best practices in report design, data governance, and version control. Support the integration and automation of data pipelines from source systems to Power BI. More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can transform enterprise operations? Do you possess the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? If so, you might be the ideal candidate for the … Data and Analytics role within Mars's Global Pet Nutrition (PN) division. Pet Nutrition (PN) is a vibrant category in the FMCG sector. As we aim to transform this sector, the Digital First program has been launched by the PN leadership team. Digital First centers pet parents in … This initiative requires significant thought leadership, technical know-how, and the ability to navigate complex challenges while leading a team of top-tier data and analytics professionals. In this role, you will operate globally, collaborating with engineering teams across growth products, to develop and maintain robust data More ❯

engineering, and publishing in one role. This is a fantastic opportunity to join a growing, tech-forward quant research team. As a Senior Data Scientist, you’ll be joining a collaborative and innovation-focused environment where you’ll help solve complex problems using modern AI and machine learning … techniques. You’ll work on designing intelligent systems that uncover hidden signals in data and influence how assets are allocated. What you’ll be doing: This role is ideal for someone who’s motivated by research, enjoys working with large-scale data systems, and wants to … unstructured or alternative sources) Strong coding ability in Python; familiarity with cloud environments and scalable data platforms Experience with data pipeline tools (e.g. Kafka, SQL, DevOps, microservices) Prior publications, patents or research contributions What you’ll get in return: A salary of between More ❯

engineering, and publishing in one role. This is a fantastic opportunity to join a growing, tech-forward quant research team. As a Senior Data Scientist, you’ll be joining a collaborative and innovation-focused environment where you’ll help solve complex problems using modern AI and machine learning … techniques. You’ll work on designing intelligent systems that uncover hidden signals in data and influence how assets are allocated. What you’ll be doing: This role is ideal for someone who’s motivated by research, enjoys working with large-scale data systems, and wants to … unstructured or alternative sources) Strong coding ability in Python; familiarity with cloud environments and scalable data platforms Experience with data pipeline tools (e.g. Kafka, SQL, DevOps, microservices) Prior publications, patents or research contributions What you’ll get in return: A salary of between More ❯

Mid-Level Data Scientist Up to 65,000 West London (Hybrid, 3 days onsite per week) Company: This data-first property tech startup empowers businesses to make smarter decisions by turning complex data into clear, actionable insights. Leveraging rich UK property data and advanced data science, they provide deep customer insights, predict behaviour, and enable hyper-targeted marketing. Responsibilities: Collaborate to develop data science solutions and outputs supporting the organisation’s product offerings Recognise opportunities to use data science or ML to solve product … problems Develop data pipelines to support data science experimentation Show an understanding of the organisation and the benefits of data science Develop, deploy and support science models in live production products Confidently talk about the benefits of data science approaches to existing More ❯