1 to 25 of 460 Data Pipeline Jobs in London

advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers differentiation, scalability and security for the business. Reporting to the COO, Technology provides digital tools, software services … our enterprise-wide services to end users and actively manages the firm's infrastructure and data. Within IT, Marex Technology has established a Data team that enables the firm to leverage data assets to increase productivity and improve business decisions, as well as maintain data compliance. The Data Team encompasses Database Administration, Data Engineering, Data Analysis, Data Architecture, Data Intelligence and AI expertise. In recent years, they have developed a Data Lakehouse architecture, that is relied upon by different departments across More ❯

advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers differentiation, scalability and security for the business. Reporting to the COO, Technology provides digital tools, software services … our enterprise-wide services to end users and actively manages the firm's infrastructure and data. Within IT, Marex Technology has established a Data team that enables the firm to leverage data assets to increase productivity and improve business decisions, as well as maintain data compliance. The Data Team encompasses Database Administration, Data Engineering, Data Analysis, Data Architecture, Data Intelligence and AI expertise. In recent years, they have developed a Data Lakehouse architecture, that is relied upon by different departments across More ❯

get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “Application Support Request”. Role : Data Architect Job Type: Permanent (Hybrid) Location: London, United Kingdom Ready to utilize your skills in designing, creating, and managing data architecture? Join … us as a Data Architect. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients … an exciting team where you will be challenged every day. • Build strong relationships with a diverse range of stakeholders. The Role As a Data Architect, you will be responsible for designing, creating, and managing data architecture. You will also ensure that data is efficiently More ❯

economic crime across the NHS. Further information about our work and annual plan for delivering this is available on our website. As a Data Engineer you will have direct oversight and responsibility for the development implementation review and establishment of data and techniques used in the … Advanced Data Analytics Portfolio (DAP). You will collaborate with project managers, data scientists, counter fraud experts, stakeholders, and senior management across the NHSCFA and our wider stakeholders. The primary responsibilities will include developing, evaluating, maintaining, and managing data pipelines, processing, preparing data … structures, and data formats such as JSON, XML and XSD. Machine learning for engineering practices, such as meta driven intelligent ETL and pipeline processes. Strong skills in relevant programming languages, frameworks, and platforms including SQL, Python, Spark, R etc. A strong track record of achievement in data More ❯

Position : Senior Data Engineer Salary: £55,000 - £65,000 Location : Hybrid - Bristol, Manchester, or London Security Requirement : SC Clearance to start and be willing/able to obtain DV Clearance We are seeking Data Engineers, with a keen interest/experience in AI/ML and … in Python Scripting. To join our Consultancy client working on meaningful projects in the Defence and Security sector. Required Experience: End-to-End Data Development : Strong experience with data pipelines, ETL processes, and workflow orchestration, demonstrating best practices across tech stacks. Strong Python Skills Diverse Data … engineering tools, integration frameworks, and query engines to create high-quality, standardised data for AI applications and reporting. Data Pipeline Development : Design and implement robust data pipelines and stores in collaboration with other engineers and developers. Innovative Problem Solving : Bring fresh approaches More ❯

Amazon Music is awash in data! To help make sense of it all, the DISCO (Data, Insights, Science & Optimization) team: (i) enables the Consumer Product Tech org make data driven decisions that improve the customer retention, engagement and experience on Amazon Music. We build … and maintain automated self-service data solutions, data science models and deep dive difficult questions that provide actionable insights. We also enable measurement, personalization and experimentation by operating key data programs ranging from attribution pipelines, northstar weblabs metrics to causal frameworks. (ii) delivering exceptional … Analytics & Science infrastructure for DISCO teams, fostering a data-driven approach to insights and decision making. As platform builders, we are committed to constructing flexible, reliable, and scalable solutions to empower our customers. (iii) accelerates and facilitates content analytics and provides independence to generate valuable insights in a More ❯

across WPP. It has been created to accelerate the transformation for Nestlé's media function. Core to the solution is the advanced best data and technology capabilities, fueled by WPP's investment in AI, to maximise the impact of Nestlé media investment. ROLE PURPOSE The Performance Analytics Manager … development, implementation, and maintenance of cutting-edge analytics strategies. This role will have a strong focus on data management, data pipeline construction, and ensuring data quality across all analytics initiatives. Experience with data integration platforms is highly desirable. The Performance Analytics … Manager will be responsible for building and maintaining the data infrastructure that enables advanced analytics and drives data-driven decision-making. THE ROLE The Performance Analytics Director will collaborate closely with the Global Performance Lead, regional performance teams, the Ad Tech Director, Performance Solutions team, and More ❯

Select how often (in days) to receive an alert: Head of Data Strategy Location: UK - Hatfield, UK - London, UK - Manchester, UK - Milton Keynes, UK - Nottingham Job-ID: 213406 Contract type: Standard Business Unit: Information Technology Life on the team You will oversee the development and implementation of a … comprehensive data strategy, encompassing data governance, data management, data quality, and data analytics to ensure high-quality data outcomes, insights leading to action, maximizing data value, and treating data as an asset. What you … ll do As Head of Data Strategy, you will be responsible for defining and implementing our Data Strategy, including data governance, management, quality, master data management, and reporting/analytics/outcomes-aligned with our Technology Strategy. You will: Own, define, and More ❯

Job summary The post holder will lead the Trust on a smooth transition of the onsite data warehouse solutions into a more efficient, scalable and secure cloud infrastructure, whilst managing a team of Data Engineers and developers. The Data Engineering Manager plays a pivotal … role in ensuring that data flows smoothly, remains consistent, and is available for decision-making, insights and analytics. The post holder will also be responsible for maintaining the current data warehouse solutions by ensuring operational efficiency, routine maintenance, issue resolution, monitoring and reporting Main duties of … the job Lead and mentor the trust data engineering team and act as an architectural and strategic lead in the development and maintenance of data warehouse and associated solutions and systems. Deliver the trust's future data landscape by designing scalable and reliable data More ❯

people. It's big-scale stuff, and we're still growing. Job Purpose The Analytics Engineer plays a crucial role in data-driven teams, focusing on ensuring that data is fit for purpose, curated for consumption, and discoverable within and beyond their immediate domain. They operate … within domain-specific product teams, leveraging their analytical expertise and knowledge of data tools available to inform product development. They perform the heavy lifting of data preparation, allowing Data Scientists and Business Intelligence Analysts to act on data focusing on their core … databases, and third-party systems. Ensuring data quality through monitoring and validation throughout pipelines. Strong troubleshooting skills for resolving data pipeline issues and performance optimisation. Familiarity with Tableau and ThoughtSpot for analytics and data compatibility. What You'll Get in Return Competitive base More ❯

Technical Data Specialist Contract onsite in London Day rate: £650 - £858 per day inside IR35 We're currently seeking an accomplished and highly ambitious Technical Data Specialist to work with our exceptional client, a world class brand in a secure environment to drive major business transformation … process and technical change across this complex organisation. This contract roles will require you to conduct security clearance prior to assignment. The Technical Data Specialist role is conducted in an environment that is far from ordinary, therefore, we're not looking for ordinary. The Technical Data Specialists set the vision for the organisation's use of data (through data design) to ensure that data is managed properly and meets the organisation's needs. You will work with key internal and external partners to deliver data architecture More ❯

Title: Head of Data Engineering Industry: FinTech Location: London Salary: Up to £140,000 Seeking an experienced Head of Data Engineering to lead data strategy, architecture, and team management in a fast-paced fintech environment. This role involves designing scalable Apache Spark , Databricks , and … Snowflake solutions on Azure , optimizing ETL/ELT pipelines , ensuring data security and compliance, and driving innovation in big data processing. The ideal candidate has 8+ years of data engineering experience , strong leadership skills, and deep expertise in cloud-based data infrastructure. … Stakeholders: Work closely with product, analytics, and engineering teams to deliver data-driven insights and support business growth. ETL & Data Pipeline Management: Design, implement, and optimize ETL/ELT workflows using modern cloud technologies. Performance Optimization: Drive continuous improvement in data infrastructure performance More ❯

who think big, act fearlessly, and create an inclusive environment that drives positive impact to join our team. What you'll do The Data Led Sales team is a central function within the Product Management division. We build software tools to help the sales teams in the business … organizations systems and processes. The team has a variety of skills and experience in technical domains such as Software development, Automation, Data-pipeline-modelling, IT project management, Data visualisation. We also pride ourselves on our close integration with non-technical/non-data … full back-end data architecture on behalf of the Data Led Sales team • Create and maintain optimal data pipeline architectures • Design and implement data quality monitoring and testing frameworks • Work with customers to define and apply data modeling guidelines More ❯

Data Engineer (DV Cleared) 6 Month Contract (Inside IR35) Location: London Rate: £700 - £800 per day Skills: DV Clearance ESSENTIAL - Must already hold DV clearance, Cloud technology experience We are looking to recruit a DV Cleared Data Engineer to join a defence organisation based in Central … office based in Central London. Key Responsibilities: Technical Leadership: Lead and guide the technical direction of data engineering projects. Data Pipeline Development: Design, develop, and maintain robust data pipelines using Azure Data Factory (ADF), Azure Synapse Analytics, and SQL Server. Data … teams to ensure seamless integration and effective communication. Essential Skills and Experience: Proven experience in data engineering roles, including data pipeline development and data integration. Experience working with diverse data sets and data sources. Excellent communication and collaboration skills. More ❯

and we're still growing. JOB PURPOSE The Senior Analytics Engineer leads the development and optimisation of our advanced analytics ecosystem, ensuring that data is not only fit for purpose but also robustly designed for scalability, reusability, and actionable insights. This role bridges technical expertise and strategic vision … making. Key responsibilities include designing scalable data architectures in conjunction with Domain and Product Data Architects, overseeing data pipeline development, and maintaining data integrity. This role involves collaboration with Domain and Business Data Stewards to align data … is demonstrated through rigorous validation and monitoring processes throughout the data pipeline. Strong problem-solving abilities are essential for diagnosing and resolving pipeline issues while optimising performance for scalability. Knowledge of analytics platforms, such as Tableau and ThoughtSpot, ensures compatibility with data visualisation and reporting More ❯

We are seeking a Data Support Engineer (Level 3) to provide expert technical support and drive the performance and reliability of our data infrastructure. In this role, you will serve as the go-to expert for complex data issues, collaborate with data engineers, analysts, and IT teams to optimize data pipelines, and resolve integration and performance challenges. You will play a key role in ensuring data quality and supporting data-driven decision-making while leveraging your expertise in cloud and on-premises technologies. A … integration and processing issues, troubleshoot performance bottlenecks, and ensure high availability of critical data services with minimal downtime. Data Pipeline Management & Optimization : Oversee and optimize data pipelines (ETL/ELT) across on-premise and cloud environments, ensuring seamless data flow More ❯

Position: Data Engineer (Python/Databricks) Location: Remote Salary: up to £80,000 + Bens Are you passionate about health tech and innovation? Do you want to be at the forefront of transforming clinical research with cutting-edge technology? If so, we have an exciting new role for … you! Join our dynamic and forward-thinking team as a Data Engineer and help us build secure, scalable microservices that operationalise clinical research applications. This is your chance to make a meaningful impact on healthcare while working with some of the most advanced technologies in data engineering. About Us We are a pioneering health tech company dedicated to revolutionising clinical research through innovative data solutions. Our cross-functional team, including Frontend Developers, QA Engineers, and DevOps Engineers, collaborates to create high-performance data pipelines and REST APIs that drive AI More ❯

in August 2023, followed by the launch of its direct-to-customer retail banking proposition in December 2024. We are seeking a skilled Data Engineer with a strong focus on modern data warehousing , data product development , and data democratization . You will … play a key role in designing, building, and optimizing scalable data pipelines and clean data layers that empower teams across the organization to make informed, data-driven decisions. This is a hands-on role that blends engineering excellence with product thinking, metadata management, and … a passion for enabling self-service analytics and data literacy across the business. Key Responsibilities: Build & Maintain Scalable Data Warehousing Solutions: Design, build, and maintain robust ELT pipelines and transformation workflows Model and maintain curated data layers to support reporting, analytics, and decision-making More ❯

up our clients' potential, thereby fulfilling our own. Take it seriously. Make it fun. Know it matters. As we develop an enterprise-wide data and digital strategy that moves us toward greater focus on the use of data and data-driven insights, we are … seeking a Data & Digital Solutions Architect. The Data & Digital Solutions Architect is a hands-on, execution focused role helping translate the data and digital strategy to architecture and to execution. In this role you will have an understanding of our data and … monitoring Container and Container Orchestration UX and UI Azure cloud platform environment Data access control and security Integration and Data Pipeline/ETL/ELT technologies DevOps and CI/CD AXA XL is committed to equal employment opportunity and will consider applicants regardless of More ❯

growing, values-driven team of specialists who work with government clients across Cyber, Telecommunications and Data. We are seeking a talented and motivated Data Engineer to join our team and contribute to our mission of protecting the UK through data-driven insights and solutions. As a … Data Engineer, you will work closely with our public sector clients and project teams to develop and implement data engineering pipelines to support data science and business/mission intelligence use cases. Key Responsibilities Assessing your clients' technical needs and understanding how their needs … are different to wants and managing clients' stakeholders relationship appropriately Identifying data sources, data extraction, transformation, and loading (ETL/ELT) concepts and methods Designing, evaluating, and implementing on-premise, cloud-based and hybrid data engineering solutions (including providing review and guidance on testing More ❯

with cutting-edge technology? If so, we have an exciting new role for you! Join our dynamic and forward-thinking team as a Data Engineer and help us build secure, scalable microservices that operationalise clinical research applications. This is your chance to make a meaningful impact on healthcare … while working with some of the most advanced technologies in data engineering. About Us We are a pioneering health tech company dedicated to revolutionising clinical research through innovative data solutions. Our cross-functional team, including Frontend Developers, QA Engineers, and DevOps Engineers, collaborates to create high … performance data pipelines and REST APIs that drive AI applications and external data integrations. Your Role As a Data Engineer, you will: Build and Optimise Data Pipelines: Implement high-performance data pipelines for AI applications using Databricks.Develop REST APIs: Create More ❯

Whatever your priorities - work/life balance, career progression, sustainability, volunteering - you'll find like-minded people driving change at Howden. Job Title: Data Architect Location: London/Hybrid Job Type: Full-time Job Summary Are you passionate about designing scalable, high-performance data architectures on … Azure and Databricks ? Do you thrive on solving complex data challenges, integrating modern data platforms, and defining best practices for enterprise data management? We are looking for a Data Architect to lead the design and implementation of cutting-edge data solutions in a cloud-native environment. You will play a key role in shaping data strategy, designing high-level and low-level architectures , and ensuring the seamless integration of data management tools. If you enjoy working with big data technologies, governance frameworks More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in … and quality standards. DataOps and Optimisation : Implement DataOps practices to streamline data engineering workflows and improve operational efficiency. Automate data pipeline deployment and monitoring using CI/CD tools. Technical Leadership: Provide technical leadership and guidance on data engineering best practices. Stay informed … data management, security, and compliance. Promote data quality and integrity across all data products. Monitor data pipeline performance and optimise for scalability, reliability, and speed. Stakeholder Engagement: Collaborate with PN D&A leadership, PN product owners, and segment D&A leadership More ❯

That to be considered you must be in possession of active NPPV3 clearance. THE ROLE To design, implement, and develop robust and scalable data infrastructure that supports advanced analytics and intelligence operations within the police department, enabling data-driven decision-making for crime prevention, investigations, and … safety. This post will work within a 130-strong team of intelligence professionals. Enabling seamless integration and analysis of complex criminological and intelligence data, empowering analysts and investigators to identify crime patterns, predict future incidents, and enhance investigative outcomes. Ensuring the integrity, security, and ethical use of sensitive … criminal justice information, adhering to stringent compliance standards and fostering public trust. Drive innovation in data management and analytics, leveraging cutting-edge technologies to enhance the department's ability to respond to evolving crime trends and emerging threats. Empower the department with the tools to transform data More ❯

Data Engineer Remote - UK based As a Data Engineer, you will lay the groundwork for extracting value from data by developing and maintaining powerful and efficient data infrastructure. In addition, you will help Zeelo's Data Team become the center … of excellence on data and responsible for educating other teams, establishing best practices, and facilitating knowledge sharing on data-related matters across the company. Zeelo and its clients have many data analytics needs all supported by Zeelo's data team. You will … support data analysts by engineering ETL pipelines to deliver useful, clean, clear, and timely data ready for analytics use. Zeelo's data maturity is growing, and you will help incorporate streaming and AI tools into the business effectively. You will also maintain Zeelo's More ❯