1 to 25 of 587 Data Pipeline Jobs in London

advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers differentiation, scalability and security for the business. Reporting to the COO, Technology provides digital tools, software services … our enterprise-wide services to end users and actively manages the firm's infrastructure and data. Within IT, Marex Technology has established a Data team that enables the firm to leverage data assets to increase productivity and improve business decisions, as well as maintain data compliance. The Data Team encompasses Database Administration, Data Engineering, Data Analysis, Data Architecture, Data Intelligence and AI expertise. In recent years, they have developed a Data Lakehouse architecture, that is relied upon by different departments across More ❯

advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers differentiation, scalability and security for the business. Reporting to the COO, Technology provides digital tools, software services … our enterprise-wide services to end users and actively manages the firm's infrastructure and data. Within IT, Marex Technology has established a Data team that enables the firm to leverage data assets to increase productivity and improve business decisions, as well as maintain data compliance. The Data Team encompasses Database Administration, Data Engineering, Data Analysis, Data Architecture, Data Intelligence and AI expertise. In recent years, they have developed a Data Lakehouse architecture, that is relied upon by different departments across More ❯

get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “Application Support Request”. Role : Data Architect Job Type: Permanent (Hybrid) Location: London, United Kingdom Ready to utilize your skills in designing, creating, and managing data architecture? Join … us as a Data Architect. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients … an exciting team where you will be challenged every day. • Build strong relationships with a diverse range of stakeholders. The Role As a Data Architect, you will be responsible for designing, creating, and managing data architecture. You will also ensure that data is efficiently More ❯

economic crime across the NHS. Further information about our work and annual plan for delivering this is available on our website. As a Data Engineer you will have direct oversight and responsibility for the development implementation review and establishment of data and techniques used in the … Advanced Data Analytics Portfolio (DAP). You will collaborate with project managers, data scientists, counter fraud experts, stakeholders, and senior management across the NHSCFA and our wider stakeholders. The primary responsibilities will include developing, evaluating, maintaining, and managing data pipelines, processing, preparing data … structures, and data formats such as JSON, XML and XSD. Machine learning for engineering practices, such as meta driven intelligent ETL and pipeline processes. Strong skills in relevant programming languages, frameworks, and platforms including SQL, Python, Spark, R etc. A strong track record of achievement in data More ❯

Position : Senior Data Engineer Salary: £55,000 - £65,000 Location : Hybrid - Bristol, Manchester, or London Security Requirement : SC Clearance to start and be willing/able to obtain DV Clearance We are seeking Data Engineers, with a keen interest/experience in AI/ML and … in Python Scripting. To join our Consultancy client working on meaningful projects in the Defence and Security sector. Required Experience: End-to-End Data Development : Strong experience with data pipelines, ETL processes, and workflow orchestration, demonstrating best practices across tech stacks. Strong Python Skills Diverse Data … engineering tools, integration frameworks, and query engines to create high-quality, standardised data for AI applications and reporting. Data Pipeline Development : Design and implement robust data pipelines and stores in collaboration with other engineers and developers. Innovative Problem Solving : Bring fresh approaches More ❯

across WPP. It has been created to accelerate the transformation for Nestlé's media function. Core to the solution is the advanced best data and technology capabilities, fueled by WPP's investment in AI, to maximise the impact of Nestlé media investment. ROLE PURPOSE The Performance Analytics Manager … development, implementation, and maintenance of cutting-edge analytics strategies. This role will have a strong focus on data management, data pipeline construction, and ensuring data quality across all analytics initiatives. Experience with data integration platforms is highly desirable. The Performance Analytics … Manager will be responsible for building and maintaining the data infrastructure that enables advanced analytics and drives data-driven decision-making. THE ROLE The Performance Analytics Director will collaborate closely with the Global Performance Lead, regional performance teams, the Ad Tech Director, Performance Solutions team, and More ❯

Job summary The post holder will lead the Trust on a smooth transition of the onsite data warehouse solutions into a more efficient, scalable and secure cloud infrastructure, whilst managing a team of Data Engineers and developers. The Data Engineering Manager plays a pivotal … role in ensuring that data flows smoothly, remains consistent, and is available for decision-making, insights and analytics. The post holder will also be responsible for maintaining the current data warehouse solutions by ensuring operational efficiency, routine maintenance, issue resolution, monitoring and reporting Main duties of … the job Lead and mentor the trust data engineering team and act as an architectural and strategic lead in the development and maintenance of data warehouse and associated solutions and systems. Deliver the trust's future data landscape by designing scalable and reliable data More ❯

ASCS. We are establishing a new centralized Business Intelligence team to build self-service analytical products for ASCS that provide relevant insights and data deep dives across the business. By leveraging advanced analytics and AI/ML, we will transform catalog data into predictive insights, helping … and highlight new opportunities Improve code quality and optimize BI processes Demonstrate proficiency in a scripting language, data modeling, data pipeline design, and applying basic statistical methods (e.g., regression) for difficult business problems A day in the life: Working closely with cross-functional teams including … versa - Relentless curiosity and drive to explore emerging trends and technologies in the field - Knowledge of data modeling and data pipeline design - Experience with statistical analysis, co-relation analysis, as well as exploratory, deterministic, and probabilistic analysis techniques - Experience in designing and implementing custom reporting More ❯

Job Title: Lead Data Engineer (AWS) Business Unit/Segment: Data Management/Analytics Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent - Salary -£80k to £100k Summary of the Role: A leading global data and AI company is looking for a Lead … with emerging data technologies and recommend improvements to data engineering practices. Develop and enforce best practices for data pipeline orchestration, testing, and deployment. Provide mentorship, feedback, and leadership across project and operational initiatives. Collaborate with cross-functional teams to design a consistent and … CD practices and code versioning systems. Key Skills and Attributes: Cloud & Data Engineering: Deep expertise in AWS services and data pipeline development. Data Modelling & Architecture: Strong background in data warehousing and modern modelling frameworks. Leadership: Ability to lead teams, provide feedback More ❯

Job Title: Lead Data Engineer (AWS) Business Unit/Segment: Data Management/Analytics Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent - Salary -£80k to £100k Summary of the Role: A leading global data and AI company is looking for a Lead … with emerging data technologies and recommend improvements to data engineering practices. Develop and enforce best practices for data pipeline orchestration, testing, and deployment. Provide mentorship, feedback, and leadership across project and operational initiatives. Collaborate with cross-functional teams to design a consistent and … CD practices and code versioning systems. Key Skills and Attributes: Cloud & Data Engineering: Deep expertise in AWS services and data pipeline development. Data Modelling & Architecture: Strong background in data warehousing and modern modelling frameworks. Leadership: Ability to lead teams, provide feedback More ❯

the FT1000 Fast growing companies in Europe in 2022 and 2023, Intent HQ is a leader and innovator in Customer AI Analytics and Data Science with a blue chip international enterprise customer base and solid financial backing from our investors. Our mission is to become the world's … monitoring of data pipelines for performance issues, bottlenecks, and data integrity anomalies. Lead troubleshooting and support for data pipeline issues, ensuring quick resolution and minimal disruption. What we're looking for: Bachelor's or Master's degree in Data Science, Computer … data and machine learning models. Strong experience with SQL and programming languages like Python or R for data analysis and pipeline development. Deep understanding of data modelling, data access, and data storage techniques. Familiarity with machine learning frameworks and More ❯

Title: Head of Data Engineering Industry: FinTech Location: London Salary: Up to £140,000 Seeking an experienced Head of Data Engineering to lead data strategy, architecture, and team management in a fast-paced fintech environment. This role involves designing scalable Apache Spark , Databricks , and … Snowflake solutions on Azure , optimizing ETL/ELT pipelines , ensuring data security and compliance, and driving innovation in big data processing. The ideal candidate has 8+ years of data engineering experience , strong leadership skills, and deep expertise in cloud-based data infrastructure. … Stakeholders: Work closely with product, analytics, and engineering teams to deliver data-driven insights and support business growth. ETL & Data Pipeline Management: Design, implement, and optimize ETL/ELT workflows using modern cloud technologies. Performance Optimization: Drive continuous improvement in data infrastructure performance More ❯

who think big, act fearlessly, and create an inclusive environment that drives positive impact to join our team. What you'll do The Data Led Sales team is a central function within the Product Management division. We build software tools to help the sales teams in the business … organizations systems and processes. The team has a variety of skills and experience in technical domains such as Software development, Automation, Data-pipeline-modelling, IT project management, Data visualisation. We also pride ourselves on our close integration with non-technical/non-data … full back-end data architecture on behalf of the Data Led Sales team • Create and maintain optimal data pipeline architectures • Design and implement data quality monitoring and testing frameworks • Work with customers to define and apply data modeling guidelines More ❯

Data Engineer | London Market Broker | London/Hybrid | £50 - 55,000 (doe) Are you passionate about designing and optimizing data infrastructures? Do you have a flair for working with large datasets and cloud technologies? We are seeking a highly skilled Data Engineer to join … our client, who are a boutique London market broker. As a Data Engineer, you will play a vital role in developing scalable data pipelines, ensuring data quality, and enabling efficient data processing to support business intelligence and advanced analytics. You will also … be involved in their Cloud migration project. Some key responsibilities include: Design, develop, and maintain scalable and reliable data pipelines. Build and optimize data architectures, data lakes, and data warehouses. Develop ETL/ELT processes to extract, transform, and load data More ❯

Data Engineer | London Market Broker | London/Hybrid | £50 - 55,000 (doe) Are you passionate about designing and optimizing data infrastructures? Do you have a flair for working with large datasets and cloud technologies? We are seeking a highly skilled Data Engineer to join … our client, who are a boutique London market broker. As a Data Engineer, you will play a vital role in developing scalable data pipelines, ensuring data quality, and enabling efficient data processing to support business intelligence and advanced analytics. You will also … be involved in their Cloud migration project. Some key responsibilities include: Design, develop, and maintain scalable and reliable data pipelines. Build and optimize data architectures, data lakes, and data warehouses. Develop ETL/ELT processes to extract, transform, and load data More ❯

Data Engineer (DV Cleared) 6 Month Contract (Inside IR35) Location: London Rate: £700 - £800 per day Skills: DV Clearance ESSENTIAL - Must already hold DV clearance, Cloud technology experience We are looking to recruit a DV Cleared Data Engineer to join a defence organisation based in Central … office based in Central London. Key Responsibilities: Technical Leadership: Lead and guide the technical direction of data engineering projects. Data Pipeline Development: Design, develop, and maintain robust data pipelines using Azure Data Factory (ADF), Azure Synapse Analytics, and SQL Server. Data … teams to ensure seamless integration and effective communication. Essential Skills and Experience: Proven experience in data engineering roles, including data pipeline development and data integration. Experience working with diverse data sets and data sources. Excellent communication and collaboration skills. More ❯

and we're still growing. JOB PURPOSE The Senior Analytics Engineer leads the development and optimisation of our advanced analytics ecosystem, ensuring that data is not only fit for purpose but also robustly designed for scalability, reusability, and actionable insights. This role bridges technical expertise and strategic vision … making. Key responsibilities include designing scalable data architectures in conjunction with Domain and Product Data Architects, overseeing data pipeline development, and maintaining data integrity. This role involves collaboration with Domain and Business Data Stewards to align data … is demonstrated through rigorous validation and monitoring processes throughout the data pipeline. Strong problem-solving abilities are essential for diagnosing and resolving pipeline issues while optimising performance for scalability. Knowledge of analytics platforms, such as Tableau and ThoughtSpot, ensures compatibility with data visualisation and reporting More ❯

We are seeking a Data Support Engineer (Level 3) to provide expert technical support and drive the performance and reliability of our data infrastructure. In this role, you will serve as the go-to expert for complex data issues, collaborate with data engineers, analysts, and IT teams to optimize data pipelines, and resolve integration and performance challenges. You will play a key role in ensuring data quality and supporting data-driven decision-making while leveraging your expertise in cloud and on-premises technologies. A … integration and processing issues, troubleshoot performance bottlenecks, and ensure high availability of critical data services with minimal downtime. Data Pipeline Management & Optimization : Oversee and optimize data pipelines (ETL/ELT) across on-premise and cloud environments, ensuring seamless data flow More ❯

Position: Data Engineer (Python/Databricks) Location: Remote Salary: up to £80,000 + Bens Are you passionate about health tech and innovation? Do you want to be at the forefront of transforming clinical research with cutting-edge technology? If so, we have an exciting new role for … you! Join our dynamic and forward-thinking team as a Data Engineer and help us build secure, scalable microservices that operationalise clinical research applications. This is your chance to make a meaningful impact on healthcare while working with some of the most advanced technologies in data engineering. About Us We are a pioneering health tech company dedicated to revolutionising clinical research through innovative data solutions. Our cross-functional team, including Frontend Developers, QA Engineers, and DevOps Engineers, collaborates to create high-performance data pipelines and REST APIs that drive AI More ❯

up our clients' potential, thereby fulfilling our own. Take it seriously. Make it fun. Know it matters. As we develop an enterprise-wide data and digital strategy that moves us toward greater focus on the use of data and data-driven insights, we are … seeking a Data & Digital Solutions Architect. The Data & Digital Solutions Architect is a hands-on, execution focused role helping translate the data and digital strategy to architecture and to execution. In this role you will have an understanding of our data and … monitoring Container and Container Orchestration UX and UI Azure cloud platform environment Data access control and security Integration and Data Pipeline/ETL/ELT technologies DevOps and CI/CD AXA XL is committed to equal employment opportunity and will consider applicants regardless of More ❯

growing, values-driven team of specialists who work with government clients across Cyber, Telecommunications and Data. We are seeking a talented and motivated Data Engineer to join our team and contribute to our mission of protecting the UK through data-driven insights and solutions. As a … Data Engineer, you will work closely with our public sector clients and project teams to develop and implement data engineering pipelines to support data science and business/mission intelligence use cases. Key Responsibilities Assessing your clients' technical needs and understanding how their needs … are different to wants and managing clients' stakeholders relationship appropriately Identifying data sources, data extraction, transformation, and loading (ETL/ELT) concepts and methods Designing, evaluating, and implementing on-premise, cloud-based and hybrid data engineering solutions (including providing review and guidance on testing More ❯

with cutting-edge technology? If so, we have an exciting new role for you! Join our dynamic and forward-thinking team as a Data Engineer and help us build secure, scalable microservices that operationalise clinical research applications. This is your chance to make a meaningful impact on healthcare … while working with some of the most advanced technologies in data engineering. About Us We are a pioneering health tech company dedicated to revolutionising clinical research through innovative data solutions. Our cross-functional team, including Frontend Developers, QA Engineers, and DevOps Engineers, collaborates to create high … performance data pipelines and REST APIs that drive AI applications and external data integrations. Your Role As a Data Engineer, you will: Build and Optimise Data Pipelines: Implement high-performance data pipelines for AI applications using Databricks.Develop REST APIs: Create More ❯

Whatever your priorities - work/life balance, career progression, sustainability, volunteering - you'll find like-minded people driving change at Howden. Job Title: Data Architect Location: London/Hybrid Job Type: Full-time Job Summary Are you passionate about designing scalable, high-performance data architectures on … Azure and Databricks ? Do you thrive on solving complex data challenges, integrating modern data platforms, and defining best practices for enterprise data management? We are looking for a Data Architect to lead the design and implementation of cutting-edge data solutions in a cloud-native environment. You will play a key role in shaping data strategy, designing high-level and low-level architectures , and ensuring the seamless integration of data management tools. If you enjoy working with big data technologies, governance frameworks More ❯

Data Engineer Remote - UK based As a Data Engineer, you will lay the groundwork for extracting value from data by developing and maintaining powerful and efficient data infrastructure. In addition, you will help Zeelo's Data Team become the center … of excellence on data and responsible for educating other teams, establishing best practices, and facilitating knowledge sharing on data-related matters across the company. Zeelo and its clients have many data analytics needs all supported by Zeelo's data team. You will … support data analysts by engineering ETL pipelines to deliver useful, clean, clear, and timely data ready for analytics use. Zeelo's data maturity is growing, and you will help incorporate streaming and AI tools into the business effectively. You will also maintain Zeelo's More ❯

London, United Kingdom Posted on 16/04/2025 We are looking for a Data Architect to design, develop, and manage data solutions that align with business needs and industry standards. The ideal candidate will have expertise in Java, SQL, Python, and Spark (PySpark & SparkSQL … a plus. The role requires strong communication skills to collaborate effectively with both technical and non-technical stakeholders. You will be responsible for data governance, data modelling, metadata management, and ensuring compliance with data standards. Key Responsibilities: 1. Data Architecture & Engineering Design … and implement scalable data architectures that align with business objectives. Work with Java, SQL, Python, PySpark, and SparkSQL to build robust data pipelines. Develop and maintain data models tailored to organizational needs. Reverse-engineer data models from existing live systems. Utilize Microsoft More ❯