76 to 100 of 684 Data Pipeline Jobs in London

create groundbreaking products and solutions. Our AI Team is committed to exploring AI and machine learning's full potential. Job Summary: As a Data Engineer on AI Team, you will craft the foundation of our AI models and algorithms. You will build and maintain reliable data pipelines, ensuring data availability, integrity, and quality for our AI projects. Your work will directly influence our AI initiatives, contributing to innovative solutions for complex problems. Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks and Azure services. Perform feature set engineering … report preparations, and ML tasks. Work with data scientists, ML engineers, and collaborators to deliver high-quality data solutions. Collaborate with the Data & Analytics Team on data infrastructure and ingestion. Discuss data inputs with Business Development and collaborators, advising on More ❯

automation. This team will be required to build high quality data models and products that monitor and reports on data pipeline health and data quality. Work closely with all members of the Data Reliability Engineering team to set project deliverables, review … junior members of the team. Collaborate with engineering teams to improve, maintain, performance tune, and respond to incidents on our big data pipeline infrastructure. Build out observability and intelligent monitoring of data pipelines and infrastructure to achieve early and automated anomaly detection and alerting. Present … ownership and drive A passionate bias to action and passion for delivering high-quality data solutions Deep understanding of end-to-end pipeline design and implementation. Attention to detail and quality with excellent problem solving and interpersonal skills Bachelor's degree in Computer Science, Information Systems, Software More ❯

Senior Data Engineer Job Type : Permanent Location: London – Hybrid/flexible Salary: £55,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge … client base. They are providing the utmost level of quality and security in everything they do. The Role We are seeking a Senior Data Engineer to join our Azure-native data team in a leading UK financial services firm. This role is key to maintaining and … evolving our data platform, supporting both ongoing enhancements and greenfield development. You will work on data integration, ETL pipelines, analytics, and AI-driven insights, ensuring robust data solutions that support business growth. You will be responsible for designing, building, and optimising Azure Data More ❯

Senior Data Engineer Job Type : Permanent Location: London – Hybrid/flexible Salary: £55,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge … client base. They are providing the utmost level of quality and security in everything they do. The Role We are seeking a Senior Data Engineer to join our Azure-native data team in a leading UK financial services firm. This role is key to maintaining and … evolving our data platform, supporting both ongoing enhancements and greenfield development. You will work on data integration, ETL pipelines, analytics, and AI-driven insights, ensuring robust data solutions that support business growth. You will be responsible for designing, building, and optimising Azure Data More ❯

We are looking for a Data Engineer to join our growing data engineering team at Our Future Health. The Data Engineer will bring an in-depth knowledge of NHS data and data solutions to help solve some of the key … challenges around a programme of work at industrial scale with global significance. Our data engineers work with our participant data (including various health records from the NHS, genetic data, Our Future Health's own questionnaires) and build pipelines and systems to process it, control … quality and create data releases for researchers. You'll take a lead on developing specific pipelines related to questionnaire and physical measurements data. Our Future Health will be the UK's largest ever health research programme, bringing people together to develop new ways to detect, prevent, and treat More ❯

Data Engineer Are you ready to make an impact in one of the UK's most dynamic and transformative public sector organisations? We are recruiting for the role of Data Engineer within the in-house digital product and services department of a groundbreaking public sector entity … that is redefining the way data is leveraged to drive decision-making and innovation. The Role: Data Engineer The Data Engineer will be responsible for designing, building, and maintaining the organisation’s data infrastructure. This role will focus on developing and optimising … data pipelines, virtualised environments, and business intelligence solutions.The successful candidate will have expertise in Denodo, SQL, Qlik, Power BI, and Master Data Management (MDM), ensuring high-quality data is available to support strategic decision-making. Responsibilities Strategic: Lead the development of a modern data More ❯

Data Engineer Are you ready to make an impact in one of the UK's most dynamic and transformative public sector organisations? We are recruiting for the role of Data Engineer within the in-house digital product and services department of a groundbreaking public sector entity … that is redefining the way data is leveraged to drive decision-making and innovation. The Role: Data Engineer The Data Engineer will be responsible for designing, building, and maintaining the organisation’s data infrastructure. This role will focus on developing and optimising … data pipelines, virtualised environments, and business intelligence solutions.The successful candidate will have expertise in Denodo, SQL, Qlik, Power BI, and Master Data Management (MDM), ensuring high-quality data is available to support strategic decision-making. Responsibilities Strategic: Lead the development of a modern data More ❯

You will need to login before you can apply for a job. Data Engineering Lead - Finance and Master View more categories View less categories Sector Manufacturing Role Manager Contract Type Permanent Hours Full Time Job Description: Are you passionate about Data and Analytics (D&A) and … of data products meeting quality standards. DataOps and Optimization Implement DataOps practices to improve workflows and operational efficiency. Automate data pipeline deployment and monitoring with CI/CD tools. Technical Leadership Provide guidance on data engineering best practices. Stay updated on industry trends … Ensure compliance with data governance policies and standards. Promote data quality, security, and integrity. Monitor and optimize data pipeline performance for scalability and reliability. Stakeholder Engagement Collaborate with PN D&A leadership and product owners to prioritize data initiatives that maximize More ❯

are Ataccama , and we are on a mission to power a better future with data. Our product enables both technical and less technical 'data people' across their organizations to create high-quality, governed, safe, and reusable data products. It's what made us a Leader in … the Gartner Magic Quadrant for Data Quality Solutions, and what inspired Bain Capital Tech Opportunities to invest in our future growth. Our vision is to be the leading AI-powered cloud data management company and to do that, we're making Ataccama a great place to … to a hybrid working setup. As a Lead Product Manager , you will play a crucial role in shaping the future of Ataccama's data observability offering. You will be responsible for defining the product vision, strategy, and roadmap for this critical area, working closely with engineering, design, and More ❯

Key Responsibilities My client are expanding their data and technology capabilities and seeking a skilled Data Engineer to join this growing team. The successful candidate will help ingest, cleanse, and model data into unified, analytics-ready datasets supporting Business Intelligence, machine learning, and Data Science initiatives. Core Duties Design and develop cohesive data repositories to support data-driven decision-making. Ingest data from a variety of sources, including on-premise SQL databases, REST APIs, and Apache Kafka streams. Apply data cleansing rules to ensure … data meets quality and consistency standards. Model data appropriately for usage scenarios, including designing single-source-of-truth Kimball-style datasets (dimensions and facts). Follow DevOps best practices for software development: write clean, testable code with proper linting, unit/integration testing, CI/CD More ❯

Key Responsibilities My client are expanding their data and technology capabilities and seeking a skilled Data Engineer to join this growing team. The successful candidate will help ingest, cleanse, and model data into unified, analytics-ready datasets supporting Business Intelligence, machine learning, and Data Science initiatives. Core Duties Design and develop cohesive data repositories to support data-driven decision-making. Ingest data from a variety of sources, including on-premise SQL databases, REST APIs, and Apache Kafka streams. Apply data cleansing rules to ensure … data meets quality and consistency standards. Model data appropriately for usage scenarios, including designing single-source-of-truth Kimball-style datasets (dimensions and facts). Follow DevOps best practices for software development: write clean, testable code with proper linting, unit/integration testing, CI/CD More ❯

Job Description - Senior Data Integration Engineer (006077) Description Our purpose is to make great financial decision making a breeze for everyone, and that purpose drives us every day. It's why we're on a mission to create an automated quoting engine, with the simplest of experiences, wrapped … money and that's why good things happen when you meerkat. We'd love you to be part of our journey. The Senior Data Integration Engineer bridges the gap between data processors, consumers, and Data Platform teams. This role ensures Data Products … like Knowledge Graphs, LLM applications, Self-Service tools, Data Lineage, and Quality tooling integrate seamlessly, and access relevant information curated in the most suitable and cost-effective manner. Collaborating with data, technology, and business stakeholders, the role provides expert guidance on improving data quality More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in … technology, operations, FinTech and market data, with expertise around strategic cost and human resourcing benchmarking in wholesale finance. Founded in 2001 as an independent research boutique, Expand is a wholly owned subsidiary of the Boston Consulting Group, headquartered in London and with offices in Singapore and New York. … working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not More ❯

Data Engineer Manager Department: Tech Hub Employment Type: Permanent Location: London Reporting To: Lead Data Engineer Description Contract type: Permanent Hours: Full time, 37.5 hours per week Salary: circa £80,000 depending on experience Location: Canary Wharf WFH policy: Employees are required to attend the office … days/week Flexible working: Variety of flexible work patterns subject to line manager discretion e.g. Compressed 9-day fortnight. Role Summary: The Data Engineer Manager is responsible for driving the design, development, and optimization of data solutions in LCCC's data infrastructure. In … addition to fostering the growth of a skilled team, you will play a pivotal role in delivering LCCC's data applications, infrastructure, and services, ensuring they align with organizational goals and industry best practices. As part of the Technology Hub within LCCC, the Data Engineer Manager More ❯

in a matrix organization, and have the ability to break complex problems down into steps that drive programs. Key job responsibilities - Perform deep data analysis, document findings and insights, and communicate to business stakeholders. - Empower technical and non-technical internal customers to self-serve data pull … and data analysis needs. - Be the expert on the data used and generated by the team's products. Act as Subject Matter Expert when it comes to data questions. - Derive insights from data; Synthesize data into succinct narrative and bridges … Tableau, Power BI or other BI packages - Fluency in SQL and ETL PREFERRED QUALIFICATIONS - Knowledge of data modeling and data pipeline design - Masters degree in Business, Engineering, Statistics, Computer Science, Data Science, Mathematics or related field - Experience with at least one statistical programming More ❯

Grayce is looking for ambitious and analytical graduates to join its dynamic team as Graduate Data Analysts in London. This is an exciting opportunity for individuals with a STEM degree (minimum 2:1) and a passion for data analysis to launch their careers in a fast … growing, innovative environment. As a Graduate Data Analyst, you will work with leading organisations across industries, gaining hands-on experience in data-driven decision-making, business intelligence, and technology solutions. You will receive specialist training, mentorship, and development opportunities through Grayce's Accelerated Development Programme, helping … you build a strong foundation for a successful career in data analytics. If you are eager to apply your analytical skills and contribute to transformational projects, this role offers a fantastic opportunity to develop technical expertise, problem-solving abilities, and industry experience. About Grayce For over a decade More ❯

My client is based in the London area are currently looking to recruit for an experienced Data Architect to join their team. They are one of the leaders within the consulting space and are currently going through a period of growth and are looking for an experienced Data … looking to utilise the newest technologies on the market. Your role will include: Responsible for designing and developing conceptual/logical/physical data models for Enterprise scale data lake and data warehouse solutions. Create functional & technical documentation - e.g. data integration architecture … documentation, data models, data dictionaries, data integration specifications, data testing plans, etc. Guide, influence and challenge the technology teams and stakeholders to understand the benefits, pros and cons of solution options. Agree and set the technical direction for the data More ❯

Are you interested in rapidly growing business? The Amazon ARTS team is responsible for creating core analytics tech capabilities and data engineering services for ROW (the rest of the world excl. NA and EU) countries. It comprises platforms development, research science, software development, and data engineering. … ARTS develops scalable analytics applications and research modeling to optimize operation processes. The team standardizes and optimizes data sources and visualization efforts across geographies, builds up and maintains the online BI services and data mart. At ARTS, Data engineers, data scientists, business … intelligence engineers, and product managers use rigorous quantitative approaches to ensure that we target to provide high-quality data tech products to our customers around the world, including India, Japan, Australia, Brazil, Mexico, Singapore, Turkey, and MENA. As a Data Engineer, you will be working in More ❯

/Remote from within the UK or Greece Preferred start date: ASAP LIFE AT SATALIA As an organisation, we push the boundaries of data science, optimisation and artificial intelligence to solve the hardest problems in industry. Satalia is a community of individuals devoted to working on diverse and … cutting-edge AI products and services that make a tangible impact for FTSE 100 clients. We are hiring across all experience levels in data science, from entry-level to seasoned professionals, and offer competitive salaries commensurate with experience and skills. It is a great time to be joining … as the industry transforms itself in what we believe is a generational moment for technology and AI. YOUR RESPONSIBILITIES Collaborate closely with data scientists, architects, and other stakeholders to understand and implement business requirements. Provide data engineering support for AI model development and deployment, ensuring data More ❯

us to serve customers on the same day they order or even faster. The ideal candidate should leverage AWS resources to build innovative data driven models in collaboration with stakeholders across the Amazon's transportation network. The ideal candidate relishes partnering with stakeholders and customers to identify strategic … data resources A day in the life In your role a day could start by working on a new data pipeline on AWS to automate a new process. During the day someone may ask you to perform an urgent deep dive to solve a critical …/BI space PREFERRED QUALIFICATIONS - Master's degree, or Advanced technical degree - Knowledge of data modeling and data pipeline design - Experience with statistical analysis, co-relation analysis Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central More ❯

A leading consultancy firm dedicated to delivering transformative data solutions. They empower their clients to harness the power of data through innovative engineering practices, enabling them to make data-driven decisions and achieve their strategic objectives. They are seeking a Senior Manager for Modern … Data Engineering to lead and expand their data engineering practice. This role is designed for an experienced leader who is both technically proficient in data engineering and skilled in managing high-performing teams. The ideal candidate will be responsible for driving the development of … modern data pipelines, ensuring data accessibility, quality, and security while fostering a collaborative culture within the team. Responsibilities Lead and manage the Modern Data Engineering team, providing strategic direction and mentorship. Design and implement scalable, robust data pipelines and architectures that meet More ❯

A leading consultancy firm dedicated to delivering transformative data solutions. They empower their clients to harness the power of data through innovative engineering practices, enabling them to make data-driven decisions and achieve their strategic objectives. They are seeking a Senior Manager for Modern … Data Engineering to lead and expand their data engineering practice. This role is designed for an experienced leader who is both technically proficient in data engineering and skilled in managing high-performing teams. The ideal candidate will be responsible for driving the development of … modern data pipelines, ensuring data accessibility, quality, and security while fostering a collaborative culture within the team. Responsibilities Lead and manage the Modern Data Engineering team, providing strategic direction and mentorship. Design and implement scalable, robust data pipelines and architectures that meet More ❯

We are a leading multi-strategy systematic hedge fund based in London, leveraging advanced technology and data to drive our trading strategies. Our team includes top quantitative researchers, data scientists, and engineers, all collaborating to develop innovative solutions. We are seeking an AI Data Engineer to join our team, focusing on building and automating data systems that support AI-driven initiatives. Role Overview: As an AI Data Engineer, you will be responsible for designing, building, and optimizing data infrastructure to support AI and machine learning initiatives … within our trading strategies. You will develop and maintain data pipelines, ensure seamless data integration for AI models, and automate processes to improve efficiency. Your role will be pivotal in enabling the successful deployment and operation of AI-driven trading models. Key Responsibilities: Design, develop, and More ❯

We are a leading multi-strategy systematic hedge fund based in London, leveraging advanced technology and data to drive our trading strategies. Our team includes top quantitative researchers, data scientists, and engineers, all collaborating to develop innovative solutions. We are seeking an AI Data Engineer to join our team, focusing on building and automating data systems that support AI-driven initiatives. Role Overview: As an AI Data Engineer, you will be responsible for designing, building, and optimizing data infrastructure to support AI and machine learning initiatives … within our trading strategies. You will develop and maintain data pipelines, ensure seamless data integration for AI models, and automate processes to improve efficiency. Your role will be pivotal in enabling the successful deployment and operation of AI-driven trading models. Key Responsibilities: Design, develop, and More ❯

defining the problem and building analytical frameworks to help the operations to streamline the process, identifying gaps in the existing process by analyzing data and liaising with relevant team(s) to plug it and analyzing data and metrics and sharing update with the internal teams. Key … and define expected output Create analytical approach to solve the problem inline with stakeholder expectation Be the domain expert and have knowledge of data availability from various sources. Execute solution with scalable development practices in scripting, data extraction and data visualization Triangulate data … or related analytical field experience PREFERRED QUALIFICATIONS - Master's degree, or Advanced technical degree - Knowledge of data modeling and data pipeline design - Experience with statistical analysis, co-relation analysis Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have More ❯