376 to 400 of 684 Data Pipeline Jobs in London

directed, action-oriented, and comfortable making high-impact decisions quickly. Your focus will include consulting on new product developments, refining complex real-time data pipelines handling millions of data points, and driving operational excellence across our SaaS platform. Key Responsibilities: Production Ownership: Manage and optimise our … integrating these into the existing production infrastructure with minimal disruption. Performance Optimisation: Continuously monitor, benchmark, and enhance system performance and reliability. Data Pipeline Management: Oversee and improve our extensive real-time data ingestion pipelines, ensuring they are resilient, scalable, and future proof. Process Innovation: Identify … startup or scale-up businesses is highly desirable. Deep technical expertise in: Databases such as MySQL, Singlestore, and BigQuery. Real-time, high-throughput data pipelines. Cloud platforms, particularly Google Cloud. Strong understanding of software engineering best practices, feature deployment processes and testing. Ability to drive rapid decision-making More ❯

IDEXX is looking for a Senior Data Engineer to join the Veterinary Software team in London! This is an exciting opportunity for a a data engineer looking to expand their technical leadership skills and make an impact in a meaningful industry. This role will be hybrid … days onsite in our Wimbledon office, London. As a Senior Data Engineer, you will lead data migration strategies and implementation across hybrid cloud environments (primarily AWS), enabling smooth and secure movement of legacy and modern systems. As a senior engineer, you'll design, develop, and optimise … scalable and efficient data pipelines integrating PHP, and C applications using .NET framework backend services and React frontends. You'll utilise tools such as Terraform for infrastructure-as-code ( IaC ), AWS (Lambda, EC2, EKS, Step Functions, VPC etc.) for ETL, Airflow pipelines, Snowflake, and ensure architectural alignment with More ❯

leading mid-market funds. With this investment, the business is going through a digital transformation strategy and is now looking to drive a data-focused culture across the organisation. As the first data hire, you will work closely with the CFO and CTO to help navigate … and develop the data roadmap in both the short term and long term. You will serve as the hands-on expert responsible for optimising data structures, performing cleansing from diverse sources to enable concise reporting in Tableau, and constructing as well as maintaining pipelines. Role: As … the technical expert, you will be responsible for creating a transformation layer mapping raw data to data marts to support analysis. You will have the opportunity to work closely with the executives, including the CFO and CTO as well as the PE Fund. You will be More ❯

leading mid-market funds. With this investment, the business is going through a digital transformation strategy and is now looking to drive a data-focused culture across the organisation. As the first data hire, you will work closely with the CFO and CTO to help navigate … and develop the data roadmap in both the short term and long term. You will serve as the hands-on expert responsible for optimising data structures, performing cleansing from diverse sources to enable concise reporting in Tableau, and constructing as well as maintaining pipelines. Role: As … the technical expert, you will be responsible for creating a transformation layer mapping raw data to data marts to support analysis. You will have the opportunity to work closely with the executives, including the CFO and CTO as well as the PE Fund. You will be More ❯

tool for drug discovery. Our patient data, biobank and biomarker technology have led to the creation of an in-house drug discovery pipeline for cancers with high unmet need. We are a VC-backed start-up based in London, England and Natick, Massachusetts. To grow our company … we’re looking for a Senior Data Scientist with experience in biotech to join our early-stage team. Will you be the one? Job Description This role offers an opportunity to apply your expertise in data science, machine learning, and statistical modeling to oncology-focused target … identification and drug discovery . You will work with diverse datasets, from different sources including genomics, transcriptomics, proteomics, and high-content imaging data, to support the identification of cancer targets and the development of novel therapeutics. You will be part of the Software Team and support wet-lab More ❯

tool for drug discovery. Our patient data, biobank and biomarker technology have led to the creation of an in-house drug discovery pipeline for cancers with high unmet need. We are a VC-backed start-up based in London, England and Natick, Massachusetts. To grow our company … we’re looking for a Senior Data Scientist with experience in biotech to join our early-stage team. Will you be the one? Job Description This role offers an opportunity to apply your expertise in data science, machine learning, and statistical modeling to oncology-focused target … identification and drug discovery . You will work with diverse datasets, from different sources including genomics, transcriptomics, proteomics, and high-content imaging data, to support the identification of cancer targets and the development of novel therapeutics. You will be part of the Software Team and support wet-lab More ❯

JobDescription: Areyou passionate about Data and Analytics (D&A) and excited abouthow it can completely transform the way an enterprise works? Do youhave the strategic vision, technical expertise, and leadershipskills to drive data-driven solutions? Do you want to work in adynamic, fast-growing category? If … so, you might be the idealcandidate for the role in the Data and Analytics function forGlobal Pet Nutrition (PN) atMars. Pet Nutrition (PN) isthe most vibrant category in the FMCG sector. As we work totransform this exciting category, a new program, Digital First, hasbeen mobilized by the Mars … thought leadership, quality decisionmaking, deep technical know-how, and an ability to navigate complexbusiness challenges while building and leading a team of worldclass data and analyticsleaders. With Digital First,PN is moving to a Product based model to create business facingdigital capabilities. Develop and maintain robust data More ❯

join our consulting practice. In this role, you will act as a strategic advisor to clients, leading the design and delivery of advanced data solutions leveraging the Databricks Lakehouse Platform. You will partner with business and technical stakeholders to modernize data ecosystems, enabling data … Strategy: Serve as the primary Databricks expert in client engagements, advising on architecture, best practices, and use cases. Lead discovery sessions to assess data maturity and define tailored data modernisation strategies. Translate business requirements into scalable technical architectures and roadmaps using Databricks and cloud technologies. Solution … Leadership: Design and oversee implementation of data platforms and AI/ML solutions on Databricks. Drive end-to-end project delivery in collaboration with cross-functional teams (data engineering, cloud, analytics). Ensure solution quality, performance, and governance through robust architecture design and code reviews. Team More ❯

join our consulting practice. In this role, you will act as a strategic advisor to clients, leading the design and delivery of advanced data solutions leveraging the Databricks Lakehouse Platform. You will partner with business and technical stakeholders to modernize data ecosystems, enabling data … Strategy: Serve as the primary Databricks expert in client engagements, advising on architecture, best practices, and use cases. Lead discovery sessions to assess data maturity and define tailored data modernisation strategies. Translate business requirements into scalable technical architectures and roadmaps using Databricks and cloud technologies. Solution … Leadership: Design and oversee implementation of data platforms and AI/ML solutions on Databricks. Drive end-to-end project delivery in collaboration with cross-functional teams (data engineering, cloud, analytics). Ensure solution quality, performance, and governance through robust architecture design and code reviews. Team More ❯

Machine Learning Engineer, JP Science and Data Job ID: Amazon Japan G.K. - A43 The JP Retail Science team is looking for a Machine Learning Engineer to expand our efforts in vendor tooling. To help vendors grow their business, Amazon provides multiple programs such as deals, ads, etc. In … scientists to design and develop scalable ML infrastructure that supports model training, deployment, and monitoring across hundreds of vendors Implement efficient data pipeline and architectures that enable automated ML workflows for our eCommerce partners Build ML debugging and analysis tools to ensure model reliability and performance Utilizing … technical roadmap for vendor growth tooling at AMZ. About the team In this position, you will be part of the JP Science and Data team, consisting of scientists, business intelligence engineers, data engineers, and machine learning engineers, collaborating with Product Managers and Software Developers worldwide. Our More ❯

is a dynamic digital agency based in the heart of London. As we continue to grow, we're looking for a passionate AI & Data Lead to join our team. About the Role: We are seeking a highly motivated and experienced AI & Data Lead to spearhead our … agency's adoption and application of artificial intelligence and data-driven strategies. This is a pivotal role that will shape our future direction, driving innovation and enhancing our creative output. The ideal candidate will be a strategic thinker with a deep understanding of AI and data … a passion for creative problem-solving and a strong commercial acumen. Key Responsibilities: Strategy Development: Develop and implement the agency's AI and data strategy, aligning it with business objectives and client needs. This includes identifying opportunities for AI and data integration across all agency functions More ❯

Lead Data Engineer ( Databricks ) London - Hybrid - Remote Permanent £100,000 - £130,000 plus up to 20% bonus based on performance and commercial contribution About the Role We’re looking for a Lead Data Engineer to spearhead some of our clients most strategic Databricks engagements. This is … build capacity for future growth. What You’ll Be Doing Act as the technical lead on client engagements, owning design and delivery of data solutions in Databricks. Architect robust, scalable data platforms using the medallion architecture. Translate business requirements into scalable workflows, advising on data governance, quality, and security. Design and implement complex data pipelines using tools like Delta Live Tables (DLT) and Unity Catalog. Guide teams in implementing best practices across engineering, DevOps, and model deployment. Support pre-sales activity, including shaping proposals, estimates, and technical roadmaps. Provide technical leadership More ❯

Lead Data Engineer ( Databricks ) London - Hybrid - Remote Permanent £100,000 - £130,000 plus up to 20% bonus based on performance and commercial contribution About the Role We’re looking for a Lead Data Engineer to spearhead some of our clients most strategic Databricks engagements. This is … build capacity for future growth. What You’ll Be Doing Act as the technical lead on client engagements, owning design and delivery of data solutions in Databricks. Architect robust, scalable data platforms using the medallion architecture. Translate business requirements into scalable workflows, advising on data governance, quality, and security. Design and implement complex data pipelines using tools like Delta Live Tables (DLT) and Unity Catalog. Guide teams in implementing best practices across engineering, DevOps, and model deployment. Support pre-sales activity, including shaping proposals, estimates, and technical roadmaps. Provide technical leadership More ❯

Job Title: Lead Data Engineer (leading a team of 5). Salary: £130,000 – £150,000 + benefits Location: West London - Hybrid (3 days p/w in-office) Tech: AWS, Snowflake, Airflow, DBT, Python The Company: Immersum have engaged with a leading PropTech company on a mission … to revolutionise how the property sector understands people, places, and data. By combining cutting-edge data science with powerful location intelligence, they help major organisations make smarter, faster decisions. Backed by top-tier investors and growing fast, this is your chance to shape the future of PropTech from … the inside. The Role Requirements: You’ll take ownership of the design and delivery of scalable, high-performing data pipelines that drive core product features and insights. Sitting at the heart of the engineering and data function, you’ll play a critical role in the company More ❯

As a Finance Business Intelligence Analyst you will be a key member of the Data team translating data into useful and meaningful information that can be utilised for decision making and strategic planning. You will be responsible for delivering timely, accurate, and actionable insights across Loadsure … s financial and commercial functions. As the analytical bridge between the Data, Finance, and Commercial teams, the Business Intelligence Analyst will develop and maintain dashboards, reporting frameworks, and data models to support strategic decision-making, revenue attribution, partner evaluation, and operational performance tracking. The ideal candidate … and commercial acumen, with the ability to design and deliver high-impact reporting that aligns with Loadsure's rapid scaling, product expansion, and data-driven culture. You will be highly organised and comfortable building relationships and working with all levels of the firm. Stakeholder management and communication will More ❯

As a Finance Business Intelligence Analyst you will be a key member of the Data team translating data into useful and meaningful information that can be utilised for decision making and strategic planning. You will be responsible for delivering timely, accurate, and actionable insights across Loadsure … s financial and commercial functions. As the analytical bridge between the Data, Finance, and Commercial teams, the Business Intelligence Analyst will develop and maintain dashboards, reporting frameworks, and data models to support strategic decision-making, revenue attribution, partner evaluation, and operational performance tracking. The ideal candidate … and commercial acumen, with the ability to design and deliver high-impact reporting that aligns with Loadsure's rapid scaling, product expansion, and data-driven culture. You will be highly organised and comfortable building relationships and working with all levels of the firm. Stakeholder management and communication will More ❯

As a Finance Business Intelligence Analyst you will be a key member of the Data team translating data into useful and meaningful information that can be utilised for decision making and strategic planning. You will be responsible for delivering timely, accurate, and actionable insights across Loadsure … s financial and commercial functions. As the analytical bridge between the Data, Finance, and Commercial teams, the Business Intelligence Analyst will develop and maintain dashboards, reporting frameworks, and data models to support strategic decision-making, revenue attribution, partner evaluation, and operational performance tracking. The ideal candidate … and commercial acumen, with the ability to design and deliver high-impact reporting that aligns with Loadsure’s rapid scaling, product expansion, and data-driven culture. You will be highly organised and comfortable building relationships and working with all levels of the firm. Stakeholder management and communication will More ❯

users, we're building a world-class R&D team to push the boundaries of AI creativity. The Role: As a Research Engineer - Data at Leonardo , you will architect and manage petascale data pipelines, combining text, images, 3D models, and other data modalities to … world-class AI models. You'll work hand-in-hand with our Researchers to create and curate large, multi-modal datasets, including synthetic data, that supercharge SOTA generative AI solutions. Your expertise in distributed systems, data processing, and experimentation will shape the backbone of our research … work. Responsibilities: Data Acquisition & Curation Lead the ingestion, unification, and organization of large, unstructured data sources (e.g., text, images, 3D geometry, code snippets) into scalable, high-quality datasets suitable for machine learning research and production. High-Performance Data Pipelines Develop and optimize distributed systems More ❯

A large utility client is seeking a highly skilled Senior Data Engineer to join their European Trading team. This role involves leading and participating in the design, development, testing, implementation, and maintenance of data-driven software solutions. The ideal candidate will possess expert-level knowledge of … They will identify and champion innovation in technology and processes to unlock new commercial opportunities. Collaborating closely with the trading team, the Senior Data Engineer will shape quantitative strategies and ensure data/analytics pipelines meet front-office needs. This position requires the ability to work … with minimal guidance, exercising broad latitude in decision-making. Key responsibilities include migrating an existing Python-based reporting/analytics application and its data workflows from Azure SQL to Databricks, creating and optimizing data pipelines in Databricks, and leveraging scheduling, job orchestration, and optionally machine learning More ❯

A large utility client is seeking a highly skilled Senior Data Engineer to join their European Trading team. This role involves leading and participating in the design, development, testing, implementation, and maintenance of data-driven software solutions. The ideal candidate will possess expert-level knowledge of … They will identify and champion innovation in technology and processes to unlock new commercial opportunities. Collaborating closely with the trading team, the Senior Data Engineer will shape quantitative strategies and ensure data/analytics pipelines meet front-office needs. This position requires the ability to work … with minimal guidance, exercising broad latitude in decision-making. Key responsibilities include migrating an existing Python-based reporting/analytics application and its data workflows from Azure SQL to Databricks, creating and optimizing data pipelines in Databricks, and leveraging scheduling, job orchestration, and optionally machine learning More ❯

and intuitive user experience. Rapid Problem-Solving: Quickly fix bugs and solve problems, particularly related to AI performance, model integration, or data pipeline issues, to enhance customer satisfaction. Continuous Improvement: Participate in code reviews and contribute to improving our AI development processes, ensuring that the AI components … experience working with AI automation engines, process automation using AI, or integrating AI with business logic to streamline processes. Enterprise Governance: Understanding of data privacy regulations (GDPR, HIPAA, etc.) and EU AI Act. What's in it for you? Join an ambitious tech company reshaping the way people More ❯

An esteemed Data Consultancy are seeking a number of ambitious Databricks Data Engineers to join their team. They are both a Microsoft Partner and a Databricks Partner, and are experts in helping their clients to better manage and uncover the value in their data. They pride … themselves on developing tailor-made data-driven solutions to suit the specific needs of their clients, with a growing client base largely within Financial Services, amongst other industries. In this role, you will be working in a team of highly skilled professionals to deliver effective market-leading data solutions using the latest cutting-edge technologies. This particular role will focus on leveraging the Databricks Data Intelligence platform, and Azure Data Platform technologies. You will split your time between client-site, home and the London office depending on requirements, and are asked to More ❯

Senior Data Engineer | Systematic Trading A Top-tier quant fund is hiring a Senior Data Engineer to help architect and scale a global Data Lakehouse that feeds directly into live trading strategies. If you’ve already been building data infrastructure inside a … hedge fund or HFT shop, you’ll know what this role really means: low-latency, high-availability, globally distributed data pipelines that quant teams trust every day. This is your chance to level up from patching legacy pipelines to building the core platform used by quant researchers and … traders across desks and regions. What You’ll Be Driving Architect and build a global Lakehouse platform (Data Lake + OLAP) in AWS Develop scalable data pipelines in Python , working with SDKs and data libs Own end-to-end data modeling , ingestion More ❯

Senior Data Engineer | Systematic Trading A Top-tier quant fund is hiring a Senior Data Engineer to help architect and scale a global Data Lakehouse that feeds directly into live trading strategies. If you’ve already been building data infrastructure inside a … hedge fund or HFT shop, you’ll know what this role really means: low-latency, high-availability, globally distributed data pipelines that quant teams trust every day. This is your chance to level up from patching legacy pipelines to building the core platform used by quant researchers and … traders across desks and regions. What You’ll Be Driving Architect and build a global Lakehouse platform (Data Lake + OLAP) in AWS Develop scalable data pipelines in Python , working with SDKs and data libs Own end-to-end data modeling , ingestion More ❯

What's the opportunity? The Research, Analytics & Data Science (RAD) team at Intercom uses data and insights to drive evidence-based decision-making. We're a team of data scientists and product researchers who use data - both big and small - to unlock … and shape products that deliver real value to our customers. If you get really excited about asking the right questions, exploring patterns in data, and surfacing actionable insights that drive strategic decisions, then this role is for you. Data Scientists in RAD partner with teams across … Intercom make sense of our users, our products, and our business, using metrics and data. This role will enable you to drive key data projects that directly impact our customers and millions of end users who communicate via our messaging platform daily. What will I be doing? You More ❯