Data Pipeline Jobs in London

126 to 150 of 832 Data Pipeline Jobs in London

Azure Data Engineer - Local Government / Public Sector

London, United Kingdom
Hybrid / WFH Options
Salt Digital Recruitment
Job Title: Data Engineer - Azure Local Government Inside IR35 Location: Central London (Hybrid - 1-2 days on-site per week) Rate: £500/day (Inside IR35) Contract: 6 months (initial) Start: ASAP/on notice Salt's Public Sector team is proud to be partnered with a forward-thinking Local Government organisation in Central London, currently delivering a … large-scale corporate data programme. We're seeking an experienced Data Engineer with a strong background in Microsoft Azure and Power BI to play a key role in leading the council's Modern Data Platform and supporting improved data-driven decision-making across services. The Role: As a Data Engineer … based analytics solutions. Key Responsibilities: Lead the management and development of the organisation's Modern Data Platform (Azure-based) Build and maintain robust ETL/ELT pipelines , data models, and reporting marts Develop Power BI dashboards and implement best practice modelling and workspace governance Integrate data from internal departments and external agencies to support More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Lead Data Engineer

London, United Kingdom
Hybrid / WFH Options
Jumpcrypto
Notabene is growing fast-and we're looking for people like you to help shape the future rails of the crypto industry! About The Role As a Lead Data Engineer at Notabene , you'll play a pivotal role in shaping how crypto transactions are settled globally. You'll collaborate with stakeholders across all levels of the business, turning … their BI requirements into accessible, accurate, real-time reporting. You will maintain and continuously improve Notabene's org-wide data management and analytics. In this role, you'll be responsible for building and maintaining our data pipelines, scaling our data warehouse architecture, and ensuring data insights are optimized and scalable across the … organization. You'll also be instrumental in driving forward a data-driven culture at Notabene and training/upskilling power-users across the organization. You'll be working closely with key stakeholders across the business to understand their BI/reporting needs and will enable providing insights to inform strategic decisions both at the Board/Executive level More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Machine Learning Engineer with Data Engineering expertise (London)

London, UK
Tadaweb
Machine Learning Engineer with Data Engineering expertise Machine Learning Engineer with Data Engineering expertise 2 weeks ago Be among the first 25 applicants Tadaweb is a pioneering technology company with roots in Luxembourg and a growing global presence, with offices in the United Kingdom, France, and the United States. For over 13 years, we’ve been … for our “nothing is impossible” ethos, we prioritize trust, transparency, and innovation in everything we do. About the Role: We are looking for a Machine Learning Engineer with Data Engineering expertise to help scale our platform. In this hybrid role, you’ll design data pipelines, develop ML models, and work across data and AI … machine learning models for production. • Optimize model performance based on key metrics for scalability, reliability, and real-world impact. • Build and maintain end-to-end ML pipelines, including data preprocessing, model training, deployment, and monitoring. • Work closely with cross-functional teams to integrate ML models into our SaaS platform for PAI and OSINT investigations. • Develop, maintain, and optimize More ❯
Employment Type: Full-time
Posted:

Machine Learning Data Engineer (London)

London, UK
Epic Games
part of a team that continually strives to do right by our community and users. We’re constantly innovating to raise the bar of engine and game development. DATA ENGINEERING What We Do Our mission is to provide a world-class platform that empowers the business to leverage data that will enhance, monitor, and support our … products. We are responsible for data ingestion systems, processing pipelines, and various data stores all operating in the cloud. We operate at a petabyte scale, and support near real-time use cases as well as more traditional batch approaches. What You'll Do You will be responsible for designing, building, and maintaining our data infrastructure to ensure the reliability and efficiency of our data and systems used by our Machine Learning team. Your role will include creating and maintaining data pipelines that transform and load data from various products and managing the AWS infrastructure for our machine learning platform. Additionally, you will work with engineers, product More ❯
Employment Type: Full-time
Posted:

Data Engineering Manager

London, United Kingdom
Live Nation
You will be joining the Data Science and Engineering team to help get the most value out of our real-time data streams with a focus on elevating business decisions and ensuring genuine fans have the best opportunity to buy tickets. THE JOB We are seeking a skilled Data Engineering Manager to join and … lead our growing Data Engineering team and play a critical role in developing and maintaining our data infrastructure. As a member of the Data Science and Engineering leadership team, you will be key in driving the technical strategy and vision for data infrastructure, ensuring alignment with business objectives, and overseeing the delivery … of complex data-related projects. The ideal candidate will have a deep understanding of data platforms and tools, as well as experience designing and implementing data pipelines and ETL processes. WHAT YOU WILL BE DOING Lead the Data Engineering team in delivering high-quality data solutions that meet business needs More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer

City of London, London, United Kingdom
TechYard
Our Client We power the future of Marketing and realise business value by applying human creativity to AI, data, and technology. Our expert consultants partner with leading brands to unlock the power of their enterprise data and transform their Marketing capabilities, building sustainable value in a privacy-respectful way. Integrating enterprise technologies, Google’s ecosystem, and … our proprietary solutions to clients' first-party data, we create innovative solutions and unlock the power of AI, delivering tangible ROIs for our clients. Our expert consultants orchestrate Google Marketing and Google Cloud technologies to unlock ultimate AI-powered performance within our client’s organisation. About the Role As one of our Data Engineers, you will … be part of a team responsible for the development and overall delivery of big data platform solutions, automation solutions and data AI Agents. You will be designing and proposing effective combinations of Google Marketing Platform tools (GA4, Campaign Manager 360, Search Ads 360, etc.) and Google Cloud solutions (BigQuery, BQ Sharing (Analytics Hub), Cloud Storage, APIs More ❯
Posted:

Data Engineer

London Area, United Kingdom
TechYard
Our Client We power the future of Marketing and realise business value by applying human creativity to AI, data, and technology. Our expert consultants partner with leading brands to unlock the power of their enterprise data and transform their Marketing capabilities, building sustainable value in a privacy-respectful way. Integrating enterprise technologies, Google’s ecosystem, and … our proprietary solutions to clients' first-party data, we create innovative solutions and unlock the power of AI, delivering tangible ROIs for our clients. Our expert consultants orchestrate Google Marketing and Google Cloud technologies to unlock ultimate AI-powered performance within our client’s organisation. About the Role As one of our Data Engineers, you will … be part of a team responsible for the development and overall delivery of big data platform solutions, automation solutions and data AI Agents. You will be designing and proposing effective combinations of Google Marketing Platform tools (GA4, Campaign Manager 360, Search Ads 360, etc.) and Google Cloud solutions (BigQuery, BQ Sharing (Analytics Hub), Cloud Storage, APIs More ❯
Posted:

Data Engineer

London Area, United Kingdom
Mars
a 3-year Digital Transformational program that aims to digitize Mars irreversibly. As part of our Pet Nutrition digital first strategy, our purpose is to establish strong Digital & Data Foundations (DDF) for PN products through transversal foundational technology & data capabilities that enable the creation of scalable fit-for-purpose solutions, deliver superior propositions and fuel integrated … with Increased agility and reduced cost. Some of the key deliverables we will look to unlock are: From siloed, small-scale product performance evaluation to a fully Integrated, data driven performance assessment through real-time predictive solutions; maximizing capability and reducing evaluation time & cost by building confidence to drive superior propositions across the portfolio. From traditional Innovation and … enables rapid scenario evaluation, accelerated development and scale-up, with increased agility and reduced costs/resources. From dispersed physical quality records to digitalized quality standards, capturing of data and trend predictions, which can be leveraged in order to proactively mitigate emerging risks and avoid non-quality Impacts. From fragmented legacy IT systems holding unreliable data More ❯
Posted:

Data Engineer

City of London, London, United Kingdom
Mars
a 3-year Digital Transformational program that aims to digitize Mars irreversibly. As part of our Pet Nutrition digital first strategy, our purpose is to establish strong Digital & Data Foundations (DDF) for PN products through transversal foundational technology & data capabilities that enable the creation of scalable fit-for-purpose solutions, deliver superior propositions and fuel integrated … with Increased agility and reduced cost. Some of the key deliverables we will look to unlock are: From siloed, small-scale product performance evaluation to a fully Integrated, data driven performance assessment through real-time predictive solutions; maximizing capability and reducing evaluation time & cost by building confidence to drive superior propositions across the portfolio. From traditional Innovation and … enables rapid scenario evaluation, accelerated development and scale-up, with increased agility and reduced costs/resources. From dispersed physical quality records to digitalized quality standards, capturing of data and trend predictions, which can be leveraged in order to proactively mitigate emerging risks and avoid non-quality Impacts. From fragmented legacy IT systems holding unreliable data More ❯
Posted:

Data Engineer

London, United Kingdom
Moneyfarm
what we do. To accommodate our different needs and commitments, we offer flexible working to all. Our individual impact and output is what counts most. About the role Data plays a central role in Moneyfarm's success. Are you excited about launching a new product and building from scratch its data pipelines? Are you ready to … make an impact on the whole Moneyfarm data platform? If the answer is yes, we are looking forward to hearing from you. Main Responsibilities: Design, implement, optimise and deploy ETL pipelines in production. Monitor and maintain existing ETL procedures in the data platform. Monitor data quality within company data warehouse and discover … potential issues Collaborate on maintenance and evolution of Moneyfarm's data models. Collaborate with data analysts and product teams to understand data requirements, and implement data transformations and aggregations to support their analyses and modelling. Collaborate with Platform Engineers to develop and improve data platform, and workflow scalability Collaborate with More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Big Data Engineer

London, United Kingdom
Amazon
Amazon Retail Financial Intelligence Systems is seeking a seasoned and talented Senior Data Engineer to join the Fortune Platform team. Fortune is a fast growing team with a mandate to build tools to automate profit-and-loss forecasting and planning for the Physical Consumer business. We are building the next generation Business Intelligence solutions using big data technologies such as Apache Spark, Hive/Hadoop, and distributed query engines. As a Data Engineer in Amazon, you will be working in a large, extremely complex and dynamic data environment. You should be passionate about working with big data and are able to learn new technologies rapidly and evaluate them critically. … languages such as Java, C++, Spark/Scala, Python, etc. Major Responsibilities: - Work with a team of product and program managers, engineering leaders, and business leaders to build data architectures and platforms to support business - Design, develop, and operate high-scalable, high-performance, low-cost, and accurate data pipelines in distributed data processing platforms More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer

London, South East, England, United Kingdom
Hybrid / WFH Options
Harnham - Data & Analytics Recruitment
Role: Data Engineer Salary: £70,000 - £75,000 WFH: Hybrid - 2 days/week in office, Central London Overview Our client is a fast-growing technology company powering personalised mobile content experiences for millions of users across the UK. With strong partnerships in place and a clear path for continued growth, they are now hiring a Data Engineer to support their next generation of products and data initiatives. Reporting to the VP of Engineering Operations, this role will focus on building scalable data systems and integrating machine learning workflows that drive real-time personalisation and business insights across a high-traffic platform. Key Responsibilities Design, build, and maintain robust data pipelines (batch and real-time)* Integrate and monitor machine learning models within live data workflows* Collaborate with Engineering, Product, and Analytics to ensure data accessibility and reliability* Optimise data infrastructure and automate manual processes* Uphold data integrity with strong validation and testing practices* Drive improvements in data delivery More ❯
Employment Type: Full-Time
Salary: £70,000 - £75,000 per annum, Inc benefits
Posted:

Lead Data Scientist

London, South East, England, United Kingdom
Tenth Revolution Group
A small and rapidly growing Consultancy are looking for a Lead Data Scientist to join their expanding team - this is a hybrid role, requiring around 2-3 days per week either in the office or on client site, depending on requirements. Many of their clients are in the Public Sector, meaning you must be eligible for SC Clearance … order to apply for this role. In this role, you will lead on client projects and provide them with subject matter expertise - you'll proactively identify opportunities for data science to be used to help solve their unique challenges, and will action this appropriately. This will involve working with varied data sources, and designing and implementing … various data science and machine learning techniques and algorithms, both on-premises and on the cloud, depending on what's best for each particular client. You'll communicate your findings and insight to the client, getting involved in presentations to uncover the "story" the data is telling, and therefore what action can be taken. This role More ❯
Employment Type: Full-Time
Salary: £55,000 - £75,000 per annum
Posted:

Lead Data Scientist

City of London, London, United Kingdom
Tenth Revolution Group
A small and rapidly growing Consultancy are looking for a Lead Data Scientist to join their expanding team - this is a hybrid role, requiring around 2-3 days per week either in the office or on client site, depending on requirements. Many of their clients are in the Public Sector, meaning you must be eligible for SC Clearance … order to apply for this role. In this role, you will lead on client projects and provide them with subject matter expertise - you'll proactively identify opportunities for data science to be used to help solve their unique challenges, and will action this appropriately. This will involve working with varied data sources, and designing and implementing … various data science and machine learning techniques and algorithms, both on-premises and on the cloud, depending on what's best for each particular client. You'll communicate your findings and insight to the client, getting involved in presentations to uncover the "story" the data is telling, and therefore what action can be taken. This role More ❯
Employment Type: Permanent
Salary: £55000 - £75000/annum
Posted:

Data Engineer II

London, United Kingdom
American Society of Safety Professionals
ll take ownership and drive real change. Constantly grow as you work hard for a mission that matters at a company where you matter. Your Impact As a Data Engineer at Axon, you will play a pivotal role in transforming public safety through building a highly innovative, multi-tenant data platform. You'll work to develop … highly scalable solutions that empower public safety agencies to use their data to drive transformative analytics and insights. You'll build pipelines that ingest, enrich and unlock the data for our customers in a safe, secure and highly performant manner. Most importantly your work will have a direct impact daily on Axon's mission to protect … life and preserve truth. What You'll Do Design, build, and maintain scalable, secure, and efficient data pipelines using modern data tools and cloud-native technologies Work with a variety of data sources-structured, semi-structured, unstructured-to support diverse analytics and operational workloads Ensure data quality and consistency by incorporating automated More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Data Scientist - Product Analytics New London, England

London, United Kingdom
Hybrid / WFH Options
Intercom
Senior Data Scientist - Product Analytics London, England Intercom is the AI Customer Service company on a mission to help businesses provide incredible customer experiences. Our AI agent Fin, the most advanced customer service AI agent on the market, lets businesses deliver always-on, impeccable customer service and ultimately transform their customer experiences for the better. Fin can also … Driven by our core values, we push boundaries, build with speed and intensity, and consistently deliver incredible value to our customers. What's the opportunity? The Research, Analytics & Data Science (RAD) team at Intercom use data and insights to drive evidence based decision-making. We're a team of data scientists and product researchers … who use data - both big and small - to unlock actionable insights about our customers, our products and our business. We generate insights that build customer empathy, drive product strategy and shape products that deliver real value to our customers. If you get really excited about asking the right questions, exploring patterns in data and surfacing actionable More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Principal Data Engineer

London, United Kingdom
Hippo Digital Limited
About The Role Hippo is recruiting for a Principal Data Engineer to join our Hippo Herd. Principal Data Engineers work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. Hippo's Principal Data Engineers are experts in their field. You will act as … a principal consultant providing technical expertise in data engineering practices both internally and to our clients. You will drive the team's technical deliverables, maintain client relationships and be passionate about developing and upskilling others. Please note, we are looking for candidates who are looking for growth at this level (principal), therefore the advertised salary band is the … team and stakeholders, identifying and ensuring that challenges are overcome Lead in the recruitment of other engineers, and support other consultants in their professional development Ensure Hippo's Data and Engineering communities contribute to Hippo's business at a strategic level Lead on new business opportunities, writing technical bids and proposals Promote Hippo's Data Herd More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Analyst

City of London, London, United Kingdom
Peregrine
Join us a Data Analyst for our client. At Peregrine, we’re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector – we are always in search of the best talent to … across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: The business is undergoing an exciting data transformation, and we’re looking for a talented Data Analyst to join our growing data team. In this role, you’ll be instrumental in supporting … the Head of Data in building and deploying fit for purpose data quality management capability underpinned by modern data stack (Azure Databricks, ADF and Power BI), ensuring that data is reliable and trustworthy, then extract insights from it to improve operations and optimise resources. Key responsibilities & deliverables: Drive requirements for data More ❯
Posted:

Data Analyst

London Area, United Kingdom
Peregrine
Join us a Data Analyst for our client. At Peregrine, we’re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector – we are always in search of the best talent to … across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: The business is undergoing an exciting data transformation, and we’re looking for a talented Data Analyst to join our growing data team. In this role, you’ll be instrumental in supporting … the Head of Data in building and deploying fit for purpose data quality management capability underpinned by modern data stack (Azure Databricks, ADF and Power BI), ensuring that data is reliable and trustworthy, then extract insights from it to improve operations and optimise resources. Key responsibilities & deliverables: Drive requirements for data More ❯
Posted:

Data Engineer London, England, United Kingdom London, England, United Kingdom

London, United Kingdom
Axon Enterprise
Location: London, England, United Kingdom Join Axon and be a Force for Good. Design, build, and maintain scalable, secure, and efficient data pipelines using modern data tools and cloud-native technologies Work with a variety of data sources-structured, semi-structured, unstructured-to support diverse analytics and operational workloads Ensure data quality … and consistency by incorporating automated testing, data validation, and monitoring mechanisms Drive best practices around data engineering, including testing, observability, security, and documentation Troubleshoot and resolve issues in production environments to ensure data integrity and platform reliability What you bring: 5+ years of professional experience in data engineering roles, preferably for a … customer facing data product Expertise in designing and implementing large-scale data processing systems with data tooling such as Spark, Kafka, Airflow, dbt, Snowflake, Databricks, or similar Strong programming skills in languages such as SQL, Python, Go or Scala Demonstrable use and an understanding of effective use of AI tooling in your development process More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Data Analyst

London, South East, England, United Kingdom
Hybrid / WFH Options
Red Engine
products, which means we’re always growing and looking for passionate people to join the family. The Job We’re looking for a commercially savvy, forward-thinking, Senior Data Analyst to join our Strategy & Insight team, helping to unlock meaningful insights across our hospitality brands. In this role, you’ll work closely with stakeholders across Marketing, Product, Operations … and Commercial to deliver data-driven recommendations that shape strategic decisions with a knack for orchestrating compelling data stories. Using your deep understanding of hospitality, customer and loyalty behaviours, and business operations, you'll uncover opportunities for smarter engagement, operational efficiency, and performance optimisation. Whether you're exploring guest visit patterns, optimising our offering, or analysing … how we grow and evolve as a business. This is an exciting role for a sharp thinker who thrives in fast-paced, experience-led environments and understands that data isn't just numbers — it's our story. Key Responsibilities will include: Insight Generation & Strategy: Own and maintain the architecture and structure within our Power BI reporting suite. Own More ❯
Employment Type: Full-Time
Salary: £55,000 - £60,000 per annum
Posted:

Senior BI Developer - Front Office, Power BI,Python,Databricks

London, South East, England, United Kingdom
Harvey Nash
bank based in the city of London. **Inside IR35 - 4 days a week on site** Overview BI Developer role supporting Front Office operations with expertise in Power BI, data engineering, and stakeholder management in investment banking environment. Key Responsibilities Design and maintain Power BI dashboards for trading, risk, and regulatory reporting Build data pipelines for real … time and batch processing of financial data Partner with traders, portfolio managers, and risk teams to deliver analytics solutions Ensure compliance with regulatory reporting requirements Optimize data models for front office metrics and P&L reporting Troubleshoot data quality issues in time-sensitive trading environments Required Skills BI development with strong Power BI (DAX … Power Query, data modeling) Data engineering experience building production pipelines Python, SQL, and Spark proficiency Experience with investment banking data (trades, positions, market data, reference data) Understanding of regulatory reporting processes Proven ability to work directly with demanding front office stakeholders Experience with real-time data feeds and More ❯
Employment Type: Contractor
Rate: £700 - £800 per day
Posted:

Graduate Digital Analyst - London

London, United Kingdom
Grayce
Graduate Development Programme Locations: London Starting Salary: £28,000 Application Requirements: Minimum 2:1 or above in a STEM (Science, Technology, Engineering, and Math) subject Experience in analysing data Right to work in the UK unsponsored for the duration of the programme Ability to work on site 5 days a week Grayce is not on the UK Border … delivering excellence. If you have a keen attention to detail and accuracy, a knack for spotting trends and patterns, and the ability to tell a compelling story using data, you'll thrive in our environment. We value resourcefulness, resilience, and a passion for driving change. Join us and be part of a community that cares, collaborates, and thrives … together. Understanding the types of roles available to a Graduate Digital Analyst: Data Analyst: Transform complex data into actionable insights, create dynamic visualisations, and drive business decisions. Work with cutting-edge tools, collaborate with stakeholders, and develop automated reports and dashboards while refining your technical expertise in a fast-paced environment. Data Engineer: Design More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Machine Learning Engineer (London)

London, UK
Hybrid / WFH Options
PhysicsX
multiple positions, however please only apply for the role that best aligns with your skillset and career goals. What You Will Do Work closely with our simulation engineers, data scientists and customers to develop an understanding of the physics and engineering challenges we are solving Design, build and test data pipelines for machine learning that are … reliable, scalable and easily deployable Explore and manipulate 3D point cloud & mesh data Own the delivery of technical workstreams Create analytics environments and resources in the cloud or on premise, spanning data engineering and science Identify the best libraries, frameworks and tools for a given task, make product design decisions to set us up for success … Work at the intersection of data science and software engineering to translate the results of our R&D and projects into re-usable libraries, tooling and products Continuously apply and improve engineering best practices and standards and coach your colleagues in their adoption What You Bring To The Table Experience applying Machine learning methods (including 3D graph/ More ❯
Employment Type: Full-time
Posted:

Generative AI Architect (Open AI) Professional Services

City of London, London, United Kingdom
HCLTech
highly skilled Generative AI Architect to lead the design and implementation of advanced AI solutions tailored for professional services. This role requires expertise in AI-driven decision automation , data-driven insights , and scalable architecture to enhance business processes and client outcomes. As a key member of our team, you will architect solutions that learn, reason, and make intelligent … AI algorithms for predictive analytics, recommendation engines, and automation in professional services. Apply machine learning (ML) and deep learning (DL) techniques to enhance decision-making and business intelligence. Data Engineering & Integration Architect robust data pipelines to support AI model training and inference. Implement automated data collection, integration, cleansing, and transformation techniques to ensure high … quality data inputs. Collaborate with data engineering teams to align AI solutions with real-world business applications. AI Model Training, Evaluation & Performance Optimization Train AI models using supervised, unsupervised, and reinforcement learning techniques , refining them based on business insights . Define model performance metrics to ensure AI solutions deliver tangible value. Real-Time AI Applications & System More ❯
Posted:
Data Pipeline
London
10th Percentile
£50,250
25th Percentile
£62,500
Median
£85,000
75th Percentile
£100,000
90th Percentile
£136,000