1 to 25 of 173 Data Engineering Jobs in the City of London

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working … with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules More ❯

Senior Data Engineer Salary: around £75k - plus a very attractive on top Location: London or Leeds - relaxed about hybrid working, if preferred About Us Sports forecasting company specializing in developing player level, play-by-play simulators that generate highly accurate, near-instant outcome projections for sporting events. Since its establishment, the company has focused on serving the emerging sports … has grown into a globally recognized leader in sports modelling and analytics. Purpose of role: The purpose of this role is to design, build, and maintain scalable and efficient data transformation workflows that empower the business with actionable insights and impactful visualisations. This role bridges the gap between data engineering and business intelligence by owning the transformation … layer and enabling clear, trusted, and timely analytics across the organisation. The successful candidate will have a strong grasp of modern data modelling practices, analytics tooling, and interactive dashboard development in Power BI and Plotly/Dash. Key responsibilities: Designing and maintaining robust data transformation pipelines (ELT) using SQL, Apache Airflow, or similar tools. Building and optimizing data More ❯

outstanding customer outcomes. Innovation, continuous improvement, and courage drive them forward in a rapidly evolving industry. What You'll Be Doing Lead and coordinate a team of MI Analysts, Data Analysts, and BI Developers to deliver insightful analysis and reporting supporting business managers. Own the MI, BI, and Analytics function, working with operational leaders to ensure reporting meets business … needs. Ensure compliance with policies, procedures, legislative, and regulatory requirements while maintaining excellent internal customer service. Develop and execute the roadmap for data platforms and reporting solutions. Manage data governance, ensuring data collection, storage, security, and accessibility. Create and implement a MI and BI framework to standardise team practices and ensure data quality. Lead design, implementation … and operation of BI data analysis systems, driving the BI strategy to meet organisational goals. Manage BI/MI lifecycle with business user involvement in design processes, data modelling, and integration. Prioritise and deliver data-driven initiatives and incremental improvements. Optimise the use of commercial and enterprise data across products, sales, finance, and claims. Collaborate with More ❯

Employment Type:** Permanent **Salary:** Up to £62,000 **Location:** in the West of London **Work Arrangement:** In-office only, five days a week. **Job Title:** Data Architect/Data Engineer **Experience Required:** 6-7Years **Role Overview:** We are seeking a Senior Data Architect/Data Engineer to design and implement scalable data solutions, including … real-time and ETL/ELT data pipelines. Responsibilities include optimizing our data warehouse, creating Power BI reports, and developing AI-driven solutions using OpenAI APIs. **Key Responsibilities:** - Design and implement robust real-time data pipelines from diverse sources. - Maintain a high-performance data warehouse for reporting and analytics. - Develop insightful Power BI dashboards and reports … for stakeholders. - Use Azure Data Factory, Azure Functions, and Logic Apps for data integration. - Employ Python and SQL for data transformation and analysis. - Leverage OpenAI APIs for AI/ML solutions. - Collaborate with teams to align data strategy with business goals. - Ensure data quality, consistency, and compliance. **Required Qualifications:** - 7-8 years in Data More ❯

our people too - creating new challenges and opportunities all the time. We're a business that never stands still. Join us on our journey to as a Head of Data Engineering & Insight, and you won't either. As part of our accelerated digital transformation and the implementation of our new Next Generation BI platform, we are looking for … a Head of Data Engineering & Insight to lead our global Business Intelligence organisation. This key leadership role is aligned with our strategy - a modular, cloud-native data-centric architecture designed to democratise data access, strengthen governance, and maximise business value. Key Responsibilities : Lead the global BI organisation across APAC, EMEA, and the AMERICAS , with direct accountability … roadmap in line with our overall technology strategy and business imperatives. Oversee the transition and integration from legacy BI platforms to the Next Generation BI ecosystem . Ensure robust data governance, including a centralised data catalogue, data quality, compliance, and access management. Manage global teams across Data Engineering, Reporting, Data Governance, and Advanced Analytics More ❯

Job Title: Principal Data Engineer Location: London, UK – Hybrid (Liverpool Street office) Department: Data & Engineering Reports To: Head of Data Science Employment Type: Permanent A leading global payments and fintech platform, empowering clients to innovate and scale. Their mission is to create frictionless, secure, and intelligent payment solutions that unlock value across banking, financial services, and … digital assets. As they continue to scale their data infrastructure, they’re seeking a seasoned Principal Data Engineer to help design, build, and optimise a modern data platform, with a focus on orchestration (Airflow), scalable data warehouse architecture, and high-performance pipelines. The ideal candidate will bring both technical depth and strategic thinking, with the ability … to communicate effectively across business and technical teams. Key Responsibilities Design and lead the development of scalable, secure, and high-performance data warehouse solutions for BI and analytics. Define and drive the long-term architecture and data strategy in alignment with business goals. Own orchestration of ETL/ELT workflows using Apache Airflow, including scheduling, monitoring, and alerting. More ❯

Senior Data Engineering Consultant - MS Fabric - London - Hybrid - £80k My client are an emerging Microsoft-partnered consultancy looking to expand their data engineering team. If you are an expert data engineer with Microsoft products and a consultancy background, this should be a great fit for you. Salary and Benefits Competitive salary of up to £80k … Hybrid working (2-3 days in London-based office) Competitive annual leave package Private medical care Health insurance And many more Role and Responsibilities Possess a wide range of data engineering skills, with a focus on having delivered in Microsoft Fabric Develop good working relationships with clients on a project including interpersonal skills with both business and technical … focused colleagues. Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment. Delivering high-quality pieces of work, proven ability to escalate problems to client/senior team members where necessary and propose possible solutions. Support building the Consulting practice through contribution to ongoing initiatives. This can include contributing to knowledge More ❯

to support EQ's transition into a stronger, more profitable, product-led business, driven by real insights and the needs of its customers. We are looking for a skilled Data Engineer to join our Data team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines using Microsoft Fabric … and Databricks. You will work closely with our Product and Engineering teams to ensure data flow and integration across our data ecosystem. Your expertise will help us to improve our data infrastructure, improve data quality, and enable data-driven decision-making across the organization. Core Duties and Responsibilities Design, build, and maintain large-scale … data pipelines using Microsoft Fabric and Databricks Develop and implement data architectures that meet business requirements and ensure data quality, security, and compliance Collaborate with wider Product & Engineering teams to integrate data pipelines with machine learning models and analytics tools Optimise data processing and storage solutions for performance, scalability, and cost-effectiveness Develop and More ❯

Data Engineer London/Hybrid Circa £90k + bonus + benefits Azure, Lakehouse, SQL We’re looking for a Data Engineer with strong hands-on experience in data management and Azure technologies, ideally with a background in MGA or (re)insurance environments. You’ll help design, build, and enhance a strategic Data Lakehouse platform to support … role that requires attention to detail, the ability to manage multiple projects, and a collaborative approach to working with regional and group teams. Key Responsibilities: Develop and maintain scalable data solutions on Azure (ADF, Databricks, Synapse, etc.) Maintain and enhance the integrity of the Data Lakehouse in partnership with regional and group data teams. Partner with analytical … and reporting teams to ensure data is presented accurately for performance insights. Ensure best practices in data governance, quality, and security Collaborate with business analysts, data scientists, and stakeholders across underwriting, finance, and ops Contribute to solution design, development assurance, and platform evolution Support delivery of data models, APIs, ML integrations, and reporting tools Key Skills More ❯

As a Senior Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Airflow, etc.) and automation. The Senior Data Engineer will work closely with the data, Architecture, Business Analyst, Data Stewards to integrate and … align requirements, specifications and constraints of each element of the requirement. They will also need to help identify gaps in resources, technology, or capabilities required, and work with the data engineering team to identify and implement solutions where appropriate. Work type: Contract Length: initial 6 months Work structure: hybrid 2 days a week in London. Primary Responsibilities: Integrate … data from multiple on prem and cloud sources and systems. Handle data ingestion, transformation, and consolidation to create a unified and reliable data foundation for analysis and reporting. Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and More ❯

Job Title: Data Engineer (Fabric, Synapse & ADF) Location: Remote (UK-based candidates only) Contract: 3–6 Month Rolling Contract IR35 Status: Outside IR35 Day Rate: £500–£600 per day Overview: We’re looking for an experienced Data Engineer to join a dynamic team working across a variety of exciting data projects. This role involves a blend of … greenfield builds, brownfield enhancements, and support of existing solutions, giving you the chance to work across the full data engineering lifecycle. This is a remote-based position, open to UK-based candidates only, and is offered on an Outside IR35 basis. Key Responsibilities: Design, build, and maintain scalable data pipelines using Microsoft Fabric, Azure Synapse, and Azure … Data Factory (ADF). Develop and optimise ETL/ELT processes to support business intelligence and analytics solutions. Collaborate with data architects, analysts, and stakeholders to understand business requirements and translate them into technical solutions. Contribute to the modernisation of legacy data platforms and assist in greenfield implementations. Ensure data quality, governance, and security best practices More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents at … to demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and storage More ❯

more including day-to-day life at Clarksons, visit us at Role Summary As part of the Digital Transformation team, you will be helping us build the best shipping data platform and reporting, enabling us to provide accurate and timely insights to the business and our clients. We’ve been building out a central data platform for the … its worth. We are now looking for an individual to help scale the platform and accelerate its roll out across the business. What you’ll be doing Work with data engineers & analysts to problem solve, build & deliver data products from ideation to production. Lead and own the full lifecycle of data engineering deliverables. Deliver complex data flows to process external data sources to provide the company with a competitive edge. Act as a consultant to the business to meet their needs. Maintain existing data products to ensure reliability and high data quality to maximise the utility of data within the business. Innovate by recommending opportunities to improve data engineering More ❯

Manager, Data & Analytics, Global Insight (London-based) Hybrid working – Central London office Salary and benefits in line with industry Job Reference J12978 Reporting to: VP, Data & Analytics (New York) About Fremantle Join the place creatives call home! Fremantle is a world leader in creating, producing and distributing across Entertainment, Drama, Film and Documentary content. Our formats are some … in all that we do. The Role and the team Fremantle’s Global Insight Department plays a pivotal role in analysing performance metrics, audience behaviours, and content trends. The Data & Analytics team within this department is responsible for developing and maintaining the company’s performance data infrastructure and delivering actionable insights across a wide range of business areas … using Microsoft Fabric, Power BI, Azure Data Factory and other tools. We are looking for a Manager, Data & Analytics to lead a small London-based team within our Insights division, reporting directly to the VP of Data & Analytics based in New York. This is a newly created role designed to oversee the day-to-day running of More ❯

Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to some of the most complex infrastructure projects across the UK and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock the … full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at various seniority levels — from experienced engineers to those ready to step into leadership roles. The Role As a Data Engineering Consultant, you will … Collaborate with stakeholders across development, analytics, and business teams to define and implement components of the data landscape in line with strategic data goals Translate business and end-user needs into robust technical solutions, delivery plans, and architectural designs Build and maintain highly automated, scalable data pipelines using modern cloud-based tools Identify and resolve data More ❯

We are supporting a fast-growing, high-performing investment firm as they expand their lean, agile technology team. This newly created role sits at the intersection of data engineering and business intelligence — offering real ownership, front-to-back exposure, and close interaction with the business. The team is small, collaborative, and strategically embedded within the firm’s data … an opportunity to have impact from day one while helping shape the future of reporting and analytics. Key Responsibilities: Maintain and extend ETL pipelines and support the firm’s data warehouse infrastructure. Work closely with business teams to understand data and reporting needs. Develop and enhance Power BI dashboards and reporting solutions. Assist with modernising and automating legacy … processes. Play a key role in the design, testing, and deployment of new data solutions. Technology Stack: Azure SQL, SSIS, Power BI, PowerShell C# (used for testing automation) Excel/Power Query CI/CD tooling What We’re Looking For: A hands-on data engineer or BI engineer with solid SQL skills and experience in building or More ❯

My client, a leading private capital asset manager, is seeking a talented Data Engineer to join their growing Technology team based in London. As a Data Engineer, you will work at the heart of the firm’s data operations, building robust pipelines, modernising reporting frameworks, and enhancing data automation across business-critical functions. This is a … collaborative, hands-on role interfacing with stakeholders across the business to deliver efficient, scalable data solutions. You’ll join a close-knit and dynamic team with direct exposure to senior leadership and the chance to influence Pollen Street’s data architecture as the firm expands its private credit and equity platforms. Responsibilities Develop and support data pipelines … to ingest, transform and manage data in the data lake and warehouse. Design and deliver insightful MI and BI reports from a variety of sources including SQL databases and Excel. Translate business needs into technical reporting requirements, liaising with users to resolve data queries. Manage and maintain ETL processes and troubleshoot data issues, including log analysis More ❯

Product Owner (Data & Analytics) London Hybrid - 3 days pw onsite £60,000 to £75,000 We currently have an exciting opportunity for a Data Product Owner to join a one-of-a-kind customer centric organisation in the not-for-profit space, whose solutions support customers and their families across the UK. In this role, you’ll drive … the evolution and implementation of data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between business stakeholders, data scientists, analysts … engineers, and governance teams, you'll manage the data product backlog and ensure continuous delivery of data capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. What you'll bring... More ❯

Manager, Data & Analytics, Global Insight (London-based) Hybrid working – Central London office Salary and benefits in line with industry Job Reference J12978 Reporting to: VP, Data & Analytics (New York) About Fremantle Join the place creatives call home! Fremantle is a world leader in creating, producing and distributing across Entertainment, Drama, Film and Documentary content. Our formats are some … in all that we do. The Role and the team Fremantle’s Global Insight Department plays a pivotal role in analysing performance metrics, audience behaviours, and content trends. The Data & Analytics team within this department is responsible for developing and maintaining the company’s performance data infrastructure and delivering actionable insights across a wide range of business areas … using Microsoft Fabric, Power BI, Azure Data Factory and other tools. We are looking for a Manager, Data & Analytics to lead a London-based team within our Insights division, reporting directly to the VP of Data & Analytics based in New York. This is a newly created role designed to oversee the day-to-day running of the More ❯

Senior Engineering Manager - Data (six month FTC) Lead the data platform behind a high-scale, mission-driven consumer product. We’re looking for a Senior Engineering Manager to lead the teams building the foundational data platform for one of the UK’s best known ecommerce companies. You’ll help scale data infrastructure that powers … learning, experimentation, and analytics - supporting millions of users. Location: London surrounds (once a week in office ideally) Salary: £150k+ pro rata What you’ll do Manage and mentor two data infrastructure squads, covering batch and real-time pipelines, data observability, and governance Collaborate with Product, Engineering, Data Science and ML teams to align platform capabilities with … business needs Define and own the roadmap for scalable, privacy-aware, and resilient data systems Promote engineering best practices and long-term system sustainability Embed data quality, observability and governance principles across teams Contribute to hiring, coaching, and growing a high-performing data organisation What you’ll bring Strong experience leading data or platform teams More ❯

Data Architect -Contract Inside IR35 UST are seeking an experienced Data Architect with strong expertise in Google Cloud Platform (GCP) to design and implement scalable data solutions. Location Leeds or London Duration 3 Months Contract Inside IR35 About the role The ideal candidate will have a solid background in data engineering, cloud data architecture … and ETL pipeline development, with a focus on enabling data-driven decision-making across the organization. Key Responsibilities: Design, build, and maintain scalable data pipelines and ETL processes using GCP services such as Cloud Dataflow, Cloud Dataproc, and BigQuery. Implement and optimize data storage solutions utilizing Cloud Storage, Cloud SQL, and Cloud Spanner. Develop and manage data lakes and data warehouses on GCP, ensuring high standards of data quality, availability, and security. Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver efficient data access solutions. Implement robust data governance and security controls to meet regulatory requirements and industry best practices. Automate data workflows and More ❯

Our client a London based Technology and Data Engineering leader have an opportunity in a high growth AI Lab for an ‘AI Engineering Researcher' A UK based 'Enterprise' Artificial Intelligence organisation, focussing on helping accelerate their clients journey towards becoming 'AI-Optimal' - starting with significantly enhancing its abilities in leveraging AI & machine intelligence to outperform traditional competition. … rapidly expanding research team of exceptional PhD computer scientists, software engineers, mathematicians & physicists, to use a unique multi-disciplinary approach to solving enterprise-AI problems. Principal Activities of role: Data Pipeline Development: • Design, develop, and maintain ETL processes to efficiently ingest data from various sources into data warehouses or data lakes. • Data Integration and Management … Integrate data from disparate sources, ensuring data quality, consistency, and security across systems. Implement data governance practices and manage metadata. • System Architecture: Design robust, scalable, and high-performance data architectures using cloud-based platforms (e.g., AWS, Google Cloud, Azure). • Performance Optimization: Monitor, troubleshoot, and optimize data processing workflows to improve performance and reduce latency. More ❯

by Fast Track and published in The Sunday Times each September, celebrates Britain's private mid-market growth companies with the biggest performance. Purpose : We are seeking an experienced Data Engineer to join our growing team. In this role, you will be responsible for overseeing the planning, development, and design of data engineering processes within a customer … facing data warehousing product. This product plays a critical role in delivering analytics solutions for both the State and Commercial sectors. To be successful in this role you will work with the product and engineering team to identify valuable data sources and analyse trends in the data for our customers. You will build predictive models and … work with the engineering team to provide further insights to our customers. You will of course be competent in agile data development, with a focus on innovation and positive disruption. You’ll know how to get the best from a customer facing data warehouse solutions and be able to improve the value of data through research More ❯

owned by the company’s Managing Partners, senior staff, and Oaktree Capital. Find out more about us by visiting our website at: ROLE OVERVIEW: Hartree Partners is growing its data-driven analytics team and is hiring a Statistical Data Scientist to sharpen our view of weather-driven risk and support wider supply-and-demand modelling for power & gas … trading. You will play a pivotal role in shaping our data strategy and driving the development of our modelling approaches. You will collaborate with cross-functional teams to design, implement, and optimize data pipelines and predictive models that inform trading decisions and enhance operational efficiency. RESPONSIBILITIES: Primary Focus: Probabilistic Weather Modelling: Research and prototype probabilistic methods (Bayesian inference … state-space filtering, change-detection tests, etc.) that flag when fresh weather guidance materially diverges from prior outlooks. Continuous Development and Improvement: Calibrate confidence metrics with historical data and measure their value to trading & risk learning models. Continuously improve these models based on real-time data and feedback from trading activities. Model Communication: Explain uncertainty clearly, turning numbers More ❯

and highly skilled Generative AI Architect to lead the design and implementation of advanced AI solutions tailored for professional services. This role requires expertise in AI-driven decision automation , data-driven insights , and scalable architecture to enhance business processes and client outcomes. As a key member of our team, you will architect solutions that learn, reason, and make intelligent … optimize AI algorithms for predictive analytics, recommendation engines, and automation in professional services. Apply machine learning (ML) and deep learning (DL) techniques to enhance decision-making and business intelligence. Data Engineering & Integration Architect robust data pipelines to support AI model training and inference. Implement automated data collection, integration, cleansing, and transformation techniques to ensure high-quality … data inputs. Collaborate with data engineering teams to align AI solutions with real-world business applications. AI Model Training, Evaluation & Performance Optimization Train AI models using supervised, unsupervised, and reinforcement learning techniques , refining them based on business insights . Define model performance metrics to ensure AI solutions deliver tangible value. Real-Time AI Applications & System Integration Work More ❯