1 to 25 of 158 Permanent Data Engineering Jobs in the City of London

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working … with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules More ❯

Job title: Sr. Data Engineer Will the role be 100% remote, hybrid or 100% office? Hybrid – 3 days/week If the role is hybrid/office based specify location: London, UK Duration of assignment: 3 months contract InsideIR35 Role description: As a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining scalable … data pipelines, ensuring high-quality data is available for decision-making across the business. You’ll collaborate closely with data architects, product teams, analysts, and data scientists to implement data solutions that power analytics and reporting. The ideal candidate will have strong experience in data engineering, cloud platforms like DBT, Azure/AWS … data modeling, and ETL/ELT processes. You’ll be part of a dynamic and innovative team, working on cutting-edge technologies to deliver impactful data products for our retail chain Key responsibilities: ETL Pipeline Development: Develop, optimize, and maintain ETL pipelines to efficiently extract, transform, and load data from various sources, ensuring high data quality. More ❯

Job Title: Data Engineering Consultant Locations: London/Bristol/Manchester Salary: Competitive salary and package (Depending on level of experience) Please Note: Any offer of employment is subject to satisfactory BPSS and SC security clearance which requires 5 years continuous UK address history (typically including no periods of 30 consecutive days or more spent outside of the … clients and with the communities in which we work and live. It is personal to all of us.” – Julie Sweet, Accenture CEO Key responsibilities Implement ETL pipelines and orchestrate data flows using batch and streaming technologies based on software engineering best practice Define, document and iterate data mappings based on concepts and principles of data modelling … Re-engineer data pipelines to be scalable, robust, automatable, and repeatable Navigate, explore and query large scale datasets Build processes supporting data transformation, data structures, metadata, dependency and workload management Identify and resolve data issues including data quality, data mapping, database and application issues Implement data flows to connect operational systems, data More ❯

Data Engineer - Leading Energy Company - London (Tech Stack: Data Engineer, Databricks, Python, PySpark, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) Company Overview: Join a dynamic team, a leading player in the energy sector, committed to innovation and sustainable solutions. Our client are seeking a talented Data Engineer to help build and optimise our data infrastructure, enabling them to harness the power of data-driven insights to drive our business forward. Responsibilities: Design and develop a cutting-edge data warehouse capable of efficiently ingesting and organising large volumes of data from multiple sources. Champion best practices in data architecture governance, ensuring compliance with security and privacy regulations. Implement automated, scalable … data migration processes across various project phases. Conduct rigorous data quality assessments, employing cleansing and validation techniques as needed. Construct robust data pipelines for cleaning, transforming, and aggregating diverse datasets. Collaborate closely with software development and product teams to align data strategies with business objectives. Stay abreast of emerging trends and technologies in data engineering More ❯

platform, we are looking for a Head of BI to lead our global Business Intelligence organisation. This key leadership role is aligned with our strategy - a modular, cloud-native data-centric architecture designed to democratise data access, strengthen governance, and maximise business value. Key Responsibilities : Lead the global BI organisation across APAC, EMEA, and the AMERICAS , with direct … roadmap in line with our overall technology strategy and business imperatives. Oversee the transition and integration from legacy BI platforms to the Next Generation BI ecosystem . Ensure robust data governance, including a centralised data catalogue, data quality, compliance, and access management. Manage global teams across Data Engineering, Reporting, Data Governance, and Advanced Analytics … fostering an agile, value-driven, and innovation-focused culture. Collaborate with business and IT stakeholders (Data Owners, Product Owners, Business Leaders) to position data as a core strategic asset. Oversee BI delivery KPIs, service performance and budgets, ensuring high quality of service and alignment with organisational goals. Promote a data-driven culture through the adoption of self More ❯

Job Title: Principal Data Engineer Location: London, UK – Hybrid (Liverpool Street office) Department: Data & Engineering Reports To: Head of Data Science Employment Type: Permanent A leading global payments and fintech platform , empowering clients to innovate and scale. Their mission is to create frictionless, secure, and intelligent payment solutions that unlock value across banking, financial services, and … digital assets. As they continue to scale their data infrastructure , they’re seeking a seasoned Principal Data Engineer to help design, build, and optimise a modern data platform, with a focus on orchestration (Airflow), scalable data warehouse architecture, and high-performance pipelines. The ideal candidate will bring both technical depth and strategic thinking , with the ability … to communicate effectively across business and technical teams. Key Responsibilities Design and lead the development of scalable, secure, and high-performance data warehouse solutions for BI and analytics. Define and drive the long-term architecture and data strategy in alignment with business goals. Own orchestration of ETL/ELT workflows using Apache Airflow , including scheduling, monitoring, and alerting. More ❯

Senior Data Engineering Consultant - MS Fabric - London - Hybrid - £80k My client are an emerging Microsoft-partnered consultancy looking to expand their data engineering team. If you are an expert data engineer with Microsoft products and a consultancy background, this should be a great fit for you. Salary and Benefits Competitive salary of up to £80k … Hybrid working (2-3 days in London-based office) Competitive annual leave package Private medical care Health insurance And many more Role and Responsibilities Possess a wide range of data engineering skills, with a focus on having delivered in Microsoft Fabric Develop good working relationships with clients on a project including interpersonal skills with both business and technical … focused colleagues. Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment. Delivering high-quality pieces of work, proven ability to escalate problems to client/senior team members where necessary and propose possible solutions. Support building the Consulting practice through contribution to ongoing initiatives. This can include contributing to knowledge More ❯

As a Senior Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Airflow, etc.) and automation. The Senior Data Engineer will work closely with the data, Architecture, Business Analyst, Data Stewards to integrate and … align requirements, specifications and constraints of each element of the requirement. They will also need to help identify gaps in resources, technology, or capabilities required, and work with the data engineering team to identify and implement solutions where appropriate. Work type: Contract Length: initial 6 months Work structure: hybrid 2 days a week in London. Primary Responsibilities: Integrate … data from multiple on prem and cloud sources and systems. Handle data ingestion, transformation, and consolidation to create a unified and reliable data foundation for analysis and reporting. Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and More ❯

Job Title: Data Engineer (Fabric, Synapse & ADF) Location: Remote (UK-based candidates only) Contract: 3–6 Month Rolling Contract IR35 Status: Outside IR35 Day Rate: £500–£600 per day Overview: We’re looking for an experienced Data Engineer to join a dynamic team working across a variety of exciting data projects. This role involves a blend of … greenfield builds, brownfield enhancements, and support of existing solutions, giving you the chance to work across the full data engineering lifecycle. This is a remote-based position, open to UK-based candidates only, and is offered on an Outside IR35 basis. Key Responsibilities: Design, build, and maintain scalable data pipelines using Microsoft Fabric, Azure Synapse, and Azure … Data Factory (ADF). Develop and optimise ETL/ELT processes to support business intelligence and analytics solutions. Collaborate with data architects, analysts, and stakeholders to understand business requirements and translate them into technical solutions. Contribute to the modernisation of legacy data platforms and assist in greenfield implementations. Ensure data quality, governance, and security best practices More ❯

Job Title: Senior Data Engineer Location: Abu Dhabi Job Summary: As a Senior Data Engineer , you will be responsible for designing, developing, and maintaining advanced, scalable data systems that power critical business decisions. You will lead the development of robust data pipelines, ensure data quality and governance, and collaborate across cross-functional teams to deliver … high-performance data platforms in production environments. This role requires a deep understanding of modern data engineering practices, real-time processing, and cloud-native solutions. Key Responsibilities: Data Pipeline Development & Management: Design, implement, and maintain scalable and reliable data pipelines to ingest, transform, and load structured, unstructured, and real-time data feeds from diverse … sources. Manage data pipelines for analytics and operational use , ensuring data integrity, timeliness, and accuracy across systems. Implement data quality tools and validation frameworks within transformation pipelines. Data Processing & Optimization: Build efficient, high-performance systems by leveraging techniques like data denormalization , partitioning , caching , and parallel processing . Develop stream-processing applications using Apache Kafka and More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents at … to demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and storage More ❯

including day-to-day life at Clarksons, visit us at www.clarksons.com Role Summary As part of the Digital Transformation team, you will be helping us build the best shipping data platform and reporting, enabling us to provide accurate and timely insights to the business and our clients. We’ve been building out a central data platform for the … its worth. We are now looking for an individual to help scale the platform and accelerate its roll out across the business. What you’ll be doing Work with data engineers & analysts to problem solve, build & deliver data products from ideation to production. Lead and own the full lifecycle of data engineering deliverables. Deliver complex data flows to process external data sources to provide the company with a competitive edge. Act as a consultant to the business to meet their needs. Maintain existing data products to ensure reliability and high data quality to maximise the utility of data within the business. Innovate by recommending opportunities to improve data engineering More ❯

Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to some of the most complex infrastructure projects across the UK and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock the … full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at various seniority levels — from experienced engineers to those ready to step into leadership roles. The Role As a Data Engineering Consultant, you will … Collaborate with stakeholders across development, analytics, and business teams to define and implement components of the data landscape in line with strategic data goals Translate business and end-user needs into robust technical solutions, delivery plans, and architectural designs Build and maintain highly automated, scalable data pipelines using modern cloud-based tools Identify and resolve data More ❯

We are supporting a fast-growing, high-performing investment firm as they expand their lean, agile technology team. This newly created role sits at the intersection of data engineering and business intelligence — offering real ownership, front-to-back exposure, and close interaction with the business. The team is small, collaborative, and strategically embedded within the firm’s data … an opportunity to have impact from day one while helping shape the future of reporting and analytics. Key Responsibilities: Maintain and extend ETL pipelines and support the firm’s data warehouse infrastructure. Work closely with business teams to understand data and reporting needs. Develop and enhance Power BI dashboards and reporting solutions. Assist with modernising and automating legacy … processes. Play a key role in the design, testing, and deployment of new data solutions. Technology Stack: Azure SQL, SSIS, Power BI, PowerShell C# (used for testing automation) Excel/Power Query CI/CD tooling What We’re Looking For: A hands-on data engineer or BI engineer with solid SQL skills and experience in building or More ❯

My client, a leading private capital asset manager, is seeking a talented Data Engineer to join their growing Technology team based in London. As a Data Engineer, you will work at the heart of the firm’s data operations, building robust pipelines, modernising reporting frameworks, and enhancing data automation across business-critical functions. This is a … collaborative, hands-on role interfacing with stakeholders across the business to deliver efficient, scalable data solutions. You’ll join a close-knit and dynamic team with direct exposure to senior leadership and the chance to influence Pollen Street’s data architecture as the firm expands its private credit and equity platforms. Responsibilities Develop and support data pipelines … to ingest, transform and manage data in the data lake and warehouse. Design and deliver insightful MI and BI reports from a variety of sources including SQL databases and Excel. Translate business needs into technical reporting requirements, liaising with users to resolve data queries. Manage and maintain ETL processes and troubleshoot data issues, including log analysis More ❯

Product Owner (Data & Analytics) London Hybrid - 3 days pw onsite £60,000 to £75,000 We currently have an exciting opportunity for a Data Product Owner to join a one-of-a-kind customer centric organisation in the not-for-profit space, whose solutions support customers and their families across the UK. In this role, you’ll drive … the evolution and implementation of data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between business stakeholders, data scientists, analysts … engineers, and governance teams, you'll manage the data product backlog and ensure continuous delivery of data capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. What you'll bring... More ❯

user base. The role is to define and set up a greenfield standardized MLOps framework for capital markets and set up all the tools and best practices to educate data scientists and equip them with the right tools and expertise. You MUST be hands on. A strong understanding of Devops, Machine learning and Data engineering is required … such, you will gain exposure to lots of different business areas and business stakeholders, so relationship building and good communication will be key. You will bring a expertise in data science or data engineering, with a specific focus on MLOps for at least 2 years . This platform is critical and will be rolled out across the … that handle very large datasets. You will be responsible for building out a greenfield standaridised framework for Capital markets. The core platform is built on Azure Databricks Lakehouse, consolidating data from various front and Middle Office systems to support BI, MI, and advanced AI/ML analytics. As a lead, you will shape the MLOps framework and establish best More ❯

Our client a London based Technology and Data Engineering leader have an opportunity in a high growth AI Lab for an ‘AI Engineering Researcher' A UK based 'Enterprise' Artificial Intelligence organisation, focussing on helping accelerate their clients journey towards becoming 'AI-Optimal' - starting with significantly enhancing its abilities in leveraging AI & machine intelligence to outperform traditional competition. … rapidly expanding research team of exceptional PhD computer scientists, software engineers, mathematicians & physicists, to use a unique multi-disciplinary approach to solving enterprise-AI problems. Principal Activities of role: Data Pipeline Development: • Design, develop, and maintain ETL processes to efficiently ingest data from various sources into data warehouses or data lakes. • Data Integration and Management … Integrate data from disparate sources, ensuring data quality, consistency, and security across systems. Implement data governance practices and manage metadata. • System Architecture: Design robust, scalable, and high-performance data architectures using cloud-based platforms (e.g., AWS, Google Cloud, Azure). • Performance Optimization: Monitor, troubleshoot, and optimize data processing workflows to improve performance and reduce latency. More ❯

Data Engineer – Data Consultancy A forward-thinking UK-based data consultancy is seeking talented Data Engineers to help clients unlock the full potential of their data assets. In this role, you’ll be instrumental in guiding organisations through the evolving landscape of data strategy, engineering, and analytics Key Responsibilities: Forge strong partnerships with … bridging the gap between business needs and technical solutions. Deliver high-impact work with precision, proactively identifying challenges and proposing smart, scalable solutions. Architect and maintain resilient, high-performance data pipelines (ETL/ELT) to ingest, transform, and deliver data from diverse sources. Required Skills & Experience: Deep expertise in building and deploying data solutions using platforms like … Databricks (Azure/AWS) , Microsoft Fabric , Azure Data Factory , and Azure Synapse . Solid experience with the Microsoft data stack —including SSIS , SSAS , and SSRS . A strong foundation in data disciplines such as governance , architecture , modelling , data lakes , warehousing , MDM , and BI . Advanced skills in SQL and Python , with hands-on experience in relational More ❯

by Fast Track and published in The Sunday Times each September, celebrates Britain's private mid-market growth companies with the biggest performance. Purpose : We are seeking an experienced Data Engineer to join our growing team. In this role, you will be responsible for overseeing the planning, development, and design of data engineering processes within a customer … facing data warehousing product. This product plays a critical role in delivering analytics solutions for both the State and Commercial sectors. To be successful in this role you will work with the product and engineering team to identify valuable data sources and analyse trends in the data for our customers. You will build predictive models and … work with the engineering team to provide further insights to our customers. You will of course be competent in agile data development, with a focus on innovation and positive disruption. You’ll know how to get the best from a customer facing data warehouse solutions and be able to improve the value of data through research More ❯

twentyAI are partnering with a globally renowned law firm currently undergoing a major digital and data transformation. With a deep-rooted legacy in legal excellence and a strong global footprint, the firm is currently modernising their data capability and building a new data platform. About the Role You will be part of a diverse group of engineers … and machine learning experts, working with cutting-edge Azure cloud technologies, including Microsoft Fabric and related services. Your mission is to design reliable, efficient data pipelines that enable the business to access trusted, well-structured data. You will also focus on building and scaling the core data infrastructure that supports advanced analytics and machine learning efforts across the … business. Responsibilities Design and develop end-to-end data pipelines that ingest, transform, and prepare data for analytics and machine learning workflows. Work with Infrastructure as Code, primarily Terraform, to automate and manage cloud infrastructure, enabling repeatable and reliable deployment processes. Collaborate closely with data scientists, MLEs, and business teams in an agile environment to deliver data More ❯

Synechron is looking for a Senior Data Engineer to join their Data and AI Practice to work on a multi - year, AI programme of work within a leading financial institution. Role Overview: We are seeking a talented Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. Your work will ensure reliable, efficient, and … secure data flow across systems, enabling advanced analytics, reporting, and business insights. Key Responsibilities: Develop and optimise data pipelines Build and maintain data infrastructure on cloud platforms (Azure) Collaborate with data scientists and analysts to support data workflows Ensure data security, reliability, and performance at scale Monitor and troubleshoot data pipelines and systems … Qualifications & Skills: x5 + experience with Python programming for data engineering tasks Strong proficiency in SQL and database management Hands-on experience with Databricks and Apache Spark Familiarity with Azure cloud platform and related services Knowledge of data security best practices and compliance standards Excellent problem-solving and communication skills Multi-Year Project - Flexible Start Date - Competitive More ❯

Managing Partners, senior staff, and Oaktree Capital. Find out more about us by visiting our website at: http://www.hartreepartners.com/ROLE OVERVIEW: Hartree Partners is growing its data-driven analytics team and is hiring a Statistical Data Scientist to sharpen our view of weather-driven risk and support wider supply-and-demand modelling for power & gas … trading. You will play a pivotal role in shaping our data strategy and driving the development of our modelling approaches. You will collaborate with cross-functional teams to design, implement, and optimize data pipelines and predictive models that inform trading decisions and enhance operational efficiency. RESPONSIBILITIES: Primary Focus: Probabilistic Weather Modelling: Research and prototype probabilistic methods (Bayesian inference … state-space filtering, change-detection tests, etc.) that flag when fresh weather guidance materially diverges from prior outlooks. Continuous Development and Improvement: Calibrate confidence metrics with historical data and measure their value to trading & risk learning models. Continuously improve these models based on real-time data and feedback from trading activities. Model Communication: Explain uncertainty clearly, turning numbers More ❯

and highly skilled Generative AI Architect to lead the design and implementation of advanced AI solutions tailored for professional services. This role requires expertise in AI-driven decision automation , data-driven insights , and scalable architecture to enhance business processes and client outcomes. As a key member of our team, you will architect solutions that learn, reason, and make intelligent … optimize AI algorithms for predictive analytics, recommendation engines, and automation in professional services. Apply machine learning (ML) and deep learning (DL) techniques to enhance decision-making and business intelligence. Data Engineering & Integration Architect robust data pipelines to support AI model training and inference. Implement automated data collection, integration, cleansing, and transformation techniques to ensure high-quality … data inputs. Collaborate with data engineering teams to align AI solutions with real-world business applications. AI Model Training, Evaluation & Performance Optimization Train AI models using supervised, unsupervised, and reinforcement learning techniques , refining them based on business insights . Define model performance metrics to ensure AI solutions deliver tangible value. Real-Time AI Applications & System Integration Work More ❯

tools for musicians and artists to use to promote their music. At un:hurd music, we've created a music-tech platform that uses proprietary technology to turn music data into stronger promotional campaigns for artists. We've created both mobile and web applications which act as the 'digital marketing companion' for independent artists, facilitating data-led promotional … hire responsible for the software development and technical infrastructure needed to design, train, deploy and scale machine learning models in production environments. You will harness a diverse array of data sources, from streaming services to social media, revolutionizing the way artists promote their music. Our Data Team members are full stack data professionals who independently manage projects … across the complete spectrum, from raw data ingestion to deployment, monitoring, and optimization. While this role emphasizes data engineering and ML deployment, you will have the responsibility of managing projects with autonomy across the full data lifecycle. Responsibilities📝 As an ML Engineer at Un:hurd music, you'll be: MLOps and Model Deployment : Own the deployment More ❯