1 to 25 of 209 Data Engineering Jobs in London

company that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … We're underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP, but we also work on systems More ❯

London - Lead Solutions Data Architect, Data Engineering Ekimetrics UK Job Description About Ekimetrics Ekimetrics is a leader in data science and AI, specialising in Marketing Effectiveness, Customer Analytics and business optimisation since 2006. We have pioneered the use of AI to drive sustainable growth, helping companies across industries like retail, banking, luxury fashion, insurance and many … more to maximise their data potential. Our goal: Combine high-impact AI and data science solutions for sustainable business performance. Our approach combines cutting-edge technology with a deep understanding of business challenges, ensuring that our solutions not only meet current needs but also pave the way for future innovations. At Ekimetrics, your work will directly contribute to … shaping the future of data-driven decision-making in a sustainable, ethical manner. About the Role Based in London and reporting to our Head of Data Engineering, you will lead large-scale digital transformations, building bespoke analytics solutions to answer clients' key questions, develop solutions around Geni AI, and consult on the findings, including high-profile presentations More ❯

is at the forefront of industrialized, AI-enabled drug discovery and development. We are seeking a highly skilled and experienced Staff Engineer to join our team, focusing on critical data engineering initiatives within our late-stage discovery and early clinical phases. This role is pivotal in building robust, scalable, and compliant data pipelines and systems that accelerate … our scientific and clinical endeavors. The ideal candidate will possess a deep understanding of modern data engineering practices, distributed computing frameworks, and the unique challenges of data management in a highly regulated environment. You will be instrumental in designing, implementing, and optimizing data workflows that empower our scientific and clinical teams, ensuring data integrity, accessibility … and regulatory readiness (GxP). In this role, you will: Architect and Implement Scalable Data Pipelines: Design, build, and maintain high-performance, fault-tolerant data pipelines for processing large-scale scientific and clinical datasets. Drive Data Engineering Best Practices: Establish and champion best practices for data modeling, ETL/ELT processes, data quality, and More ❯

and it is deeply rooted throughout our work, to elevate and bring to life our differences throughout the platform world Overview We are seeking an experienced and highly skilled Data Engineering Technical Lead to drive the design, development, and optimization of our cloud-based data platforms and solutions. This role will be a blend of hands on … technical development, leading the engineering team and also input into design and strategy decisions. Initially there will be a focus on GCP but will also involve working extensively with Snowflake and Databricks, as well as other modern cloud and data engineering tools. As the technical leader for the data engineering function, you will define architectural … standards, mentor engineers, and collaborate with cross-functional teams to ensure scalable, reliable, and high-performance data solutions. You will be responsible for guiding the evolution of our data infrastructure, enabling advanced analytics, and ensuring data quality and accessibility across the organization. The ideal candidate will have had essential hands-on experience building pipelines in Python, analysing More ❯

Risk Reporting Data Engineering Lead Central London/Hybrid Financial Risk Data/Data Analytics/International Banking Base salary: c. £135k + bonus + comprehensive bens. As a tech recruitment partner for this international bank, we're assisting in hiring a Technical Lead for the Risk Reporting team, which involves designing technologies for data warehousing, mining, BI, and reporting. Are You Ready to Lead in a Fast-Paced, Global Environment? The client seeks a Data & Analytics Engineering Lead to head an international team (10-15 members), driving innovation in Risk Reporting. As the organisation evolves with regulations and tech, they need someone with strong technical leadership, a passion for data … Main Purpose Lead and develop a high-performing team of 10-15 Engineers delivering robust, scalable risk reporting solutions globally. Key Responsibilities Mentor an international team focused on risk data ingestion, transformation, and reporting. Act as SME in database and reporting solutions, working with Risk stakeholders to meet business needs. Design innovative, fault-tolerant systems for large-scale data More ❯

Data Engineering Lead (Azure) London (3 days in office) Up to £105,000 + 5% Bonus + Benefits Are you ready to take the lead on building a cutting-edge data platform? We're seeking a Data Engineering Lead to shape and grow data engineering capabilities at a global, forward-thinking organisation. This … architect a modern Azure-based platform, lead a talented team, and make a direct impact on business-wide decision making. Why this role? Spearhead the creation of a new data platform from the ground up. Balance hands-on engineering with team leadership and mentoring. Collaborate with analysts, data scientists, and business leaders to deliver impactful solutions. Hybrid … week , remote flexibility the rest. Join a supportive and inclusive culture, with a global footprint and a focus on innovation. What you'll be doing: Designing and building scalable data pipelines to support analytics, reporting, and machine learning. Leading the implementation of Azure data solutions and ensuring robust ETL/ELT processes. Defining architecture strategies that allow for More ❯

AWS Data Engineer - VP Level Location: London (Canary Wharf)Salary: £115000 - 120000 A leading financial institution is seeking a Senior AWS Data Engineer to join a greenfield initiative focused on transforming market data access and utilization. This VP-level role offers strategic influence, technical leadership, and cross-functional collaboration across business units. Key Responsibilities:* Design and maintain … scalable data pipelines, warehouses, and lakes using AWS technologies.* Implement robust data governance, quality, and security practices.* Collaborate with data scientists to deploy machine learning models.* Lead or contribute to strategic planning, risk management, and stakeholder engagement.* Drive innovation through advanced analytics and research-based problem solving. To be successful you should have: 10 years hands-on … experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Previous experience in implementing best practices for data engineering, including data governance, data quality, and data security. Proficiency in data processing and analysis using Python and SQL. Experience with data More ❯

AWS Data Engineer - VP Level Location: London (Canary Wharf) Salary: £(phone number removed) - (phone number removed) A leading financial institution is seeking a Senior AWS Data Engineer to join a greenfield initiative focused on transforming market data access and utilization. This VP-level role offers strategic influence, technical leadership, and cross-functional collaboration across business units. Key … Responsibilities: * Design and maintain scalable data pipelines, warehouses, and lakes using AWS technologies. * Implement robust data governance, quality, and security practices. * Collaborate with data scientists to deploy machine learning models. * Lead or contribute to strategic planning, risk management, and stakeholder engagement. * Drive innovation through advanced analytics and research-based problem solving. To be successful you should have … years hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Previous experience in implementing best practices for data engineering, including data governance, data quality, and data security. Proficiency in data processing and analysis using Python and SQL. More ❯

LocationBloomsbury Square, London, United Kingdom# Technology Architect - Data Engineering at N Consulting LtdLocationBloomsbury Square, London, United KingdomSalary£400 - £500/dayJob TypeContractDate PostedSeptember 17th, 2025Apply Now We're Hiring: Technology Architect - Data Engineering (Hybrid - London) Contract: 6 months Work Mode: Hybrid (12 days WFO/month)We are looking for an experienced Technology Architect with deep … expertise in PySpark, ADF, and Databricks to lead and design data engineering solutions for our client. What You'll Do: Lead technical design using Medallion architecture and Azure ServicesCreate conceptual diagrams, source-to-target mapping, and dimensional data modelsGuide the data engineering team on development with ADF, Databricks, Python, JSON, and YAMLImplement performance optimization strategies … during data transformationDeploy code artifacts using GitHub Workflows/CI-CD pipelines Collaborate effectively with team members and stakeholdersOptional: Work with Log Analytics and KQL queries Must-Have Skills: 10+ years of experience in Data Engineering Hands-on experience with PySpark, ADF, Databricks, SQL Strong understanding of dimensional modeling, normalization, schema design, and data harmonization Experience More ❯

Data Engineering Technical Lead Global Investment Bank London - Hybrid Permanent - Excellent Package + Benefits We are working with one of the world's leading banking groups, who we have partnered with for 15 years. We are seeking an experienced Data Architect/EDM Developer/Data Engineering Lead to join their International Technology team in … London. You will be a key part of the Architecture, Middleware, Data & Enterprise Services (AMD) division, driving data engineering, integration and automation initiatives across MUFG's EMEA banking and securities entities. This is a hands-on leadership role, combining technical expertise with mentoring and team leadership. Key Responsibilities Architect, design and deliver enterprise-wide EDM and data solutions. Lead and mentor EDM developers, ensuring high-quality, cost-effective delivery. Drive data innovation, automation and best practices across EMEA. Translate business requirements into functional and technical designs. Ensure compliance with SDLC, governance, and risk policies. Skills & Experience - Essential Strong SQL Server or Snowflake skills. Advanced knowledge of low-code/no-code data engineering More ❯

Data Engineering Technical Lead Global Investment Bank London - Hybrid Permanent - Excellent Package + Benefits We are working with one of the world's leading banking groups, who we have partnered with for 15 years. We are seeking an experienced Data Architect/EDM Developer/Data Engineering Lead to join their International Technology team in … London. You will be a key part of the Architecture, Middleware, Data & Enterprise Services (AMD) division, driving data engineering, integration and automation initiatives across MUFG's EMEA banking and securities entities. This is a hands-on leadership role, combining technical expertise with mentoring and team leadership. Key Responsibilities Architect, design and deliver enterprise-wide EDM and data solutions. Lead and mentor EDM developers, ensuring high-quality, cost-effective delivery. Drive data innovation, automation and best practices across EMEA. Translate business requirements into functional and technical designs. Ensure compliance with SDLC, governance, and risk policies. Skills & Experience - Essential Strong SQL Server or Snowflake skills. Advanced knowledge of low-code/no-code data engineering More ❯

Join our rapidly expanding team as a hands-on Cloud Data Analytics Platform Engineer and play a pivotal role in shaping the future of data at Citi. We're building a cutting-edge, multi-cloud data analytics platform that empowers our users with secure, scalable, and efficient data insights. This role sits at the intersection of … infrastructure, data engineering, and architecture, offering a unique opportunity to work with the latest cloud-native technologies and influence our data strategy. This is a hands-on role requiring deep technical skills and a passion for building and optimizing data platforms. What You'll Do: Architect and Build: Design and implement a robust, cloud-native data … other emerging cloud environments. You'll leverage services like S3/GCS, Glue, BigQuery, Pub/Sub, SQS/SNS, MWAA/Composer, and more to create a seamless data experience. (Required) Data Lake , Data Zone, Data Governance: Design, build, and manage data lakes and data zones within our cloud environment, ensuring data More ❯

Data Services Manager, Must live within 2 hours of London and be able to come in for ad-hoc meetings when required. Primarily home based though. Role 90% management and 10% technical and you will manage a team of 6. Salary £ 80000 - 85000 + good benefits. Expanding financial services client are looking for a Data Services Manager to … of years and is looking to further develop their management career. Guiding a team of 6 you will be responsible for supporting the day to day operations of the data function, with a focus on leading and mentoring data engineers to deliver high quality, scaleable data solutions. Working across the business with multiple stakeholders you will design … and continually improve data solutions A critical aspect of this role is Data Governance, Data Quality and Data Management practices, ensuring the business meet regulatory obligations and manage risk. You must have therefore worked in a regulated environment, ideally financial services. Accountabilities include - Technical leadership - provide technical leadership for the high performing data engineering More ❯

a uniquely collaborative model across the firm and throughout all levels of the client organization, generating results that allow our clients to thrive. What You'll Do Join the Data Layer Team, a global portfolio transforming our organization into a data-driven enterprise! The Data Layer Team is a portfolio of 30 people who build essential data platforms, products, and capabilities to empower our clients and colleagues with high-quality, actionable insights. Our focus is on creating scalable data solutions and advancing our data infrastructure to drive informed decision-making across the company. As Use Case Enablement Product Analyst within BCG's Data Layer Team, you will collaborate with Use Case Enablement Product … Owner and cross-functional teams to gather and analyze business and data requirements. Your role is critical to bridging the gap between business stakeholders and technical teams, ensuring that new GenAI use cases are well-scoped, feasible, and aligned with user needs. You will work with various Gen AI use cases and applications, including: Consultant Journey - internal GenAI assistants More ❯

combine private and commercial banking, wealth planning and investment management. We believe in traditional relationship and service-led banking powered by modern technology. Job purpose Develop and maintain complex data systems that support the Bank's operations and reporting needs, ensuring they meet all essential data requirements, following strong engineering and automation best practices and collaborating with … the Technical Lead for Data Engineering to develop innovative solutions that address business needs. As a Senior Data Engineer this person will also play a key role in the development of less experienced members of the team day to day. To place the interests of customers at the centre of all activities, act in a way that … is consistent with achieving good outcomes for consumers; and to comply with the FCA and PRA's Conduct Rules. Key Responsibilities The development of data ingest, transformation, analytics, and data publishing pipelines, facilitating complex data transformations to meet business requirements, ensuring optimal performance and efficiency of the data platform. Support for the live platform day to More ❯

Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing … overseeing a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. You will collaborate with stakeholders to understand their … strategic objectives and identify opportunities to leverage data and data quality. You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems. You will collaborate with More ❯

and employees in multiple countries committed to serving patients worldwide. Please visit for more information. The Principal will be responsible for supporting complex or leading singular projects related to data engineering requirements and initiatives across Jazz Research and Development. The Principal will support data projects from across the business including Clinical, Pre-Clinical, Non-Clinical, Chemistry, RWD … and Omics. Essential Functions Support the design, development and maintenance of data pipelines for processing Research and Development data from diverse sources (Clinical Trials, Medical Devices, Pre-Clinical, Omics, Real World Data) utilizing the AWS technology platform. Create and optimize ETL/ELT processes for structured and unstructured data using Python, R, SQL, AWS services and … other tools. Build and maintain data repositories using AWS S3 and FSx technologies. Establish data warehousing solutions using Amazon Redshift. Build and maintain standard data models. Develop data quality frameworks, validation processes and KPIs to ensure accuracy and consistency of data pipelines. Implement data versioning and lineage tracking to support data traceability, regulatory More ❯

As a Senior Data Engineer specializing in Natural Gas and Power, you will support the design, development, and optimization of advanced data infrastructure and products that support critical trading, risk, and market analytics functions. You will collaborate closely with traders, quantitative analysts, risk managers, and IT stakeholders to ensure data systems are scalable, secure, and aligned with … the strategic goals of the energy business. In addition to hands-on engineering, you will play a pivotal role supporting the data architecture roadmap, mentoring junior engineers, and driving innovation in data-driven decision-making across the Natural Gas and Power value chain. This role reports to the Data Engineer Lead. Main Responsibilities Data Architecture … Engineering Leadership Architect and implement robust, scalable, and secure data pipelines and platforms tailored to the needs of Natural Gas and Power trading, including real-time market data ingestion, time-series storage, and high-frequency analytics. Lead the design and governance of data models that support complex trading strategies, asset optimization, and regulatory reporting. Ensure data More ❯

and defeat diseases. Join us in our commitment to uniting science, technology, and talent to get ahead of disease together. Project Details At GSK, we want to supercharge our data capability to better understand our patients and accelerate our ability to discover vaccines and medicines. The Onyx Research Data Platform organization represents a major investment by GSK R … D and Digital & Tech, designed to deliver a step-change in our ability to leverage data, knowledge, and prediction to find new medicines.We are a full-stack shop consisting of product and portfolio leadership, data engineering, infrastructure and DevOps, data/metadata/knowledge platforms, and AI/ML and analysis platforms, all geared toward: Building … a next-generation, metadata- and automation-driven data experience for GSK’s scientists, engineers, and decision-makers, increasing productivity and reducing time spent on “data mechanics”. Providing best-in-class AI/ML and data analysis environments to accelerate our predictive capabilities and attract top-tier talent. Aggressively engineering our data at scale, as More ❯

Data Solution Architect - Azure, ADF, Snowflake, Insurance £Market rate (Inside IR35) London/Hybrid 6 Months My client is an instantly recognisable Insurance brand who urgently require a Data Solution Architect with expertise in Data Modelling, Data Engineering Design, strong Azure stack (including Data Factory (ADF), Data Lake Storage, SQL, Azure ML and … Power BI), Snowflake and Enterprise scale Data Sources to join a business-critical Programme ASAP. Key Requirements: Proven expertise in Data Solution Architecture working on large, complex Data Programmes Strong Data Modelling experience (especially Conceptual Data Models) Demonstrable background in Data Engineering Design processes (ETL, ELT), with good knowledge of Data Vault … Inmon and Kimball Strong knowledge of MS Azure stack (including Data Factory (ADF), Data Lake Storage, SQL, Azure ML and Power BI) Proven experience with Snowflake Architecture, including DevOps integration and CI/CD practices Previous experience with large, Enterprise scale Data sets and sources Strong understanding of Data Governance principles (Data stewardship, Data More ❯

Job summary Data Engineering Team supports decision-making within the Trust through the provision of a comprehensive information and analysis service by managing and optimizing the flow, storage, and accessibility of data from clinical\non-clinical systems within the Trust. The post holder plays a pivotal role in ensuring that data flows smoothly, remains consistent, and … is available for decision-making, insights and analytics. Main duties of the job The post holder will contribute to the smooth transition of the onsite data warehouse solutions into a more efficient, scalable and secure cloud infrastructure while supporting the current data platform and infrastructure. The post holder plays a pivotal role in ensuring that data flows … smoothly, remains consistent, and is available for decision-making, insights and analytics. The post holder will also be responsible for maintaining the current data warehouse solutions by ensuring operational efficiency, routine maintenance, issue resolution, monitoring and reporting About us St George's University Hospitals NHS Foundation Trust is one of the country's principal teaching hospitals and our main More ❯

into the next exciting chapter: integrating advanced artificial intelligence to redefine how robotics can transform healthcare. About the Role We are looking for a talented and mission-driven Senior Data Engineer to design and maintain scalable data infrastructure for real-time, image-guided medical robotics applications. You will work hands-on with AI scientists, clinical and imaging specialists … building robust data pipelines that power AI workflows and integrate seamlessly with our robotic systems Key Responsibilities Design and implement scalable data pipelines for real-time and batch processing Build and maintain data lakes, warehouses, and streaming platforms Develop architectures that support AI workflows and integration with clinical/robotic software Data Operations and Quality Ensure … reliability, scalability, and high performance of data systems Implement data versioning, lineage tracking, and reproducibility practices Define data engineering standards and best practices aligned with medical device requirements Monitor data quality, availability, and integrity across platforms Manage backups, disaster recovery, and incident response Compliance & Governance Ensure compliance with healthcare data privacy regulations (GDPR, HIPAA More ❯

Principal Data Engineer - Core Systems Team Hybrid in London/Remote within UK The company Imagine a world where every small business has the power to thrive. That's the world we're building at iwoca. Small businesses aren't just statistics - they're the heartbeat of our communities, the character of our high streets, and the engine of … s leading fintech innovators. But we're just getting started. Our mission? To empower one million businesses with the financial tools they deserve. We combine cutting-edge technology and data science with genuine human understanding to make finance feel less like a barrier and more like a superpower. Whether it's managing cash flow or seizing unexpected opportunities, we … the funds they need - often within minutes. The team You'll join the Core Systems team, who are responsible for driving innovation across the business by optimising development, building data systems, and continuously improving iwoca products. We follow Agile-inspired processes, using continuous integration and delivery, so that features go live in days or weeks, not months or years. More ❯

Location: London, England, United Kingdom Join Axon and be a Force for Good. Design, build, and maintain scalable, secure, and efficient data pipelines using modern data tools and cloud-native technologies Work with a variety of data sources-structured, semi-structured, unstructured-to support diverse analytics and operational workloads Ensure data quality and consistency by incorporating … automated testing, data validation, and monitoring mechanisms Drive best practices around data engineering, including testing, observability, security, and documentation Troubleshoot and resolve issues in production environments to ensure data integrity and platform reliability What you bring: 5+ years of professional experience in data engineering roles, preferably for a customer facing data product Expertise … in designing and implementing large-scale data processing systems with data tooling such as Spark, Kafka, Airflow, dbt, Snowflake, Databricks, or similar Strong programming skills in languages such as SQL, Python, Go or Scala Demonstrable use and an understanding of effective use of AI tooling in your development process A growth mindset and eagerness to work in a More ❯

Data Strategy Lead – Charity Sector - £67,752 – Hybrid 2 days in City HQ Offered on a 24 month FTC basis, the Data Strategy Lead will play a central role in delivering this charity’s data strategy, with a particular focus on enabling the work of their data engineering and data management specialists. The data strategy will set out a clear ambition to strengthen how they manage and deliver data across the organisation. The Data Strategy Lead will embed these aims into delivery plans, team workflows and supplier relationships. While not a technical specialist, the role requires credible and confident leadership across a technically complex and evolving environment. It demands a strong … understanding of data systems and the health and care data landscape, along with experience delivering complex programmes, managing supplier performance, and influencing internal and external stakeholders. Data Strategy Lead - Key responsibilities: Strategic Leadership of the Data Strategy Programme Management and Coordination Oversight and Development of Data Platforms Stakeholder Engagement and Influence Data Strategy Lead More ❯