1 to 25 of 32 Data Engineer Jobs in the City of London

to support EQ's transition into a stronger, more profitable, product-led business, driven by real insights and the needs of its customers. We are looking for a skilled Data Engineer to join our Data team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines using … Microsoft Fabric and Databricks. You will work closely with our Product and Engineering teams to ensure data flow and integration across our data ecosystem. Your expertise will help us to improve our data infrastructure, improve data quality, and enable data-driven decision-making across the organization. Core Duties and Responsibilities Design, build, and maintain large … scale data pipelines using Microsoft Fabric and Databricks Develop and implement data architectures that meet business requirements and ensure data quality, security, and compliance Collaborate with wider Product & Engineering teams to integrate data pipelines with machine learning models and analytics tools Optimise data processing and storage solutions for performance, scalability, and cost-effectiveness Develop and More ❯

Data Engineer London/Hybrid Circa £90k + bonus + benefits Azure, Lakehouse, SQL We’re looking for a Data Engineer with strong hands-on experience in data management and Azure technologies, ideally with a background in MGA or (re)insurance environments. You’ll help design, build, and enhance a strategic Data Lakehouse platform … role that requires attention to detail, the ability to manage multiple projects, and a collaborative approach to working with regional and group teams. Key Responsibilities: Develop and maintain scalable data solutions on Azure (ADF, Databricks, Synapse, etc.) Maintain and enhance the integrity of the Data Lakehouse in partnership with regional and group data teams. Partner with analytical … and reporting teams to ensure data is presented accurately for performance insights. Ensure best practices in data governance, quality, and security Collaborate with business analysts, data scientists, and stakeholders across underwriting, finance, and ops Contribute to solution design, development assurance, and platform evolution Support delivery of data models, APIs, ML integrations, and reporting tools Key Skills More ❯

Data Engineer Bond street 70k ROLE OBJECTIVE This role requires a strong understanding of data architecture, data modelling, and performance optimisation. The role will contribute significantly to the company’s success. There are opportunities for professional development, such as training programs, certifications, and career advancement paths. KEY RESPONSIBILITIES Design, develop, and maintain scalable data pipelines … SQL, Azure ADF, Azure Functions, DBT Collaborate with analysts and stakeholders to understand their data needs, scoping and implementing solutions Optimising and cleaning of data warehouse, cleaning existing codebase and creating documentation. Monitor and troubleshoot data pipeline issues Provide technical support and guidance to junior team members Provide ongoing support for business applications. Provide help with data … KNOWLEDGE, SKILLS AND EXPERIENCE Technical Educated to Degree Level, or equivalent, in Computer Science, Information Technology or related discipline. Proven experience in software support and technical/business/data analysis. Able to communicate effectively and clearly in writing and verbally, including drafting correspondence and documents and good presentation skills. Experience with business intelligence and reporting tools like Tableau More ❯

Lead Data Engineer – London – £120,000 Sector: AI Consulting | Client Delivery Type: Full-time | Hybrid Join a tech consultancy at the forefront of applied AI—helping global brands design and deploy intelligent systems that solve real business problems. They combine deep engineering know-how with domain expertise to build the data infrastructure that powers machine learning and … generative AI at scale. 🔍 About the Role As a Lead Data Engineer , you’ll play a critical role in delivering AI-driven solutions for clients—owning the architecture and development of robust, scalable data platforms that feed into machine learning models and intelligent applications. You’ll work closely with Data Scientists, MLOps Engineers, and domain experts … to ensure clean, accessible, and production-grade data pipelines are in place to support experimentation and deployment. 🛠️ Key Responsibilities Build and maintain high-performance data pipelines to power AI/ML use cases Architect cloud-native data platforms using tools like Databricks , Airflow , Snowflake , and Spark Collaborate with AI/ML teams to align data processing More ❯

GCP Data Engineer London (Hybrid) Salary: Up to £115,000 + benefits A global consultancy is looking for a Google Cloud Platform (GCP) Data Engineer to join a cross-functional data team delivering high-impact projects across multiple industries. This role focuses on building and managing end-to-end data solutions within the GCP … ecosystem, working with or building Agentic AI systems - supporting clients with scalable, cloud-native platforms and tools. Key Responsibilities: Design and implement data platforms using GCP Manage data workflows from ingestion to reporting Collaborate across teams to ensure seamless data integration Evaluate and implement the right technologies for each use case Support knowledge sharing and technical best … practice Essential Experience: Proven expertise in building data warehouses and ensuring data quality on GCP Strong hands-on experience with BigQuery, Dataproc, Dataform, Composer, Pub/Sub Skilled in PySpark, Python and SQL Solid understanding of ETL/ELT processes Clear communication skills and ability to document processes effectively Desirable Skills: GCP Professional Data Engineer certification More ❯

Lead Data Engineer | Location: London (Hybrid - 1-2 day a month in office) | Salary: £90,000-£110,000 | London Market Insurance The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Lead Data Engineer with Insurance experience … to play a key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You’ll help shape the data strategy, improve data quality, and empower the business to make data-driven decisions. As a Lead Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built to scale, incorporating the More ❯

Data Software Engineer (Python PySpark) Remote UK to £95k Are you a data savvy Software Engineer with strong Python coding skills? You could be progressing your career in a senior, hands-on Data Software Engineer role as part of a friendly and supportive international team at a growing and hugely successful European car insurance … tech company as they expand their UK presence; their platform enables an insurance quote to be made to the consumer within 60 seconds, using just 4 clicks. As a Data Software Engineer within the Claims team you will help shape the architecture of data products, building reusable technology that enables teams to ingest, store, transform and serve … their own data products. You'll take a lead in data transformation, setting up best practices in areas like Data modelling, performance optimisation and Data Governance to ensure that the data used within the business is consistent, available and reliable. You will be supported with continual learning and self development opportunities and will be encouraged More ❯

Junior Data Engineer – Financial Services – £35-40k - London Overview: We are currently partnered with a market-leading financial services organisation who are seeking a Junior Data Engineer to join their growing London team. The team currently operates around 60 Python pipelines, drawing from a mix of on-prem SQLite and Azure SQL Data Warehouse … feed into Power BI dashboards and published reports. Over the next 12 months, they are undertaking a major transformation where they will be containerising workflows, migrating to cloud-based data systems, and introducing orchestration tools like Prefect. This role will be a hands-on opportunity to contribute to the design and build of a next-generation data platform … while playing a key role in shaping a new, centralised data engineering function. Role & Responsibilities: Support the redesign of their data stack, including containerising workflows, migrating to cloud SQL, and introducing tools like Prefect. Maintain and optimise ~60 Python pipelines, refactoring legacy code into modular components. Keep Power BI dashboards accurate and up to date, supporting evolving business More ❯

Principal Data Engineer – AWS Location : London (Hybrid) Salary : £105,000 Job Type : Permanent A top-tier digital consultancy is making a key strategic hire at the Associate Director level for a hands-on, stakeholder-savvy Principal Data Engineer. You will take the helm of public and private sector data transformation programmes, drive technical delivery, and help … shape a growing practice at scale. This is a greenfield opportunity for a high-impact leader with deep AWS expertise and a consulting mindset as an experienced Principal Data Engineer. Key Responsibilities • Lead and deliver enterprise-grade data engineering solutions using core AWS services (S3, Glue, Lambda, Redshift, Matillion, etc.). • Define architecture, mentor large technical teams, and … engage directly with senior client stakeholders. • Own technical responses for RFI/RFP processes, partnering with senior leadership and business development. • Develop scalable data pipelines and analytics solutions in compliance with UK Government standards. • Act as a hands-on engineering lead while contributing to practice development and thought leadership. • Work closely with delivery and consulting leadership (including Head of More ❯

A small and fast-growing Power Platform Consultancy is seeking a Microsoft Fabric Data Engineer to join their dynamic team in London, and play a key role in expanding their Microsoft Fabric offering. This is a fantastic opportunity to join a collaborative and forward-thinking consultancy that is passionate about delivering cutting-edge data solutions. You’ll … be working closely with clients to help them unlock the full potential of their data using Microsoft Fabric, acting as a trusted advisor and technical expert. This role is ideal for someone currently working in a consultancy or someone eager to step into their first consulting role. In line with a hybrid working model, you'll spend … days per week in Central London for team collaboration and client engagement. The Role: As a Fabric Data Engineer, you will: Lead the end-to-end delivery of Microsoft Fabric projects for a range of clients. Act as a Fabric Subject Matter Expert, championing best practices and innovative solutions. Work closely with stakeholders to understand business needs and More ❯

Senior Data Engineer MUST HAVE SNOWFLAKE, AWS, SNOWPRO CORE Salary - £70-80k with 15% bonus Hybrid working - couple of days in the office City of London We are looking for: Good understanding of data engineering principles A good technical grasp of Snowflake and automating it, and transforming complex datasets SnowPro core certification. AWS Skillset Delivery experience … Building solutions in snowflake Insurance experience - advantageous but not necessary MUST HAVE SNOWFLAKE, AWS, SNOWPRO CORE Key Responsibilities: Lead the design and implementation of Snowflake [and Redshift] based data warehousing solutions within an AWS environment Mentoring of team members through code reviews and pair programming Build and support new AWS native cloud data warehouse solutions Develop and optimize … ETL processes using AWS services (e.g. AWS Glue, Lambda) to ensure efficient data ingestion, transformation, storage, and cost optimization. Deliver data to presentation layers to power reporting and analytics Collaborate with stakeholders, product owners, and developers Create and maintain data models that serve as a foundation for reporting and analytics Monitor performance metrics and troubleshoot issues within More ❯

Senior Data Engineer – Azure -up to £80,000 + Benefits | Hybrid (London or Hertfordshire) Build the data backbone of a leading UK infrastructure and engineering group Our client, an industry leading, multi-sector engineering organisation is looking for a skilled Data Engineer to influence and shape its growing data function. Operating across a multitude … of critical sectors, the company combines the scale of a national business with the values of its family-run origins — collaboration, integrity, and quality. Reporting into both the Data Architect and newly appointed Head of Data & Reporting , you’ll be at the forefront of modernising their data infrastructure and operations, with real ownership from day one. Requirements … Essential: 4+ years’ experience in data engineering with Azure Strong experience with ADF, Databricks, SQL, Python, and ADL Clear communicator, team-oriented, and adaptable to change Desirable: Exposure to D365 or similar CRM platforms Experience with Azure Synapse Familiarity with Power BI reporting environments Background in the construction or infrastructure industry Benefits & Working Pattern Salary: up to More ❯

Data Engineering Consultant | London (Hybrid) | Permanent £70,000 - £85,000 + Bonus Are you a Databricks expert ready to design the future of data platforms? Join a next-gen data & AI consultancy delivering real-world impact through smart, scalable solutions for some of the UK’s top organisations. 🔍 The Role We’re looking for a Data Engineering Consultant who can blend deep technical expertise with strong client-facing skills. You’ll lead the design and delivery of modern data architectures using Databricks on AWS or Azure , developing high-performance pipelines and helping businesses unlock the power of their data. What You’ll Do Design and build modern data solutions using Databricks on the … cloud ☁️ Create scalable pipelines in Python and SQL to drive insight and innovation 🐍 Work closely with clients to turn real business challenges into effective data strategies 💡 Lead and mentor technical teams as a subject matter expert 🧠 Support pre-sales with scoping and solution design Stay at the forefront of data engineering and AI trends What We’re Looking More ❯

RSMB is looking for an enthusiastic Data Analytics Engineer to join the team based in London ( Hybrid 2 days per week in the office ) . You will join us on a full-time, permanent basis and in return, you will receive a competitive salary of £50,000 - £65,000 per annum depending on degree of relevant experience. RSMB … since 2007. Our team of around 50 people are based in Central London, and we are currently operating hybrid working: splitting the week between home and office working. The Data Analytics Engineer role: RSMB are seeking a technically adept and proactive Data Analytics Engineer to join our Technology Department. Based in Holborn with hybrid working, this … is a great opportunity to play a key role in driving data-driven decision-making across our business. You ll be working with complex datasets to build reporting pipelines, support business intelligence, and help evolve our data architecture. Proficiency in SQL, Python, BI tools, and cloud platforms is essential, along with a collaborative, problem-solving mindset. We offer More ❯

Data Engineer We’re looking for a Data Engineer to join our fast-moving, hands-on data engineering team. This isn’t a traditional pipelines-for-analysts role - you’ll be building data systems and products that directly power real-time applications, internal tooling, and commercial projects across the business. Entrepreneurial and autonomous - we … the space to experiment and the responsibility to stabilise when it counts. You’ll work across AWS and GCP, using a modern, containerized, event-driven stack. From real-time data processing to batch workflows, from APIs to backend services, you’ll help evolve our data fabric — the foundation for how data flows and generates value across the … business. What you’ll be doing: -Design and build real-time, event-driven, and batch data pipelines using Python. -Develop and deploy containerized microservices using Docker, running in ECS Fargate or similar cloud-native environments. -Work across AWS and GCP, leveraging services like Lambda, Kinesis, SQS, EventBridge, AWS Batch, Spark, and BigQuery to power cross-cloud data products. More ❯

Role Overview We have partnered with a fast-growing asset manager looking to hire a Data Engineer with strong analytics experience to join their UK-based investment technology and analytics team. This is a newly created position and the role supports a variety of internal business units, including operations, investment solutions, and reporting functions. The successful candidate will … have 2–5 years of experience , with strong proficiency in Python , a sound understanding of derivatives, and a demonstrated ability to work with business users to deliver practical, data-driven solutions. This is not a modeling or pricing-focused role and is better suited for individuals motivated by problem-solving in production environments rather than purely analytical research. Key … a financial institution. Demonstrable Python experience in a collaborative, version-controlled production environment. Familiarity with financial markets and instruments, especially derivatives and fixed income products. Exposure to systems involving data movement or transformation (ETL processes) is beneficial though not central to the role. Strong verbal and written communication skills, with a track record of collaborating across both technical and More ❯

As a Data Specialist at this tech scaleup in London, you will analyse, collect, sort, and create data solutions that integrate across multiple products. You will steer decisions regarding data and build the models that power their products. You will take client insights and requirements and make them a reality, by developing datasets and operational models to … drive innovation into the product development process. You will interpret your client’s objectives, desires, and preferences to help the wider technical team understand the opportunities and apply data engineering responsibilities consistently. You will be working on an interesting range of projects that deliver to National Security customers and as such, you will have to hold the highest level … of UK Security Vetting (DV), upon application. Key Responsibilities: You will blend Data Engineering and Data Science, and will have experience that might cover a number of the tasks listed below: Data Engineering tasks Manage the implementation and development of integrations between the data warehouse and other systems. Create deployable data pipelines that are tested More ❯

Role: Senior Data Engineer (12-month FTC) Location: City of London Salary : £100,000 WFH: Hybrid A well-known Insurance company is looking for a Senior Data Engineer to join their team. This is an exciting opportunity to join a prestigious company and to take your career to the next level: Keys skills/Experience: Strong … experience working the Azure Data Stack Advance experience with Databricks Insurance experience is a must Solid Data warehousing experience Strong experience with Python T-SQL and SQL is a must Experience leading large projects Experienced working on finance related projects If this role sounds of interest and you would like to know more do not hesitate to submit More ❯

Principal Data Engineer – AWS Location: London (Hybrid/Flexible) - Other UK Locations available Salary: £95,000 - £105,000 + Bonus A leading consultancy is hiring for a Principal Data Engineer to join their fast-growing data team, delivering cloud-native data platforms for high-profile clients across sectors. This role will focus on designing … and implementing end-to-end data solutions using modern AWS tooling. It suits someone who thrives in greenfield environments, enjoys client engagement, and values clean, scalable, well-documented engineering. Key Responsibilities: Design and build robust data pipelines using AWS (S3, Redshift, Glue, Lambda, Step Functions, DynamoDB). Deliver ETL/ELT solutions with Matillion and related tooling. Work … junior engineers. Requirements: Strong hands-on AWS experience – S3, Redshift, Glue essential. Proven experience building ETL/ELT pipelines in cloud environments. Proficient in working with structured/unstructured data (JSON, XML, CSV, Parquet). Skilled in working with relational databases and data lake architectures. Experienced with Matillion and modern data visualisation tools (QuickSight, Tableau, Looker, etc. More ❯

x Contract Data Engineers - Snowflake/AWS/Python/Airflow/Iceberg Location: London (Hybrid - 3 days per week onsite) Duration: 6 months Day Rate: £550 - £600 (Inside IR35) A highly reputable consultancy is seeking 2 x Contract Data Engineers to join their data team on a 6-month engagement. You will play a key role … in building and optimising data pipelines, supporting modern data platform architecture, and enabling advanced analytics and reporting capabilities. Key Skills & Experience: Strong experience with Snowflake data warehousing Solid AWS cloud engineering experience Proficient in Python for data engineering workflows Skilled in building and maintaining Airflow DAGs Familiarity with Apache Iceberg for table format and data More ❯

Data Engineer London Insurance, 3 days in the office per week Up to £90,000 (DOE) Finitas are delighted to be working with a leading provider of insurance on a Data Engineer position. Reporting to the Group Lead Data Engineering, the role focuses on developing and maintaining strategic data platforms, especially Data Lakehouse … to enhance underwriting analytics and business insights. Key requirements Hands on experience designing and delivering solutions using Azure services including Azure Data Factory, Azure Databricks High proficiency in SQL and Python Insurance background If you are looking for a company who nurture and retain the best talent in the market then apply today. Interviews are happening next week, this More ❯

Data Engineer - MS Fabric - UK role (WFH) - 6 months initial contract - Top rates - Outside IR35 Major consultancy urgently requires a Data Engineer with experience of MS Fabric (tech stack is Microsoft Fabric, PySpark/RSpark and Github) for an initial 6 months contract (WFH and Outside IR35) who is passionate about building new capabilities from the … ground up and want to help explore the full potential of your data platform. As aa Data Engineer you will have hands-on technical ability and experience of building and managing modern data platforms, preferably in Microsoft Fabric and ideally be familiar with integrating customer/third-party data into Fabric, possess Product Development Awareness … Understanding how data platform capabilities may integrate into digital products and services. Experience working with or within product development teams is a plus Technical knowledge and underrating of the following is required:- Data Engineering Best Practices, CI/CD for data pipelines, Modular, testable ETL development, Git-based collaboration and branching strategies, Metadata management and data More ❯

Principal Data Engineer (Python AWS) London/WFH to £105k Do you have significant experience with Python data engineering and architecture? You could be progressing your career in an impactful, hands-on Principal Data Engineer role at a hugely successful European eCommerce with a customer base of over 10 million. As a Principal Data Engineer you will take a lead role in building a platform that enables a decentralised-by-design data adoption model within the business, defining and championing technical principles and practices to make improvements and implement a well engineered, well governed data platform that meets customer needs. You will provide technical leadership and technical solution design on … multiple, complex initiatives, drive continuous improvement on key metrics (business value, cost efficiency, speed and quality of delivery) and contribute to key decision making across the Data and Machine Learning engineering space on technical approaches to balance delivering near-term commercial impact and building long-term foundations. Location/WFH: You can work from home most of the time More ❯

Job Description AWS Stack, data being landed in S3, Lambda triggers, Data Quality, data written back out to AWS S3(Parquet Formats), Snowflake for dimensional model. Design and build the data pipelines, work with someone around understanding data transformation, this is supported by BA's, building out the data pipelines, moving into layers in … the data architecture (Medallion architecture). Requirements 5 plus year's experience with AWS 5-8 years overall exposure to Data Technical Lead experience Proficient in Snowflake, S3, Lambda Triggers Hybrid London 1-2 days a week £(Apply online only) (Outside IR35) The reason they're hiring now, they have a client that is all on a legacy More ❯

A specialist reinsurance broker is seeking a Data Engineer with Google Cloud Platform (GCP) experience to join their growing team in Central London. This is a hybrid role, requiring 2-3 days per week in the office. This is a modern, digitally native business with no legacy systems - a rare opportunity to work in a clean, forward-thinking … values innovation, adaptability, and continuous improvement. Key responsibilities will include: Lead and support the migration from Azure to Google Cloud Platform (GCP), including BigQuery Collaborate with stakeholders to understand data needs and ensure smooth transition and integration Become the internal GCP subject matter expert, with direct support from Google Contribute to the adoption of AI and emerging technologies post … migration Thrive in a fast-evolving environment with minimal legacy constraints Requirements : Proven experience as a Data Engineer. Hands-on experience with cloud migrations (on-prem to cloud or cloud-to-cloud). Strong knowledge of GCP, including BigQuery. Experience in Financial Services is desirable but not essential Exposure to AI technologies is a plus Excellent communication and stakeholder More ❯