1 to 25 of 31 Senior Data Engineer Jobs in London

Senior Data Engineer Rate: up to £450/day Outside IR35 Contract Length: 6 Months (with likely extension) Location: Hybrid - 1 day per week onsite in Central London Working hours: 9am - 5pm - Monday - Friday An established international organisation is seeking a Senior Data Engineer to join their growing Data & Middleware function, driving innovation … and excellence across complex data ecosystems. This is a fantastic opportunity to shape the future of a large-scale data transformation programme, working on high-impact projects that enable data-driven decision-making. Responsibilities for the Senior Data Engineer: Design, build, and maintain scalable data pipelines and architectures, ensuring reliability, performance, and best … in-class engineering standards Leverage Databricks, Spark, and modern cloud platforms (Azure/AWS) to deliver clean, high-quality data for analytics and operational insights Lead by example on engineering excellence, mentoring junior engineers and driving adoption of DevOps and CI/CD best practices within the data function Contribute to the evolution of a modern event-sourcing More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … role with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating infrastructure … using Infrastructure-as-Code tools such as Terraform and Ansible. Ensuring system reliability through observability, monitoring, and proactive issue resolution. Collaborating with cross-functional teams to align data solutions with wider business needs. Supporting the continuous improvement of processes, deployment, and data quality standards. What We Are Looking For: Previously worked as a Senior Data Engineer More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … role with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating infrastructure … using Infrastructure-as-Code tools such as Terraform and Ansible. Ensuring system reliability through observability, monitoring, and proactive issue resolution. Collaborating with cross-functional teams to align data solutions with wider business needs. Supporting the continuous improvement of processes, deployment, and data quality standards. What We Are Looking For: Previously worked as a Senior Data Engineer More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … role with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating infrastructure … using Infrastructure-as-Code tools such as Terraform and Ansible. Ensuring system reliability through observability, monitoring, and proactive issue resolution. Collaborating with cross-functional teams to align data solutions with wider business needs. Supporting the continuous improvement of processes, deployment, and data quality standards. What We Are Looking For: Previously worked as a Senior Data Engineer More ❯

The Opportunity Are you passionate about data engineering? The Open Data team at the Parliamentary Digital Service (PDS) is beginning the development of a new Open Data Platform for parliamentary procedure data, replacing existing platforms and their associated data integration and publishing services. As our Senior Data Engineer you will play a … key role in designing, building, and evolving the data platforms that support decision-making across the organisation. This role sits at the intersection of engineering, analytics, and product delivery. You'll work closely with cross-functional teams to provide high-quality, reliable, and scalable data solutions that drive insight and operational excellence. You'll bring strong software engineering … production-ready code as standard. Alongside this, you'll have hands-on cloud experience (Azure preferred, but AWS or GCP also welcome), including deploying, managing, and supporting cloud-hosted data services and applications. Using your advanced technical expertise and experience delivering modern data systems, you'll help shape our data strategy, improve how teams access and use More ❯

Senior Data Engineer Azure, Power BI, ADF, Synapse Salary: £60,000£70,000 + excellent benefits Location: Birmingham or London (12 days per month in office) Employment: Full time Join a leading and growing UK financial services company as a Senior Data Engineer, taking ownership of enterprise-grade Azure data solutions and advanced … Power BI reporting. This is a high-impact role for an experienced data engineer who wants technical leadership, architectural influence, and the chance to shape a modern cloud-based data platform built on Azure Data Factory, Synapse, Data Lake, and Microsoft Fabric. The Role As Senior Data Engineer, you will: Lead the … design, build, and optimisation of Azure Data Factory (ADF) ETL pipelines . Develop scalable Synapse Analytics data models and performance-optimised SQL workloads. Own and enhance Power BI datasets, semantic models, and reporting standards (major focus). Shape cloud data architecture across Azure Data Lake and Synapse environments. Play a key role in the organisations transition More ❯

have earned superior financial strength ratings from each of the major rating agencies. General Reinsurance, London Branch (a subsidiary of General Reinsurance AG) is offering an opportunity for a Senior Data Engineer in our Data and Governance domain. Main Purpose of the Role We are seeking a detail-oriented senior data engineer to … support the implementation of our Data and AI Governance initiatives that reports into the Enterprise Data and AI Services (EDAS) team. This role will play a key part in supporting the team of governance processes, audits, managing risks and ensuring data privacy in close collaboration with the Security, Legal and Privacy teams. The post holder will also … contribute to the Implementation, integration, development and maintenance of relevant governance, MDM and lineage tools. The ideal candidate will have a strong foundation in data engineering and report configurations in a modern landscape and a keen interest in expanding their expertise in governance, audit, and privacy. This role offers the opportunity to gain hands-on experience in applying policies More ❯

Senior Data Engineer - Azure Databricks/SC Clearance - Contract Active SC Clearance is required for this position Hybrid working - 3 days/week on site required Up to £620/day - Inside IR35 We are currently recruiting for a well experienced Senior Data Engineer, required for a leading global transformation consultancy, based in London. … The Senior Data Engineer will be responsible for providing hands-on, technical expertise within an agile team. The ideal candidate will be well experienced in building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies … cloud computing (specifically Azure), and experience working with large datasets Key skills and responsibilities: Design, build, and maintain scalable ETL pipelines for ingesting, transforming, and loading data from APIs, databases, and financial data sources into Azure Databricks. Optimize pipelines for performance, reliability, and cost, incorporating data quality checks. Develop complex transformations and processing logic using Spark (PySpark More ❯

Senior Data Engineer - (AI/ML Deployment Experience Required) Location: London (Hybrid: Monday-Wednesday in office) Salary: £65,000-£75,000 DoE Job Ref: J13026 An AI-first SaaS company on a mission to help organisations unlock the full potential of their first-party data is seeking a forward-thinking Senior Data Engineer with strong deployment experience to help manage and scale its intelligent platform. Data sits at the heart of everything they do - transforming complex, messy datasets into actionable insights that empower smarter decisions and accelerate growth across industries. As they enter an exciting phase of rapid expansion, they're looking for a talented engineer to join them on … this journey and help shape the future of their data-driven platform. The Role The Senior Data Engineer will take ownership, shape the data foundations, and help power the next generation of AI-driven solutions. This is a hands-on, high-impact role where you'll design and build cloud-native data pipelines, champion More ❯

Senior Data Engineer Hybrid (3 Days Per Week) - London Up to £80,000 + Benefits We're partnering with one of the most exciting InsurTech scale-ups in the market - a company transforming how brokers and insurers exchange risk, already processing over $150m in premium and targeting $1B by 2027 . They're looking for a Senior Data Engineer (3-5 years' experience) to help scale their modern data platform as they continue rapid growth. What you'll do: Build and maintain scalable, automated, reliable data pipelines across a modern cloud stack Extend and improve a cutting-edge Data & Analytics Platform supporting mission-critical insurance products Implement data quality checks … observability metrics and troubleshooting processes Manage cloud resources via Infrastructure-as-Code Ensure strong data security, access control, and governance Work closely with commercial, analytics and engineering teams to deliver high-quality data products What you'll bring: 3-5 years' experience as a Data Engineer Strong SQL and Python skills Proven experience building modern ETL More ❯

Senior Databricks Data Engineer 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform to … power decision-making across every area of the business - from supply chain and logistics to marketing, customer sales and in-store operations. We are seeking an experienced Senior Data Engineer with deep expertise in Databricks and Medallion Architecture (Bronze-Silver-Gold) to design, build, and optimize our next-generation data platform. This role will be pivotal … in developing scalable data pipelines, enabling advanced analytics, and driving data quality and governance across the organization. You'll work closely with data scientists, analysts, and business stakeholders to transform raw data into trusted, actionable insights that power critical business decisions. Key Responsibilities Design and implement scalable data pipelines and ETL/ELT workflows in More ❯

If you are a natural collaborator and a creative problem solver - this position might be for you! We are looking for a Senior Data Engineer to join our Data team and be a part of Nest's transformation to use its data and insight to drive decision making.You’ll work closely with stakeholders to develop … test, and maintain data products and solutions that align with their requirements. You’ll be helping to develop and maintain a cloud-based data and analytics platform on Azure and help end-users of every level integrate their workflows between this and other platforms, including AWS-based solutions.You’ll combine data from different sources, and build data pipelines to transform and organise raw data into formats and structures that can be easily used for business intelligence, visualisations and dashboards, deep dive analysis, and long term forecasting/modelling. To be successful in this positions you will have the following skills, competencies and experience: You’re a natural collaborator and a creative problem solver who knows More ❯

COSTAR GROUP - SENIOR DATA ENGINEER ONTHEMARKET TECHNOLOGY - LONDON OVERVIEW CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index and the NASDAQ 100, CoStar Group is on a mission to digitize the worlds real estate, empowering all people to discover … written content, imagery, design and functionality. The OnTheMarket product will support home buyers, sellers, and agents better than ever! Learn more about OnTheMarket . ROLE DESCRIPTION The role ofSenior Data Engineerwill be a key role within the OTM Data team, reporting to the Head of Data and working closely with the CTO. The Data team is … responsible for data acquisition, data loading, data quality, data processing, data delivery, and data support for OnTheMarket. This role will provide focus on delivering value to our customers, by leveraging data to improve the OTM users and agents experience. This role would be suited to an individual with a background in Python, SQL More ❯

Role : Senior Data Engineer Day Rate : £550 - £580p/d (dependant on SFIA Level experience) - OUTSIDE IR35 Location : Central London (hybrid up to 2 days a week) Clearance required : ACTIVE SC clearance Duration : Initial work package end of FY, March 26 (scope for extension as a 2 year project) Are you a Senior Data Engineer … the ability to successfully bring the customer user on the journey, closely consulting and innovating with cutting-edge innovation and leadership? We're on the look out for a Senior Data Engineer who has experience in: AWS - S3 for storage, Lambda functions, Athena (thus strong SQL). Open to interchangable Azure experience. Databricks Python Devops experience a … bonus e.g. Terraform, Drone, Kubernetes cluster management for microservice style API data consumption Consultative behaviour - strong stakeholder engagement skills, providing true consultancy and leading the user journey If you hold active SC clearance - please do get in touch to find out more: Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and More ❯

Job Title: Senior SQL & SSIS Data Engineer (Data warehouse) Contract Length: 6 Months (possibility for perm) Location: London (5 days in 10 ) Working Pattern: Full Time Rate: Highly competitive rate available for suitable candidates Are you a data wizard ready to take on a challenging role in a dynamic Data Warehouse team? Our client … is on the lookout for a talented Senior Data Engineer with a passion for SQL and SSIS development. Join us for a thrilling 6-month journey focused on optimising our existing SQL Server 2019 data warehouse environment, which is poised for transformation! About the Role In this hands-on, technical position, you will take ownership of … a significant portfolio of around 90 SSIS batch jobs. You'll dive deep into performance analysis, tackle existing technical debt, and implement best practises that will elevate our data operations. Your expertise will be crucial as we gear up for an exciting data warehouse migration from New York to London in 2026! Key Responsibilities Analyse and optimise SSIS More ❯

Job Title: Senior SQL & SSIS Data Engineer (Data warehouse) Contract Length: 6 Months (possibility for perm) Location: London (5 days in 10 ) Working Pattern: Full Time Rate: Highly competitive rate available for suitable candidates Are you a data wizard ready to take on a challenging role in a dynamic Data Warehouse team? Our client … is on the lookout for a talented Senior Data Engineer with a passion for SQL and SSIS development. Join us for a thrilling 6-month journey focused on optimising our existing SQL Server 2019 data warehouse environment, which is poised for transformation! About the Role In this hands-on, technical position, you will take ownership of … a significant portfolio of around 90 SSIS batch jobs. You'll dive deep into performance analysis, tackle existing technical debt, and implement best practises that will elevate our data operations. Your expertise will be crucial as we gear up for an exciting data warehouse migration from New York to London in 2026! Key Responsibilities Analyse and optimise SSIS More ❯

Senior Data Engineer Azure, Power BI, ADF, Synapse Salary: £60,000£70,000 + excellent benefits Location: Birmingham or London (12 days per month in office) Employment: Full time Join a leading and growing UK financial services company as a Senior Data Engineer, taking ownership of enterprise-grade Azure data solutions and advanced More ❯

Senior Data Engineer (GenAI) - Leading Tech Company | London (Hybrid) Hybrid: 1 day in the office/4 days WFH Permanent role only Represented by Robert Half Limited Please note: No visa sponsorship on offer, No B2B,B2C, Fully remote workers or contractors on offer. The Opportunity We're looking for a Senior Data Engineer with hands-on GenAI experience to join a forward-thinking technology business that's building data-driven solutions with real-world impact. This is a highly visible, senior-level role where you'll take ownership of data pipelines, architecture, and GenAI operational frameworks - helping shape the next generation of AI-driven products and analytics. If you … enjoy combining engineering rigor with AI innovation, this role gives you the platform, freedom, and backing to make it happen. Key Responsibilities Design, build, and maintain scalable data pipelines across modern cloud platforms Drive the implementation of GenAI frameworks, including model deployment, monitoring, and lifecycle management ('GenAI Ops') Develop robust ETL/ELT workflows and optimise performance within Snowflake More ❯

Senior Data Engineer - (AI/ML Deployment Experience Required) Location: London (Hybrid: Monday-Wednesday in office) Salary: £65,000-£75,000 DoE Job Ref: J13026 An AI-first SaaS company on a mission to help organisations unlock the full potential of their first-party data is seeking a forward-thinking Senior Data Engineer More ❯

Senior Data Engineer (Python/AWS) Full-time | London, UK Hybrid working: 2-3 days per week on-site Must be SC cleared, or eligible to obtain SC-level security clearance Job description We are looking for a developer with expertise in Python, AWS Glue, step function, EMR cluster and redshift, to join our AWS Development Team. … person interview will be required as part of the interview process. Key responsibilities Hands-on experience in Python programming is essential Responsible for Build, Test and Maintain optimal AWS data pipeline architecture. Building AWS glue, step function, AWS Lambda functions and unit test Work with fellow developers, data architects, data analysts and data scientists on data … to client expectation Communications, including deck writing Delivery of output Gathering of client feedback on problem structuring Understand and define business problems, get all background information and collect relevant data points Create solution hypothesis and get client buy in, discuss and align on end objective, staffing need, timelines and budget Nice to have Hive Pig No-SQL database More ❯

Senior Data Engineer (GenAI) - Leading Tech Company London (Hybrid) Hybrid: 1 day in the office/4 days WFH Permanent role only Represented by Robert Half Limited Please note: No visa sponsorship on offer, No B2B,B2C, Fully remote workers or contractors on offer. The Opportunity We're looking for a Senior Data Engineer More ❯

Role : Senior Data Engineer Day Rate : £550 - £580p/d (dependant on SFIA Level experience) - OUTSIDE IR35 Location : Central London (hybrid up to 2 days a week) Clearance required : ACTIVE SC clearance Duration : Initial work package end of FY, March 26 (scope for extension as a 2 year project) Are you a Senior Data Engineer More ❯

Senior Data Engineer (OLAP/Semantic Modelling) | 6 Month Contract | £550-600 p/day | Outside IR35 We're seeking a highly specialised Data Engineer with deep expertise in OLAP, Tabular, and Multidimensional modelling to join a technology-driven organisation on a long-term contract. If you have strong SSAS, semantic modelling, and Excel cube … integration experience - this role is for you . This is a hands-on, onsite position where you'll architect and optimise analytical models, build high-performance data pipelines, and design robust semantic layers that directly power business-critical reporting and Excel-based analysis. Required Skills: OLAP, Tabular, Semantoc Layer Expertise: Advanced SSAS Tabular & Multidimensional modelling (MUST have) Proven experience … designing semantic layers , calculated measures, perspectives, hierarchies, partitions, aggregation strategies Strong Power BI semantic model understanding (datasets, relationships, optimisation) Ability to dynamically load data into Excel using OLAP cubes - essential Expert in DAX/MDX , cube optimisation, processing strategies Data Engineering & SQL: Strong expertise with MSSQL Server (schema design, tuning, indexing, profiling) Advanced SQL and dimensional data More ❯

Senior Data Engineer (Python/AWS) Full-time London, UK Hybrid working: 2-3 days per week on-site Must be SC cleared, or eligible to obtain SC-level security clearance Job description We are looking for a developer with expertise in Python, AWS Glue, step function, EMR cluster and redshift, to join our AWS Development Team More ❯

wet lab experiments weekly-and massive computational scale-owning and operating one of the most powerful supercomputers in the world-Recursion is uniting technology, biology, chemistry and patient-centric data to advance the future of medicine. In this role, you will: Build, scale, and operate a data platform. You will be a member of the platform team responsible … for building, operating, and tuning a data platform that allows users to discover and query across the breadth of our data at Recursion, which includes a chemistry library of billions compounds, petabytes of cellular microscopy images taken in millions of different experimental contexts, and millions of assay results, all supporting Recursion's drug discovery. Build relatability into a … heterogeneous dataset. At Recursion, we generate datasets based on a wide swath of diverse biological models and treatment approaches. You'll work with biologists, chemists, and data scientists to build relatability and query-ability into these datasets so they can be used in the future to answer the sorts of questions we haven't even thought of asking yet. More ❯