Senior DataEngineer - (Azure/Databricks) page is loaded Senior DataEngineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 7 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our … status, civil union status, family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. Senior DataEngineer (Azure/Databricks Job Family Grouping: Chief Underwriting Officer Job Family: Data & Analytics Location: London How does this role contribute to our collective success? The Data & Analytics department transforms raw data into actionable insights to drive informed decision-making and optimize business operations. The Senior Azure DataEngineer will support these goals by designing, implementing, and managing scalable data solutions on the Azure platform, ensuring efficient data processing, storage, and retrieval. You will play a key role in modernizing our More ❯
About Us: ATREIDES is a leader in advanced geospatial technologies, big data solutions, and data analytics. We specialize in providing cutting-edge software platforms that enable our clients to process, analyze, and visualize large-scale geospatial and sensor data for critical decision-making. Our mission is to deliver innovative, scalable, and high-performance platforms that help organizations … unlock the full potential of their data for various industries, including defense, national security, environmental monitoring, and urban planning. We are seeking a highly skilled Senior DataEngineer with a strong focus on big data, data analytics, and geospatial data intelligence to join our engineering team. In this role, you will help design and … develop robust, scalable platforms that handle vast amounts of geospatial data and provide actionable insights through data analytics. Job Overview: As a Senior DataEngineer at ATREIDES, you will be responsible for developing and optimizing our core software platform, with an emphasis on integrating and processing big data, performing advanced data analytics, and enabling More ❯
West London, London, United Kingdom Hybrid / WFH Options
Young's Employment Services Ltd
DataEngineer Manager Hybrid - London with 2/3 days WFH Circ £85,000 - £95,000 + Bonus This newly created DataEngineer Managers position is an excellent opportunity for a hands on Senior DataEngineer/Technical Lead/Engineering Team Lead etc looking to move into a Management position. The postholder will … lead and mentor a team of 3 Data Engineers whilst overseeing data platform development and optimisation. Our client is a well-established and rapidly growing global ecommerce business with its headquarters based in London. They've been expanding at pace and have ambitious plans to take the business even further. The DataEngineer Manager will play … a pivotal role at the heart of our clients data & analytics operation. Having implemented a new MS Fabric based Data platform, the need is now to scale up to meet the demand to deliver data driven insights and strategies right across the business globally. The role will require someone that's happy to be hands on as More ❯
Senior DataEngineer/Technical Lead Hybrid - London with 2/3 days WFH Circ £85,000 - £95,000 + Bonus An excellent opportunity is available for a Senior DataEngineer/Technical Lead looking to move into a Management/Leadership position. This is an exciting newly created hands-on DataEngineer Managers … post that will be responsible for leading and mentoring a small team of Data Engineers whilst overseeing data platform development and optimisation. Our client is a well-established and rapidly growing global ecommerce business with its headquarters based in London. Having implemented a new MS Fabric based Data platform, the need is now to scale up to … meet the demand to deliver data driven insights and strategies right across the business globally. The role will require someone that's happy to be hands-on (potentially up to 50% of the time) as you'll be troubleshooting, doing code reviews, steering the team through deployments, acting as an escalation point for technical issues etc. Key Responsibilities include More ❯
Employment Type: Permanent
Salary: £80000 - £95000/annum Attractive Bonus and Benefits
West London, London, United Kingdom Hybrid / WFH Options
Young's Employment Services Ltd
Senior DataEngineer/Technical Lead Hybrid - London with 2/3 days WFH Circ £85,000 - £95,000 + Bonus An excellent opportunity is available for a Senior DataEngineer/Technical Lead looking to move into a Management/Leadership position. This is an exciting newly created hands-on DataEngineer Managers … post that will be responsible for leading and mentoring a small team of Data Engineers whilst overseeing data platform development and optimisation. Our client is a well-established and rapidly growing global ecommerce business with its headquarters based in London. They've been expanding at pace and have ambitious plans to take the business even further. Having implemented … a new MS Fabric based Data platform, the need is now to scale up to meet the demand to deliver data driven insights and strategies right across the business globally. The role will require someone that's happy to be hands-on (potentially up to 50% of the time) as you'll be troubleshooting, doing code reviews, steering More ❯
health condition, or are neurodiverse. If you'd like to apply and need adjustments made, you can let us know in your application. About the role As an Azure DataEngineer, your role involves designing, implementing, and managing data solutions on the Microsoft Azure cloud platform. Your responsibilities will include, but not limited to: Data Integration … Data Integration and ETL (Extract, Transform, Load): You'll develop and implement data integration processes to extract data from diverse sources and load it into data warehouses or data lakes. Azure Data Factory is a key tool for building efficient ETL pipelines. Your goal is to ensure that data is effectively cleaned, transformed … and loaded. Your sources will include Rest API from various systems. Being able to onboard data from API's is essential. Use of Postman for testing outside of ADF is a preferred skill. Data Engineering As an Azure DataEngineer, you'll handle and analyse large volumes of data using big data technologies available More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Client Server Ltd
DataEngineer (Python SQL ETL) London/WFH to £80k Are you a tech savvy DataEngineer with experience of working with sensitive patient/healthcare data? You could be progressing your career as a DataEngineer working on Tech for Good application for the healthcare sector that utilises AI and Machine Learning … techniques to help prevent patients from experiencing health crisis. As a DataEngineer you will take ownership of the healthcare data pipelines and platforms, focussing on implementing robust ETL processes and scalable data architectures, collaborating with various teams to deliver high quality data solutions. You'll develop and maintain data infrastructure on Azure Data Lakes and Data Warehouses; create robust data transformation processes that ensure data quality, consistency and security and implement automation workflows. You will help to maintain compliance with ISO27001 and ISO13485 requirements for healthcare data management and ensure that security first practices are employed in all data processing solutions to protect sensitive patient information. This More ❯
Central London, London, United Kingdom Hybrid / WFH Options
Singular Recruitment
DataEngineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a DataEngineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, youll not only be part of a creative and open work culture focused on innovation and … making it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of DataEngineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. Integrate … data management technologies and software tools into existing structures. Create data tools to support sport data modelling, prediction and analytics. Work with data and analytics experts to strive for greater functionality in our data systems. As the selected DataEngineer, your background will include: 3+ years industry experience in a DataEngineerMore ❯
East London, London, United Kingdom Hybrid / WFH Options
Client Server
Senior DataEngineer (AWS Kafka Python) London/WFH to £85k Are you a tech savvy DataEngineer with AWS expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on DataEngineer role. As a … Senior DataEngineer you will design and build end-to-end real-time data pipelines using AWS native tools, Kafka and modern data architectures, applying AWS Well-Architected Principles to ensure scalability, security and resilience. You'll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust … well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you: You are an experienced DataEngineer within financial services environments You have expertise with AWS including Lake formation and More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Client Server Ltd
Senior DataEngineer (AWS Kafka Python) London/WFH to £85k Are you a tech savvy DataEngineer with AWS expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on DataEngineer role. As a … Senior DataEngineer you will design and build end-to-end real-time data pipelines using AWS native tools, Kafka and modern data architectures, applying AWS Well-Architected Principles to ensure scalability, security and resilience. You'll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust … well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you: You are an experienced DataEngineer within financial services environments You have expertise with AWS including Lake formation and More ❯
Central London, London, United Kingdom Hybrid / WFH Options
Client Server
DataEngineer (PySpark SQL Databricks AWS) London/WFH to £70k Opportunity to progress your career as a DataEngineer at a scaling, tech driven company that specialises in music royalty management, they've put significant investment into data processing capabilities, with a modern data platform that handles billions of lines of royalty data with an emphasis on streaming. As a DataEngineer you focus on Data Ingestion, bringing in data from a range of sources and then processing, cleaning and standardising datasets that leverage the company's bespoke data infrastructure, preparing audits and carrying out analysis. You'll be primarily working with PySpark, SQL and Databricks within … work from home most of the time meeting up with colleagues in the London office two or three times a month. About you: You have strong experience as a DataEngineer within the Music industry or an Accountancy environment You have strong technical skills with PySpark, SQL, Databricks and AWS You have experience with ETL pipelines and DataMore ❯
Position : Senior DataEngineer Salary: £55,000 - £65,000 Location : Hybrid - Bristol, Manchester, or London Security Requirement : SC Clearance to start and be willing/able to obtain DV Clearance We are seeking Data Engineers, with a keen interest/experience in AI/ML and strong proficiency in Python Scripting. To join our Consultancy client working … on meaningful projects in the Defence and Security sector. Required Experience: End-to-End Data Development : Strong experience with data pipelines, ETL processes, and workflow orchestration, demonstrating best practices across tech stacks. Strong Python Skills Diverse Data Handling : Familiarity with batch, streaming, real-time, and unstructured data sources. Architectural Design & Systems Thinking : Ability to design and … build scalable, high-performance data solutions. Data Modelling & Warehouse Design : Proficiency in data modelling, warehouse design, and database optimization, with examples of logical and physical models. Distributed Data Systems : Experience in deploying, managing, and tuning distributed systems for optimal reliability and performance. Coding & Development Practices : Demonstrated coding expertise with modular, reusable, and efficient code in various More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Circle Recruitment
Role: Senior DataEngineer Salary/Rate: £600-700 per day inside IR35 Location: hybrid multiple locations available, 2 days on siteContract Duration: 4 months, potential to extend We are currently looking for a Senior DataEngineer for our government client. This Senior DataEngineer role is hybrid, based between 2 days per week … on site and the remainder of the week working remotely. Office locations include most major towns, with London being a preference. The contract for the Senior DataEngineer position is for 4-months with potential to extend, operating inside IR35. Security Clearance: Security Check ("SC Clearance") This role is inside IR35 - Due to the service of the role … it will now be based on an Umbrella solution. Essential skills/experience required: Strong experience designing, building and maintaining data pipelines using modern, cloud-based tools and practices Proficiency in Python and SQL for data engineering tasks Experience with DBT and a good understanding of data modelling approaches (e.g. star schema, dimensional modelling) Familiarity with Airflow More ❯
Role Summary Tasman is defining the future of Data Analytics-as-a-Service. We are a young and growing company funded fully by analytics & data science work for our ambitious clients. We are hiring a senior dataengineer at Tasman to: Take ownership of the design and implementation of data pipelines and platforms for our … clients Mentor and develop other Engineers to achieve their full potential Work with Data Product Manager to develop plans and roadmaps that deliver on client objectives each sprint and throughout the engagement Support and enable other functions within your team to deliver data products. ABOUT TASMAN At Tasman, we transform disorganised data into meaningful business value, empowering … analytics. As a boutique consultancy with offices in the UK and the Netherlands, we have been serving clients across Europe since 2017. Our expertise spans analytics, business intelligence, and data science, allowing us to deliver rapid, impactful results through tailored, scalable solutions. Our past and current clients include well known brands like The Earthshot Prize, Verisure, Paired, Ecosia, Gousto More ❯
Senior DataEngineer We are seeking a highly skilled DataEngineer to focus on maintaining data streams and ETL pipelines within a cloud-based environment. The ideal candidate will have experience in building, monitoring, and optimizing data pipelines, ensuring data consistency, and proactively collaborating with upstream and downstream teams to enable seamless data flow across the organization. In this role, you will not only troubleshoot and resolve pipeline issues but also contribute to enhancing data architecture, implementing best practices in data governance and security, and ensuring the scalability and performance of data solutions. You will play a critical role in understanding the business context of data, supporting analytics … and decision-making by collaborating with data scientists, analysts, and other key stakeholders This position requires client presence between 25%-50% of the time per month at the client's office, which is located in London. Key Responsibilities: Data Pipeline Development & Maintenance Build, maintain, and optimize scalable ETL/ELT pipelines using tools such as Dagster, or similar. More ❯
East London, London, United Kingdom Hybrid / WFH Options
UK Health Security Agency
and outlook are not only respected but expected. We want all our employees to feel that they can be themselves at work and that they are valued. Digital and Data The UKHSA Digital and Data Directorate provides strategic leadership and oversight for developing and managing a common and bespoke suite of performant, modern, secure, data and analytical … tools, services, platforms and applications, ensuring access to high quality data and analytics services, internally and externally. There is a Market pay supplement available for this position of £10,000 up until the end of June 2026. Main duties of the job You will work in the Data Engineering and Enablement Division that reports into the Digital and … Data Directorate. Its an exciting time to join as we seek to create leading Health Protection data capabilities that enable data scientists and data analysts to develop insights that inform public health decisions with resilience platforms and curated data assets. The core activities of Engineering and Enablement include the ingestion of data sources, building More ❯
Employment Type: Permanent, Part Time, Work From Home
and outlook are not only respected but expected. We want all our employees to feel that they can be themselves at work and that they are valued. Digital and Data The UKHSA Digital and Data Directorate provides strategic leadership and oversight for developing and managing a common and bespoke suite of performant, modern, secure, data and analytical … tools, services, platforms and applications, ensuring access to high quality data and analytics services, internally and externally. There is a Market pay supplement available for this position of £10,000 up until the end of June 2026. Main duties of the job You will work in the Data Engineering and Enablement Division that reports into the Digital and … Data Directorate. It's an exciting time to join as we seek to create leading Health Protection data capabilities that enable data scientists and data analysts to develop insights that inform public health decisions with resilience platforms and curated data assets. The core activities of Engineering and Enablement include the ingestion of data sources More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Searchability NS&D
Palantir Foundry DataEngineer - DV Cleared NEW CONTRACT OPPORTUNITY FOR A PALANTIR FOUNDRY DATAENGINEER TO WORK ON A NATIONAL SECURITY PROJECT IN LONDON WITH DV CLEARANCE - Contract role in London for a Palantir Foundry DataEngineer - Must hold DV Security Clearance - Central London based - Daily rate up to £800 - Hybrid position - To apply … email: or call Who we are... We are seeking an experienced Palantir Foundry DataEngineer with current DV clearance to join a high-profile programme. This is a contract position offering hybrid working and a daily rate of up to £800 . In this role, you will be responsible for designing, developing, and optimising data pipelines and … integrations within Palantir Foundry , ensuring data is efficiently processed, transformed, and made available for analysis and operational use. You will collaborate closely with analysts, data scientists, and business stakeholders to deliver robust, secure, and scalable data solutions. What we're looking for... Key Responsibilities: Develop and maintain data pipelines and workflows in Palantir Foundry Integrate diverse More ❯
. Meet the team behind this journey DeepL has millions of passionate users around the globe, both consumer and enterprise. These users produce a massive quantity of data. The Data Domain teams increase operational efficiency and drive innovation at DeepL by facilitating the flow of this data from producers to consumers, in order to maximize business impact. Through … the creation of stable and user-friendly analytical data models, we make customer data models and user behavioral data accessible and reusable for data professionals throughout the company. In this role, your main responsibilities and deliverables will be to build and maintain ETL pipelines, create foundational data models in our data warehouse, and integrate … new data sources using DataOps best practices, including documentation and testing. You will also support other data specialists in their work to make their queries and tables efficient and their use of data effective. We are looking for a Senior DataEngineer to join a versatile team that builds and maintains data models, libraries More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Robert Half
DataEngineer - Azure/Microsoft Fabric City of London - Hybrid Working Circa £55-65k + Bonus & Benefits Our client, a forward-thinking and globally connected staffing & consulting organization is seeking a skilled and driven DataEngineer to join their growing Data & Analytics team. Based in the City of London, this role presents a fantastic … opportunity for someone with 2-3 years of data engineering experience who is passionate about building robust data solutions using Microsoft Azure and Microsoft Fabric technologies. This is a hands-on technical role where you'll work closely with the Lead Data Architect and collaborate across the business to design, build, and support scalable data infrastructure … that powers business intelligence, reporting, and analytics. The ideal candidate will be eager to grow their skills and take ownership of impactful data projects within a fast-paced, modern tech environment. Key Responsibilities: Design, develop, and maintain data pipelines and data warehousing solutions using Azure services Work with stakeholders to convert business requirements into scalable technical solutions More ❯
City of London, London, England, United Kingdom Hybrid / WFH Options
Client Server Ltd
Principal DataEngineer (Python AWS) London/WFH to £120k Do you have significant experience with Python data engineering and architecture? You could be progressing your career in an impactful, hands-on Principal DataEngineer role at a hugely successful European eCommerce with a customer base of over 10 million. As a Principal DataEngineer you will take a lead role in building a platform that enables a decentralised-by-design data adoption model within the business, defining and championing technical principles and practices to make improvements and implement a well engineered, well governed data platform that meets customer needs. You will provide technical leadership and technical solution design on … multiple, complex initiatives, drive continuous improvement on key metrics (business value, cost efficiency, speed and quality of delivery) and contribute to key decision making across the Data and Machine Learning engineering space on technical approaches to balance delivering near-term commercial impact and building long-term foundations. Location/WFH: You can work from home most of the time More ❯
DataEngineer - AWS, Databricks & Pyspark Contract Role - DataEngineer Location: Hybrid (1 day per month onsite in Harrow, London) Rate: £350 per day (Outside IR35) Duration: 6 months A client of mine is looking for a DataEngineer to help maintain and enhance their existing cloud-based data platform. The core migration to … existing ETL pipelines to support reporting and analytics - Assist with improvements to performance, scalability, and cost-efficiency across the platform - Work within the existing Databricks environment to develop new data solutions as required - Collaborate with analysts, data scientists, and business stakeholders to deliver clean, usable datasets - Contribute to good data governance, CI/CD workflows, and engineering … standards - Continue developing your skills in PySpark, Databricks, and AWS-based tools Tech Stack Includes: - Databricks (Delta Lake, PySpark) - AWS - CI/CD tooling (Git, DevOps pipeline - Cloud-based data warehousing and analytics tools If your a mid to snr level DataEngineer feel free to apply or send your C.V DataEngineer - AWS, Databricks More ❯
South West London, London, United Kingdom Hybrid / WFH Options
Get Staffed Online Recruitment
DataEngineer (Data Migrations) Remote | Full-time | UK Timezones (UTC-4 to UTC+3 preferred) About Our Client They are a design-led, remote-first healthtech company helping hundreds of private doctors across the UK run their practices more efficiently—and delivering a better experience for their patients. They're profitable, bootstrapped, and committed to staying remote. They … doubled revenue in 2024 and continue to grow at a rapid pace. With a growing queue of new practices ready to migrate, they're hiring a DataEngineer to own and deliver migrations from start to finish, and improve their robust Ruby data tooling. The role You'll guide new customers through migrating from their old practice … management systems. This involves cleaning, validating, and converting data (patients, bookings, invoices, etc.)—usually from structured exports or spreadsheets. You'll communicate with customers throughout the process, helping them feel confident and supported. All key processes are well documented in their internal playbook. A typical migration includes: Booking a migration date and answering any customer queries Receiving dataMore ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Get Staffed Online Recruitment Limited
DataEngineer (Data Migrations) Remote | Full-time | UK Timezones (UTC-4 to UTC+3 preferred) About Our Client They are a design-led, remote-first healthtech company helping hundreds of private doctors across the UK run their practices more efficiently—and delivering a better experience for their patients. They’re profitable, bootstrapped, and committed to staying remote. They … doubled revenue in 2024 and continue to grow at a rapid pace. With a growing queue of new practices ready to migrate, they’re hiring a DataEngineer to own and deliver migrations from start to finish, and improve their robust Ruby data tooling. The role You’ll guide new customers through migrating from their old practice … management systems. This involves cleaning, validating, and converting data (patients, bookings, invoices, etc.)—usually from structured exports or spreadsheets. You’ll communicate with customers throughout the process, helping them feel confident and supported. All key processes are well documented in their internal playbook. A typical migration includes: Booking a migration date and answering any customer queries Receiving dataMore ❯
DataEngineer (Data Migrations) Remote | Full-time | UK Timezones (UTC-4 to UTC+3 preferred) About Carebit Carebit is a design-led, remote-first healthtech company helping hundreds of private doctors across the UK run their practices more efficiently—and delivering a better experience for their patients. We’re profitable, bootstrapped, and committed to staying remote. We doubled … revenue in 2024 and continue to grow at a rapid pace. With a growing queue of new practices ready to migrate, we’re hiring a DataEngineer to own and deliver migrations from start to finish, and improve our robust Ruby data tooling. The role You’ll guide new customers through migrating from their old practice management … systems into Carebit. This involves cleaning, validating, and converting data (patients, bookings, invoices, etc.)—usually from structured exports or spreadsheets. You’ll communicate with customers throughout the process, helping them feel confident and supported. All key processes are well documented in our internal playbook. A typical migration includes: Booking a migration date and answering any customer queries Receiving dataMore ❯