Senior Data Engineer - (Azure/Databricks) page is loaded Senior Data Engineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 15 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding client … status, civil union status, family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. Senior Data Engineer (Azure/Databricks Job Family Grouping: Chief Underwriting Officer Job Family: Data & Analytics Location: London How does this role contribute to our collective success? The Data & Analytics department transforms raw data into actionable insights to drive informed decision-making and optimize business operations. The Senior Azure Data Engineer will support these goals by designing, implementing, and managing scalable data solutions on the Azure platform, ensuring efficient data processing, storage, and retrieval. You will play a key role in modernizing our dataMore ❯
Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 The role of the Senior … Azure Data Engineer is to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The role holder will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient … engineering. Accountabilities: ·Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable components and products. ·Design, write and iterate code from prototype to production ready. Understand securityMore ❯
City of London, London, United Kingdom Hybrid / WFH Options
83data
Job Title: Principal Data Engineer Location: London, UK – Hybrid (Liverpool Street office) Department: Data & Engineering Reports To: Head of Data Science Employment Type: Permanent A leading global payments and fintech platform , empowering clients to innovate and scale. Their mission is to create frictionless, secure, and intelligent payment solutions that unlock value across banking, financial services, and digital … assets. As they continue to scale their data infrastructure , they’re seeking a seasoned Principal Data Engineer to help design, build, and optimise a modern data platform, with a focus on orchestration (Airflow), scalable data warehouse architecture, and high-performance pipelines. The ideal candidate will bring both technical depth and strategic thinking , with the ability to … communicate effectively across business and technical teams. Key Responsibilities Design and lead the development of scalable, secure, and high-performance data warehouse solutions for BI and analytics. Define and drive the long-term architecture and data strategy in alignment with business goals. Own orchestration of ETL/ELT workflows using Apache Airflow , including scheduling, monitoring, and alerting. Collaborate More ❯
Job Title: Principal Data Engineer Location: London, UK – Hybrid (Liverpool Street office) Department: Data & Engineering Reports To: Head of Data Science Employment Type: Permanent A leading global payments and fintech platform , empowering clients to innovate and scale. Their mission is to create frictionless, secure, and intelligent payment solutions that unlock value across banking, financial services, and digital … assets. As they continue to scale their data infrastructure , they’re seeking a seasoned Principal Data Engineer to help design, build, and optimise a modern data platform, with a focus on orchestration (Airflow), scalable data warehouse architecture, and high-performance pipelines. The ideal candidate will bring both technical depth and strategic thinking , with the ability to … communicate effectively across business and technical teams. Key Responsibilities Design and lead the development of scalable, secure, and high-performance data warehouse solutions for BI and analytics. Define and drive the long-term architecture and data strategy in alignment with business goals. Own orchestration of ETL/ELT workflows using Apache Airflow , including scheduling, monitoring, and alerting. Collaborate More ❯
Job Title: Principal Data Engineer Location: London, UK - Hybrid (Liverpool Street office) Department: Data & Engineering Reports To: Head of Data Science Employment Type: Permanent A leading global payments and fintech platform , empowering clients to innovate and scale. Their mission is to create frictionless, secure, and intelligent payment solutions that unlock value across banking, financial services, and digital … assets. As they continue to scale their data infrastructure , they're seeking a seasoned Principal Data Engineer to help design, build, and optimise a modern data platform, with a focus on orchestration (Airflow), scalable data warehouse architecture, and high-performance pipelines. The ideal candidate will bring both technical depth and strategic thinking , with the ability to … communicate effectively across business and technical teams. Key Responsibilities Design and lead the development of scalable, secure, and high-performance data warehouse solutions for BI and analytics. Define and drive the long-term architecture and data strategy in alignment with business goals. Own orchestration of ETL/ELT workflows using Apache Airflow , including scheduling, monitoring, and alerting. Collaborate More ❯
Job Title: Principal Data Engineer Location: London, UK - Hybrid (Liverpool Street office) Department: Data & Engineering Reports To: Head of Data Science Employment Type: Permanent A leading global payments and fintech platform , empowering clients to innovate and scale. Their mission is to create frictionless, secure, and intelligent payment solutions that unlock value across banking, financial services, and digital … assets. As they continue to scale their data infrastructure , they're seeking a seasoned Principal Data Engineer to help design, build, and optimise a modern data platform, with a focus on orchestration (Airflow), scalable data warehouse architecture, and high-performance pipelines. The ideal candidate will bring both technical depth and strategic thinking , with the ability to … communicate effectively across business and technical teams. Key Responsibilities Design and lead the development of scalable, secure, and high-performance data warehouse solutions for BI and analytics. Define and drive the long-term architecture and data strategy in alignment with business goals. Own orchestration of ETL/ELT workflows using Apache Airflow , including scheduling, monitoring, and alerting. Collaborate More ❯
South East London, England, United Kingdom Hybrid / WFH Options
83data
Job Title: Principal Data Engineer Location: London, UK – Hybrid (Liverpool Street office) Department: Data & Engineering Reports To: Head of Data Science Employment Type: Permanent A leading global payments and fintech platform , empowering clients to innovate and scale. Their mission is to create frictionless, secure, and intelligent payment solutions that unlock value across banking, financial services, and digital … assets. As they continue to scale their data infrastructure , they’re seeking a seasoned Principal Data Engineer to help design, build, and optimise a modern data platform, with a focus on orchestration (Airflow), scalable data warehouse architecture, and high-performance pipelines. The ideal candidate will bring both technical depth and strategic thinking , with the ability to … communicate effectively across business and technical teams. Key Responsibilities Design and lead the development of scalable, secure, and high-performance data warehouse solutions for BI and analytics. Define and drive the long-term architecture and data strategy in alignment with business goals. Own orchestration of ETL/ELT workflows using Apache Airflow , including scheduling, monitoring, and alerting. Collaborate More ❯
Daintta are a rapidly growing, values-driven team of specialists who work with government clients across Cyber, Telecommunications and Data. We are seeking a talented and motivated Data Engineer to join our team and contribute to our mission of protecting the UK through data-driven insights and solutions. As a Data Engineer, you will work closely with … our public sector clients and project teams to develop and implement data engineering pipelines to support data science and business/mission intelligence use cases. Key Responsibilities Assessing your clients' technical needs and understanding how their needs are different to wants and managing clients' stakeholders relationship appropriately Identifying data sources, data extraction, transformation, and loading (ETL …/ELT) concepts and methods Designing, evaluating, and implementing on-premise, cloud-based and hybrid data engineering solutions (including providing review and guidance on testing aspects related to data engineering, identification of risks and proposing and implementing their mitigations) Modelling, structuring and storing data along with their data flows for uses including - but not limited to More ❯
trade and settle directly from the safety of their MPC-secured wallets. By reducing settlement time for transfers to a few milliseconds (without blockchain network dependency) and offering enhanced security measures, ClearLoop is rapidly reshaping the way asset managers trade and manage capital. In addition to industry-leading security certifications, Copper has one of the strongest insurance coverages … a large client base since Copper's launch in 2018, our engineering team has remained at the forefront of blockchain technology. Setting standards for the cryptocurrency infrastructure globally. The Data Engineering team extends upon this to provide critical data services to the organisation. Through innovative data management and analytics, we enable our teams to make informed, data-driven decisions to drive growth, reduce risk and improve operational efficiencies. ROLE PURPOSE: A Data Engineer Apprentice supports the design, development, and maintenance of data systems and pipelines. This apprenticeship provides hands-on experience in managing data infrastructure and ensuring data is accessible, reliable, and secure. You will learn to use visualisation tools such as More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Datatech Analytics
Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. … Additionally you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable More ❯
East London, London, United Kingdom Hybrid / WFH Options
Datatech Analytics
Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. … Additionally you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable More ❯
Central London / West End, London, United Kingdom Hybrid / WFH Options
Datatech Analytics
Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. … Additionally you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable More ❯
Job Title: Software Engineer (Consultant) - Data & AI Location: London, hybrid (up to 3 days per week in office) Duration: 12 month FTC, full-time Salary: £70,000-£80,000 Start: ASAP At Pace, our consultants genuinely care about the impact our work has on our customers and their customers alike. We are ‘problem solvers’ who call on our collective … wide Client Lifecycle Management (CLM) system for a leading accounting firm. This role is hands-on and impactful – you’ll be designing and building key technical components such as data migrations, Azure-hosted integrations, and system connectivity across Power Platform, Dataverse, and the firm’s practice management system. You’ll work across a modern stack – including Azure Logic Apps … a mix of Python, C#, and Typescript – all supported by robust CI/CD pipelines and infrastructure automation. Your contributions will be central to ensuring secure, accurate, and timely data movement across the CLM ecosystem. Working alongside the Technical Business Analyst, Test Manager, Change Manager, and Project Manager, you will contribute across key technical workstreams — including endpoint builds, integration More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Pace
Job Title: Software Engineer (Consultant) - Data & AI Location: London, hybrid (up to 3 days per week in office) Duration: 12 month FTC, full-time Salary: £70,000-£80,000 Start: ASAP At Pace, our consultants genuinely care about the impact our work has on our customers and their customers alike. We are ‘problem solvers’ who call on our collective … wide Client Lifecycle Management (CLM) system for a leading accounting firm. This role is hands-on and impactful – you’ll be designing and building key technical components such as data migrations, Azure-hosted integrations, and system connectivity across Power Platform, Dataverse, and the firm’s practice management system. You’ll work across a modern stack – including Azure Logic Apps … a mix of Python, C#, and Typescript – all supported by robust CI/CD pipelines and infrastructure automation. Your contributions will be central to ensuring secure, accurate, and timely data movement across the CLM ecosystem. Working alongside the Technical Business Analyst, Test Manager, Change Manager, and Project Manager, you will contribute across key technical workstreams — including endpoint builds, integration More ❯
Daintta are a rapidly growing, values-driven team of specialists who work with government clients across Cyber, Telecommunications and Data. We are seeking a talented and motivated Data Architect to join our team and contribute to our mission of protecting the UK through data-driven insights and solutions. As a Data Architect, you will work closely with … our public sector clients and project teams to collect, analyse and interpret complex data sets, providing valuable insights that support evidence-based decision-making. Key Responsibilities Leading client projects and providing subject matter expertise Assessing your clients' technical needs and understanding how their needs are different to wants and managing clients' stakeholders relationship appropriately Identifying data sources, data extraction, transformation, and loading (ETL/ELT) concepts and methods Developing suitable data governance and provenance strategies and how they will be implemented in data architecture Designing and evaluating on-premise, cloud-based and hybrid data solutions (including providing review and guidance on testing aspects, identification of risks and proposing and implementing their mitigations) Modelling, structuring More ❯
London, England, United Kingdom Hybrid / WFH Options
Kieran Knight Consulting
Azure/Databricks Data Engineer (D365 F&O Deployment) £550 - £580 PER DAY 6 month contract OUTSIDE IR35 REMOTE, but have to be UK based Our client, a leader in their field, requires a talented Data Engineer, to join their Group technology team, responsible for the global intelligent data platform. You will be joining the business at … a key moment in their evolution and will make a key and lasting impact on our technology organisation and landscape. Reporting to the Group Director of Data and Architecture with responsibility for the data workloads delivered against their Azure/Databricks platform. You will be working within a major transformation programme migrating data to D365 F&O. … You will be expected to have a proactive, hands-on approach. You will be a key contributor to designing, developing, and managing data ingestion processes and transformation pipelines within Azure and Databricks environments. The role involves utilizing Databrick's medallion architecture to create well-defined and governed data consumption models, adopting a data-as-a-product mindset More ❯
supportive, and offers the opportunity for growth. As a company, we live by six core values that guide everything we do: Clear Honest Ambitious Inquisitive Caring Sustainable The Role Data Engineering Lead at SO ENERGY As a Data Engineering Lead, you will be responsible for leading the execution of our data engineering initiatives, ensuring alignment with our … Data Platform Strategy. This role requires a strong balance between hands-on technical expertise and exceptional leadership skills. You will play a crucial role in shaping the data architecture, designing scalable data solutions, and driving best practices in data engineering. Additionally, you will lead and mentor a team of data engineers, fostering a culture of … innovation, collaboration, and continuous improvement. The role requires an inspiring leader who can drive best practices, shape the data engineering roadmap, and align technical solutions with business objectives. Reporting into our Head of Data, Nethin Maharaj . What you'll be getting up to: Lead & Develop the Data Engineering Team Manage, mentor, and develop a team of More ❯
been clearly demonstrated. Your expertise must include design and development experience with various relevant Microsoft platforms, tools, technologies, patterns, and techniques related to MSFT suites, Azure tools, integration, and data is required. Experience with industry/domains like pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred. Experience with healthcare industry regulations, datasecurity and compliance … with MS Office/MS Office 365 suite, SharePoint Online, Power Apps/Power Automate, GitHub, MS Teams, etc. In-depth knowledge & development experience using Azure integration tools like Data factory, Logic Apps, etc. Along with knowledge of utilizing Azure SQL Server, Data lake, etc. In-depth knowledge & experience using Visual Studio, with one of the programming languages … T-SQL, Stored procedures, Functions, Views, Queries, Datatype conversions, etc.). Experience working with APIs, Postman/SOAPUI tools, MS D365, ServiceNow, Azure Analytics tools, Azure Synapse, Azure BYOD & Data verse, Azure DevOps, Informatica, BI tools, etc. is a big plus. General business skills: Excellent communication to translate and explain business requirements to technology & vice-versa. Analytical & methodical mindset More ❯
Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise will enable organisations … to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and data science are distinct but … interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's AI transformation agenda, seeking skilled data specialists to architect and More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Amber Labs
Azure Data Architects x 2 The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all colleagues, regardless of their role, work together to minimise risk and shorten delivery … analysts, and support staff. Mostly remote some Ad hoc travel (London) Eligble for BPSS or SC clearance Digital Transformation Project About the Role: We are seeking highly skilled Azure Data Architects who have worked for the NHS to join our dynamic team. In this role, you will be responsible for designing and implementing end-to-end cloud solutions on … will collaborate closely with stakeholders, engineers, and developers to translate business requirements into secure, scalable, and reliable Azure architectures. Key Responsibilities: Design and implement robust, scalable, and secure Azure data architectures for NHS digital transformation initiatives. Lead architectural discussions and design sessions with stakeholders, ensuring solutions align with NHS requirements and best practices. Develop end-to-end dataMore ❯
Azure Data Architects x 2 The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all colleagues, regardless of their role, work together to minimise risk and shorten delivery … analysts, and support staff. Mostly remote some Ad hoc travel (London) Eligble for BPSS or SC clearance Digital Transformation Project About the Role: We are seeking highly skilled Azure Data Architects who have worked for the NHS to join our dynamic team. In this role, you will be responsible for designing and implementing end-to-end cloud solutions on … will collaborate closely with stakeholders, engineers, and developers to translate business requirements into secure, scalable, and reliable Azure architectures. Key Responsibilities: Design and implement robust, scalable, and secure Azure data architectures for NHS digital transformation initiatives. Lead architectural discussions and design sessions with stakeholders, ensuring solutions align with NHS requirements and best practices. Develop end-to-end dataMore ❯
City of London, London, United Kingdom Hybrid / WFH Options
twentyAI
twentyAI are partnering with a globally renowned law firm currently undergoing a major digital and data transformation. With a deep-rooted legacy in legal excellence and a strong global footprint, the firm is currently modernising their data capability and building a new data platform. About the Role You will be part of a diverse group of engineers … and machine learning experts, working with cutting-edge Azure cloud technologies, including Microsoft Fabric and related services. Your mission is to design reliable, efficient data pipelines that enable the business to access trusted, well-structured data. You will also focus on building and scaling the core data infrastructure that supports advanced analytics and machine learning efforts across the … business. Responsibilities Design and develop end-to-end data pipelines that ingest, transform, and prepare data for analytics and machine learning workflows. Work with Infrastructure as Code, primarily Terraform, to automate and manage cloud infrastructure, enabling repeatable and reliable deployment processes. Collaborate closely with data scientists, MLEs, and business teams in an agile environment to deliver dataMore ❯
twentyAI are partnering with a globally renowned law firm currently undergoing a major digital and data transformation. With a deep-rooted legacy in legal excellence and a strong global footprint, the firm is currently modernising their data capability and building a new data platform. About the Role You will be part of a diverse group of engineers … and machine learning experts, working with cutting-edge Azure cloud technologies, including Microsoft Fabric and related services. Your mission is to design reliable, efficient data pipelines that enable the business to access trusted, well-structured data. You will also focus on building and scaling the core data infrastructure that supports advanced analytics and machine learning efforts across the … business. Responsibilities Design and develop end-to-end data pipelines that ingest, transform, and prepare data for analytics and machine learning workflows. Work with Infrastructure as Code, primarily Terraform, to automate and manage cloud infrastructure, enabling repeatable and reliable deployment processes. Collaborate closely with data scientists, MLEs, and business teams in an agile environment to deliver dataMore ❯
South East London, England, United Kingdom Hybrid / WFH Options
twentyAI
twentyAI are partnering with a globally renowned law firm currently undergoing a major digital and data transformation. With a deep-rooted legacy in legal excellence and a strong global footprint, the firm is currently modernising their data capability and building a new data platform. About the Role You will be part of a diverse group of engineers … and machine learning experts, working with cutting-edge Azure cloud technologies, including Microsoft Fabric and related services. Your mission is to design reliable, efficient data pipelines that enable the business to access trusted, well-structured data. You will also focus on building and scaling the core data infrastructure that supports advanced analytics and machine learning efforts across the … business. Responsibilities Design and develop end-to-end data pipelines that ingest, transform, and prepare data for analytics and machine learning workflows. Work with Infrastructure as Code, primarily Terraform, to automate and manage cloud infrastructure, enabling repeatable and reliable deployment processes. Collaborate closely with data scientists, MLEs, and business teams in an agile environment to deliver dataMore ❯
Who are we looking for? You enjoy working on complex data problems whilst being able to suggest simple (yet effective) solutions. You are comfortable working with uncertainty and like to make things clearer. You're passionate about technology and keep up as it evolves. You focus on the future and thrive most when solving problems. Client's love working … and do things when you say you will, you also know how to explain things clearly and concisely. You can educate and inspire. You've got a background in data science, machine learning algorithms and data engineering along with their technologies. You're equally comfortable presenting to clients, providing advice or building prototypes. You're a collaborator and … matter expertise. Working in scrum-like environments for iterative and 'fail-fast' work and innovation. Assessing your clients' business and technical needs with the ability to identify opportunities for data science to be used and managing clients' stakeholders' relationship appropriately. Solving problems using data science techniques and in a scientifically robust fashion. Identifying data sources that are More ❯