Senior Data Engineer - (Azure/Databricks) page is loaded Senior Data Engineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 7 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding client service, intelligent … family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. Senior Data Engineer (Azure/Databricks Job Family Grouping: Chief Underwriting Officer Job Family: Data & Analytics Location: London How does this role contribute to our collective success? The Data & Analytics department transforms raw data into actionable … MDW) technologies, big data, and Lakehouse architectures to ensure our data solutions are secure, efficient, and optimized. Key Responsibilities: Design and implement data solutions using Azure services, including Azure Databricks, ADF, and Data Lake Storage. Develop and maintain ETL/ELT pipelines to process structured and unstructured data from multiple sources. - Automate loads using Databricks workflows and Jobs Develop, test More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Robert Half
testing methodologies and development team collaboration Experience working with Power BI and DAX Strong documentation, communication, and stakeholder engagement skills Preferred Qualifications: Experience with Lakehouse architecture, Delta Lake, or Databricks Exposure to Agile/Scrum working practices Microsoft certifications (e.g., Azure Data Engineer Associate) Background in consulting or professional services Understanding of data governance and data security principles Nice to More ❯
with data visualisation platforms like Tableau or Power BI Exposure to machine learning or data science application development Knowledge of modern data platform technologies such as Quantexa, Palantir, or Databricks Proficiency with open-source data tools and frameworks Experience with test automation within CI/CD pipelines Reference: AMC/RHU/LDE #ryhu More ❯
and internal policies. What We're Looking For: Solid experience in data engineering or backend data development. Strong experience with Azure data services (e.g., Data Factory, Dake Lake, Synapse, Databricks) and tools like dbt. Proficiency in SQL and Python, with a solid understanding of data modelling and transformation. Experience integrating data from enterprise systems (CRM, ERP, HRIS). Familiarity with More ❯
and internal policies. What We're Looking For: Solid experience in data engineering or backend data development. Strong experience with Azure data services (e.g., Data Factory, Dake Lake, Synapse, Databricks) and tools like dbt. Proficiency in SQL and Python, with a solid understanding of data modelling and transformation. Experience integrating data from enterprise systems (CRM, ERP, HRIS). Familiarity with More ❯
and internal policies. What We're Looking For: Solid experience in data engineering or backend data development. Strong experience with Azure data services (e.g., Data Factory, Dake Lake, Synapse, Databricks) and tools like dbt. Proficiency in SQL and Python, with a solid understanding of data modelling and transformation. Experience integrating data from enterprise systems (CRM, ERP, HRIS). Familiarity with More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Tenth Revolution Group
and internal policies. What We're Looking For: Solid experience in data engineering or backend data development. Strong experience with Azure data services (e.g., Data Factory, Dake Lake, Synapse, Databricks) and tools like dbt. Proficiency in SQL and Python, with a solid understanding of data modelling and transformation. Experience integrating data from enterprise systems (CRM, ERP, HRIS). Familiarity with More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Tenth Revolution Group
and internal policies. What We're Looking For: Solid experience in data engineering or backend data development. Strong experience with Azure data services (e.g., Data Factory, Dake Lake, Synapse, Databricks) and tools like dbt. Proficiency in SQL and Python, with a solid understanding of data modelling and transformation. Experience integrating data from enterprise systems (CRM, ERP, HRIS). Familiarity with More ❯
South West London, London, England, United Kingdom Hybrid / WFH Options
Tenth Revolution Group
and internal policies. What We're Looking For: Solid experience in data engineering or backend data development. Strong experience with Azure data services (e.g., Data Factory, Dake Lake, Synapse, Databricks) and tools like dbt. Proficiency in SQL and Python, with a solid understanding of data modelling and transformation. Experience integrating data from enterprise systems (CRM, ERP, HRIS). Familiarity with More ❯
Cardiff, South Glamorgan, Wales, United Kingdom Hybrid / WFH Options
Octad Recruitment Consultants (Octad Ltd )
Azure engineering experience (IaaS ? PaaS), including Infra as Code. Strong SQL skills and proficiency in Python or PySpark . Built or maintained data lakes/warehouses using Synapse , Fabric , Databricks , Snowflake , or Redshift . Experience hardening cloud environments (NSGs, identity, Defender). Demonstrated automation of backups, CI/CD deployments, or DR workflows. Nice-to-Haves: Experience with Azure OpenAI More ❯
Cardiff, South Glamorgan, Wales, United Kingdom Hybrid / WFH Options
Octad Recruitment Ltd
Azure engineering experience (IaaS PaaS), including Infra as Code. Strong SQL skills and proficiency in Python or PySpark . Built or maintained data lakes/warehouses using Synapse , Fabric , Databricks , Snowflake , or Redshift . Experience hardening cloud environments (NSGs, identity, Defender). Demonstrated automation of backups, CI/CD deployments, or DR workflows. Nice-to-Haves: Experience with Azure OpenAI More ❯
data from various sources. Ensure that pipelines are automated, scalable, and fault-tolerant to accommodate large volumes of data. Experience with Notebooks, Pipelines, and Workflows: Utilise Notebooks (e.g., Jupyter, Databricks) for data exploration, analysis, and reporting. Design and optimise data workflows to streamline key processing tasks, enhancing operational efficiency. API Integration & Data Ingestion: Integrate external and internal APIs to ingest More ❯
junior colleagues, including line management and development of teams, where required. Essential Skills and Experience: Educated to degree level or have equivalent professional experience. Essential experience of MS Azure Databricks, Synapse, ADF and CI/CD Experience working with Database technologies such as SQL Server, and Data Warehouse Architecture with knowledge of big data, data lakes and NoSQL. Experience following More ❯
the ability to influence at both technical and senior stakeholder levels. Desirable Skills: Familiarity with data visualisation tools (e.g., Power BI, Tableau). Exposure to platforms such as Quantexa, Databricks, or Palantir. Experience building machine learning pipelines or working on data science applications. Knowledge of test automation and CI/CD for data workflows. This is a unique opportunity to More ❯
Promote user adoption, training, and change management initiatives Ensure high standards of documentation and data security compliance Technical Skills (desirable): Microsoft Azure Data Services (e.g., Azure Data Factory, Synapse, Databricks, Fabric) Data warehousing and lakehouse design ETL/ELT pipelines SQL, Python for data manipulation and machine learning Big Data frameworks (e.g., Hadoop, Spark) Data visualisation (e.g., Power BI) Understanding More ❯
Reading, Oxfordshire, United Kingdom Hybrid / WFH Options
Henderson Drake
Promote user adoption, training, and change management initiatives Ensure high standards of documentation and data security compliance Technical Skills (desirable): Microsoft Azure Data Services (e.g., Azure Data Factory, Synapse, Databricks, Fabric) Data warehousing and lakehouse design ETL/ELT pipelines SQL, Python for data manipulation and machine learning Big Data frameworks (e.g., Hadoop, Spark) Data visualisation (e.g., Power BI) Understanding More ❯
Reading, Berkshire, United Kingdom Hybrid / WFH Options
Henderson Drake
Promote user adoption, training, and change management initiatives Ensure high standards of documentation and data security compliance Technical Skills (desirable): Microsoft Azure Data Services (e.g., Azure Data Factory, Synapse, Databricks, Fabric) Data warehousing and lakehouse design ETL/ELT pipelines SQL, Python for data manipulation and machine learning Big Data frameworks (e.g., Hadoop, Spark) Data visualisation (e.g., Power BI) Understanding More ❯
East London, London, United Kingdom Hybrid / WFH Options
Client Server
and data modelling; as well as healthcare technology and regulatory requirements (ISO13485, ISO27001) You have experience of managing data in Azure using tools such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics You have a good knowledge of Data Lake and Data Warehouse architectures You have experience implementing monitoring and logging for data pipelines You are collaborative, enjoy problem More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Client Server Ltd
and data modelling; as well as healthcare technology and regulatory requirements (ISO13485, ISO27001) You have experience of managing data in Azure using tools such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics You have a good knowledge of Data Lake and Data Warehouse architectures You have experience implementing monitoring and logging for data pipelines You are collaborative, enjoy problem More ❯
as an Azure Data Architect or Lead Data Engineer. Expertise in Microsoft Fabric, as well as in one or more of the following platforms: Azure Synapse Analytics and Azure Databricks, and supporting data technologies like Power BI, Microsoft Purview, Azure SQL Database, Azure Data Lake, etc. Excellent stakeholder engagement and communication skills. Able to consult, advise, architect and estimate project More ❯
Manchester Area, United Kingdom Hybrid / WFH Options
Noir
Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge technologies and contribute to exciting projects More ❯
Studio). Strong Data Analysis skills and hands-on experience with SQL/Python for data interrogation. Working knowledge of Cloud-based data and analytics solutions (e.g., Microsoft Azure, Databricks, Informatica, PowerBI) and ETL/ELT technology (e.g., Informatica DEI). Proven ability to understand business processes, facilitate meetings with senior stakeholders, and translate business requirements into technical designs. Excellent More ❯
Basingstoke, Hampshire, United Kingdom Hybrid / WFH Options
Automobile Association
Studio). Strong Data Analysis skills and hands-on experience with SQL/Python for data interrogation. Working knowledge of Cloud-based data and analytics solutions (e.g., Microsoft Azure, Databricks, Informatica, PowerBI) and ETL/ELT technology (e.g., Informatica DEI). Proven ability to understand business processes, facilitate meetings with senior stakeholders, and translate business requirements into technical designs. Excellent More ❯
and junior colleagues, including line management and development of teams, where required. Essential Skills and Experience: ·Educated to degree level or have equivalent professional experience. ·Experience of MS Azure Databricks ·Experience working with Database technologies such as SQL Server, and Data Warehouse Architecture with knowledge of big data, data lakes and NoSQL. ·Experience following product/solution development lifecycles using More ❯
building robust delivery pipelines if the solution is to adopt modern DevOps processes. What does it take to be a Data Engineer? Previous experience in data engineering ideally using Databricks, Azure Data Factory, Spark, Python, SQL, Cosmos DB, Microsoft Azure Analysis services, PowerBI Experience in delivering end to end BI solution from requirements, design to delivery Experience of working within More ❯