1 to 25 of 152 Remote Databricks Jobs in London

Senior Data Engineer - (Azure/Databricks) page is loaded Senior Data Engineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 7 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding client service, intelligent … family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. Senior Data Engineer (Azure/Databricks Job Family Grouping: Chief Underwriting Officer Job Family: Data & Analytics Location: London How does this role contribute to our collective success? The Data & Analytics department transforms raw data into actionable … MDW) technologies, big data, and Lakehouse architectures to ensure our data solutions are secure, efficient, and optimized. Key Responsibilities: Design and implement data solutions using Azure services, including Azure Databricks, ADF, and Data Lake Storage. Develop and maintain ETL/ELT pipelines to process structured and unstructured data from multiple sources. - Automate loads using Databricks workflows and Jobs Develop, test More ❯

testing methodologies and development team collaboration Experience working with Power BI and DAX Strong documentation, communication, and stakeholder engagement skills Preferred Qualifications: Experience with Lakehouse architecture, Delta Lake, or Databricks Exposure to Agile/Scrum working practices Microsoft certifications (e.g., Azure Data Engineer Associate) Background in consulting or professional services Understanding of data governance and data security principles Nice to More ❯

viable, and aligned with client expectations. Enterprise Solution Design : Architect and lead the delivery of large-scale data platforms (including lakes, lakehouses, and warehouses) using GCP, Cloud Storage, BigQuery, Databricks, Snowflake. Cloud Data Strategy: Own cloud migration and modernisation strategy, leveraging GCP, and tools such as Terraform, Azure DevOps, GitHub, and CI/CD pipelines. Data Modelling: Apply deep hands More ❯

and internal policies. What We're Looking For: Solid experience in data engineering or backend data development. Strong experience with Azure data services (e.g., Data Factory, Dake Lake, Synapse, Databricks) and tools like dbt. Proficiency in SQL and Python, with a solid understanding of data modelling and transformation. Experience integrating data from enterprise systems (CRM, ERP, HRIS). Familiarity with More ❯

and internal policies. What We're Looking For: Solid experience in data engineering or backend data development. Strong experience with Azure data services (e.g., Data Factory, Dake Lake, Synapse, Databricks) and tools like dbt. Proficiency in SQL and Python, with a solid understanding of data modelling and transformation. Experience integrating data from enterprise systems (CRM, ERP, HRIS). Familiarity with More ❯

and internal policies. What We're Looking For: Solid experience in data engineering or backend data development. Strong experience with Azure data services (e.g., Data Factory, Dake Lake, Synapse, Databricks) and tools like dbt. Proficiency in SQL and Python, with a solid understanding of data modelling and transformation. Experience integrating data from enterprise systems (CRM, ERP, HRIS). Familiarity with More ❯

and internal policies. What We're Looking For: Solid experience in data engineering or backend data development. Strong experience with Azure data services (e.g., Data Factory, Dake Lake, Synapse, Databricks) and tools like dbt. Proficiency in SQL and Python, with a solid understanding of data modelling and transformation. Experience integrating data from enterprise systems (CRM, ERP, HRIS). Familiarity with More ❯

and internal policies. What We're Looking For: Solid experience in data engineering or backend data development. Strong experience with Azure data services (e.g., Data Factory, Dake Lake, Synapse, Databricks) and tools like dbt. Proficiency in SQL and Python, with a solid understanding of data modelling and transformation. Experience integrating data from enterprise systems (CRM, ERP, HRIS). Familiarity with More ❯

and internal policies. What We're Looking For: Solid experience in data engineering or backend data development. Strong experience with Azure data services (e.g., Data Factory, Dake Lake, Synapse, Databricks) and tools like dbt. Proficiency in SQL and Python, with a solid understanding of data modelling and transformation. Experience integrating data from enterprise systems (CRM, ERP, HRIS). Familiarity with More ❯

data from various sources. Ensure that pipelines are automated, scalable, and fault-tolerant to accommodate large volumes of data. Experience with Notebooks, Pipelines, and Workflows: Utilise Notebooks (e.g., Jupyter, Databricks) for data exploration, analysis, and reporting. Design and optimise data workflows to streamline key processing tasks, enhancing operational efficiency. API Integration & Data Ingestion: Integrate external and internal APIs to ingest More ❯

teams, where required. Essential Skills and Experience: Educated to degree level or have equivalent professional experience. Experience translating business requirements into solution design and implementation. Experience of MS Azure Databricks Experience working with Database technologies such as SQL Server, and Data Warehouse Architecture with knowledge of big data, data lakes and NoSQL. Experience following product/solution development lifecycles using More ❯

junior colleagues, including line management and development of teams, where required. Essential Skills and Experience: Educated to degree level or have equivalent professional experience. Essential experience of MS Azure Databricks, Synapse, ADF and CI/CD Experience working with Database technologies such as SQL Server, and Data Warehouse Architecture with knowledge of big data, data lakes and NoSQL. Experience following More ❯

and data modelling; as well as healthcare technology and regulatory requirements (ISO13485, ISO27001) You have experience of managing data in Azure using tools such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics You have a good knowledge of Data Lake and Data Warehouse architectures You have experience implementing monitoring and logging for data pipelines You are collaborative, enjoy problem More ❯

and data modelling; as well as healthcare technology and regulatory requirements (ISO13485, ISO27001) You have experience of managing data in Azure using tools such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics You have a good knowledge of Data Lake and Data Warehouse architectures You have experience implementing monitoring and logging for data pipelines You are collaborative, enjoy problem More ❯

as an Azure Data Architect or Lead Data Engineer. Expertise in Microsoft Fabric, as well as in one or more of the following platforms: Azure Synapse Analytics and Azure Databricks, and supporting data technologies like Power BI, Microsoft Purview, Azure SQL Database, Azure Data Lake, etc. Excellent stakeholder engagement and communication skills. Able to consult, advise, architect and estimate project More ❯

data integration, and data governance, and at least 2 years of experience with cloud-based AI/ML technologies (such as tools from AWS, Azure, Google, HuggingFace, OpenAI and Databricks) building ML or applied AI solutions. A passion for Generative AI, and an understanding of strengths and weaknesses of Generative LLM's Fundamental knowledge of ML, and basic knowledge of More ❯

Studio). Strong Data Analysis skills and hands-on experience with SQL/Python for data interrogation. Working knowledge of Cloud-based data and analytics solutions (e.g., Microsoft Azure, Databricks, Informatica, PowerBI) and ETL/ELT technology (e.g., Informatica DEI). Proven ability to understand business processes, facilitate meetings with senior stakeholders, and translate business requirements into technical designs. Excellent More ❯

and junior colleagues, including line management and development of teams, where required. Essential Skills and Experience: ·Educated to degree level or have equivalent professional experience. ·Experience of MS Azure Databricks ·Experience working with Database technologies such as SQL Server, and Data Warehouse Architecture with knowledge of big data, data lakes and NoSQL. ·Experience following product/solution development lifecycles using More ❯

engagementtranslating client requirements into solution blueprints and supporting proposal development. Key Responsibilities Architect and oversee the delivery of enterprise-scale data platforms (data lakes, lakehouses, warehouses) using tools like Databricks , Snowflake , Synapse , and Azure Fabric Define and execute cloud migration strategies, leveraging CI/CD pipelines, Terraform, Azure DevOps, and GitHub Support RFP/RFI responses, conduct client workshops, and More ❯

quality assurance, test automation, or data validation . Experience in testing data pipelines, ETL/ELT workflows, and big data environments . Familiarity with Azure data platforms , such as Databricks, Azure Data Factory, Synapse Analytics, or ADLS . Proficiency in SQL and scripting languages (e.g., Python, Scala) for data validation and test automation. Experience with test automation frameworks (e.g., Great More ❯

or Azure DevOps . Excellent communication skills and stakeholder engagement capabilities. Nice to Have Familiarity with data visualization tools (e.g., Power BI, Tableau). Exposure to cloud platforms (e.g., Databricks , Snowflake ). Understanding of data governance , lineage , and metadata management . Experience with data cataloguing and quality frameworks . More ❯

Key Experience Required: Proven experience as a Data Solution Architect on complex, multi-disciplinary consulting engagements Deep knowledge of Kafka , Confluent , and event-driven architecture Hands-on experience with Databricks , Unity Catalog , and Lakehouse architectures Strong architectural understanding across AWS, Azure, GCP , and Snowflake Familiarity with Apache Spark, SQL/NoSQL databases, and programming (Python, R, Java) Knowledge of data More ❯

firm Modeling data for a civil service department replacing a legacy HR system Experience and qualifications Technical 3+ years' experience in data or software engineering Knowledge of Python, SQL, Databricks, Snowflake, and major cloud platforms (AWS/Azure/GCP) Ability to learn quickly and adapt to new technologies and sectors Understanding of data engineering best practices and system design More ❯

role. Experience with Agile/Scrum Framework. Excellent problem-solving and analytical skills. Excellent communication skills, both at a deep technical level and stakeholder level. Data Expert experience with Databricks (PySpark). Experience building and maintaining complex ETL Projects, end-to-end (ingestion, processing, storage). Expert knowledge and experience with data modelling, data access, and data storage techniques. Experience More ❯

junior colleagues. You will bring experience in designing data solutions, writing code, and documentation, and must have strong skills in tools including but not limited to: MS Fabric stack Databricks Azure SQL Tableau/Power BI A knowledge of data modelling and of general IT architecture and systems integration is also required. Other technologies such as Azure Data Factory, RedShift More ❯