376 to 400 of 868 Permanent Databricks Jobs

Job Description Please make an application promptly if you are a good match for this role due to high levels of interest. We have an exciting and rewarding opportunity for you to take your software engineering career to the next More ❯

We are seeking a Senior Data Engineer for our Oil & Gas Operator client based in Aberdeen. This is a STAFF role working as part of a Data Team where you will be focussed on process and looking for improvements. As More ❯

Principal Data Engineer Hybrid - London – weekly office visit We’re working with a cutting-edge SaaS business that's revolutionising how organisations integrate systems, manage data, and deliver insights. This high-growth, product-led company offers a game-changing, AI More ❯

Principal Data Engineer Hybrid - London – weekly office visit We’re working with a cutting-edge SaaS business that's revolutionising how organisations integrate systems, manage data, and deliver insights. This high-growth, product-led company offers a game-changing, AI More ❯

Strategic planning and execution of projects, ensuring alignment with broader company objectives and vision. Extensive hands-on software engineering background, primarily based around their core data capabilities of Python, Databricks, AWS, Azure. Ideally, you will have a background of working within data analytics/data intelligence organisations. Strong experience designing, building, and supporting infrastructure in cloud environments. Deep understanding of More ❯

Strategic planning and execution of projects, ensuring alignment with broader company objectives and vision. Extensive hands-on software engineering background, primarily based around their core data capabilities of Python, Databricks, AWS, Azure. Ideally, you will have a background of working within data analytics/data intelligence organisations. Strong experience designing, building, and supporting infrastructure in cloud environments. Deep understanding of More ❯

products and analytics. Key Responsibilities: Lead and grow a small team of data engineers and developers (initially 2 headcount) Drive the end-to-end delivery of data solutions using Databricks Define and implement scalable, secure, and high-performing data platform architecture Establish strong partnerships with business stakeholders to understand requirements and deliver fit-for-purpose solutions Champion best practices in … data governance, pipeline development, and cloud infrastructure Monitor and manage platform performance, resolving issues efficiently Stay current on the evolving Databricks ecosystem and emerging technologies to keep the platform innovative Maintain clear technical documentation and ensure delivery consistency Experience Required: 5+ years in data engineering or platform roles, with 2+ years in a management or technical leadership position Proven hands … on experience with Databricks, with broader exposure to platforms such as Hadoop or Spark Strong understanding of data processing, ETL pipelines, and warehousing principles Experience with cloud services (AWS or Azure preferred) Excellent leadership, stakeholder engagement, and communication skills Ability to define technical roadmaps and influence architecture decisions Databricks certification is a plus Skills and Competencies: Databricks and Spark ecosystem More ❯

Data Engineer Azure | Databricks | PySpark | Hybrid Cloud | Fabric Location: London (Hybrid) Salary: £85,000 + Bonus + Benefits Type: Permanent A Data Engineer is required for a fast-evolving (re)insurance business at the heart of the Lloyd's market, currently undergoing a major data transformation. With a strong foundation in the industry and a clear vision for the future … looking for a Data Engineer to join their growing team. This is a hands-on role focused on building scalable data pipelines and enhancing a modern Lakehouse architecture using Databricks, PySpark, and Azure. The environment is currently hybrid cloud and on-prem, with a strategic move towards Microsoft Fabric-so experience across both is highly valued. What you'll be … doing: Building and maintaining robust data pipelines using Databricks, PySpark, and Azure Data Factory. Enhance and maintain a Lakehouse architecture using Medallion principles Working across both cloud and on-prem environments, supporting the transition to Microsoft Fabric. Collaborating with stakeholders across Underwriting, Actuarial, and Finance to deliver high-impact data solutions. Support DevOps practices and CI/CD workflows in More ❯

needs) Contract duration: 6 months Location: London JOB DETAILS Role Title: Senior Data Engineer Note: (Please do not submit the same profiles as for 111721-1) Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have … Gold) using ADF, Python, and PySpark. Must have hands-on experience with PySpark, Python, AWS, data modelling. Must have experience in ETL processes. Must have hands-on experience in Databricks development. Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must have hands-on experience in SQL development. Excellent More ❯

Core Responsibilities: Contribute as a Senior Data/AI Engineer within the client's internal Data Center of Excellence. Maintain and evolve a modern cloud-based data platform using Databricks and Azure. Lead technical deployment and ownership of advanced AI services including search, document intelligence, and large language models. Implement governance, compliance, and security best practices across Azure-based services. … Of the Collaborate with internal stakeholders and cross-functional teams to deliver AI-enabled solutions. Qualifications Proven experience as a Data/AI Engineer Expert in Databricks with at least 3 years of practical experience Experience with Azure AI Services Experience with Infrastructure as Code using Terraform Possibility to work remotely (up to 50%). Skills AI Azure Services Level … Expert This includes; AI Foundry, AI Search, OpenAI, Document Intelligence Azure Level Expert Azure platform and infrastructure management Data Pipeline & ETL Processes Level Advanced Databricks Level Expert Infrastructure As Code (Terraform) Level Advanced Performance Tuning & Optimization Level Advanced Python Level Advanced Spark Level Intermediate SQL Level Advanced More ❯

The Machine Learning (ML) Practice team is a highly specialized customer-facing ML team at Databricks facing an increasing demand for Large Language Model (LLM)-based solutions. We deliver professional services engagements to help our customers build, scale, and optimize ML pipelines, as well as put those pipelines into production. We work cross-functionally to shape long-term strategic priorities … teams on various data science such as architecture, tooling, and best practices Present at conferences such as Data+AI Summit Provide technical mentorship to the larger ML SME community in Databricks Collaborate cross-functionally with the product and engineering teams to define priorities and influence the product roadmap What we look for: Experience building Generative AI applications, including RAG, agents, text2sql … and/or teaching technical concepts to non-technical and technical audiences alike Passion for collaboration, life-long learning, and driving business value through ML Preferred Experience working with Databricks & Apache Spark to process large-scale distributed datasets About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide - including Comcast, Condé Nast, Grammarly, and over More ❯

the hunt for a Data Engineering Unit Head to join the IT Data and Analytics team, where you’ll spearhead innovation across cloud-native architecture, Azure Data Platform, and Databricks ecosystems—powering insights across an entire banking empire. Why Join? Opportunity to relocate and live in Manila, Philippines Influence the strategy of a banking giant in hyper-growth mode Senior … engineering excellence What You’ll Lead: • Data platform strategy, standards, and architecture at scale • End-to-end data pipeline optimization using Azure Data Factory, SQL, Cosmos DB, Streaming, and Databricks • A high-performing team of engineers, analysts, and architects • Strategic vendor partnerships and enterprise data governance initiatives • Cross-functional collaboration with business leaders and technical stakeholders What You’ll Bring … 10+ years in data engineering, with solid leadership experience Mastery of Azure cloud data services and Databricks Expertise in large-scale data platforms, ETL frameworks, and DevOps practices Passion for building team capability, coaching talent, and enforcing engineering standards Background in banking/finance? MUST HAVE Location: Full-time role requiring relocation to Manila, Philippines. Reporting to: CIO – Head of More ❯

At Databricks, we are on a mission to empower our customers to solve the world's toughest data problems by utilising the Databricks Data Intelligence Platform. As a Delivery Solutions Architect (DSA), you will play an important role during this journey. You will collaborate with our sales and field engineering teams to accelerate the adoption and growth of the Databricks … Platform in your customers. You will also help ensure customer success by increasing focus and technical accountability to our most complex customers who need guidance to accelerate usage on Databricks workloads that they have already selected, helping them maximise the value they get of our platform and the return on investment. This is a hybrid technical and commercial role. It … the sense that you will drive growth in your assigned customers and use cases through leading your customers' stakeholders, building executive relationships, orchestrating other focused/specialised teams within Databricks, and creating and driving plans and strategies for Databricks colleagues to build upon. This is in parallel to being technical, with expectations being that you become the post-sale technical More ❯

be responsible for maintaining and evolving data pipelines, contributing to architecture decisions, and working closely with both internal stakeholders and external vendors. The tech stack centres around AWS and Databricks , and you'll have the chance to drive impactful data initiatives from day one. Key Responsibilities: Build, maintain, and scale reliable data pipelines Work across AWS services (Redshift, Glue, Lambdas … and Databricks Design and evolve data models, data lakes, and warehouse solutions Apply CI/CD practices using GitHub and modern DevOps workflows Engage with cross-functional teams and vendors to deliver high-quality data solutions What We're Looking For: Strong hands-on experience with AWS, Databricks, and Python Proven ability to work with large-scale datasets and cloud More ❯

empowers advanced analytics, supports regulatory reporting, and drives long-term business value. You will lead the design of a high-performance data estate, built primarily on Microsoft Azure and Databricks Key Responsibilities: Design and implement scalable, secure cloud-based data architecture (Azure & Databricks) Develop optimised data models and pipelines using Delta Lake and Azure services Define data standards, policies, and … data engineering and architecture Collaborate with internal stakeholders and third-party vendors Key Skills & Experience: Proven background designing and delivering enterprise-scale data platforms Strong knowledge of Microsoft Azure, Databricks, Delta Lake, and data warehousing Advanced data modelling and ETL/ELT optimisation experience Familiarity with regulatory frameworks such as IFRS 17 , BCBS 239 , and UK Data Protection Excellent stakeholder … cross-functional collaboration skills Prior experience in a regulated industry (e.g. insurance, financial services, healthcare) is desirable Microsoft Certified: Azure Solutions Architect Expert Microsoft Certified: Azure Data Engineer Associate Databricks Certified Data Engineer or Machine Learning Associate Benefits for the Enterprise Data Architect Discretionary annual bonus Hybrid working (2 days office/3 days home) 25 days annual leave + More ❯

empowers advanced analytics, supports regulatory reporting, and drives long-term business value. You will lead the design of a high-performance data estate, built primarily on Microsoft Azure and Databricks Key Responsibilities: Design and implement scalable, secure cloud-based data architecture (Azure & Databricks) Develop optimised data models and pipelines using Delta Lake and Azure services Define data standards, policies, and … data engineering and architecture Collaborate with internal stakeholders and third-party vendors Key Skills & Experience: Proven background designing and delivering enterprise-scale data platforms Strong knowledge of Microsoft Azure, Databricks, Delta Lake, and data warehousing Advanced data modelling and ETL/ELT optimisation experience Familiarity with regulatory frameworks such as IFRS 17 , BCBS 239 , and UK Data Protection Excellent stakeholder … cross-functional collaboration skills Prior experience in a regulated industry (e.g. insurance, financial services, healthcare) is desirable Microsoft Certified: Azure Solutions Architect Expert Microsoft Certified: Azure Data Engineer Associate Databricks Certified Data Engineer or Machine Learning Associate Benefits for the Enterprise Data Architect Discretionary annual bonus Hybrid working (2 days office/3 days home) 25 days annual leave + More ❯

empowers advanced analytics, supports regulatory reporting, and drives long-term business value. You will lead the design of a high-performance data estate, built primarily on Microsoft Azure and Databricks Key Responsibilities: Design and implement scalable, secure cloud-based data architecture (Azure & Databricks) Develop optimised data models and pipelines using Delta Lake and Azure services Define data standards, policies, and … data engineering and architecture Collaborate with internal stakeholders and third-party vendors Key Skills & Experience: Proven background designing and delivering enterprise-scale data platforms Strong knowledge of Microsoft Azure, Databricks, Delta Lake, and data warehousing Advanced data modelling and ETL/ELT optimisation experience Familiarity with regulatory frameworks such as IFRS 17 , BCBS 239 , and UK Data Protection Excellent stakeholder … cross-functional collaboration skills Prior experience in a regulated industry (e.g. insurance, financial services, healthcare) is desirable Microsoft Certified: Azure Solutions Architect Expert Microsoft Certified: Azure Data Engineer Associate Databricks Certified Data Engineer or Machine Learning Associate Benefits for the Enterprise Data Architect Discretionary annual bonus Hybrid working (2 days office/3 days home) 25 days annual leave + More ❯

be responsible for maintaining and evolving data pipelines, contributing to architecture decisions, and working closely with both internal stakeholders and external vendors. The tech stack centres around AWS and Databricks, and you’ll have the chance to drive impactful data initiatives from day one. Key Responsibilities: Build, maintain, and scale reliable data pipelines Work across AWS services (Redshift, Glue, Lambda … and Databricks Design and evolve data models, data lakes, and warehouse solutions Apply CI/CD practices using GitHub and modern DevOps workflows Engage with cross-functional teams and vendors to deliver high-quality data solutions What We’re Looking For: Strong hands-on experience with AWS, Databricks, and Python Proven ability to work with large-scale datasets and cloud More ❯

effective data management and analytics across the organisation. The ideal candidate will have strong expertise in data architecture, data modelling, and data governance, with hands-on experience in Azure Databricks and Unity Catalog for metadata management and scalable data & analytics. Key responsibilities Define and enforce enterprise data architecture principles, policies, and standards in collaboration with the Head of Data. Develop … and maintain current (as-is) and future (to-be) data architecture blueprints, ensuring alignment with business needs. Design and document conceptual, logical, and physical data models, optimizing for Azure Databricks Lakehouse implementation and Unity Catalog integration. Implement and manage data cataloguing and metadata governance using Unity Catalog to contextualise data and ensure data discoverability, lineage, and compliance. Support Head of … Data to define data access, security, and sharing policies for the enterprise and work with the engineering team to implement policies within Azure Databricks environments. Work closely with business stakeholders, IT, and external partners to capture data requirements and translate them into scalable architectural solutions. Ensure data architecture supports regulatory compliance, security, and data quality requirements. Support Head of Data More ❯

Senior Data Architect Azure/Databricks/Python Location: London (2 days per week in-office) Salary: ~£100,000 Type: Permanent Join a global leader in legal market intelligence as they embark on a major data transformation journey. Our client is internationally recognised for their deep-dive publications, trusted globally in the same way the Michelin Guide is for restaurants. … engineering team to define the platforms technical direction Deliver architectural outputs and solutions aligned with governance, compliance, and performance best practices Work with both structured and unstructured datasets, leveraging Databricks and Azure Data Factory Provide thought leadership across data strategy, tooling, and modelling Tech Environment Azure Cloud Services (Data Factory, Databricks, Azure SQL, CosmosDB, Synapse) SQL Server (on-prem and More ❯

Senior Data Architect – Azure/Databricks/Python Location: London (2 days per week in-office) Salary: Up to £100,000 Join a global leader in legal market intelligence as they embark on a major data transformation journey. Our client is internationally recognised for their deep-dive publications, trusted globally in the same way the Michelin Guide is for restaurants. … team to define the platform’s technical direction Deliver architectural outputs and solutions aligned with governance, compliance, and performance best practices Work with both structured and unstructured datasets, leveraging Databricks and Azure Data Factory Provide thought leadership across data strategy, tooling, and modelling Tech Environment Azure Cloud Services (Data Factory, Databricks, Azure SQL, CosmosDB, Synapse) SQL Server (on-prem and More ❯

Senior Data Architect – Azure/Databricks/Python Location: London (2 days per week in-office) Salary: Up to £100,000 Join a global leader in legal market intelligence as they embark on a major data transformation journey. Our client is internationally recognised for their deep-dive publications, trusted globally in the same way the Michelin Guide is for restaurants. … team to define the platform’s technical direction Deliver architectural outputs and solutions aligned with governance, compliance, and performance best practices Work with both structured and unstructured datasets, leveraging Databricks and Azure Data Factory Provide thought leadership across data strategy, tooling, and modelling Tech Environment Azure Cloud Services (Data Factory, Databricks, Azure SQL, CosmosDB, Synapse) SQL Server (on-prem and More ❯

currently 2 engineers + external partners) across complex data and cloud engineering projects Designing and delivering distributed solutions on an AWS-centric stack, with open-source flexibility Working with Databricks, Apache Iceberg, and Kubernetes in a cloud-agnostic environment Guiding architecture and implementation of large-scale data pipelines for structured and unstructured data Steering direction on software stack, best practices … deployments (especially AWS), and orchestration technologies Proven delivery of big data solutions-not necessarily at FAANG scale, but managing high-volume, complex data (structured/unstructured) Experience working with Databricks, Apache Iceberg, or similar modern data platforms Experience of building software environments from the ground up, setting best practice and standards Experience leading and mentoring teams Worked in a startup … that is adaptable Tech Stack Snapshot Languages: Python and data engineering background. Opportunity to shape wider tech stack moving forward. Cloud: AWS preferred, cloud-agnostic approach encouraged Data: SQL, Databricks, Iceberg, Kubernetes, large-scale data pipelines CI/CD & Ops: Open source tools, modern DevOps principles Why Join Us? Impactful Work - Help solve security problems that truly matter Ownership & Autonomy More ❯

and delivery of a secure, scalable data platform using Azure services. * Collaborate with internal teams and external partners to meet critical delivery milestones. * Build robust data pipelines using ADF, Databricks, and Synapse. * Work in an agile delivery environment with regular integration and testing. * Attend one in-person workshop per month in London. Required Skills & Experience: * Strong hands-on experience with … Azure Data Factory, Databricks, and Synapse. * Proven track record of delivering secure, performant data engineering solutions. * Ability to work independently and collaboratively in a remote-first setup. * Active SC and NPPV3 clearance. * Excellent problem-solving and stakeholder communication skills. Contract Details: * Start Date: Within 2 weeks * Rate: up to £475/day * IR35: Outside IR35 * Location: Remote-first, with monthly More ❯

at Howden. Job Title: Data Architect Location: London/Hybrid Job Type: Full-time Job Summary Are you passionate about designing scalable, high-performance data architectures on Azure and Databricks ? Do you thrive on solving complex data challenges, integrating modern data platforms, and defining best practices for enterprise data management? We are looking for a Data Architect to lead the … you enjoy working with big data technologies, governance frameworks, and modern analytics platforms , this role is for you! Key Responsibilities Design and architect scalable, secure, and cost-effective Azure Databricks solutions for business and analytical workloads. Translate business requirements into high-level and low-level solution designs , ensuring alignment with best practices. Define and implement enterprise data governance, security, and … and-spoke data architectures , optimising for performance, scalability, and security. Collaborate with business stakeholders, data engineers, and analytics teams to ensure solutions are fit for purpose. Implement and optimise Databricks Delta Lake, Medallion Architecture, and Lakehouse patterns for structured and semi-structured data. Ensure best practices in Azure networking, security, and federated data access . Key Skills & Experience 5+ years More ❯