426 to 450 of 663 Permanent Databricks Jobs

industry and are continuing to expand their growing data practice. They are now looking to hire a highly experienced data engineer with expertise in the Azure Data stack and Databricks to join their team. Salary and Benefits Competitive salary of £60k - £75k (DOE) Hybrid working (2-3 days in office) 26 days annual leave, plus bank holidays And many more. … CRM, finance, procurement, fleet, and commercial data, ensuring comprehensive data quality and reliability for analytical insights and decision-making processes Implemented scalable data pipelines and ELT processes, leveraging Azure Databricks, Azure Data Factory & SQL store procedures to efficiently process, transform, and store large volumes of business data, resulting in streamlined data workflows and improved operational efficiency. Collaborate cross-functionally with … and data-driven decision-making across the organization's business units. What do I need to apply for the role High level of Azure data engineering experience Strong Azure Databricks experience Expert SQL Strong Python experience My client will be progressing with interviews next week so if you’re interested, get in touch ASAP with a copy of your most More ❯

spearhead our data initiatives, with a primary focus on Azure Data Lake and its associated ecosystem. The ideal candidate will possess deep architectural knowledge of Azure Data Lake and Databricks, a solid understanding of security concepts within Azure, and a proven track record of leading teams in delivering scalable and secure data solutions. Major Responsibilities: Architectural Design and Implementation: Design … teams, to deliver data-driven solutions. Drive agile practices and ensure timely delivery of projects. Platform Optimization and Monitoring: Oversee the deployment and management of Azure Data Lake and Databricks environments. Implement monitoring and alerting systems to ensure system reliability and performance. Evaluate and incorporate new Azure services and technologies to enhance the data platform. Strategic Planning and Roadmap Development … Technology, or a related field. 8+ years of experience in data engineering, with at least 3 years in a leadership role. Extensive hands-on experience with Azure Data Lake, Databricks, and other Azure services. Proven expertise in architecting and implementing large-scale data solutions. Required Knowledge and Skills: Technical Skills: Proficiency in SQL. Deep understanding of Azure security concepts, including More ❯

ongoing enhancement of data and reporting infrastructure. You will be the strategic owner of our Azure Data Platform, overseeing services such as Azure Data Lake, Data Warehouse, Data Factory, Databricks, and Power BI. This role combines technical leadership, agile delivery, and stakeholder engagement to drive data-driven decision-making across departments including safeguarding, education, residential care, HR, finance, and compliance. … function and ensure alignment with business goals Platform Ownership & Governance Administer and govern the Azure Fabric Platform, including: Azure Data Lake & Data Warehouse (storage) Azure Data Factory (data integration) Databricks (data transformation and modelling) Power BI (analytics and dashboards) Ensure data integrity, access control, platform monitoring, and incident resolution Explore AI capabilities to enhance data presentation and consumption Agile Delivery … years in BI architecture and team leadership Degree in Data Science, Computer Science, Information Systems, or related field Extensive hands-on experience with Azure Fabric, SQL warehousing, and Databricks Track record in MI/BI product development using Agile and Waterfall methods Experience managing cross-functional teams and sprint activities Background in social care, childcare, or education is desirable Success More ❯

experience in data engineering within Azure environments, with a strong track record in modernisation and large-scale migration projects. You'll be confident designing metadata-driven frameworks and managing Databricks environments, with hands-on expertise in Python, T-SQL, and PySpark. Your leadership and mentoring skills will be key, alongside your ability to collaborate across teams and drive strategic decisions. … Essential Skills Include: Proven leadership and mentoring experience in senior data engineering roles Expertise in Azure Data Factory, Azure Databricks, and lakehouse architecture Strong programming skills (Python, T-SQL, PySpark) and test-driven development Deep understanding of data security, compliance, and tools like Microsoft Purview Excellent communication and stakeholder management skills Experience with containerisation and orchestration (e.g., Kubernetes, Azure Container More ❯

lead. You’ll help solve significant scaling challenges and modernise a mission-critical platform using: Core stack: .NET, C#, SQL Server, REST APIs Data engineering tools: Azure Data Factory, DataBricks Cloud: Microsoft Azure (Functions, Logic Apps, Service Bus Serverless) If you love hands-on coding, owning delivery, and mentoring others, this could be the role for you. Key Responsibilities Leadership … performance-tuned queries, and optimise data models Design and build scalable, secure applications using C# and .NET Build and enhance data pipelines and integrations using Azure Data Factory/DataBricks Implement clean, maintainable code using SOLID principles and design patterns Collaborate with architecture and product teams to deliver high-quality software at pace Refactor and re-platform legacy data centric … and ownership mindset · Passion for knowledge sharing and mentoring others Desirable · Experience with Azure services (App Services, Functions, Service Bus) · ETL pipeline development using Azure Data Factory · Exposure to DataBricks, Synapse or Spark · Experience working within event-driven architectures · Understanding of DevOps, IaC (Terraform/Bicep), Observability We’re looking for a strong engineer who enjoys working across both data More ❯

lead. You’ll help solve significant scaling challenges and modernise a mission-critical platform using: Core stack : .NET, C#, SQL Server, REST APIs Data engineering tools: Azure Data Factory, DataBricks Cloud : Microsoft Azure (Functions, Logic Apps, Service Bus Serverless) If you love hands-on coding, owning delivery, and mentoring others, this could be the role for you. Key Responsibilities Engineering … performance-tuned queries, and optimise data models Design and build scalable, secure applications using C# and .NET Build and enhance data pipelines and integrations using Azure Data Factory/DataBricks Implement clean, maintainable code using SOLID principles and design patterns Collaborate with architecture and product teams to deliver high-quality software at pace Refactor and re-platform legacy data centric … passion for mentoring and knowledge sharing Desirable Experience Exposure to Azure services such as App Services, Functions, or Service Bus ETL pipeline development using Azure Data Factory Familiarity with Databricks , Synapse , or Spark Experience working within event-driven architectures Understanding of DevOps principles , Infrastructure as Code (Terraform/Bicep) , and observability best practices Who You Are A strong engineer who More ❯

ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more This role would be well-suited to a Data Engineer looking to take their first-step into Consultancy, or perhaps someone from a BI or SQL … similar) role Strong scripting skills in SQL (and Python would be a bonus) Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable More ❯

ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more This role would be well-suited to a Data Engineer looking to take their first-step into Consultancy, or perhaps someone from a BI or SQL … similar) role Strong scripting skills in SQL (and Python would be a bonus) Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable More ❯

ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more This role would be well-suited to a Data Engineer looking to take their first-step into Consultancy, or perhaps someone from a BI or SQL … similar) role Strong scripting skills in SQL (and Python would be a bonus) Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable More ❯

ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more This role would be well-suited to a Data Engineer looking to take their first-step into Consultancy, or perhaps someone from a BI or SQL … similar) role Strong scripting skills in SQL (and Python would be a bonus) Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable More ❯

ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more This role would be well-suited to a Data Engineer looking to take their first-step into Consultancy, or perhaps someone from a BI or SQL … similar) role Strong scripting skills in SQL (and Python would be a bonus) Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable More ❯

ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more This role would be well-suited to a Data Engineer looking to take their first-step into Consultancy, or perhaps someone from a BI or SQL … similar) role Strong scripting skills in SQL (and Python would be a bonus) Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable More ❯

ingestion, data storage (e.g. building new data lakes or data warehouses), data processing, data management, analytics and visualisation, using the latest technologies such as Azure SQL, Synapse Analytics, Fabric, Databricks, Power BI and more This role would be well-suited to a Data Engineer looking to take their first-step into Consultancy, or perhaps someone from a BI or SQL … similar) role Strong scripting skills in SQL (and Python would be a bonus) Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable More ❯

Translating Business requirements to technical solutions and the production of specifications, Designing and implementing business intelligence & modern data analytics platform technical solutions, Data architecture design and implementation Data modelling, Databricks ETL, data integration and data migration design and implementation Master data management system and process design and implementation, Data quality system and process design and implementation, Major focus on data … day to day basis, Managing technical delivery of solution, Strong stakeholder management and communication skills Qualifications Hands on experience with data solution architecture, design and rollout. Strong experience in Databricks Hands on experience with business intelligence tools, data modelling, data staging, and data extraction processes, including data warehouse and cloud infrastructure. Experience with multi-dimensional design, star schemas, facts and More ❯

insights. From developing robust proof-of-concepts to deploying enterprise-grade solutions, you will apply your expertise in AI engineering, cloud platforms, and technologies such as Generative AI, Azure, Databricks to embed intelligence into critical audit workflows and products. You will mentor junior engineers, promote best practices, and foster a culture of collaboration, innovation, and continuous improvement. You will stay … in Python and key ML libraries (e.g. PyTorch, PySpark, scikit-learn, Hugging Face Transformers). Hands-on experience with modern data platforms and AI tooling such as Azure ML, Databricks, MLflow, LangChain, LangGraph. Proven experience with modern engineering practices Git, version control, unit testing and containerisation. Familiarity with agile work methodologies and tools like Jira and Confluence. Behavioural Attributes and More ❯

insights. From developing robust proof-of-concepts to deploying enterprise-grade solutions, you will apply your expertise in AI engineering, cloud platforms, and technologies such as Generative AI, Azure, Databricks to embed intelligence into critical audit workflows and products. You will mentor junior engineers, promote best practices, and foster a culture of collaboration, innovation, and continuous improvement. You will stay … in Python and key ML libraries (e.g. PyTorch, PySpark, scikit-learn, Hugging Face Transformers). Hands-on experience with modern data platforms and AI tooling such as Azure ML, Databricks, MLflow, LangChain, LangGraph. Proven experience with modern engineering practices Git, version control, unit testing and containerisation. Familiarity with agile work methodologies and tools like Jira and Confluence. Behavioural Attributes and More ❯

An exciting opportunity has arisen for an experienced Data Solution Architect to become part of the National Data and Analytics (NDA) Platform & Engineering Team.The NDA Platform & Engineering Team is working on providing data to drive the business forward. You'll More ❯

world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. YOUR ROLE We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on designing, building, and optimizing scalable data solutions … using the Databricks platform. YOUR PROFILE Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable data engineering solutions using Apache Spark on Databricks. Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. Optimize performance and cost-efficiency of Databricks workloads. Develop and maintain CI/CD workflows for … Databricks using GitLab or similar tools. Ensure data quality and reliability through robust unit testing and validation frameworks. Implement best practices for data governance, security, and access control within Databricks. Provide technical mentorship and guidance to junior engineers Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable data engineering solutions using Apache Spark on More ❯

PositionID: Client: Gainwell Technologies Position: Azure Databricks Engineer Responsibilities: Data pipeline Development: Design, develop, and maintain scalable data pipelines and ETL processes using Azure Databricks, Azure Data Factory, and other Azure services. Data Processing: Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks. Integration: Integrate data from various sources, such as databases, APIs, and streaming data … into the Databricks environment, often using tools like Azure Data Factory or Databricks Workflows. Performance Optimization: Enhance the performance of data processing tasks by optimizing Spark jobs, managing cluster resources, and implementing best practices for data storage and retrieval. Collaboration: Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure the solutions meet business needs. Data More ❯

that unlock reporting, analytics, and application capabilities. This is a hands-on, consultative role combining stakeholder engagement, data modelling, backlog definition, and delivery support in a modern Azure/Databricks Lakehouse environment. As a Senior Data Consultant, you'll be a bridge between business stakeholders and technical teams, helping shape data solutions that align with real-world goals and unlock … and written articulation of requirements Ability to collaborate within cross-functional agile teams (engineers, analysts, POs, business SMEs) Consulting mindset: proactive, adaptable, outcome-oriented Azure (esp. Data Lake/Databricks environments) Databricks & Unity Catalogue SQL(esp. MSSQL), Python Nice to Have Experience in insurance or reinsurance data environments Working knowledge of data security and compliance considerations in regulated environments Working More ❯

Data Engineering Lead - Databricks - London - £95K Global construction business with a strong technology focus are looking for a hands on Data Engineering Lead to manage, mentor and help develop a small team of Engineers, coupled with technical leadership. You will be using the latest, cutting edge technology across the Azure and Databricks ecosystem within a close knit, collaborative environment.Key Responsibilities … and Skills Required:- Proficiency in MS Business Intelligence tools and practices (SQL, Azure, Data Factory, Power BI, Databricks)- Strong background in data engineering principles and methodologies.- Experience leading and mentoring teams in technical environments.- Ability to collaborate effectively with cross-functional teams to deliver impactful solutions.- Excellent problem-solving skills and a data-driven mindset.This role suits an innovative candidate More ❯

Python & Databricks Developer (ML Ops) Job responsibilities include: Build and maintain scalable machine learning models using Python and Databricks.Develop APIs to support model deployment and integration with enterprise systems.Implement ML Ops practices for model versioning, monitoring, and automation.Collaborate with developers, system administrators, and end users to resolve technical issues.Apply strong problem-solving skills to identify and troubleshoot complex data and … clarity on technical solutions. Desired Qualifications: Bachelor's Degree in Computer Science, Data Science, or related field.6+ years of experience in Python development and data engineering.Hands-on experience with Databricks and model lifecycle management.Experience in building and deploying APIs.Familiarity with ML Ops tools and frameworks.Strong understanding of data science workflows and automation.Excellent communication and collaboration skills.Ability to work independently and More ❯

Senior Databricks Data Architect – London (Hybrid) Permanent | Global Analytics & Digital Solutions | Major Growth Projects - £90K to £125k + bonus and benefits Are you a Databricks expert who loves architecting large-scale data platforms, shaping cloud strategy, and solving complex client challenges? This is a senior role within a $1B global systems integrator supporting major enterprise clients across Banking, Insurance, BFI … Technical Leadership – Lead and mentor engineering teams delivering end-to-end data solutions across cloud and on-premise environments. Solution Architecture – Design modern data lakes, warehouses, and lakehouses using Databricks , with additional exposure to Snowflake, Azure Synapse, or Fabric being a bonus. Data Modelling – Build and optimise enterprise-grade data models across varied data layers. ETL/ELT Engineering – Use … tooling such as Databricks, SSIS, ADF, Informatica, IBM DataStage to drive efficient data ingestion and transformation. Data Governance – Implement governance and MDM using tools like Unity Catalog, Profisee, Alation, DQ Pro . Client Advisory – Act as a trusted consultant supporting strategy, cloud migrations, architecture assessments, and solution roadmaps. Documentation & Compliance – Produce high-quality models, integration patterns, and technical artefacts. Continuous More ❯

Senior Databricks Data Architect – London (Hybrid) Permanent | Global Analytics & Digital Solutions | Major Growth Projects - £90K to £125k + bonus and benefits Are you a Databricks expert who loves architecting large-scale data platforms, shaping cloud strategy, and solving complex client challenges? This is a senior role within a $1B global systems integrator supporting major enterprise clients across Banking, Insurance, BFI … Technical Leadership – Lead and mentor engineering teams delivering end-to-end data solutions across cloud and on-premise environments. Solution Architecture – Design modern data lakes, warehouses, and lakehouses using Databricks , with additional exposure to Snowflake, Azure Synapse, or Fabric being a bonus. Data Modelling – Build and optimise enterprise-grade data models across varied data layers. ETL/ELT Engineering – Use … tooling such as Databricks, SSIS, ADF, Informatica, IBM DataStage to drive efficient data ingestion and transformation. Data Governance – Implement governance and MDM using tools like Unity Catalog, Profisee, Alation, DQ Pro . Client Advisory – Act as a trusted consultant supporting strategy, cloud migrations, architecture assessments, and solution roadmaps. Documentation & Compliance – Produce high-quality models, integration patterns, and technical artefacts. Continuous More ❯

on Microsoft Azure services Design large-scale data processing and analytics solutions using Azure Databricks. Develop comprehensive architecture blueprints and technical documentation for data solutions. Lead the implementation of Databricks-based solutions, ensuring alignment with best practices and business requirements. Lead Data Mesh/Data products architecture building in Databricks-based solutions Provide technical leadership and guidance throughout the project … industry trends. Requirements: Bachelor's degree in computer science, Engineering, or a related field. 10-15 years of experience in data engineering or a related field. Extensive experience with Databricks and Apache Spark. Proficiency in programming languages such as Python Strong knowledge of SQL and experience with relational databases. Experience with cloud platforms Especially in Azure Strong with data warehousing More ❯