551 to 575 of 729 Databricks Jobs

ll be at the heart of our data transformation journey. 🎯 What We’re Looking For: Proven experience in data engineering and solution design Strong skills in Azure Data Factory, Databricks, Unity Catalogue, and SQL Server Practical knowledge of data modelling and ETL development Hands-on coding and development with a focus on quality Excellent communication and stakeholder engagement skills A … data models and ETL pipelines Develop and maintain applications and automation tools Champion best practices in data quality, lineage, and governance Act as SME in Azure Data Factory, Azure Databricks, Unity Catalogue, and SQL Server Support agile delivery, code control, and QA standards Monitor and improve existing data sets and processes Enable colleagues through testing, training, and knowledge sharing 🎁 What More ❯

Data Engineering Lead – Azure & Databricks | Full Time Role - Hybrid 2/3 days per week London This role has a Flexible salary and company benefits as well get in touch to learn more! My client is looking for a hands-on Data Engineering Lead to shape and evolve a modern hybrid data platform built on Azure and Databricks. This role … reporting across the organisation. What does the role consist of? Design and enhance data pipelines that support large-scale ingestion, transformation, and delivery across varied sources. Leverage Azure and Databricks to ensure reliable, high-throughput data movement and integration for analytics and BI. Apply best practices in orchestration, monitoring, and error handling to maintain consistent and dependable data flows. Optimise … decision-making. Enforce strong data governance, quality standards, and security protocols across the data estate. What type of candidate do they need? Deep experience in data engineering using Azure, Databricks, SQL, and Azure Data Factory, including medallion architecture. Proven leadership in guiding teams through complex data deliveries and adopting best practices. Strong background in ETL orchestration and hybrid cloud integration. More ❯

Data Engineering Lead – Azure & Databricks | Full Time Role - Hybrid 2/3 days per week London This role has a Flexible salary and company benefits as well get in touch to learn more! My client is looking for a hands-on Data Engineering Lead to shape and evolve a modern hybrid data platform built on Azure and Databricks. This role … reporting across the organisation. What does the role consist of? Design and enhance data pipelines that support large-scale ingestion, transformation, and delivery across varied sources. Leverage Azure and Databricks to ensure reliable, high-throughput data movement and integration for analytics and BI. Apply best practices in orchestration, monitoring, and error handling to maintain consistent and dependable data flows. Optimise … decision-making. Enforce strong data governance, quality standards, and security protocols across the data estate. What type of candidate do they need? Deep experience in data engineering using Azure, Databricks, SQL, and Azure Data Factory, including medallion architecture. Proven leadership in guiding teams through complex data deliveries and adopting best practices. Strong background in ETL orchestration and hybrid cloud integration. More ❯

high-performing team managing a complex hybrid SQL Server and Azure data estate. This includes over 80 on-premises SQL Server instances, as well as Azure SQL, Cosmos DB, Databricks, and Power BI services—all managed using modern DevOps and Infrastructure as Code (IaC) practices with Terraform. You’ll act as a technical leader across key areas such as performance … Administer and support 80+ SQL Server instances (2017–2022) across standalone, multi-instance, and clustered environments. Manage and optimise Azure SQL, Cosmos DB, and related services such as Azure Databricks and Power BI Reporting Services. Support and maintain SSRS, SSAS, and SSIS across hybrid environments. Cloud Transformation & Azure Landing Zone Participate in the migration of databases and data services to … Demonstrated strength in problem-solving, root cause analysis, and cross-system diagnostics. Desirable Skills Microsoft certifications such as DP-300, AZ-104, AZ-305, or equivalent. Experience with Azure Databricks, Data Factory, or other analytics services. Familiarity with ARM templates, Bicep, or other IaC alternatives. Experience working in regulated or security-sensitive environments. Personal Attributes Technically curious and passionate about More ❯

Copilot Lead, Azure OpenAI, Copilot Studio, Microsoft Fabric, Microsoft Graph, Azure Cognitive Services, Databricks, Power Platform, AI Builder, Power Automate, Dynamics 365 (F&O/CE/BC), LLMs, agentic AI, product ownership, roadmap, backlog, MLOps, Responsible AI, data governance, rapid prototyping, commercialisation, £75,000 - £80,000 per annum Copilot Lead - Join a trusted Microsoft Partner specialising in business and … operations, and scalable data architectures. Technical and Professional Skills Product ownership excellence - roadmapping, backlog management, value hypothesis, and outcome-based prioritisation. Strong architecture and engineering acumen across Azure AI, Databricks, Fabric, Copilot Studio, and integration patterns for D365 and Power Platform. MLOps and lifecycle management - CI/CD for models, monitoring, drift management, and continuous improvement. Hands-on capability in … and partner alignment where applicable, maximising Microsoft co-sell opportunities. Solution Design and Delivery Lead the end-to-end design and architecture of AI solutions using Azure AI services, Databricks, Microsoft Fabric, and Copilot Studio, integrated with Dynamics 365 (F&O, CE, BC) and the Power Platform. Embed intelligent automation, predictive analytics, and natural-language experiences within ERP and line More ❯

integration strategies, and legacy modernization to microservices. Contribute to Disaster Recovery planning and platform resilience. Implement Identity and Access Management (IDAM) and enterprise security architecture. Support data architecture using Databricks, Snowflake, ETL pipelines, and Big Data tools. Champion Data Governance practices including classification, cataloging, and lineage. Ensure compliance with ISO 27001, GDPR, PCI DSS, and other security standards. Embed DevSecOps … Support business development initiatives, contributing to bids and proposals. Business Analysis experience and stakeholder engagement skills. Architecture - SOA, DDD, Microservices, Event-Drive Design Cloud - Azure, AWS, Oracle Cloud Data - Databricks, Snowflake, ETL, Big Data, Data Governance Security - ISO 27001, GDPR, PCI DSS, IDAM, DevSecOps Integration - API Design & Management, CMS, Legacy Migration Agile - SAFe, DevOps, Scrum Collaboration - Stakeholder Engagement, Governance, Team More ❯

ll possess experience of working with large data sets in an enterprise environment. Microsoft Data Components: You'll have strong experience in Microsoft data components including: Azure Analysis Services Databricks Azure SQL Data Warehouse (Synapse Analytics) Data Quality and Security: You'll have experience of using tools and techniques for ensuring data quality, security, validation and recovery. Analytical Skills: You … Query and DAX skills. Experience of working with large data sets in an enterprise environment. Dimensional model design and implementation. Experience in Microsoft data components including: Azure Analysis Services Databricks Azure SQL Data Warehouse (Synapse Analytics) Tools and techniques for ensuring data quality, security, validation and recovery. Strong analytical skills, with the ability to adopt a logical approach to solving More ❯

seamlessly integrate traditional and modern data systems You Will Demonstrate Deep knowledge of the Azure data stack (Azure SQL Server, CosmosDB, Azure Data Factory, Purview, Synapse, Event Hub, Azure Databricks/Fabric) Extensive data modelling experience: both normalised relational models and de-normalised Star Schema/dimensional models Excellent relational database design skills with expertise in diagnosing and optimising performance … in AI technologies, data services, and architectural practices Industry specialisation in specific sectors (Engineering, Manufacturing, Healthcare etc.) Public sector or defence experience Experience with modern unified data platforms like Databricks or Microsoft Fabric Understanding of data mesh or data fabric architectural approaches Relevant industry certifications such as TOGAF 9, CDMP (Certified Data Management Professional), or Microsoft Certified: Azure Solutions Architect More ❯

Role: Guidewire Data Engineer Bill Rate: $86/hour C2C Location: Glen Allen, VA Duration: 12+ months/long-term Interview Criteria: Telephonic + Skype Direct Client Requirement Job Description: We are seeking a strong Data Engineer with a background More ❯

and connected data. This strategic role bridges business needs with technical delivery to build a unified data and analytics capability. Key Responsibilities Design scalable, secure data solutions using Azure, Databricks, Power BI Define patterns for data ingestion, transformation, and sharing Collaborate with cross-functional teams to deliver pragmatic solutions Modernise legacy platforms and simplify the data landscape Required Skills Strong … experience in data architecture and solution design Proficiency in Azure, Databricks, Power BI, SAP BTP, Salesforce Knowledge of data governance, modelling, and metadata management Familiarity with AI, ML, and data mesh concepts More ❯

this role will either contribute to strategic deliverables by building data engineering pipelines using the AWS technology stack, or support platform modernization efforts by migrating existing AWS components to Databricks, depending on their assessed skill sets. UI development experience as must along with AWS CloudFormation. AWS Data Engineering JD Strong hands on data engineering experience delivering production grade solutions. Ability … proactively analyse existing processes, suggest improvements, and drive technical solutions end to end. Comfortable engaging with stakeholders, understanding business requirements, and translating them into technical design. Strong Experience in Databricks development/migration. (this is for Databricks engineer) Experience with Apache Spark, Databricks Delta Lake, Unity Catalog, and MLflow. (this is for Databricks engineer) Accountabilities Build and maintenance of data More ❯

Databricks Tech Lead – Azure Data Engineering (Contract) We are looking for a highly technical, hands-on Databricks Tech Lead to join a large-scale digital transformation programme within the Energy Trading space. This role will focus on building, optimising, and scaling a data lake on Azure with particular emphasis on streaming pipelines, Delta Live Tables (DLT), and cost-efficient architecture. … Role: Designing and developing streaming and batch data pipelines in Databricks (including DLT). Managing structured streaming in continuous mode, ensuring low-latency data delivery. Collaborating with architects, consultants, and business stakeholders to build a unified Azure-based lakehouse. Troubleshooting and optimising performance bottlenecks in high-volume streaming systems. Applying best practices for cloud cost management and efficient Databricks resource … from on-prem and cloud sources using tools like Qlik Replicate (CDC). Supporting future phases involving data science and machine learning enablement. Tech Environment Platform: Azure Core Tools: Databricks, Delta Live Tables, Qlik Replicate (CDC) Architecture: Hybrid (on-prem + cloud) Data Modes: Real-time streaming & batch jobs If you are a Tech Lead with a strong background in More ❯

Databricks Tech Lead – Azure Data Engineering (Contract) We are looking for a highly technical, hands-on Databricks Tech Lead to join a large-scale digital transformation programme within the Energy Trading space. This role will focus on building, optimising, and scaling a data lake on Azure with particular emphasis on streaming pipelines, Delta Live Tables (DLT), and cost-efficient architecture. … Role: Designing and developing streaming and batch data pipelines in Databricks (including DLT). Managing structured streaming in continuous mode, ensuring low-latency data delivery. Collaborating with architects, consultants, and business stakeholders to build a unified Azure-based lakehouse. Troubleshooting and optimising performance bottlenecks in high-volume streaming systems. Applying best practices for cloud cost management and efficient Databricks resource … from on-prem and cloud sources using tools like Qlik Replicate (CDC). Supporting future phases involving data science and machine learning enablement. Tech Environment Platform: Azure Core Tools: Databricks, Delta Live Tables, Qlik Replicate (CDC) Architecture: Hybrid (on-prem + cloud) Data Modes: Real-time streaming & batch jobs If you are a Tech Lead with a strong background in More ❯

Lead Software Engineer – .NET/AWS/Databricks .NET, C#, Python, SQL, Databricks, AWS, Azure, Microservices, APIs, Cloud Security Salary up to £85k Hybrid – Greater Manchester Excellent progression and leadership opportunities Who We Are We’re an established technology-driven organisation focused on building secure, scalable, and high-performing digital platforms. Our engineering culture promotes innovation, collaboration, and continuous improvement. … fostering a high-performance culture within the engineering team. What You’ll Be Doing Lead the design, development, and implementation of .NET back-end systems and data workflows using Databricks . Oversee the build and optimisation of data pipelines within AWS . Drive engineering excellence , establishing and maintaining standards, metrics, and best practices. Mentor and develop engineering teams, encouraging innovation … AWS data services and cloud-native architectures. Proficiency in Python and SQL Excellent stakeholder management skills, able to bridge technical and business perspectives. Knowledge of Azure and experience with Databricks or similar data platforms. Benefits Salary up to £85,000 25 days holiday + bank holidays + birthday off Hybrid working Collaborative, forward-thinking engineering culture Real influence over technical More ❯

Engineering (Hybrid - London) Contract: 6 months Work Mode: Hybrid (12 days WFO/month)We are looking for an experienced Technology Architect with deep expertise in PySpark, ADF, and Databricks to lead and design data engineering solutions for our client. What You'll Do: Lead technical design using Medallion architecture and Azure ServicesCreate conceptual diagrams, source-to-target mapping, and … dimensional data modelsGuide the data engineering team on development with ADF, Databricks, Python, JSON, and YAMLImplement performance optimization strategies during data transformationDeploy code artifacts using GitHub Workflows/CI-CD pipelines Collaborate effectively with team members and stakeholdersOptional: Work with Log Analytics and KQL queries Must-Have Skills: 10+ years of experience in Data Engineering Hands-on experience with PySpark … ADF, Databricks, SQL Strong understanding of dimensional modeling, normalization, schema design, and data harmonization Experience with Erwin and data modeling toolsExcellent communication, problem-solving, and client-facing skills Why Join Us: Work in a dynamic, collaborative environment Hands-on experience with cutting-edge Azure data engineering technologies Hybrid setup providing flexibility while staying connected to the team More ❯

Data Engineering Lead - Summary A leading global construction firm is seeking a Data Engineering Lead to drive the evolution of its hybrid Azure/Databricks data platform. This role is central to building scalable, high-performance data solutions that bridge infrastructure and business intelligence. Key Responsibilities:* Design and maintain robust data pipelines for ingestion, transformation, and delivery* Leverage Azure, Databricks … dashboards and data products* Promote adoption of best practices and continuous learning within the team* Enforce data quality, governance, and security standards Technical Requirements:* Deep experience with Azure, SQL, Databricks, Azure Data Factory, and medallion architecture* Strong ETL design and hybrid cloud integration skills* Proficiency in Power BI and DAX for dashboard development* Solid understanding of KPI frameworks and dashboarding More ❯

for a Data Engineer for an exciting project with our consultancy client! Looking for someone who is a hands on problem solver with a strong foundation in Python development, Databricks (preferably on AWS), and a good understanding of machine learning (ML) workflow. What I’m looking for: Strong programming experience in Python, including data processing, automation, and ETL development. Hands … on experience with Databricks (ideally on AWS), including notebook workflows, cluster management, and performance tuning. Solid understanding of data engineering principle-pipelines, orchestration, and version control (Git, CI/CD). Familiarity with machine learning (ML) development and tools such as MLflow or equivalent. More ❯

for a Data Engineer for an exciting project with our consultancy client! Looking for someone who is a hands on problem solver with a strong foundation in Python development, Databricks (preferably on AWS), and a good understanding of machine learning (ML) workflow. What I’m looking for: Strong programming experience in Python, including data processing, automation, and ETL development. Hands … on experience with Databricks (ideally on AWS), including notebook workflows, cluster management, and performance tuning. Solid understanding of data engineering principle-pipelines, orchestration, and version control (Git, CI/CD). Familiarity with machine learning (ML) development and tools such as MLflow or equivalent. More ❯

architectures supporting analytics and digital initiatives Develop and maintain logical and physical data models to support business needs. Define and govern data architecture standards across Azure Data Factory and Databricks Oversee data integration frameworks and manage the Information Management architecture Shape strategic data roadmaps aligned with the company’s long-term goals Review and ensure consistency of high-level designs … Strong hands-on experience in data modelling, with tools such as Erwin Strong background in London Market/Specialty Insurance data domains – essential Proficient in Azure Data Factory and Databricks, including pipeline design and orchestration Solid understanding of data warehousing, ETL/ELT pipelines, and integration practices Knowledge of SDLC methodologies (Agile, DevOps, etc.) Confident communicator with the ability to … engage technical and business stakeholders Relevant certifications in Azure, Databricks, or Data Architecture a strong plus Must live within daily access of Central London for 2/3 hybrid days Must be available within 6 weeks More ❯

architectures supporting analytics and digital initiatives Develop and maintain logical and physical data models to support business needs. Define and govern data architecture standards across Azure Data Factory and Databricks Oversee data integration frameworks and manage the Information Management architecture Shape strategic data roadmaps aligned with the company’s long-term goals Review and ensure consistency of high-level designs … Strong hands-on experience in data modelling, with tools such as Erwin Strong background in London Market/Specialty Insurance data domains – essential Proficient in Azure Data Factory and Databricks, including pipeline design and orchestration Solid understanding of data warehousing, ETL/ELT pipelines, and integration practices Knowledge of SDLC methodologies (Agile, DevOps, etc.) Confident communicator with the ability to … engage technical and business stakeholders Relevant certifications in Azure, Databricks, or Data Architecture a strong plus Must live within daily access of Central London for 2/3 hybrid days Must be available within 6 weeks More ❯

data engineering, a thorough understanding of AEP s data architecture, and hands-on experience with Data Distiller. This role also requires proficiency in modern data platforms and technologies including Databricks, GraphQL, Snowflake, and Enterprise Data Warehousing (EDW Key Responsibilities Design, develop, and maintain scalable data pipelines within A e Experience Platform. Write and optimize complex queries using AEP Data Distiller … using batch and streaming ingestion methods. Collaborate with cross-functional teams to ensure data quality, accessibility, and usability. Implement data governance, performance tuning, and monitoring for AEP workflows. Leverage Databricks for advanced data processing and transformation tasks. Utilize GraphQL to query and interact with APIs and data services. Work with Snowflake and EDW systems to support data integration and analytics. … years working directly with A e Experience Platform. Strong proficiency in SQL, with the ability to write and optimize complex queries in AEP Data Distiller. Hands-on experience with Databricks, GraphQL, Snowflake, and Enterprise Data Warehousing. Deep understanding of XDM schemas, datasets, and identity stitching in AEP. Experience with data ingestion, transformation, and activation workflows in AEP. Familiarity with A More ❯

foundation in Data Engineering and experience managing a squad of 47 Data Engineers. Youll bring solid SQL skills, cloud expertise (preferably Azure), and familiarity with tools such as Snowflake, Databricks, ADF, Python, and GenAI. Youll manage a squad of engineers and play a key role in delivering scalable, modern data solutions as part of a group-wide transformation. Requirements: Proven … data architectures and tooling; Financial Services experience is a plus. Experience managing Data Engineering teams Strong SQL and cloud skills (Azure preferred) Familiar with modern data tools (e.g. Snowflake, Databricks, ADF, Python) Track record of building/maintaining robust data pipelines Agile experience Financial Services experience is a bonus If you are an experienced Data Engineering Manager with the required More ❯

Head of Data – Azure & Databricks | Permanent | Hybrid (2–3 Days in London) Flexible salary + comprehensive benefits package – contact us to learn more! Are you ready to lead the evolution of a cutting-edge data platform? My client is seeking a visionary Head of Data to define and drive their data strategy, leveraging Azure and Databricks to deliver scalable, high … Enforce strong data governance, quality standards, and security protocols across the data estate. What We’re Looking For Proven leadership in data engineering and analytics , ideally within Azure and Databricks ecosystems . Expertise in ETL orchestration , Azure Data Factory , and medallion architecture . Strong experience with Power BI , DAX , and KPI-driven dashboarding. Ability to translate complex technical concepts into More ❯

Head of Data – Azure & Databricks | Permanent | Hybrid (2–3 Days in London) Flexible salary + comprehensive benefits package – contact us to learn more! Are you ready to lead the evolution of a cutting-edge data platform? My client is seeking a visionary Head of Data to define and drive their data strategy, leveraging Azure and Databricks to deliver scalable, high … Enforce strong data governance, quality standards, and security protocols across the data estate. What We’re Looking For Proven leadership in data engineering and analytics , ideally within Azure and Databricks ecosystems . Expertise in ETL orchestration , Azure Data Factory , and medallion architecture . Strong experience with Power BI , DAX , and KPI-driven dashboarding. Ability to translate complex technical concepts into More ❯

a scaling startup in the AI and Healthcare technology sector Salary up to £110k + Equity Paddington-based (4-5 days per week in-office) Tech environment: Python | Spark | Databricks | AWS | PostgreSQL | Scala | Data Pipelines | AI Infrastructure If you wish to keep your CV/data private, feel free to WhatsApp your details/CV to me, Dan - WHO WE … of rapid growth and increasing data complexity. DATA SOFTWARE ENGINEER - ESSENTIAL SKILLS: Strong foundation in Python and at least one other programming language. Hands-on experience with Spark or Databricks for distributed data processing. Proven experience developing custom components and tools for data pipelines. Deep understanding of data engineering architectures and best practices. Solid experience with cloud-based platforms (AWS … role, you are giving express consent for us to process (subject to required skills) your application to our client in conjunction with this vacancy only. KEY SKILLS: Python | Spark | Databricks | AWS | PostgreSQL | Scala | Data Pipelines | Cloud Architecture | Data Infrastructure | AI | Automation More ❯