251 to 275 of 351 Databricks Jobs

impact opportunity to shape the future of a modern data platform at scale. You will take ownership of architecture, performance, and governance across a Databricks Lakehouse environment, directly influencing how business decisions are made. THE COMPANY They are a global, data-driven organisation operating at the intersection of technology … deliver a scalable and high-performing architecture. Specifically, you can expect to be involved in the following: Design and implement a governed Databricks Lakehouse, including catalog and data structures. Migrate complex legacy SQL into clean, modular, and maintainable pipelines. Build scalable transformation frameworks using Spark and Python or SQL-based ...

impact opportunity to shape the future of a modern data platform at scale. You will take ownership of architecture, performance, and governance across a Databricks Lakehouse environment, directly influencing how business decisions are made. THE COMPANY They are a global, data-driven organisation operating at the intersection of technology … deliver a scalable and high-performing architecture. Specifically, you can expect to be involved in the following: Design and implement a governed Databricks Lakehouse, including catalog and data structures. Migrate complex legacy SQL into clean, modular, and maintainable pipelines. Build scalable transformation frameworks using Spark and Python or SQL-based ...

outset. This role is suited to mid-level or experienced data engineers with a strong understanding of modern cloud platforms such as Snowflake, Databricks, or Microsoft Fabric, who are keen to move beyond maintenance work and help shape a platform. The client is a leading organisation in the live entertainment … with platform developments and contribute ideas for improving or evolving the architecture. Skills, qualities and experience Familiar with modern cloud data platforms such as DataBricks, Snowflake or MS Fabric. Comfortable engaging directly with stakeholders, taking ownership of technical decisions, and contributing to the broader data strategy. Essential SQL PySpark/ ...

outset. This role is suited to mid-level or experienced data engineers with a strong understanding of modern cloud platforms such as Snowflake, Databricks, or Microsoft Fabric, who are keen to move beyond maintenance work and help shape a platform. The client is a leading organisation in the live entertainment … with platform developments and contribute ideas for improving or evolving the architecture. Skills, qualities and experience Familiar with modern cloud data platforms such as DataBricks, Snowflake or MS Fabric. Comfortable engaging directly with stakeholders, taking ownership of technical decisions, and contributing to the broader data strategy. Essential SQL PySpark/ ...

expert in cloud data architecture with a passion for building secure, scalable, and cutting-edge data platforms? We are seeking an Azure Databricks Solution Architect to spearhead the design, implementation, and enablement of our secure Azure Databricks platform. In this role, you won't just build a platform; you will … core reference patterns, governance controls, and onboarding frameworks that empower decentralized teams to innovate safely. Key Responsibilities Platform Design & Deployment: Design and deploy Azure Databricks workspaces, clusters, and policies using secure, enterprise-grade patterns aligned with cost and security guardrails. Governance & Security: Implement Unity Catalog (metastores, access connectors, external locations ...

fortnight etc). Required Skills & Experience Strong experience testing data pipelines/ETL processes Hands-on experience with Apache Spark Experience working with Databricks and/or AWS Glue Proven ability to build automation or testing frameworks (Python preferred) Experience with large-scale data generation and validation Solid understanding ...

days onsite Location - London/Glasgow/Cardiff SC Security Clearance required Role Purpose To design, implement, and enable a secure Azure Databricks platform aligned with architecture, security standards, and operating model. The role will establish reference patterns, governance controls, and onboarding guidance to support decentralized teams. Responsibilities Design … deploy Azure Databricks using secure, enterprise patterns Configure Databricks workspaces, clusters, and policies aligned with cost and security guardrails. Implement Unity Catalog including metastores, access connectors, external locations, and fine-grained RBAC recommending best practices Define and implement least-privilege access models for multiple teams. Support security and TDA assurance ...

Data Engineer (SQL Databricks Python) Newcastle Onsite to £120k Do you have a first class education combined with Data Engineering skills? You could be progressing your career at a scaling Technology Consultancy within the finance division. As a Data Engineer you will work closely with front office teams to understand ...

FEQ427R38) At Databricks, our core values are at the heart of everything we do; creating a culture of proactiveness and a customer‐centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions … better world! Impact you will have Create impactful and successful relationships with customer accounts across the regions, providing technical and business value to Databricks customers in collaboration with the extended team. Act as a trusted advisor to C‐level executives, defining long‐term Data & AI strategies, modernising platforms, and aligning ...

looking to grow in a forward-thinking environment. THE ROLE: You will take ownership of supporting and developing data pipelines within a modern Azure Databricks Lakehouse environment. Working closely with engineering teams, you'll contribute to building scalable, high-quality data solutions while developing your technical skillset. Key responsibilities include … development processes Contributing to data engineering and data modelling activities Applying DevOps principles throughout the engineering lifecycle Collaborating across squads and upskilling within the Databricks ecosystem YOUR SKILLS AND EXPERIENCE: You will bring strong capability in: Python development Databricks Azure PySpark Understanding of data engineering principles A proactive, growth-mindset ...

looking to grow in a forward-thinking environment. THE ROLE: You will take ownership of supporting and developing data pipelines within a modern Azure Databricks Lakehouse environment. Working closely with engineering teams, you'll contribute to building scalable, high-quality data solutions while developing your technical skillset. Key responsibilities include … development processes Contributing to data engineering and data modelling activities Applying DevOps principles throughout the engineering lifecycle Collaborating across squads and upskilling within the Databricks ecosystem YOUR SKILLS AND EXPERIENCE: You will bring strong capability in: Python development Databricks Azure PySpark Understanding of data engineering principles A proactive, growth-mindset ...

frameworks, and real-time personalisation. The team operates 60+ LLM-based evaluation judges, develops proprietary fine-tuned health models, and maintains active partnerships with Databricks, Google, OpenAI, Anthropic, and AWS. What You’ll Do LLM Judge Ecosystem: build and scale Judge-as-a-Service, prompt registries, calibration pipelines, and evaluation … Serving: develop LoRA/SFT/preference optimisation pipelines for health-domain models (Llama, Gemma, MedGemma) and manage model serving at scale on Databricks Data and Evaluation Pipelines: build synthetic Q&A generation, golden test sets, reward function engineering, and Delta table schemas in Unity Catalog for reliable, reproducible evaluation ...

Location: London, United Kingdom Responsibilities: Create impactful and successful relationships with customer accounts across the regions, providing technical and business value to Databricks customers in collaboration with the extended team. Act as a trusted advisor to C-level executives, defining long-term Data & AI strategies, modernising platforms, and aligning technical … across territories in the regions. Scale best practices in your field by authoring reference architectures, how-tos, and demo applications, and help build the Databricks community in your region by leading workshops, seminars, and meet-ups. Grow your knowledge and expertise to the level of a technical and/ ...

play a key role in bringing alignment, structure, and consistency across engineering practices, while working within a modern Microsoft technology stack including Azure, Databricks, Fabric, Power Platform, SharePoint, and Azure DevOps . The focus is on creating a high-performing engineering function that delivers reliably and continuously improves. Key Responsibilities … Support and strengthen L2/L3 support models. Continuous Improvement Identify opportunities to optimise tools, processes, and delivery practices. Champion best practice across Azure, Databricks, Fabric, and the wider engineering ecosystem. Skills & Experience Proven experience leading multi-disciplinary engineering teams , including managing team leaders or managers. Strong delivery background across ...

aligned with business requirements Develop and optimise semantic models (data models) in Power BI Collaborate with data engineering teams working across Fabric, Azure, and Databricks Ensure best practices across performance, governance, and usability Engage with stakeholders to gather requirements and deliver actionable insights Required Skills & Experience Proven experience delivering … Strong expertise in Power BI (reporting, DAX, data modelling, performance tuning) Experience building and managing semantic/data models Strong experience working with Azure, Databricks and Fabric Strong stakeholder engagement and communication skills Experience in the financial sector is advantageous If this is a role that suits your skill ...

Senior Analytics Engineer will: Build and maintain curated, analysis-ready datasets for business use Develop scalable data models and transformation layers using dbt and Databricks Create reliable sources of truth for analysts and reporting teams Collaborate with stakeholders to understand data requirements and deliver impactful solutions Contribute to best practices … Understanding of data warehouse modelling concepts such as medallion architecture or Kimball methodologies Familiarity with Python for data workflows Exposure to tools such as Databricks, or similar cloud-based platforms Experience working in collaborative data teams and delivering for multiple stakeholders Strong communication skills and a proactive approach to problem ...

UTA seeks a Principal AI Engineer to lead the design, development, and delivery of intelligent software systems that bring together enterprise application architecture, full-stack engineering, data science, and machine learning. In this highly visible ...

Exposure Data Analyst/Quantitative Exposure Analyst London 80,000 - 90,000 + Benefits Are you a data-driven insurance professional with strong Python and SQL skills looking to work at the forefront of exposure ...

AI Engineer - FS consulting London A leading consulting and technology firm is seeking AI Engineers and Technical AI Leaders to join their team in London on a hybrid basis. The business delivers production-grade AI ...

AI Engineer - FS consulting London A leading consulting and technology firm is seeking AI Engineers and Technical AI Leaders to join their team in London on a hybrid basis. The business delivers production-grade AI ...

before reaching production. Responsibilities Execute end-to-end functional and integration testing across applications, APIs and data platforms Validate data pipelines (Azure Data Factory, Databricks, Microsoft Fabric) ensuring accuracy and consistency Partner with Developers and Business Analysts on test planning, scenario creation and early validation Perform SQL-based data validation … Strong SQL skills for data validation and troubleshooting Experience testing across Power Platform (PowerApps, Dataverse), SharePoint and APIs Exposure to Azure data technologies (ADF, Databricks, Microsoft Fabric) Ability to design structured test cases, scenarios and test cycles Strong analytical and communication skills What's on Offer Salary ...

Senior Data Engineer - London (Hybrid) - Databricks - Up to £80,000 A fast-growing analytics and data-led organisation within the entertainment space is continuing to invest heavily in its data platform as demand scales. Data sits at the centre of how this business drives commercial performance, insight and strategic decision … modern, cloud-native data architecture to support that growth. This is an excellent opportunity for a Senior Data Engineer who wants to shape Databricks-based solutions, influence architectural direction, playing a key role in setting engineering standards. What you'll be doing Designing and evolving scalable, resilient data platforms ...

will own the quality assurance of Sagacity's client data platform deployments — the Databricks Lakehouse pipelines, gold-layer views, and analytics datasets that drive marketing, billing, credit and debt outcomes for our clients across financial services, retail, energy, telecoms & media, water, and the not-for-profit sector. Working closely with … volume checks, data quality rules, and migration parity — using SPHERE's YAML-driven test framework Investigate test failures systematically: trace root causes through the Databricks Lakehouse stack (bronze silver gold), distinguish pipeline bugs from data issues, and produce clear, evidenced findings for the development team Manage QA work items ...

high-quality data platforms that support critical, real-world decision-making. Looking for a strong Principal Data Engineer whos hands-on with Azure (ADF, Databricks, Lakehouse), has led big modernisation/migration projects, and knows how to build secure data platforms. You need to be a genuine leader - someone … senior capacity Demonstrable experience designing and managing metadata-driven frameworks using Azure Data Factory and Azure Databricks. Competence in and hands-on experience managing Databricks environments and developing lakehouse architectures with a focus on automation, performance tuning, cost optimisation, and system reliability. Proven proficiency in programming languages such as Python ...

Participation in an on-call or out-of-hours rota may be required depending on operational needs. Opportunity to work with specialist platforms including Databricks, Azure ML, and enterprise-scale data tools. What you’ll bring to the role Essential Strong experience with Azure DevOps, including pipeline and template development. … Hands-on experience with ML Ops practices and tools such as Databricks or MLflow. Proficiency in PowerShell, Bash, Azure CLI, and scripting for automation. Experience supporting application development in Python, C#, and JavaScript. Knowledge of Terraform, Bicep, ARM templates, and CI/CD best practice. Azure certification. Desirable Experience with ...