76 to 100 of 145 Databricks Jobs in the South East

Platform Architecture & Engineering responsibilities: Design and implement scalable Databricks Lakehouse platforms on AWS and/or Azure aligned to client requirements Architect end-to-end data platforms including ingestion, storage (Delta Lake), processing, and consumption layers Build and configure cloud infrastructure using infrastructure-as-code (e.g. Terraform & Declarative Automation Bundles … data governance (Unity Catalog), and access controls Define environment strategies (dev/test/prod), CI/CD pipelines, and release processes for Databricks deployments Implement monitoring, logging, cost optimisation, and performance tuning across the platform Design and implement data pipelines using Delta Live Tables, Auto Loader, and Databricks Workflows ...

junior engineers and progress into technical architecture or leadership roles. Key Responsibilities Design, develop and maintain data pipelines using Azure Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly … technical best practices. About You You'll have: Strong experience with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills ...

Senior Data Engineer - Databricks | Hybrid London | £550/day Outside IR35 | 12 Months A well-established transport/travel sector business is expanding its Data & Middleware function as part of a major analytics transformation, and is looking for a Senior Data Engineer to help build out its data platform … delivery and run Maintain a strong security and data-protection focus throughout What you'll need: 5+ years' progressive data engineering experience Strong Databricks and Spark expertise - platform internals, performance, DAB, Delta Lake, declarative pipelines Advanced Python, with solid software/DevOps practice (version control, unit testing, pipelines-as-code ...

engineering, product, design, digital services and data to deliver a cohesive digital estate. The role requires transformation leadership, cloud data platform expertise (Azure/Databricks) and governance with UK GDPR. #J-18808-Ljbffr ...

Lead to own four predictive models, guiding governance and the internal data science function. You will shape data strategies in a Microsoft Azure and Databricks environment, advise senior stakeholders, and translate complex analytics into commercial value. You will manage model lifecycle, drive strategic initiatives, and work with external partners ...

role requires strong statistical modelling experience (GLMs/GBMs), governance awareness and excellent communication with senior stakeholders. WTW Radar/Emblem knowledge and Databricks, SQL or Python are advantageous. #J-18808-Ljbffr ...

enterprise-scale cloud solutions and mentoring high-performing engineers. You will work with AWS/Azure/GCP, modern data platforms like Snowflake and Databricks, and promote AI-enabled software engineering practices while partnering with clients to translate requirements into scalable designs. #J-18808-Ljbffr ...

destination marketing, or visitor economy sectors is highly beneficial. Strong understanding of data platforms, data engineering, and analytics ecosystems. Hands-on experience working with Databricks is essential. Ability to collaborate effectively with business stakeholders and technical delivery teams. Experience supporting Agile delivery environments. ...

Anthropic tools, and a clear view on how to build solutions with them (not just use them) Working knowledge of Excel, SQL and Databricks - comfortable learning fast where gaps exist Experience supporting or training mixed-skill audiences: patient with beginners, credible with engineers Practical familiarity with AI usage/cost ...

team. This is an excellent opportunity for an experienced data professional to play a key role in the development and evolution of a modern Databricks environment while working alongside Data Science, Analytics and Product teams. Working closely with senior engineering leadership, you will be responsible for designing and delivering robust … business-critical data ecosystem while supporting the delivery of high-value data products. Key Responsibilities Design, build and maintain scalable data pipelines using Databricks and Apache Spark. Develop and optimise batch and streaming data workflows, ensuring reliability, scalability and performance. Contribute to the design and implementation of modern Lakehouse data ...

data transformation processes and supporting the ongoing performance and reliability of the SQL database estate. This role would suit a Data Engineer with strong Databricks, SQL and Python/PySpark expertise who enjoys solving technical challenges, improving data platforms and working collaboratively with both technical and non-technical stakeholders. … Responsibilities Design, develop and maintain robust, scalable data pipelines using Databricks, helping to build and shape the wider data platform. Build and optimise ETL processes that bring together data from a range of sources and make it ready for reporting, analytics and insight. Create high-quality SQL and Python transformations ...

excellent opportunity to join a global, technology-driven organisation where you'll work with modern Microsoft Azure technologies, including Cosmos DB, Azure Data Factory, Databricks and Microsoft Fabric, helping design scalable data solutions and shape how data is structured, integrated, and used across the business. The Role As a Data … data migration projects, including validation and reconciliation. Experience designing data contracts, schemas, and validation rules is highly desirable. Experience with Azure services such as Databricks, Synapse, or Azure Storage would be advantageous. What's on Offer Day Rate: £375.00 Hybrid Role - 2-3 days onsite per week in London Opportunity ...

Engineer to play a key role in its transition from a SQL Server-led environment to a modern, scalable data platform built around Azure Databricks and Python. This is not a traditional reporting role - You'll work across the full data and BI lifecycle, owning complex solutions from initial stakeholder … pipeline development, data modelling, semantic layers and Power BI delivery. You'll have the opportunity to: ·Design and build production-grade pipelines using Azure Databricks, Python, PySpark and SQL ·Develop scalable Lakehouse architecture using Delta Lake and Unity Catalog ·Build data and BI products from scratch and own them through ...

grade reporting solutions while helping shape the underlying data structures that support them. You'll have exposure to modern cloud-based data platforms, including Databricks and Microsoft technologies, and will contribute across the entire analytics lifecycle from requirements gathering through to dashboard delivery. What You'll Be Doing Business Intelligence … aligned to business needs. Work closely with stakeholders to define KPIs, measures and reporting standards. Ensure data accuracy, consistency and trust across analytical solutions. Databricks & Data Platform Write and optimise SQL queries against large-scale cloud datasets. Collaborate with engineering teams to create curated reporting-ready data products. Support data ...

Data Engineer - Databricks - Oxfordshire (Hybrid) - Azure - Python - SQL - Up to £60,000 We're partnering with a growing professional services organisation that plays a critical role in delivering large-scale infrastructure, engineering and environmental projects across the UK. As the business continues to invest heavily in technology and innovation, data …/CD practices. Benefits Hybrid working with only 2 days onsite per week. Opportunity to work with a modern Microsoft data stack and Databricks platform. Exposure to a diverse range of business and data challenges. The chance to influence the future direction of a growing data function. Supportive and collaborative ...

Analytics Engineer (AI-Enabled, Databricks) - Software - London or Reading Daily rate: £350 - £450 Duration: 12 months Start: ASAP My client is looking for an Analytics Engineer to join a global analytics team supporting critical post-sales reporting, data insights, and business intelligence initiatives. This is a hands-on contract opportunity … technologies. Proven ability to validate, test, and improve AI-generated code and recommendations. Excellent stakeholder communication and collaboration skills. Desirable Experience Python programming experience. Databricks experience. Experience with platforms such as Snowflake, Hadoop, Microsoft SQL Server, or similar enterprise data technologies. Exposure to data architecture, infrastructure optimisation, and performance tuning. ...

Senior Databricks Data Engineer - London - £85K I'm currently recruiting for an experienced Senior Data Engineer with strong hands-on Databricks experience to join a growing data platform team. You'll play a key role in designing, building and optimising production-grade data pipelines across Databricks, Spark and Delta Lake … while helping shape the engineering standards and architecture behind the wider data platform. What you'll be doing: Build and optimise scalable Databricks/Spark data pipelines across batch and streaming workloads. Develop Lakehouse solutions using Delta Lake and medallion architecture. Implement data quality, monitoring, governance and security across ...

Senior Data Engineer (Databricks) - London (Hybrid) - Up to £85,000 Databricks - Apache Spark - Delta Lake - Python - SQL - Azure We're partnering with a fast-growing technology business that's investing heavily in its data platform and engineering capability. This is an opportunity to join a highly collaborative team where … play a key role in shaping a modern Databricks environment, influencing technical decisions, and delivering scalable data solutions that directly impact the business. Working within a cloud-first environment, you'll collaborate closely with Data Scientists, Analysts, Product teams, and senior stakeholders to build robust, high-performing data products whilst ...

Senior Data Engineer (Databricks) - London (Hybrid) - Up to £90,000 We're working with an innovative, data-driven organisation that is investing heavily in its Databricks platform and looking to add a Senior Data Engineer to its growing Data Engineering team. This role is ideal for someone who enjoys being … hands-on with Databricks and wants to play a key role in building and evolving a modern Lakehouse platform. You'll be working with large-scale datasets, designing robust data pipelines, and helping shape best practices across a cloud-first Azure environment. You'll join a collaborative team where Data ...

Data visualisation experience with the ability to communicate findings to both technical and non-technical audiences Exposure to cloud-based data environments such as Databricks or similar platforms A track record of translating data into actionable business recommendations What They Offer Employee discount scheme Hybrid working model with ...

evaluating marketing campaigns. Knowledge of statistical techniques including hypothesis testing, confidence intervals and significance testing. Exposure to cloud-based data platforms such as Databricks, Snowflake or BigQuery. Ability to explain complex findings to non-technical stakeholders and influence decision-making. Previous experience within a customer-rich environment, ideally retail ...

Senior Data Engineer - London (Hybrid) - Databricks - Up to £ 85,00 0 We're working with a fast-growing tech company that's putting serious investment into its data platform right now and they need a Senior Data Engineer to help lead the charge. You'll be joining a genuinely collaborative … team, with real scope to shape how their Databricks environment evolves and influence the technical decisions that go with it. It's a cloud-first setup, and you'll be working closely with Data Scientists, Analysts, Product teams and senior stakeholders to build data products that actually matter ...

days per week onsite in London. You'll be responsible for: Developing AI, GenAI and Agentic AI prototypes using Azure AI Foundry, Copilot Studio, Databricks Mosaic AI and MLflow. Building, optimising and evaluating Retrieval-Augmented Generation (RAG) solutions using prompt engineering and embedding models. Designing and deploying AI agents using … frameworks including LangChain, LangGraph and AutoGen. Delivering production-ready GenAI applications for commercial teams within Trading & Supply. Building scalable AI workflows on Databricks using Mosaic AI, MLflow, Genie and AgentBricks. Applying DevOps best practices through CI/CD pipelines, GitHub workflows and automated testing. Designing evaluation frameworks to benchmark, test ...

improvement and make a genuine contribution to how the organisation's data platform develops. Key Responsibilities Build and evolve scalable data pipelines using Databricks, playing a key role in the continued growth of the organisation's data platform. Bring data together from a variety of sources, developing and refining … architecture Skills & Experience Experience working professionally within a Data Engineering environment, with a track record of delivering reliable data solutions. Strong practical experience with Databricks and the ability to develop, support and troubleshoot data engineering workloads. A solid background in ETL and data integration Strong programming capability across ...

deploy advanced analytics, data science, machine learning and agentic ai solutions across a variety of use cases Use technologies such as Python, R, Azure, Databricks, SQL, Power BI, and Tableau to extract actionable insights from complex datasets Contribute to the design and implementation of scalable data science workflows and best … deep learning techniques (e.g., TF-IDF, word embeddings, CNNs, RNNs) Familiarity with generative AI and prompt engineering Experience with Azure Databricks, MLflow, Azure ML services, Docker, or Kubernetes Experience working in large, complex organisations or regulated industries *This role is unable to provide sponsorship* #J-18808-Ljbffr ...