26 to 50 of 59 Databricks Jobs in the Thames Valley

need to have experience with some of the following and be able to learn new technologies or concepts quickly: Deep experience with Databricks on Microsoft Azure, including Delta Lake, Unity Catalog, Delta Live Tables, PySpark and Databricks SQL, alongside complementary services such as Azure Data Factory, Synapse Analytics, and Microsoft … Fabric. Designing and implementing Lakehouse architectures in Databricks to unify data warehousing and data lake capabilities, enabling scalable analytics and governance. Building and orchestrating Databricks notebooks, Delta Live Tables, Databrick Jobs and integration with Azure Data Factory for enterprise-scale data ingestion and transformation. Proficiency in Python and PySpark ...

technology environment What You'll Work With The platform is built on a Microsoft stack with centrally stored data: Azure Machine Learning Microsoft Fabric Databricks Centralised data lake architecture Microsoft Dynamics CRM AI-powered legal tools focused on due diligence and contract review Nice to Haves Experience working on established ...

Develop and deploy advanced analytics, data science, and machine learning solutions across a variety of use cases. Use technologies such as Python, R, Azure, Databricks, SQL, Power BI, and Tableau to extract actionable insights from complex datasets. Contribute to the design and implementation of scalable data science workflows and best … deep learning techniques (e.g., TF-IDF, word embeddings, CNNs, RNNs). Familiarity with generative AI and prompt engineering. Experience with Azure Databricks, MLflow, Azure ML services, Docker, or Kubernetes. Exposure to Agile development environments and software engineering best practices. Experience working in large, complex organisations or regulated industries. Strong working ...

chance to shape how things are done while staying hands-on. The company is preparing to move from its existing Azure setup to a Databricks-based platform, with a major build programme planned over the coming months. You'll be involved in the development of new pipelines, improvements to existing … Strong background as a Data Engineer in a cloud environment Good experience with SQL, Python and data transformation Understanding of modern data platforms (Azure, Databricks, Spark or similar) Confidence leading workstreams and coaching other engineers Comfortable working in an agile setup Clear communication skills and a collaborative approach ...

Senior Data Engineer (Databricks) Full Time/Permanent £70,000 - £80,000 + car allowance, generous bonus, private medical and other extensive benefits Hybrid - 1 day a week in the Oxfordshire head office required The Company: My client is an industry leading and award-winning financial services organisation who operate … have offices throughout the UK, Europe and the US. The Role: We are looking for a driven and experienced Senior Data Engineer with extensive Databricks experience to join a rapidly growing in house Data team during an exciting period of change. This is a role where you can really make ...

automations that reduce manual process by up to 90% in globally significant banks. We've raised $7m from the backers behind Klarna, Spotify and Databricks to continue growing. Our Engineering team Our engineering team is obsessed with our users, endlessly curious about new ways to create value, and deeply technical. ...

Design & Development: Architect and develop end-to-end AI/ML solutions using Azure AI services (e.g., Azure Machine Learning, Azure Cognitive Services, Azure Databricks, Azure Synapse Analytics). • Model Deployment & Management: Implement robust MLOps practices for continuous integration, continuous delivery (CI/CD), monitoring, and retraining of machine learning … model registration, deployment (AKS, ACI), and monitoring. • Hands-on experience with Azure data services such as Azure Data Lake Storage, Azure Data Factory, Azure Databricks, or Azure Synapse Analytics. • Solid understanding of software engineering principles, including version control (Git), testing, and code review. • Experience with containerization technologies (Docker, Kubernetes). ...

pipelines, architecture, and analytics environments are reliable, performant, and secure. Key Responsibilities Platform Development & Maintenance Design and implement data pipelines using Azure Data Factory, Databricks, and related Azure services. Build ETL/ELT processes to transform raw data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability … using Azure Data Lake Storage. Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake ...

ALTEN, an engineering and technology consultancy, We are a leading Engineering and IT consultancy operating across 30 countries, making waves in all sectors: Aeronautics, Space, Defence, Security and Naval, Automotive, Rail and mobility, Energy and ...

Databricks Engineer Location: Oxfordshire (Hybrid) Salary: £Competitive + Benefits Are you an experienced Databricks Engineer looking for your next challenge? The Role This is a hands-on technical role with leadership responsibilities. You'll design and deliver scalable data solutions, work closely with data leaders on architecture and strategy … mentor a small team of Data Engineers to ensure best practices. Key Responsibilities Build and maintain scalable data pipelines and ETL processes using Databricks Collaborate on data architecture and translate designs into build plans Deliver large-scale data workflows and optimise for performance Implement data quality and validation processes What ...

with offices in both Manchester and Milton Keynes. You’ll join a high-impact team focused on rebuilding and optimising data pipelines into a Databricks Lakehouse environment, enabling clean, scalable, and high-quality data delivery for analytics and reporting. This is outside IR35, requires 1 day per week on-site … greenfield project. Key Responsibilities Design, build, and optimise data pipelines using ELT/ETL best practices. Migrate and transform data into a Databricks Lakehouse architecture. Ensure data quality, reliability, and scalability for analytics and reporting. Collaborate with stakeholders to deliver robust solutions aligned with business needs. Support production environments ...

Role Overview A leading financial services provider is embarking on a major data transformation, building a modern architecture with Microsoft and Databricks technologies to become a truly data-driven organisation. As part of our client's programme and management information team, we are seeking a Data Modeller & BI Developer … need to succeed Expert proficiency in Microsoft Power BI (Desktop, Service, DAX). Expertise in Data Modelling and Schema creation. Strong experience with Databricks and Azure Data Lake design. Proficiency in SQL, ETL frameworks, and database management systems. Analytical mindset with proven problem-solving abilities. Excellent communication, coaching, and teamwork ...

Data Engineer candidate will have the chance to make a significant impact in designing the platform and working on cutting-edge technologies like Databricks and Snowflake in the heart of a leading global Investment Banks' front-office. This is a rare greenfield role that offers the opportunity to solve … many different sectors. What We're Looking For 5 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices ...

Data Engineer candidate will have the chance to make a significant impact in designing the platform and working on cutting-edge technologies like Databricks and Snowflake in the heart of a leading global Investment Banks' front-office. This is a rare greenfield role that offers the opportunity to solve … many different sectors. What We're Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices ...

Physical) to support business needs ensuring data integrity and efficiency. • Design and govern data architecture and integration standards across Azure Data Factory and Databricks to enable integrated analytics solutions. • Manage the Information Management framework, architecture, processes, and solutions • Be responsible for strategic roadmaps that describe the journey to target state … Architecture and Data modeling Property & Casualty domain experience is a MUST Proficiency with data modeling tools like Erwin Experience with Azure Data Factory and Databricks including orchestrating and designing data pipelines PROFILE • 10+ years of experience in hands-on design, engineering, administration, and implementation of comprehensive systems and architectures ...

faster across cloud and distributed environments. Build and optimize data pipelines for large-scale, multimodal datasets. Design and operate distributed data processing across Spark, Databricks, and Kubernetes. Improve developer productivity through faster builds, better orchestration, and scalable infra. Productionize ML models (PyTorch), from prototype to deployment. We are seeking someone … with the following experience: Strong Python programming and solid data engineering fundamentals. Hands-on with Ray, Spark, Databricks, or similar distributed compute frameworks. Experience managing cloud infrastructure, Kubernetes, and CI/CD pipelines. Familiar with dataset versioning, orchestration, and experiment tracking (DVC, MLflow, Airflow). Ideally, we are looking ...

aligns with long-term objectives. In this Senior Data Engineering role, you'll design, develop, and maintain data platforms using technologies such as Snowflake, Databricks, Synapse/Fabric, and PySpark, ensuring the scalability, security, and performance of all data systems. As the Senior Data Engineer your role will … that support efficient and reliable data processing. Key Responsibilities of the Senior Data Engineer: Solid grasp of modern data engineering concepts and workflows. Strong Databricks experience Familiarity with Azure and related DevOps tools. Strong Python programming capability. Knowledge of data orchestration, pipeline development, and data modelling. Background in connecting data ...

days per week onsite What you'll be doing: Design, build, and optimise scalable data pipelines and architecture Work hands-on with SQL, PySpark, Databricks, Azure, and Data Lake to deliver high-performance solutions Translate business needs into technical requirements and data-driven solutions Ensure best practice in data governance … What you'll need: Proven experience as a Data Engineer or Senior Data Engineer with some team leadership responsibilities Strong technical expertise with PySpark, Databricks, Azure, and Data Lake Deep understanding of data architecture and ETL processes in cloud environments The ability to balance coding and technical delivery with people ...

data platforms to support a wide range of data processing and analytics requirements Leading complex data and engineering engagements using Microsoft Azure, Fabric and Databricks Writing and reviewing high-quality Python and SQL for data transformation, automation and analytics. Translating complex technical concepts into clear, actionable insights for non-technical … build Strong expertise in Microsoft Azure cloud services for data storage, processing and analytics Proven experience with modern data platforms such as Fabric and Databricks, and strong programming skills in Python and SQL A strong UK network and experience building a pipeline of data, analytics and AI work Confidence engaging ...

Senior Databricks Engineer - Banbury Hybrid - Salary £65-75K + Benefits Bibby Financial Services have an exciting opportunity available for a reliable Senior Databricks Engineer to join our team. You will join us on a full time, permanent basisand in return, you will receive a competitive salary ...

DataOps Engineer working in Azure-based data platforms, supporting complex, large-scale workloads within mature Agile delivery environments. Deep hands-on expertise with Azure Databricks, including clusters, job orchestration, Workflows, Repos, Delta Lake, Unity Catalog, metastore configuration, and workspace administration. Strong experience with Azure DevOps YAML pipelines, Git branching strategies … artifact management, automated testing, and environmental promotion workflows. Expert-level knowledge of Terraform for provisioning Databricks resources, Azure networking, storage, key vaults, identities, private endpoints, and associated cloud infrastructure. Strong understanding of Azure cloud services such as Azure Data Lake Storage, Azure Key Vault, Azure Monitor, Azure VMs, Azure Networking ...

this role, you will be responsible for: Designing end-to-end data architecture aligned with modern best practices. Building and managing ingestion pipelines using Databricks and related tools. Developing PySpark/Spark SQL notebooks for complex transformations and cleansing. Applying governance, security, and CI/CD best practices across cloud … environments. Leading technical discussions and producing professional documentation. To be successful in this role, you will have: Hands-on experience with Databricks including Unity Catalog. Strong PySpark/Spark SQL skills for large-scale transformations. Experience integrating with diverse data sources such as APIs, cloud storage and databases. Experience with ...

this role, you will be responsible for: Designing end-to-end data architecture aligned with modern best practices. Building and managing ingestion pipelines using Databricks and related tools. Developing PySpark/Spark SQL notebooks for complex transformations and cleansing. Applying governance, security, and CI/CD best practices across cloud … environments. Leading technical discussions and producing professional documentation. To be successful in this role, you will have: Hands-on experience with Databricks including Unity Catalog. Strong PySpark/Spark SQL skills for large-scale transformations. Experience integrating with diverse data sources such as APIs, cloud storage and databases. Experience with ...

this role, you will be responsible for: Designing end-to-end data architecture aligned with modern best practices. Building and managing ingestion pipelines using Databricks and related tools. Developing PySpark/Spark SQL notebooks for complex transformations and cleansing. Applying governance, security, and CI/CD best practices across cloud … environments. Leading technical discussions and producing professional documentation. To be successful in this role, you will have: Hands-on experience with Databricks including Unity Catalog. Strong PySpark/Spark SQL skills for large-scale transformations. Experience integrating with diverse data sources such as APIs, cloud storage and databases. Experience with ...

this role, you will be responsible for: Designing end-to-end data architecture aligned with modern best practices. Building and managing ingestion pipelines using Databricks and related tools. Developing PySpark/Spark SQL notebooks for complex transformations and cleansing. Applying governance, security, and CI/CD best practices across cloud … environments. Leading technical discussions and producing professional documentation. To be successful in this role, you will have: Hands-on experience with Databricks including Unity Catalog. Strong PySpark/Spark SQL skills for large-scale transformations. Experience integrating with diverse data sources such as APIs, cloud storage and databases. Experience with ...