1 to 25 of 43 Databricks Jobs in the Thames Valley

based architecture, with curated dimensional models in the gold layer built for analytical use Strong understanding and or use of unity catalog alongside core databricks functionality to drive metadata management Strong understanding of cloud economics, including cost management strategies and optimising solutions for customer needs.Experience with infrastructure as code, proficiency ...

best practices for data governance and security. Required Skills & Experience 5–10 years in data engineering roles, ideally within consultancy environments. Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice ...

best practices for data governance and security. Required Skills & Experience 5–10 years in data engineering roles, ideally within consultancy environments. Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice ...

best practices for data governance and security. Required Skills & Experience 5–10 years in data engineering roles, ideally within consultancy environments. Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice ...

technologies in the Microsoft ecosystem (e.g., Azure ML, AI Foundry, Copilot 365, OpenAI Service). Desirable: Working understanding of Azure Data Factory, Azure Databricks and Azure Data Lake. Familiarity with Microsoft Purview. Proven success in a technical/functional Pre-sales role within a consulting environment. The Person: Strong commercial ...

highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building … maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex ...

Senior DataBricks Engineer - £70,000 - Hybrid We're looking for a hands-on Senior Databricks Engineer to lead the delivery of scalable data solutions within an Agile environment. Working closely with the Data Product Manager and Data Architect, you will shape and develop our data platform, delivering high-quality pipelines … recommend improvements. Ensure adherence to governance standards. Line-manage and mentor a small team of Data Engineers. What We're Looking For Extensive Databricks experience, including Unity Catalog. Strong skills in Python, Spark, SQL and experience with SQL databases. Terraform experience for cloud infrastructure as code. Experience with Azure ...

across the entire data ecosystem. Essential tech skills include proficiency in Python, Spark, and Airflow, alongside experience with major data platforms such as Snowflake, Databricks, and BigQuery. Familiarity with data transformation and infrastructure as code tools like dbt, Fivetran, and Terraform is highly beneficial. Experience with one or more major ...

building modern data platforms Strong experience with Microsoft Azure and related data and analytics services Hands-on expertise with platforms such as Fabric and Databricks Strong programming capability in Python and SQL A proven track record of winning work and growing client relationships across the UK Experience leading teams ...

working in a fast-paced, collaborative environment with strategic and operational responsibilities. Experience with vendor management and contract oversight. Familiarity with tools such as Databricks, Tecton (or Feast), Seldon, or SageMaker. What can they offer you? Private health and mental wellbeing coverage, including access to counselling and coaching. Salary ...

LLMs and/or Agentic Systems, from development to production. Hands-on experience with LLM frameworks (e.g. langchain, langgraph, llamaindex, langsmith), AI platforms (e.g. Databricks, mlflow) and containerization solutions (e.g. Docker) is valued. Strong software engineering fundamentals and proficiency in Python are a must. Be creative, ambitious and curious. ...

LLMs and/or Agentic Systems, from development to production. Hands-on experience with LLM frameworks (e.g. langchain, langgraph, llamaindex, langsmith), AI platforms (e.g. Databricks, mlflow) and containerization solutions (e.g. Docker) is valued. Strong software engineering fundamentals and proficiency in Python are a must. Be creative, ambitious and curious. ...

LLMs and/or Agentic Systems, from development to production. Hands-on experience with LLM frameworks (e.g. langchain, langgraph, llamaindex, langsmith), AI platforms (e.g. Databricks, mlflow) and containerization solutions (e.g. Docker) is valued. Strong software engineering fundamentals and proficiency in Python are a must. Be creative, ambitious and curious. ...

experience with Kubernetes, containers, and Terraform • Hands-on experience with Kafka and infrastructure deployments • Scripting or software development experience using Python • Familiarity with Databricks • Familiarity with OpenShift • Experience working within an infrastructure team supporting high-scale data and/or ML systems Additional Context This role would suit someone ...

platforms, integration technologies, and advanced analytics, including AI/ML. Key Responsibilities Data Platform Management Design and implement solutions using Microsoft Fabric, Snowflake, CosmoDB, Databricks, MongoDB, and traditional RDBMS systems Data Replication & CDC Configure and manage Qlik Replicate and Oracle GoldenGate for real-time data synchronization Data Modeling Develop conceptual … Drive adoption of Machine Learning, Generative AI, and Agentic AI in enterprise data strategies Required Skills & Qualifications Strong experience with data platforms (Fabric, Snowflake, Databricks, MongoDB, RDBMS) Hands-on expertise in data replication tools (Qlik Replicate, Oracle GoldenGate) Proficiency in data modeling and integration architectures Knowledge of API design, data ...

academic and professional services communities to drive adoption. Desirable Experience with major cloud and AI stacks such as Azure OpenAI/OpenAI, Azure ML, Databricks, Kubernetes, and Docker. Familiarity with data platforms such as Azure Data Lake, Synapse/ADF, Delta Lake, and messaging platforms (e.g., event hubs, service … pipelines, APIs, and microservices. Hands-on experience with cloud platforms (Azure preferred; AWS or GCP also valued) and MLOps tools (e.g., MLflow, Azure ML, Databricks, SageMaker or Vertex) plus observability practices. Familiarity with higher education processes and integrations across SIS, LMS, CRM, and ERP environments. Knowledge of data privacy, accessibility ...

academic and professional services communities to drive adoption. Desirable Experience with major cloud and AI stacks such as Azure OpenAI/OpenAI, Azure ML, Databricks, Kubernetes, and Docker. Familiarity with data platforms such as Azure Data Lake, Synapse/ADF, Delta Lake, and messaging platforms (e.g., event hubs, service … pipelines, APIs, and microservices. Hands-on experience with cloud platforms (Azure preferred; AWS or GCP also valued) and MLOps tools (e.g., MLflow, Azure ML, Databricks, SageMaker or Vertex) plus observability practices. Familiarity with higher education processes and integrations across SIS, LMS, CRM, and ERP environments. Knowledge of data privacy, accessibility ...

academic and professional services communities to drive adoption. Desirable Experience with major cloud and AI stacks such as Azure OpenAI/OpenAI, Azure ML, Databricks, Kubernetes, and Docker. Familiarity with data platforms such as Azure Data Lake, Synapse/ADF, Delta Lake, and messaging platforms (e.g., event hubs, service … pipelines, APIs, and microservices. Hands-on experience with cloud platforms (Azure preferred; AWS or GCP also valued) and MLOps tools (e.g., MLflow, Azure ML, Databricks, SageMaker or Vertex) plus observability practices. Familiarity with higher education processes and integrations across SIS, LMS, CRM, and ERP environments. Knowledge of data privacy, accessibility ...

chance to shape how things are done while staying hands-on. The company is preparing to move from its existing Azure setup to a Databricks-based platform, with a major build programme planned over the coming months. You'll be involved in the development of new pipelines, improvements to existing … Strong background as a Data Engineer in a cloud environment Good experience with SQL, Python and data transformation Understanding of modern data platforms (Azure, Databricks, Spark or similar) Confidence leading workstreams and coaching other engineers Comfortable working in an agile setup Clear communication skills and a collaborative approach ...

Senior Data Engineer (Databricks) Full Time/Permanent £70,000 - £80,000 + car allowance, generous bonus, private medical and other extensive benefits Hybrid - 1 day a week in the Oxfordshire head office required The Company: My client is an industry leading and award-winning financial services organisation who operate … have offices throughout the UK, Europe and the US. The Role: We are looking for a driven and experienced Senior Data Engineer with extensive Databricks experience to join a rapidly growing in house Data team during an exciting period of change. This is a role where you can really make ...

scale. The environment looks a bit like this Python (pandas, numpy, scipy, PySpark) SQL AWS or GCP (BigQuery/RedShift/Snowflake) Spark/Databricks Airflow/Dagster ...

pipelines, architecture, and analytics environments are reliable, performant, and secure. Key Responsibilities Platform Development & Maintenance Design and implement data pipelines using Azure Data Factory, Databricks, and related Azure services. Build ETL/ELT processes to transform raw data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability … using Azure Data Lake Storage. Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake ...

AI, Data & Defence Engineering Roles Engineer to Managing Consultant | Defence, National Security & Critical Infrastructure London, Newcastle, Manchester, Glasgow We are supporting a leading UK technology and transformation consultancy delivering secure AI, data engineering, and advanced ...

deliver and support their reporting requirements and to build new cyber security metrics. Responsibilities: Work with reporting and data tools such as PowerBI and Databricks to produce insights from a range of cyber security tools such as vulnerability management, identity management, detection and response and other cyber security tools ...

heard and your career can grow. In this role, you will be responsible for: Building and managing data pipelines using Azure Synapse, Data Factory, Databricks, or Microsoft Fabric Designing and maintaining data lakes, data warehouses, and ETL/ELT processes Developing scalable data models for reporting in Power BI Work … successful in this role, you will have: Hands-on experience creating data pipelines using Azure services such as Synapse, Data Factory or Databricks Strong understanding of SQL and Python/PySpark Experience with Power BI and data modelling Commercial experience with Microsoft Fabric would be advantageous Some of the package ...