1 to 25 of 464 Databricks Jobs in England

Solution Architect - Databricks Initial 7-month Contract Role Remote Working £600 - £700, Inside IR35 We're partnering with a Global IT Partner who are looking for a Databricks Solution Architect to provide guidance on data architecture and design and optimise Databricks solutions. As a Databricks Solution Architect, you will be responsible for: Lead end-to-end architecture of data lakes … to Azure with a core focus on Databricks Provide technical leadership on Databricks Design and implement data pipelines in Azure Databricks, optimizing for performance, cost, and scalability Advise of data lake migration, data modelling and pipeline optimisation Refactor and modernize existing data models to integrate with Power BI Coordinate phased migrations to ensure zero disruption to live operations Replace legacy … tools by consolidating workflows within Databricks and native Azure services Requirements: 10+ years in cloud architecture/engineering with a strong focus on building scalable data pipelines Expertise in Azure Databricks (7+years) including building and managing ETL pipelines using PySpark or Scala (essential) Solid understanding of Apache Spark, Delta Lake, and distributed data processing concepts Hands-on experience with Azure More ❯

CDO level and translating requirements into solution blueprints, proposals, and presentations. Enterprise Solution Design – Architect end-to-end data and cloud solutions across platforms such as Azure, AWS, GCP, Databricks, Snowflake, Synapse, or Azure Fabric. Cloud Strategy & Adoption – Define and lead cloud migration, modernisation, and optimisation strategies using tools such as Terraform, Azure DevOps, and CI/CD pipelines. Data More ❯

CDO level and translating requirements into solution blueprints, proposals, and presentations. Enterprise Solution Design – Architect end-to-end data and cloud solutions across platforms such as Azure, AWS, GCP, Databricks, Snowflake, Synapse, or Azure Fabric. Cloud Strategy & Adoption – Define and lead cloud migration, modernisation, and optimisation strategies using tools such as Terraform, Azure DevOps, and CI/CD pipelines. Data More ❯

have experience working with some of the following technologies: Power BI Power Apps Blob storage Synapse Azure Data Factory (ADF) IOT Hub SQL Server Azure Data Lake Storage Azure Databricks Purview Power Platform Python More ❯

efficiency. Define reusable components, standards, and documentation to support long-term scalability. Essential Skills & Experience: Proven experience building Azure data platforms end-to-end (Data Factory, Synapse, Fabric, or Databricks). Strong SQL development and data modelling capability. Experience integrating ERP or legacy systems into cloud data platforms. Proficiency in Python or PySpark for transformation and automation. Understanding of data More ❯

efficiency. Define reusable components, standards, and documentation to support long-term scalability. Essential Skills & Experience: Proven experience building Azure data platforms end-to-end (Data Factory, Synapse, Fabric, or Databricks). Strong SQL development and data modelling capability. Experience integrating ERP or legacy systems into cloud data platforms. Proficiency in Python or PySpark for transformation and automation. Understanding of data More ❯

performance tuning, ELT best practices). Proven commercial experience with DBT for modular data modelling, testing, documentation, and CI/CD integration. Skilled in Azure Data Factory, Synapse, and Databricks for end-to-end data pipeline orchestration. Excellent SQL engineering capability; experience designing data models for analytics and operational reporting. Proven track record in the insurance or wider financial services More ❯

Key Responsibilities * End-to-end development of AI/ML solutions. * MLOps practices: CI/CD, model monitoring, retraining. * Use of open-source and enterprise tools (LangChain, Azure OpenAI, Databricks). * Generative AI features: embeddings, RAG, AI agents. * Clean, testable code with modern engineering practices. * Align with enterprise architecture and governance. * Collaborate with architects and stakeholders. * Lifecycle management of models. More ❯

LLMs: GPT-4/5, Claude, Gemini, Mistral, LLaMA, Cohere Frameworks: LangChain, LlamaIndex, Haystack Tools: GitHub Copilot, Cursor, PromptLayer, Weights & Biases Cloud: Azure ML, AWS SageMaker, Google Vertex AI, Databricks Infra: Python, Docker, Kubernetes, SQL, PyTorch More ❯

GenAI and a strong understanding of its potential impact on business and technology. Experience in regulated industries such as insurance or financial services. Experience with tools such as LangChain, Databricks, LLMOps, and Kubernetes. Behaviours: Team player Self-motivated with a drive to learn and develop Logical thinker with a professional and positive attitude Passion to innovate and improve processes Personality More ❯

migrations, CI/CD, containerisation, and secrets management. Proven track record in technical consulting, client engagement, and project management within life sciences or healthcare. Experience with cloud platforms (Azure, Databricks) and deploying ML models at scale, including Azure OpenAI Services. Excellent problem-solving, analytical, and interpretative skills; ability to think creatively and critically. Strong communication and collaboration skills, capable of More ❯

modelling data through a medallion-based architecture, with curated dimensional models in the gold layer built for analytical use Strong understanding and or use of unity catalog alongside core databricks functionality to drive metadata management Strong understanding of cloud economics, including cost management strategies and optimising solutions for customer needs.Experience with infrastructure as code, proficiency using tools such as Terraform More ❯

to architectural decisions, and support the migration of reporting services to Azure. Key Responsibilities: Design, build, and maintain ETL pipelines using Azure Data Factory , Azure Data Lake , Synapse , and Databricks . Design and build a greenfield Azure data platform to support business-critical data needs. Collaborate with stakeholders across the organization to gather and define data requirements. Assist in the More ❯

engineering teams to resolve them. Strong analytical mindset and attention to detail. Clear, concise communicator able to present technical findings simply. Desirable: Experience testing in big data environments using Databricks, Snowflake, or Redshift. Knowledge of data governance and lineage tracking tools. Exposure to data performance and load testing. Experience in an Agile delivery environment. More ❯

effect change to achieve common goals. Proficiency in the design and implementation of modern data architectures (ideally Azure/Microsoft Fabric/Data Factory) and modern data warehouse technologies (Databricks, Snowflake) Experience with database technologies such as RDBMS (SQL Server, Oracle) or NoSQL (MongoDB) Knowledge in Apache technologies such as Spark, Kafka and Airflow to build scalable and efficient data More ❯

Strong knowledge of software development methodologies, tools, and frameworks, particularly Agile. Proficiency in both SQL and NOSQL database management systems (e.g. SQL Server/Oracle/MongoDB, CosmosDB, Snowflake, Databricks). Hands-on experience with data modelling tools, data warehousing, ETL processes, and data integration techniques. Experience with at least one cloud data platform (e.g. AWS, Azure, Google Cloud) and More ❯

modelling data through a medallion-based architecture, with curated dimensional models in the gold layer built for analytical use Strong understanding and or use of unity catalog alongside core databricks functionality to drive metadata management Strong understanding of cloud economics, including cost management strategies and optimising solutions for customer needs.Experience with infrastructure as code, proficiency using tools such as Terraform More ❯

Automation Scripting Languages (Python, Powershell) Reporting tools (Power BI, SSRS or Tableau) Microsoft Fabric/Data Engineer - Modern Data Architecttures e.g lakehouse, data mesh ETL/ELT Tools (dbt, Databricks) Source Control (GitHub, Tortoise SVN) Batch Scheduling (Control-M, Autosys) CI/CD Education/Qualifications: Degree educated and/or equivalent experience.Personal Requirements: Excellent communication skills Results driven, with More ❯

data modelling and data analytics [programming languages: Python, SQL, Alteryx] - Data Visualisation experience [tools: PowerBI, Tableau or similar] - MetaData management and data cataloguing [tools: Collibra, Alation] - Data Platform tools [DataBricks, Azure, Kafka] Other skills required: - Strong stakeholder management skills - Experience working in a trading environment - An interest in automation and modern technologies [use of automation, ML and AI to drive More ❯

data requirements. Attention to detail and a strong commitment to data integrity. Excellent problem-solving skills and ability to work in a fast-paced environment. Preferred Qualifications Experience with Databricks or Ray. Familiarity with dbt and Airflow. Experience with data quality frameworks. Understanding of ML requirements and experience working with ML teams. Experience in robotics or a related field. Familiarity More ❯

data requirements. Attention to detail and a strong commitment to data integrity. Excellent problem-solving skills and ability to work in a fast-paced environment. Preferred Qualifications Experience with Databricks or Ray. Familiarity with dbt and Airflow. Experience with data quality frameworks. Understanding of ML requirements and experience working with ML teams. Experience in robotics or a related field. Familiarity More ❯

data requirements. Attention to detail and a strong commitment to data integrity. Excellent problem-solving skills and ability to work in a fast-paced environment. Preferred Qualifications Experience with Databricks or Ray. Familiarity with dbt and Airflow. Experience with data quality frameworks. Understanding of ML requirements and experience working with ML teams. Experience in robotics or a related field. Familiarity More ❯

data requirements. Attention to detail and a strong commitment to data integrity. Excellent problem-solving skills and ability to work in a fast-paced environment. Preferred Qualifications Experience with Databricks or Ray. Familiarity with dbt and Airflow. Experience with data quality frameworks. Understanding of ML requirements and experience working with ML teams. Experience in robotics or a related field. Familiarity More ❯

data requirements. Attention to detail and a strong commitment to data integrity. Excellent problem-solving skills and ability to work in a fast-paced environment. Preferred Qualifications Experience with Databricks or Ray. Familiarity with dbt and Airflow. Experience with data quality frameworks. Understanding of ML requirements and experience working with ML teams. Experience in robotics or a related field. Familiarity More ❯

example - Computer Science, Mathematics, Engineering or other STEM A strong team player with empathy, humility and dedication to joint success and shared development. Desirable Experience and Qualifications: Experience with Databricks or Delta Lake architecture. Experience building architecture and Data Warehousing within the Microsoft Stack Experience in development Source control (e.g. Bit Bucket, Github) Experience in Low Code Analytical Tools (e.g. More ❯