1 to 25 of 287 Databricks Jobs in London

Solution Architect - Databricks Initial 7-month Contract Role Remote Working £600 - £700, Inside IR35 We're partnering with a Global IT Partner who are looking for a Databricks Solution Architect to provide guidance on data architecture and design and optimise Databricks solutions. As a Databricks Solution Architect, you will be responsible for: Lead end-to-end architecture of data lakes … to Azure with a core focus on Databricks Provide technical leadership on Databricks Design and implement data pipelines in Azure Databricks, optimizing for performance, cost, and scalability Advise of data lake migration, data modelling and pipeline optimisation Refactor and modernize existing data models to integrate with Power BI Coordinate phased migrations to ensure zero disruption to live operations Replace legacy … tools by consolidating workflows within Databricks and native Azure services Requirements: 10+ years in cloud architecture/engineering with a strong focus on building scalable data pipelines Expertise in Azure Databricks (7+years) including building and managing ETL pipelines using PySpark or Scala (essential) Solid understanding of Apache Spark, Delta Lake, and distributed data processing concepts Hands-on experience with Azure More ❯

CDO level and translating requirements into solution blueprints, proposals, and presentations. Enterprise Solution Design – Architect end-to-end data and cloud solutions across platforms such as Azure, AWS, GCP, Databricks, Snowflake, Synapse, or Azure Fabric. Cloud Strategy & Adoption – Define and lead cloud migration, modernisation, and optimisation strategies using tools such as Terraform, Azure DevOps, and CI/CD pipelines. Data More ❯

CDO level and translating requirements into solution blueprints, proposals, and presentations. Enterprise Solution Design – Architect end-to-end data and cloud solutions across platforms such as Azure, AWS, GCP, Databricks, Snowflake, Synapse, or Azure Fabric. Cloud Strategy & Adoption – Define and lead cloud migration, modernisation, and optimisation strategies using tools such as Terraform, Azure DevOps, and CI/CD pipelines. Data More ❯

performance tuning, ELT best practices). Proven commercial experience with DBT for modular data modelling, testing, documentation, and CI/CD integration. Skilled in Azure Data Factory, Synapse, and Databricks for end-to-end data pipeline orchestration. Excellent SQL engineering capability; experience designing data models for analytics and operational reporting. Proven track record in the insurance or wider financial services More ❯

Key Responsibilities * End-to-end development of AI/ML solutions. * MLOps practices: CI/CD, model monitoring, retraining. * Use of open-source and enterprise tools (LangChain, Azure OpenAI, Databricks). * Generative AI features: embeddings, RAG, AI agents. * Clean, testable code with modern engineering practices. * Align with enterprise architecture and governance. * Collaborate with architects and stakeholders. * Lifecycle management of models. More ❯

LLMs: GPT-4/5, Claude, Gemini, Mistral, LLaMA, Cohere Frameworks: LangChain, LlamaIndex, Haystack Tools: GitHub Copilot, Cursor, PromptLayer, Weights & Biases Cloud: Azure ML, AWS SageMaker, Google Vertex AI, Databricks Infra: Python, Docker, Kubernetes, SQL, PyTorch More ❯

engineering teams to resolve them. Strong analytical mindset and attention to detail. Clear, concise communicator able to present technical findings simply. Desirable: Experience testing in big data environments using Databricks, Snowflake, or Redshift. Knowledge of data governance and lineage tracking tools. Exposure to data performance and load testing. Experience in an Agile delivery environment. More ❯

data modelling and data analytics [programming languages: Python, SQL, Alteryx] - Data Visualisation experience [tools: PowerBI, Tableau or similar] - MetaData management and data cataloguing [tools: Collibra, Alation] - Data Platform tools [DataBricks, Azure, Kafka] Other skills required: - Strong stakeholder management skills - Experience working in a trading environment - An interest in automation and modern technologies [use of automation, ML and AI to drive More ❯

data requirements. Attention to detail and a strong commitment to data integrity. Excellent problem-solving skills and ability to work in a fast-paced environment. Preferred Qualifications Experience with Databricks or Ray. Familiarity with dbt and Airflow. Experience with data quality frameworks. Understanding of ML requirements and experience working with ML teams. Experience in robotics or a related field. Familiarity More ❯

data requirements. Attention to detail and a strong commitment to data integrity. Excellent problem-solving skills and ability to work in a fast-paced environment. Preferred Qualifications Experience with Databricks or Ray. Familiarity with dbt and Airflow. Experience with data quality frameworks. Understanding of ML requirements and experience working with ML teams. Experience in robotics or a related field. Familiarity More ❯

data requirements. Attention to detail and a strong commitment to data integrity. Excellent problem-solving skills and ability to work in a fast-paced environment. Preferred Qualifications Experience with Databricks or Ray. Familiarity with dbt and Airflow. Experience with data quality frameworks. Understanding of ML requirements and experience working with ML teams. Experience in robotics or a related field. Familiarity More ❯

data requirements. Attention to detail and a strong commitment to data integrity. Excellent problem-solving skills and ability to work in a fast-paced environment. Preferred Qualifications Experience with Databricks or Ray. Familiarity with dbt and Airflow. Experience with data quality frameworks. Understanding of ML requirements and experience working with ML teams. Experience in robotics or a related field. Familiarity More ❯

disciplines : Cloud Engineering Data Engineering (not building pipelines but designing and building the framework) DevOps MLOps/LLMOps Often work with the following technologies : Azure, AWS, GCP Airflow, dbt, Databricks, Snowflake, etc. GitHub, Azure DevOps and related developer tooling and CI/CD platforms, Terraform or other Infra-as-Code MLflow, AzureML or similar for MLOps; LangSmith, Langfuse and similar More ❯

technologies in data engineering, and continuously improve your skills and knowledge. Profile The Data Engineer will have mastery of data management and processing tools, including Power BI, Data Factory, Databricks, SQL Server, and Oracle. Proficient in SQL and experienced in database administration. Familiarity with cloud platforms such as Azure and AWS. Excellent problem-solving and analytical skills, with strong attention More ❯

develop a team of Data Engineers to deliver robust, scalable data solutions. Provide technical leadership across the Microsoft and Azure Data Platform (SQL Server, Power BI, Azure Data Factory, Databricks, Data Lake). Champion Data Governance , Data Quality , and Data Management best practices. Collaborate with business and technology teams to align data solutions with strategic goals. Oversee Agile delivery, CI More ❯

development experience with: C# (.NET/.NET Core) REST APIs, SQL Server (T-SQL), HTML/CSS/JavaScript/React, Python Comfortable with tools like Azure Data Factory , Databricks , Power Automate , Power Platform , Copilot Studio . Strong knowledge of cloud security , automation , and DevOps principles. ?? Bonus Points for: Experience in the insurance market Familiarity with data architecture and data More ❯

solution strategies, guiding delivery teams, and acting as a trusted advisor to CDOs, CIOs, and Heads of Data. 🔑 What You’ll Do Lead enterprise solution design on GCP, BigQuery, Databricks, Snowflake Drive cloud migration & modernisation strategies (Terraform, CI/CD, Azure DevOps, GitHub) Define enterprise data models (ERwin, ER/Studio, PowerDesigner) Architect ETL/ELT frameworks & pipelines (Dataflow, Dataproc More ❯

solution strategies, guiding delivery teams, and acting as a trusted advisor to CDOs, CIOs, and Heads of Data. 🔑 What You’ll Do Lead enterprise solution design on GCP, BigQuery, Databricks, Snowflake Drive cloud migration & modernisation strategies (Terraform, CI/CD, Azure DevOps, GitHub) Define enterprise data models (ERwin, ER/Studio, PowerDesigner) Architect ETL/ELT frameworks & pipelines (Dataflow, Dataproc More ❯

Engineering, Data Science, or a related field. 5+ years of experience in data architecture, solution design, or similar roles. Strong experience with modern data platforms and technologies (e.g., Snowflake, Databricks, BigQuery, Azure/AWS/GCP data services). Deep knowledge of data modeling, APIs, event-driven architectures, and cloud-native data architectures. Proven ability to design and implement scalable More ❯

Engineering, Data Science, or a related field. 5+ years of experience in data architecture, solution design, or similar roles. Strong experience with modern data platforms and technologies (e.g., Snowflake, Databricks, BigQuery, Azure/AWS/GCP data services). Deep knowledge of data modeling, APIs, event-driven architectures, and cloud-native data architectures. Proven ability to design and implement scalable More ❯

Engineering, Data Science, or a related field. 5+ years of experience in data architecture, solution design, or similar roles. Strong experience with modern data platforms and technologies (e.g., Snowflake, Databricks, BigQuery, Azure/AWS/GCP data services). Deep knowledge of data modeling, APIs, event-driven architectures, and cloud-native data architectures. Proven ability to design and implement scalable More ❯

Python (production-level) and SQL; confident with modern ML/AI libraries such as scikit-learn, TensorFlow, or PyTorch Familiarity with MLOps frameworks, model deployment, and cloud-based platforms (Databricks, AWS, Azure) Strong experience with data visualisation tools and techniques; able to turn complex results into accessible insights Excellent communicator; able to explain technical concepts to non-technical audiences with More ❯

with trading background) Location: Canary Wharf, UK (Hybrid) (3 days onsite & 2 days remote) Role Type: 6 Months Contract with possibility of extensions Mandatory Skills : Python, Postgres SQL, Azure Databricks, AWS(S3), Git, Azure DevOps CICD, Apache Airflow, Energy Trading experience Job Description:- Data Engineer (Python enterprise developer): 6+ years of experience in python scripting. Proficient in developing applications in More ❯

Preferred Qualifications Exposure to machine learning workflows, model lifecycle management, or data engineering platforms. Experience with distributed systems, event-driven architectures (e.g., Kafka), and big data platforms (e.g., Spark, Databricks). Familiarity with banking or financial domain use cases, including data governance and compliance-focused development. Knowledge of platform security, monitoring, and resilient architecture patterns. About us More ❯

and help drive a modern, data-driven culture all within a collaborative environment that values innovation and ownership. Tech you’ll be working with: Azure Data Lake Azure Synapse Databricks Data Factory Python, SQL, PySpark Terraform, GitHub Actions, CI/CD pipelines You’ll thrive here if you: Have strong experience building and leading Azure-based data platforms Enjoy mentoring More ❯