1 to 25 of 41 Contract Databricks Jobs in London

Collaborate with stakeholders and technical teams to translate business needs into data solutions Azure Data Engineer requirements: Hands-on experience with Azure Data Factory, Databricks, and SQL-based databases Strong understanding of data engineering principles, including ELT and data modelling Experience working with CI/CD pipelines, automation, and testing ...

SSIS package design and ETL logic. DevOps: Hands-on experience with Azure DevOps , CI/CD pipelines, and Key Vault. Bonus: Experience with Azure Databricks or PySpark is highly desirable. Randstad Technologies is acting as an Employment Business in relation to this vacancy. ...

Extract, Load, Transform) Data Modeling Strong Technical Skills Required Data Integration & Ingestion Data Manipulation & Processing GitHub, GitHub Actions, Azure DevOps Azure Data Factory Databricks SQL Database Azure Synapse Stream Analytics AWS Glue Apache Airflow AWS Kinesis Amazon Redshift SonarQube PyTest Optional/Nice to Have Experience managing projects or running ...

data impact. It would be great if you had: Experience in the energy retail industry Advanced tools knowledge; proficiency in Tableau, cloud platforms (ideally DataBricks), Git, and other analytics tools that support collaborative development and efficient data pipelines. Relevant degree or equivalent (e.g. statistics, mathematics etc). Rullion celebrates ...

Lead Data Architect , not solution or enterprise architecture Deep, practical experience across the Azure data stack (for example Azure Data Factory, Synapse, Fabric, Databricks, Data Lake, SQL) Strong background in data modelling , analytics architecture, and large-scale data platforms Experience leading data architecture resets or remediation programmes Excellent verbal ...

Data Engineer (Databricks) Inside IR35 | 6-Month Contract Sector: Public Sector/Central Government Location: London or Telford (Hybrid - Remote with on-site as required) Security Clearance: Active SC Clearance due to time scales About the Role We are seeking an experienced Data Engineer with deep expertise in Databricks … optimising data pipelines that enable analytics, reporting, and downstream data services across the organisation. Key Responsibilities Design, build, and maintain data pipelines using Databricks Develop ETL/ELT processes with PySpark and Spark SQL Transform and model structured and semi-structured datasets Improve performance, reliability, and cost efficiency of data ...

hands-on experience with Starburst Enterprise or Denodo Tool Advanced SQL skills, including query optimization and performance tuning. Experience with cloud data platforms (Snowflake, Databricks) Proficiency in any Scripting language (e.g. Python/Scala) Proficiency in data analytics and data engineering Desirable skills/knowledge/experience: (As applicable) Handson ...

datasets Experience building and deploying data science/predictive models Experience with customer segmentation, forecasting, or propensity modelling Strong stakeholder communication skills Python and Databricks experience desirable Contract Details: £500 per day (Inside IR35) London/Hybrid working Initial 6-12 month contract If interested, please apply with your latest ...

Lambda, ECS/EKS) Experience designing both real-time and batch systems at enterprise scale Excellent documentation and stakeholder communication skills Nice to Have Databricks, dbt or Airflow experience Previous UK banking or financial services architecture role ...

data platforms Required Technical Expertise - Data Migration & Data Synchronisation Architecture - SQL/Python/Scala - Data Engineering & Data Pipelines - Relational & NoSQL Databases - Apache Spark - Databricks - Data Warehousing/Data Lakes - Cloud & On-Prem Data Integration Additional Requirements - Freelance contractor only - Must be eligible for security clearance - Availability to work ...

scale our modern data governance framework. You will be at the intersection of data engineering and business strategy, ensuring our data assets in Azure Databricks (Unity Catalog) and Microsoft Fabric are secure, discoverable, and high-quality click apply for full job details ...

Databricks Data Engineer £500 - £550 per day Outside IR35 We're partnering with a leading online retail company that's transforming the way data and real-time intelligence shape customer experiences. Their mission is to harness cutting-edge data and streaming technologies to drive smarter decisions, improve efficiency, and create … tools and frameworks for data governance, privacy, and quality monitoring, ensuring full compliance with data protection standards. Create resilient data workflows and automation within, Databricks, and other modern big data ecosystems. Contribute to an engineering culture that values testing, peer reviews, and automation-first principles. What You'll Bring Strong ...

Clearance - required• Lead the design, development, and deployment of scalable, secure, and cost-effective distributed data solutions [MA2.1]using Azure services (e.g., Azure Databricks, Azure Data Lake Storage, Azure Data Factory).• Architect and implement advanced data pipelines using Databricks, Delta Lake, Python and Spark, ensuring performance, reliability, and maintainability … junior and mid-level engineers, fostering a culture of continuous learning, innovation, and technical excellence. Experience needed: • Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory.• Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

data platform that will underpin some of the organisation's most critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality … Work closely with architecture, analytics and business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

Azure Databricks Architect 6 months Remote with 2 days travel to London per month Active SC Inside IR35 Role Summary We require an Azure Databricks Architect to provide architectural leadership and assurance for the design, implementation, and ongoing evolution of an Azure-based data and analytics platform within a public … ensure solutions are secure, scalable, and compliant with organisational and government standards. Key Responsibilities Define and maintain the end-to-end architecture for Azure Databricks-based data platforms. Design Lakehouse architectures using Azure Databricks, Azure Data Lake Storage (ADLS Gen2), and associated Azure services. Produce and maintain High-Level Designs ...

wider regulatory, compliance environment for global insurance businesses (e.g. GDPR) Knowledge of Business Intelligence and Data platform technologies (e.g. Microsoft Fabric, Databricks etc.). Good knowledge of technology governance standards Good knowledge of technology best practice including SDLC Please apply Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting ...

architectural oversight and design input across several delivery teams. Review, write, and work with Python used throughout platform components and frameworks. Develop patterns for Databricks Workflows , supporting their implementation, execution, and platform-level troubleshooting. If this is a role that suits your skillset, can work onsite 2 days per month ...

with fine-tuning/training LLMs and complex Graph RAG solutions (production environment). Technical Skills: Extensive knowledge of cloud services and tools (Azure & Databricks preferred), ), including Azure Machine Learning, Vertex AI, AI Search, Databricks, Mosaic ML, Genie, Webapps, Azure Service Bus, Azure DevOps, Azure CLI, Azure AI services ...

Contract Data Engineer - Azure/Databricks Location: London (2 days onsite) Rate: £550-£600 per day (Inside IR35) Contract: 6 months A leading UK financial institution is seeking an experienced Data Engineer to support the development and enhancement of a modern cloud-based data platform. This role will focus … cloud-first data architecture. Key Responsibilities Design and develop scalable data pipelines using modern cloud technologies. Build and optimise distributed data processing solutions using Databricks, Spark and Python . Develop and maintain data integration workflows using Azure Data Factory . Work with large datasets stored in Azure Data Lake environments. ...

documentation and governance standards. Support CI/CD processes and version control workflows. Required Experience Strong SQL expertise (data modelling & optimisation). Hands-on Databricks experience (Delta Lake + Spark). Experience with dbt or similar transformation frameworks. Python for data manipulation and automation. Azure cloud experience. Familiarity with … with business impact. Can operate in a fast-paced, collaborative environment. Takes ownership of data quality and KPI consistency. Why Apply? Modern cloud stack (Databricks + Azure). Strategic transformation programme. Enterprise-scale data challenges. High stakeholder visibility. Strong likelihood of contract extension. If you would like to explore further ...

pipelines. Establish standards, patterns, and best practices for platform components including Lakehouse architecture, MLOps, and data governance. Platform Engineering Architect and guide implementation of Databricks workspace setup, clusters, Unity Catalog, Delta Lake, workflows, and model serving. Lead the integration of the platform with key internal systems such as Radar … risk assessments. Required Skills & Experience: 8-12+ years of experience in data/AI engineering or cloud architecture roles. Strong expertise with Databricks (Delta Lake, Unity Catalog, MLflow, Workflows). Deep understanding of AWS cloud architecture and services relevant to data/AI workloads. Hands-on experience designing large ...

play a key role in a major data modernisation programme, focused on migrating a large SQL Server estate into a cloud-native Azure Databricks environment. You will be central to transforming legacy reporting and data logic into scalable, modernised pipelines and models, helping the business unlock faster, more reliable insights. … Deliverables * Lead the migration of SQL Server stored procedures, functions, views, and legacy reporting logic into Azure Databricks. * Reengineer and optimise SQL workloads for Databricks using Databricks SQL, dbt, and PySpark. * Support the uplift of SSRS and Tableau reporting so that all outputs are powered by Databricks-based datasets. * Validate ...

Senior Data Engineer - Azure Databricks (Contract) Fully Remote | 3 Months (Likely to Extend) | Outside IR35 I'm supporting a client who is looking for an experienced Senior Data Engineer with strong Azure and Databricks skills to join them on an initial 3-month contract , with a high likelihood of extension. … What you'll work on Building and optimising scalable data pipelines in Azure and Databricks Supporting data engineering best practices across cloud environments Collaborating with cross-functional teams to deliver high-quality data solutions What we're looking for Strong commercial experience with Azure & Databricks Skilled Senior Data Engineer with ...

Platform Engineer - Active SC, Databricks, Trivy, Azure £510 per day (Inside) Remote Working Initial 6 month Contract My client is an instantly recognisable consultancy who urgently require a Platform Engineer with Active SC Clearance for an end client within the public sector. Key Requirements: Proven commercial experience working … Databricks. Proven track record configuring and managing Azure DevOps CI/CD pipelines. Deep understanding of Azure cloud services and components. Some experience using Databricks Practical experience with Docker containerisation. Knowledge of security scanning tooling (Trivy or similar). Scripting proficiency in Bash (Python is desirable). Solid understanding ...

ASAP Role Overview Lead a team of Data Analysts and own the delivery of high-impact analytical products using modern data engineering tooling (AWS, Databricks, dbt, Airflow). You will bridge the gap between business stakeholders and the data platform. Key Responsibilities Lead and mentor a team of Data Analysts … Build and maintain self-serve analytical assets using dbt models and Databricks Design and orchestrate analytical pipelines in Airflow Translate complex business requirements into actionable insights and dashboards Perform deep-dive analysis across Retail, Commercial, Risk and Marketing domains Ensure all deliverables meet strict data governance and regulatory standards Work ...