1 to 25 of 33 Contract Databricks Jobs in the UK excluding London

frameworks, data lifecycle, and data architecture. Experience with Azure DevOps, CI/CD, Git branching strategies. Proficiency in SQL and Python. Knowledge of Databricks (added advantage). Experience in Agile/Scrum environments. Excellent problem-solving, communication, and documentation skills. Good to Have Domain knowledge. Understanding of the water industry. ...

recommendation systems (as applicable) Programming Python (NumPy, Pandas, Scikit learn) Optional: R, SQL Data Platforms Relational & NoSQL databases Big data frameworks (Spark, Hive, Databricks) MLOps & Deployment Model lifecycle management CI/CD pipelines Containerization (Docker, Kubernetes desirable) Model packaging and REST APIs Cloud & Tools (Any combination) AWS/Azure/ ...

lead and provide clarity in complex technical environments. Desirable Experience: Involvement in data-platform re-architecture programs. Exposure to Medallion/Lakehouse patterns or Databricks-style ecosystems. Experience in regulated or high-assurance data environments. Why Join Us? This is your chance to be part of a transformative journey ...

/Kinesis, streaming ETL). Knowledge of data quality frameworks (Great Expectations, Deequ) and data lineage/catalog (Atlas, Alation, Collibra). Exposure to Databricks or EMR for advanced Spark workloads. Certifications: AWS Solutions Architect/Data Analytics/DevOps Engineer. Prior experience leading multi-team programs with offshore/ ...

pipelines (Azure DevOps, GitHub Actions) specifically tailored for analytics, data science, and trading teams. Hands-on experience deploying apps, data pipelines (Azure Data Factory, Databricks), ML model training environments, event streaming (producers/consumers), and auto-trading solutions. Azure Cloud & IaC Mastery: Deep experience architecting and managing ...

level in a relevant IT or data field Expertise in designing and implementing data pipelines using Azure services (Data Factory, Data Storage), Spark, and Databricks Strong knowledge of data modelling, database design, and enterprise data architecture Experience with ETL/ELT frameworks and data integration patterns using Python or PySpark ...

Extract, Load, Transform) Data Modeling Strong Technical Skills Required Data Integration & Ingestion Data Manipulation & Processing GitHub, GitHub Actions, Azure DevOps Azure Data Factory Databricks SQL Database Azure Synapse Stream Analytics AWS Glue Apache Airflow AWS Kinesis Amazon Redshift SonarQube PyTest Optional/Nice to Have Experience managing projects or running ...

Skills Strong SQL skills and experience working with Azure-hosted datasets Power BI reporting/dashboards creation Python experience Exposure to Azure Data Lake, Databricks, or Data Factory is beneficial If this is a role that suits your skill set, you are immediately available and can work 3 days ...

Data Engineer (Databricks) Inside IR35 | 6-Month Contract Sector: Public Sector/Central Government Location: London or Telford (Hybrid - Remote with on-site as required) Security Clearance: Active SC Clearance due to time scales About the Role We are seeking an experienced Data Engineer with deep expertise in Databricks … optimising data pipelines that enable analytics, reporting, and downstream data services across the organisation. Key Responsibilities Design, build, and maintain data pipelines using Databricks Develop ETL/ELT processes with PySpark and Spark SQL Transform and model structured and semi-structured datasets Improve performance, reliability, and cost efficiency of data ...

Powershell Use of SQL Server to stage and transform data Desirable An understanding of and ideally practical exposure to Cloud based platforms such as Databricks and MSFT Azure capabilities such as ADLS GEN2 and Azure Data Factory (ADF) Modelling - Logical Modelling and Dimensional Modelling Modelling - the development of Canonical Models ...

hands-on experience with Starburst Enterprise or Denodo Tool Advanced SQL skills, including query optimization and performance tuning. Experience with cloud data platforms (Snowflake, Databricks) Proficiency in any Scripting language (e.g. Python/Scala) Proficiency in data analytics and data engineering Desirable skills/knowledge/experience: (As applicable) Handson ...

hands-on experience with Starburst Enterprise or Denodo Tool Advanced SQL skills, including query optimization and performance tuning. Experience with cloud data platforms (Snowflake, Databricks) Proficiency in any Scripting language (e.g. Python/Scala) Proficiency in data analytics and data engineering Desirable skills/knowledge/experience: (As applicable) Handson ...

hands-on experience with Starburst Enterprise or Denodo Tool Advanced SQL skills, including query optimization and performance tuning. Experience with cloud data platforms (Snowflake, Databricks) Proficiency in any Scripting language (e.g. Python/Scala) Proficiency in data analytics and data engineering Desirable skills/knowledge/experience: (As applicable) Handson ...

hands-on experience with Starburst Enterprise or Denodo Tool Advanced SQL skills, including query optimization and performance tuning. Experience with cloud data platforms (Snowflake, Databricks) Proficiency in any Scripting language (e.g. Python/Scala) Proficiency in data analytics and data engineering Desirable skills/knowledge/experience: (As applicable) Handson ...

frameworks such as PyTorch, TensorFlow, or scikit-learn * Exposure to ML/MLOps tooling such as SageMaker, MLflow, or TFServing * Experience with Spark, Databricks, CI/CD tools, and streaming or orchestration systems like Kafka or Airflow How to Apply If you are interested in this Machine Learning Engineer position ...

delivery of business-as-usual (BAU) reporting, ensuring accuracy & timeliness. Drive efficiency through automation and process improvement using tools such as SQL , Python , & Databricks , with a focus on building scalable, future-proof systems. Collaborate with stakeholders to understand challenges and identify opportunities where data can deliver value. Design & implement data ...

Databricks Data Engineer £500 - £550 per day Outside IR35 We're partnering with a leading online retail company that's transforming the way data and real-time intelligence shape customer experiences. Their mission is to harness cutting-edge data and streaming technologies to drive smarter decisions, improve efficiency, and create … tools and frameworks for data governance, privacy, and quality monitoring, ensuring full compliance with data protection standards. Create resilient data workflows and automation within, Databricks, and other modern big data ecosystems. Contribute to an engineering culture that values testing, peer reviews, and automation-first principles. What You'll Bring Strong ...

Clearance - required• Lead the design, development, and deployment of scalable, secure, and cost-effective distributed data solutions [MA2.1]using Azure services (e.g., Azure Databricks, Azure Data Lake Storage, Azure Data Factory).• Architect and implement advanced data pipelines using Databricks, Delta Lake, Python and Spark, ensuring performance, reliability, and maintainability … junior and mid-level engineers, fostering a culture of continuous learning, innovation, and technical excellence. Experience needed: • Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory.• Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

data platform that will underpin some of the organisation's most critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality … Work closely with architecture, analytics and business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

wider regulatory, compliance environment for global insurance businesses (e.g. GDPR) Knowledge of Business Intelligence and Data platform technologies (e.g. Microsoft Fabric, Databricks etc.). Good knowledge of technology governance standards Good knowledge of technology best practice including SDLC Please apply Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting ...

practice patterns such as CDC, incremental loading, schema evolution, and automated ingestion frameworks. They build cloud-native solutions using Azure Data Factory/Synapse, Databricks/Spark, ADLS Gen2, and Snowflake capabilities including stages, file formats, COPY INTO, and Streams/Tasks to support raw-to-curated data modelling. … need to succeed Strong hands-on data engineering experience, with strong focus on data ingestion Experience building production pipelines using Azure Data Factory, Databricks, Synapse Solid SQL skills and experience working with modern cloud data warehouses, ideally Snowflake Proficiency in Python for data processing, automation, and pipeline utilities Good understanding ...

performance measurement.This is a high-impact greenfield build. You’ll take full ownership of the platform’s design and lead the transition away from Databricks and Excel-centric processes—shaping critical infrastructure that underpins the organisation’s investment operations.What You’ll Work OnYou’ll be responsible for designing and developing … holdings dataPerformance and attribution reportingRisk and analytics outputsRegulatory and trustee disclosuresData governance and operational controlsYou’ll also oversee the migration of structured datasets from Databricks (Delta Lake/Spark) and replace manual Excel workflows with automated, well-governed pipelines to meet audit and regulatory standards.Key ResponsibilitiesBuild and maintain a secure ...

cloud data platform. This role is hands-on and delivery-focused — you’ll be designing and developing Azure-native data pipelines, working extensively with Databricks, and shaping scalable data models across the Microsoft ecosystem. The role would require you to be on site in Bristol 4 days per week, please … position if you are local enough to do this without relocating. What you’ll be doing Build, enhance and maintain data pipelines using Azure Databricks , Data Factory , and Delta Lake Develop and optimise Lakehouse components and cloud-based data flows Create robust data models to support analytics, MI and downstream ...

ASAP Role Overview Lead a team of Data Analysts and own the delivery of high-impact analytical products using modern data engineering tooling (AWS, Databricks, dbt, Airflow). You will bridge the gap between business stakeholders and the data platform. Key Responsibilities Lead and mentor a team of Data Analysts … Build and maintain self-serve analytical assets using dbt models and Databricks Design and orchestrate analytical pipelines in Airflow Translate complex business requirements into actionable insights and dashboards Perform deep-dive analysis across Retail, Commercial, Risk and Marketing domains Ensure all deliverables meet strict data governance and regulatory standards Work ...

reporting, and act as a subject matter expert across modern data platforms. Key Responsibilities Lead development of dashboards and reports (Power BI, Databricks or similar) Define and govern semantic models, datasets and KPI frameworks Ensure alignment with data strategy across Azure/AWS platforms Oversee data quality, governance and consistency … with Power BI and Microsoft BI stack A proven background with the Defence industry Expertise in data modelling and analytics product design Experience with Databricks and cloud platforms (Azure or AWS) Knowledge of data governance, testing and metadata standards Ability to work with senior stakeholders and lead delivery Must hold ...