1 to 25 of 33 Contract Databricks Jobs in the UK excluding London

frameworks, data lifecycle, and data architecture. Experience with Azure DevOps, CI/CD, Git branching strategies. Proficiency in SQL and Python. Knowledge of Databricks (added advantage). Experience in Agile/Scrum environments. Excellent problem-solving, communication, and documentation skills. Good to Have Domain knowledge. Understanding of the water industry. ...

recommendation systems (as applicable) Programming Python (NumPy, Pandas, Scikit learn) Optional: R, SQL Data Platforms Relational & NoSQL databases Big data frameworks (Spark, Hive, Databricks) MLOps & Deployment Model lifecycle management CI/CD pipelines Containerization (Docker, Kubernetes desirable) Model packaging and REST APIs Cloud & Tools (Any combination) AWS/Azure/ ...

lead and provide clarity in complex technical environments. Desirable Experience: Involvement in data-platform re-architecture programs. Exposure to Medallion/Lakehouse patterns or Databricks-style ecosystems. Experience in regulated or high-assurance data environments. Why Join Us? This is your chance to be part of a transformative journey ...

/Kinesis, streaming ETL). Knowledge of data quality frameworks (Great Expectations, Deequ) and data lineage/catalog (Atlas, Alation, Collibra). Exposure to Databricks or EMR for advanced Spark workloads. Certifications: AWS Solutions Architect/Data Analytics/DevOps Engineer. Prior experience leading multi-team programs with offshore/ ...

pipelines (Azure DevOps, GitHub Actions) specifically tailored for analytics, data science, and trading teams. Hands-on experience deploying apps, data pipelines (Azure Data Factory, Databricks), ML model training environments, event streaming (producers/consumers), and auto-trading solutions. Azure Cloud & IaC Mastery: Deep experience architecting and managing ...

level in a relevant IT or data field Expertise in designing and implementing data pipelines using Azure services (Data Factory, Data Storage), Spark, and Databricks Strong knowledge of data modelling, database design, and enterprise data architecture Experience with ETL/ELT frameworks and data integration patterns using Python or PySpark ...

Extract, Load, Transform) Data Modeling Strong Technical Skills Required Data Integration & Ingestion Data Manipulation & Processing GitHub, GitHub Actions, Azure DevOps Azure Data Factory Databricks SQL Database Azure Synapse Stream Analytics AWS Glue Apache Airflow AWS Kinesis Amazon Redshift SonarQube PyTest Optional/Nice to Have Experience managing projects or running ...

Skills Strong SQL skills and experience working with Azure-hosted datasets Power BI reporting/dashboards creation Python experience Exposure to Azure Data Lake, Databricks, or Data Factory is beneficial If this is a role that suits your skill set, you are immediately available and can work 3 days ...

advise development teams Understanding or experience with MongoDB and JSON-based data implementations Ability to inspect and analyse data using SQL or Python within Databricks Experience working with Data Catalogue products (Axon experience beneficial) Understanding of data governance and stewardship practices ...

Data Engineer (Databricks) Inside IR35 | 6-Month Contract Sector: Public Sector/Central Government Location: London or Telford (Hybrid - Remote with on-site as required) Security Clearance: Active SC Clearance due to time scales About the Role We are seeking an experienced Data Engineer with deep expertise in Databricks … optimising data pipelines that enable analytics, reporting, and downstream data services across the organisation. Key Responsibilities Design, build, and maintain data pipelines using Databricks Develop ETL/ELT processes with PySpark and Spark SQL Transform and model structured and semi-structured datasets Improve performance, reliability, and cost efficiency of data ...

hands-on experience with Starburst Enterprise or Denodo Tool Advanced SQL skills, including query optimization and performance tuning. Experience with cloud data platforms (Snowflake, Databricks) Proficiency in any Scripting language (e.g. Python/Scala) Proficiency in data analytics and data engineering Desirable skills/knowledge/experience: (As applicable) Handson ...

hands-on experience with Starburst Enterprise or Denodo Tool Advanced SQL skills, including query optimization and performance tuning. Experience with cloud data platforms (Snowflake, Databricks) Proficiency in any Scripting language (e.g. Python/Scala) Proficiency in data analytics and data engineering Desirable skills/knowledge/experience: (As applicable) Handson ...

hands-on experience with Starburst Enterprise or Denodo Tool Advanced SQL skills, including query optimization and performance tuning. Experience with cloud data platforms (Snowflake, Databricks) Proficiency in any Scripting language (e.g. Python/Scala) Proficiency in data analytics and data engineering Desirable skills/knowledge/experience: (As applicable) Handson ...

hands-on experience with Starburst Enterprise or Denodo Tool Advanced SQL skills, including query optimization and performance tuning. Experience with cloud data platforms (Snowflake, Databricks) Proficiency in any Scripting language (e.g. Python/Scala) Proficiency in data analytics and data engineering Desirable skills/knowledge/experience: (As applicable) Handson ...

frameworks such as PyTorch, TensorFlow, or scikit-learn * Exposure to ML/MLOps tooling such as SageMaker, MLflow, or TFServing * Experience with Spark, Databricks, CI/CD tools, and streaming or orchestration systems like Kafka or Airflow How to Apply If you are interested in this Machine Learning Engineer position ...

parties and navigate typical NHS governance and assurance processes There's also an element of working within a broader data ecosystem, including a Databricks platform managed by the team. Tech Environment Frontend: React, TypeScript Backend: Node.js (TypeScript) Cloud: AWS (serverless) Lambda, Step Functions, API Gateway S3, DynamoDB Cognito, CloudFront Infrastructure ...

Databricks Data Engineer £500 - £550 per day Outside IR35 We're partnering with a leading online retail company that's transforming the way data and real-time intelligence shape customer experiences. Their mission is to harness cutting-edge data and streaming technologies to drive smarter decisions, improve efficiency, and create … tools and frameworks for data governance, privacy, and quality monitoring, ensuring full compliance with data protection standards. Create resilient data workflows and automation within, Databricks, and other modern big data ecosystems. Contribute to an engineering culture that values testing, peer reviews, and automation-first principles. What You'll Bring Strong ...

Clearance - required• Lead the design, development, and deployment of scalable, secure, and cost-effective distributed data solutions [MA2.1]using Azure services (e.g., Azure Databricks, Azure Data Lake Storage, Azure Data Factory).• Architect and implement advanced data pipelines using Databricks, Delta Lake, Python and Spark, ensuring performance, reliability, and maintainability … junior and mid-level engineers, fostering a culture of continuous learning, innovation, and technical excellence. Experience needed: • Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory.• Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

data platform that will underpin some of the organisation's most critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality … Work closely with architecture, analytics and business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

wider regulatory, compliance environment for global insurance businesses (e.g. GDPR) Knowledge of Business Intelligence and Data platform technologies (e.g. Microsoft Fabric, Databricks etc.). Good knowledge of technology governance standards Good knowledge of technology best practice including SDLC Please apply Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting ...

practice patterns such as CDC, incremental loading, schema evolution, and automated ingestion frameworks. They build cloud-native solutions using Azure Data Factory/Synapse, Databricks/Spark, ADLS Gen2, and Snowflake capabilities including stages, file formats, COPY INTO, and Streams/Tasks to support raw-to-curated data modelling. … need to succeed Strong hands-on data engineering experience, with strong focus on data ingestion Experience building production pipelines using Azure Data Factory, Databricks, Synapse Solid SQL skills and experience working with modern cloud data warehouses, ideally Snowflake Proficiency in Python for data processing, automation, and pipeline utilities Good understanding ...

performance measurement.This is a high-impact greenfield build. You’ll take full ownership of the platform’s design and lead the transition away from Databricks and Excel-centric processes—shaping critical infrastructure that underpins the organisation’s investment operations.What You’ll Work OnYou’ll be responsible for designing and developing … holdings dataPerformance and attribution reportingRisk and analytics outputsRegulatory and trustee disclosuresData governance and operational controlsYou’ll also oversee the migration of structured datasets from Databricks (Delta Lake/Spark) and replace manual Excel workflows with automated, well-governed pipelines to meet audit and regulatory standards.Key ResponsibilitiesBuild and maintain a secure ...

from day one. What’s in it for you Opportunity to help shape and improve a modern cloud platform Work with leading technologies including Databricks, Synapse and Microsoft Fabric Join a growing team with strong technical collaboration High-impact work supporting analytics, reporting and operational decision-making Hybrid working model … experience building pipelines within cloud environments Advanced SQL capabilities with previous experience in modelling and warehousing Previous experience working with platforms such as Databricks, Azure Synapse or Microsoft Fabric Experience using Python for processing, automation or packaging Familiarity with containerisation and DevOps-based deployment practices within data environments ...

play a key role in a major data modernisation programme, focused on migrating a large SQL Server estate into a cloud-native Azure Databricks environment. You will be central to transforming legacy reporting and data logic into scalable, modernised pipelines and models, helping the business unlock faster, more reliable insights. … Deliverables * Lead the migration of SQL Server stored procedures, functions, views, and legacy reporting logic into Azure Databricks. * Reengineer and optimise SQL workloads for Databricks using Databricks SQL, dbt, and PySpark. * Support the uplift of SSRS and Tableau reporting so that all outputs are powered by Databricks-based datasets. * Validate ...

cloud data platform. This role is hands-on and delivery-focused — you’ll be designing and developing Azure-native data pipelines, working extensively with Databricks, and shaping scalable data models across the Microsoft ecosystem. The role would require you to be on site in Bristol 4 days per week, please … position if you are local enough to do this without relocating. What you’ll be doing Build, enhance and maintain data pipelines using Azure Databricks , Data Factory , and Delta Lake Develop and optimise Lakehouse components and cloud-based data flows Create robust data models to support analytics, MI and downstream ...