26 to 44 of 44 Databricks Jobs in the North of England

days expected in the office each week. The Role Key responsibilities: Design, build and maintain data pipelines using Azure Data Factory and Azure Databricks Develop and optimise PySpark and SQL transformations Model data using dimensional modelling principles Support ingestion of data from various data sources and formats Collaborate with … their skills in cloud based data platforms. Key requirements: 1-4 years experience in a Data Engineering focused role Hands-on experience with Azure Databricks and Azure Data Factory Strong SQL knowledge Familiarity with Power BI, including datasets and basic DAX Some knowledge of CI/CD concepts for data ...

significant scaling challenges and modernise a mission-critical platform using: Core stack : .NET, C#, SQL Server, REST APIs Data engineering tools: Azure Data Factory, DataBricks Cloud : Microsoft Azure (Functions, Logic Apps, Service Bus Serverless) If you love hands-on coding, owning delivery, and mentoring others, this could be the role … data models Design and build scalable, secure applications using C# and .NET Build and enhance data pipelines and integrations using Azure Data Factory/DataBricks Implement clean, maintainable code using SOLID principles and design patterns Collaborate with architecture and product teams to deliver high-quality software at pace Refactor ...

processes to improve performance, scalability, and efficiency. Contribute to migrations and modernisation projects across cloud and data platforms (e.g. AWS, Azure, GCP, Snowflake, Databricks). Create and maintain documentation aligned with internal processes and change management controls. Experience & Technical Skills Proven hands-on experience as a Data Engineer … modelling, and data warehousing principles. Experience working with cloud platforms such as AWS, Azure, or GCP. Exposure to modern data tools such as Snowflake, Databricks, or BigQuery. Familiarity with streaming technologies (e.g., Kafka, Spark Streaming, Flink) is an advantage. Experience with orchestration and infrastructure tools such as Airflow, dbt, Prefect ...

Senior Data Engineer, Databricks, £ 60000 - 70000 + benefits. Strong Data Modelling, Data Design and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role as is very strong Data Modelling. Should also have ...

data-driven decision-making at scale. Key Responsibilities Own and manage the product vision, roadmap, and backlog for data platform capabilities on AWS and Databricks Work closely with data engineers, architects, analysts, and stakeholders to define and prioritise features and enhancements Translate business requirements into clear user stories, acceptance criteria … platform stakeholders across the organisation Ensure data products are scalable, secure, cost-efficient, and aligned with best practices Drive adoption and value realisation of Databricks (e.g. data engineering, analytics, ML use cases) Collaborate with engineering teams to plan sprints, manage dependencies, and remove blockers Balance short-term delivery with long ...

Fully Remote or Hybrid This is an exciting opportunity for an Azure Data Engineer with PySpark, Python, and SQL skills (and ideally experience with Databricks) to take the next step in their career. Youll work on greenfield projects, designing and delivering end-to-end data solutions using Microsoft Azure best … enterprise environment on Microsoft Azure based projects. Good data engineering and database skills, including PySpark , SQL and Azure technologies such as Data Factory, Synapse, Databricks . Experience working with large, event-based datasets, with a solid understanding of the full data lifecycle and testing practices. Hands-on experience with ...

opportunity to shape how enterprise machine learning is delivered at scale within a modern data environment. Working on a strategic Lakehouse platform built on Databricks, you will influence how production ML models are designed, governed and optimised, helping the business turn complex data into reliable, decision-driving insight. The role … MLOps leadership, strong stakeholder engagement and long-term platform thinking. Responsibilities * Lead the design, build, deployment and monitoring of production machine learning models using Databricks, ensuring performance, reliability and continuous improvement * Define and embed MLOps best practices including model versioning, governance, access control, monitoring and retraining strategies * Develop automated model ...

heavy reporting towards a modern, centralised data platform. Core responsibilities include: Design, build and maintain data pipelines to ingest data from multiple sources (SAP, Databricks, Excel and other systems) Apply ELT principles to improve transparency, governance and trust in data Establish a centralised data platform to enable consistent reporting … include: Previous experience of building and maintaining data pipelines and data models Strong SQL skills Familiarity with Power BI Some experience of cloud platforms (Databricks or Fabric preferred) Able to operate with ambiguity and help define standards ...

champion best practices across projects. Architect, implement, and optimize Azure-based solutions, with strong focus on Containers and App Services/Functions. Use Databricks for data modelling, transformation, and advanced analytics. Build and maintain CI/CD pipelines using Azure DevOps for seamless, reliable deployments. Apply cloud security best practices … software development projects. Advanced TypeScript skills and strong containerization experience (AKS). Hands-on expertise across Azure compute, storage, networking, and security. Exposure to Databricks, ETL, and analytics workflows. Strong leadership abilities: mentoring, code review, and collaborative solution-design. Excellent problem-solving skills and the ability to communicate technical concepts ...

champion best practices across projects. Architect, implement, and optimize Azure-based solutions, with strong focus on Containers and App Services/Functions. Use Databricks for data modelling, transformation, and advanced analytics. Build and maintain CI/CD pipelines using Azure DevOps for seamless, reliable deployments. Apply cloud security best practices … software development projects. Advanced TypeScript skills and strong containerization experience (AKS). Hands-on expertise across Azure compute, storage, networking, and security. Exposure to Databricks, ETL, and analytics workflows. Strong leadership abilities: mentoring, code review, and collaborative solution-design. Excellent problem-solving skills and the ability to communicate technical concepts ...

champion best practices across projects. Architect, implement, and optimize Azure-based solutions, with strong focus on Containers and App Services/Functions. Use Databricks for data modelling, transformation, and advanced analytics. Build and maintain CI/CD pipelines using Azure DevOps for seamless, reliable deployments. Apply cloud security best practices … software development projects. Advanced TypeScript skills and strong containerization experience (AKS). Hands-on expertise across Azure compute, storage, networking, and security. Exposure to Databricks, ETL, and analytics workflows. Strong leadership abilities: mentoring, code review, and collaborative solution-design. Excellent problem-solving skills and the ability to communicate technical concepts ...

techniques using WTW Radar and Emblem. Query and engineer large datasets (e.g., Python/R/SQL/PySpark) on modern platforms (e.g., Azure Databricks). Create innovative data solutions and present actionable insights to stakeholders. Communicate results clearly to key decision-makers to influence pricing strategies. Advance the adoption … general insurance pricing with strong modelling skills. Proficiency in programming languages such as R, Python, PySpark, SAS, or SQL. Good knowledge of Azure Databricks and modern data technologies. Experience with WTW Radar software is preferred. A quantitative degree in Mathematics, Statistics, Engineering, Physics, Computer Science, or Actuarial Science. Excellent communication ...

Title: Data Engineer (Databricks) Location: Remote (once a month, Derby) Employment Type: 6-month Contract Rate: Market Rate (Outside IR35) About the Role: I’m looking to speak with an experienced Data Engineer to support a major data platform modernisation, centred around Databricks. You’ll play a key role … transformation through to modelling and optimisation — working closely with analytics, reporting, and business stakeholders. Key Responsibilities: Design, build, and maintain data pipelines using Databricks (Spark/PySpark/SQL). Support the migration of on-premise data sources to a cloud-based Databricks platform. Develop and optimise data models (e.g. ...

cloud-based data solutions. What you’ll be doing: Designing and maintaining scalable data pipelines Building and optimising data warehousing solutions Working with Databricks and modern cloud platforms (Azure or AWS) Collaborating with cross-functional teams to deliver high-impact data products Leading best practices in data engineering and pipeline … architecture What we’re looking for: Proven experience in data engineering at a senior level Strong hands-on knowledge of Databricks Experience with Azure or AWS cloud platforms Expertise in data warehousing and ETL processes Ability to work both independently and as part of a collaborative team Why join ...

related resources within the Azure Portal, with a strong focus on Azure Storage and data retention across multiple storage tiers; exposure to ADLS, Azure Databricks, and/or Elastic is advantageous. Oversee disk allocation, I/O performance, and storage scaling, identifying and implementing opportunities to improve efficiency and performance. … Practical experience working within the Azure Portal, including managing Azure Storage (Blob, Files, Disks, ADLS Gen2) and supporting broader cloud infrastructure; familiarity with Azure Databricks and Elastic is a plus. Proven experience managing virtual disks and cloud-based storage tiers, including long-term data retention strategies in ADLS. Deep understanding ...

DevOps, Product, and business partners to unlock the value of data through modern, secure and governed pipelines. Lead hands-on development work using Azure, Databricks, and Terraform (IaC) Support the migration from legacy platforms to a more modern cloud stack Act as a mentor and technical guide to the wider … YOUR SKILLS AND EXPERIENCE: A successful Principal Data Engineer will have the following skills and experience: Strong hands-on experience with Azure Proficient in Databricks Skilled in Terraform and Infrastructure as Code practices Exposure to containers/Kubernetes Awareness of ML Ops concepts THE BENEFITS: You will receive a salary ...

cases Build and maintain high-quality applications using TypeScript Design and manage solutions on Azure, including App Services, Functions, and containers (AKS) Use Databricks to support data modelling, analytics, and actuarial insights Set up and optimise CI/CD pipelines using Azure DevOps Mentor developers, conduct code reviews, and lead … development experience with technical leadership responsibility Advanced TypeScript skills and solid Azure expertise Experience with containers, CI/CD, and data platforms such as Databricks Ability to collaborate with both technical and non-technical stakeholders For a full consultation on this exciting new role, get in touch with ...

building and maintaining the infrastructure to support the full data science lifecycle from data ingestion to model deployment, monitoring, and upgrades within Azure and Databricks environments. The engineer will work closely with data scientists in a collaborative, cross-functional setting, helping transition models from research into production. Key Responsibilities … smooth productionisation of models. Write clean, production-ready Python code. Apply software engineering best practices, CI/CD, TDD. Required Skills: Proficiency in Python, Databricks, and Azure. Experience with deployment tools (e.g., AKS, managed endpoints). Strong software engineering background (CI/CD, VCS, TDD). Ability to integrate ...

We are looking to recruit an experienced Data Engineer who has experience working on the implementation and development of Microsoft Fabric. In addition you will need a wealth of SQL Experience including in a Cloud ...