22 of 22 Databricks Jobs in the North East

rule yourself out if you do not have these. They are a bonus, not a checklist. Experience with Delta Lake, Iceberg, Spark or Databricks, Palantir Experience optimising LLM serving with tools such as vLLM, TGI or TensorRT LLM Search and ranking experience. For example Elasticsearch or rerankers Background in time ...

best practices for data governance and security. Required Skills & Experience 5–10 years in data engineering roles, ideally within consultancy environments. Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice ...

data engineering, data integration and data modelling Expertise with cloud platforms (e.g. AWS, Azure, GCP) Expertise with modern cloud data platforms (e.g. Microsoft Fabric, Databricks) Expertise with multiple data analytics tools (e.g. Power BI) Deep understanding of data wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency … Experience defining and enforcing data engineering standards, patterns, and reusable frameworks Professional certifications in relevant technologies (e.g. Microsoft Azure Data Engineer, AWS Data Analytics, Databricks Certified Professional Data Engineer) Skills Data Development Process Design, build and test data products that are complex or large scale Build and lead teams ...

strong and broad understanding and experience of data engineering skills and techniques, including XPATH, R, SQL, DaX, VBA coding, experience of PowerBI, Excel, Databricks and of version control methods such as GitHub. ...

principles. Evaluate emerging technologies and methodologies to enhance delivery practices. Have an awareness of different technologies used within a typical data stack, such as Databricks, Azure Data Factory and Power BI. Knowledge of data warehousing and data modelling approaches and appropriate use. ...

Azure Data Engineer - £500PD - Hybrid We are seeking an Azure Data Engineer with strong experience in Databricks to design, build, and optimize scalable data pipelines and analytics solutions on the Azure cloud platform. The ideal candidate will have hands-on expertise across Azure data services, data modeling, ETL/… development, and collaborative engineering practices. Key Responsibilities * Design, develop, and maintain scalable data pipelines using Azure Databricks (Python, PySpark, SQL). * Build and optimize ETL/ELT workflows that ingest data from various on-prem and cloud-based sources. * Work with Azure services including Azure Data Lake Storage, Azure Data ...

Role: Data & ML Engineer Location: Newcastle Upon Tyne Levels: Senior Analyst, Specialist Please Note: Due to the nature of client work you will be undertaking, you will need to be willing to go through a ...

essentials for this role: Python, NodeJS, API Services/Processing Important: MongoDB, Containers/Docker Familiarity, HTML/CSS/JavaScript Nice to have: Databricks, VueJS We're also keen to have applications from individuals with Retail industry experience, particularly in any of the following: merchandising optimization, category management, promotions ...

essentials for this role: Python, NodeJS, API Services/Processing Important: MongoDB, Containers/Docker Familiarity, HTML/CSS/JavaScript Nice to have: Databricks, VueJS We’re also keen to have applications from individuals with Retail industry experience, particularly in any of the following: merchandising optimization, category management, promotions ...

Contract Data Engineer - Databricks & Azure (SC Cleared) Location: Newcastle (2-3 days onsite per week) Rate: £450 per day (Outside IR35) Duration: 6 months Clearance: Active SC clearance is mandatory Expenses: Not reimbursed - candidates must be based in or near Newcastle About the Role We are seeking an experienced Data … Engineer with strong expertise in Databricks and Azure to join a high-profile Public Sector project. This is a 6-month contract, outside IR35, requiring Security Clearance (SC) and regular onsite presence in Newcastle. Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks on Azure. Build and optimize ...

client, a leading financial services organisation undergoing significant growth, is seeking a Senior Data Engineer with strong Databricks expertise to drive high-value data initiatives within the reinsurance and investment domain. This role centres on building scalable data solutions, optimising analytical workflows, and partnering with senior business experts to deliver ...

client, a leading financial services organisation undergoing significant growth, is seeking a Senior Data Engineer with strong Databricks expertise to drive high-value data initiatives within the reinsurance and investment domain. This role centres on building scalable data solutions, optimising analytical workflows, and partnering with senior business experts to deliver ...

Data Engineer - Databricks & Azure (SC Cleared) Location: Newcastle (2-3 days onsite per week) Rate: £450 per day (Outside IR35) Duration: 6 months Clearance: Active SC clearance is mandatory Expenses: Not reimbursed - candidates must be based in or near Newcastle About the Role We are seeking an experienced Data Engineer … with strong expertise in Databricks and Azure to join a high-profile Public Sector project. This is a 6-month contract, outside IR35, requiring Security Clearance (SC) and regular onsite presence in Newcastle. Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks on Azure. Build and optimize data ...

Data Engineer - Databricks & Azure (SC Cleared) Location: Newcastle (2-3 days onsite per week) Rate: £450 per day (Outside IR35) Duration: 6 months Clearance: Active SC clearance is mandatory Expenses: Not reimbursed - candidates must be based in or near Newcastle About the Role We are seeking an experienced Data Engineer … with strong expertise in Databricks and Azure to join a high-profile Public Sector project. This is a 6-month contract, outside IR35, requiring Security Clearance (SC) and regular onsite presence in Newcastle. Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks on Azure. Build and optimize data ...

sector consultancy who are currently looking for a skilled Data Engineer with a lot of experience with R, Shiny & Databricks. Role Overview: As a Databricks Engineer, you will design, develop, and manage data solutions on the Databricks platform, enabling high-performance data pipelines and analytics. This role will work closely … with data scientists, analysts, and engineering teams to support data-driven decision-making across the organisation. Key Responsibilities: Develop and optimise data pipelines using Databricks, Azure Data Factory, Synapse, and ADLS. Utilize Azure Functions and Event Hub to manage data ingestion and streaming processes. Implement data storage solutions ...

Role: Senior Data engineerLocation - Newcastle upon Tyne/Hybrid (2-3 days per week in office)Contract - 6 monthsDaily rate - £450 (outside IR35)Active SC clearance is a must have Key Responsibilities Design, build, and ...

Role: Data Engineer (Azure Databricks Contract) Day Rate: £250-£300 (Outside IR35) Duration: 2 months (Initially) Location: Fully Remote (UK-based candidates only) Start Date: 5th January 2026 This role will focus on Azure Databricks, revamping Salesforce integrations, modernising data pipelines, and building a new integration layer to replace legacy … systems. Key Responsibilities: Lead development and optimisation of Azure Databricks pipelines and workflows. Work with Azure Data Factory and Azure Data Streaming to ingest, transform, and deliver data in real time. Collaborate with developers to make C# modifications as part of integration improvements. Rebuild and enhance data flows between Salesforce ...

cutting-edge AI/LLM work, including: Building models and analytics to support commercial teams Developing Q&A-style LLM tools inside Databricks Exploring customer satisfaction and review data (e.g., identifying drivers behind quality scores) NLP on large volumes of free-text data Regression and hypothesis testing across product … customer feedback Helping challenge assumptions with data-driven evidence Tech Environment Python & SQL Machine Learning, statistical modelling, data manipulation Cloud-first setup (Azure preferred; Databricks is widely used) Exposure to LLMs or AI agents is extremely valuable ...

Azure Data Engineer (Databricks) - Must be SC Cleared (Outside IR35) Contract: 6 months Location: Newcastle Upon Tyne (2-3 days onsite per week) Expenses: Not reimbursable Domain: Public Sector Clearance: SC Clearance is mandatory Role Overview: We are seeking an experienced Azure Data Engineer with strong expertise in Databricks … data workflows for performance and cost efficiency. Essential Skills & Experience: Proven experience as a Data Engineer in Azure environments. Strong hands-on expertise with Databricks and Spark. Knowledge of Azure Data Lake, Azure Synapse, and related services. Experience in Public Sector projects. SC Clearance (must be active). Must ...

work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn, PyTorch, TensorFlow/Keras, LangChain, Pydantic, Spark, Kafka, Databricks, MLflow, Azure, Docker, Kubernetes. Salary: Up to £100k Working Environment: Fully Remote in UK What you'll do Research, prototype, and deploy LLM use cases … tune models using scikit-learn, PyTorch, TensorFlow/Keras, and XGBoost Create data pipelines for batch and streaming with Spark and Kafka Use Databricks and MLflow for experiments, deployment, and monitoring What you'll bring Hands-on Python for data science and ML Practical experience with LLM frameworks (e.g. LangChain ...

Oliver Wyman is a global leader in management consulting. With offices in more than 70 cities across 30 countries, Oliver Wyman combines deep industry knowledge with specialized expertise in strategy, operations, risk management, and organization ...

catalogue, glossary, lineage and metadata curation Onboard SQL, Azure, and other structured sources, ensuring quality, performance and coverage Configure and optimise lineage for ADF, Databricks, Synapse, SQL and other pipelines Build and govern data-product and domain models within Purview Interpret governance and data-strategy requirements into platform configuration Provide … where required Essential Experience Active SC Clearance Deep, hands-on experience across Microsoft Purview structured capabilities, including: Catalogue, glossary and metadata modelling Lineage (ADF, Databricks, Synapse, SQL) Automated classification for structured datasets Data-product and domain structure design Metadata curation and schema-level governance Proven experience leading Purview deployments independently ...