19 of 19 Permanent Databricks Jobs in Scotland

Nice to Have Exposure to data engineering or analytics concepts (ETL, data modelling, analytics engineering) Familiarity with tools such as PySpark, Airflow, dbt, or Databricks Experience working with business systems (ERP, CRM, operational data) Interest in B2B SaaS, data platforms, or AI-enabled products What's On Offer Build ...

data engineering, data integration and data modelling Expertise with cloud platforms (e.g. AWS, Azure, GCP) Expertise with modern cloud data platforms (e.g. Microsoft Fabric, Databricks) Expertise with multiple data analytics tools (e.g. Power BI) Deep understanding of data wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency … Experience defining and enforcing data engineering standards, patterns, and reusable frameworks Professional certifications in relevant technologies (e.g. Microsoft Azure Data Engineer, AWS Data Analytics, Databricks Certified Professional Data Engineer) Skills Data Development Process Design, build and test data products that are complex or large scale Build and lead teams ...

Breadth of experience across a wide variety of products and tools. The following is to give you an idea of the environment – Kafka, Snowflake, Databricks, Lakehouse, Fabric, MongoDB, AWS/Azure, Astronomer, Power BI etc. Please note: This is a Hybrid role and requires 3 days a week onsite ...

data governance standards covering data quality, metadata, lineage, retention, and regulatory compliance. Architect ETL/ELT and streaming pipelines using modern tools (e.g., ADF, Databricks, Kafka, Fabric). Ensure security and compliance via IAM, encryption, data zoning, RBAC, and platform best practices. Drive performance optimisation across queries, pipelines, compute clusters ...

data governance standards covering data quality, metadata, lineage, retention, and regulatory compliance. Architect ETL/ELT and streaming pipelines using modern tools (e.g., ADF, Databricks, Kafka, Fabric). Ensure security and compliance via IAM, encryption, data zoning, RBAC, and platform best practices. Drive performance optimisation across queries, pipelines, compute clusters ...

LLMs and/or Agentic Systems, from development to production. Hands-on experience with LLM frameworks (e.g. langchain, langgraph, llamaindex, langsmith), AI platforms (e.g. Databricks, mlflow) and containerization solutions (e.g. Docker) is valued. Strong software engineering fundamentals and proficiency in Python are a must. Be creative, ambitious and curious. ...

following areas: 5+ years of experience with system development using Python Familiarity with data backends like S3, RDS, Postgres, Redis, and Elasticsearch Experience with Databricks Familiarity with Python data visualization libraries Experience implementing monitoring and alerting system using systems like Grafana, Prometheus, or Nagios Spire operates a hybrid work model ...

following areas: 5+ years of experience with system development using Python Familiarity with data backends like S3, RDS, Postgres, Redis, and Elasticsearch Experience with Databricks Familiarity with Python data visualization libraries Experience implementing monitoring and alerting system using systems like Grafana, Prometheus, or Nagios Spire operates a hybrid work model ...

academic and professional services communities to drive adoption. Desirable Experience with major cloud and AI stacks such as Azure OpenAI/OpenAI, Azure ML, Databricks, Kubernetes, and Docker. Familiarity with data platforms such as Azure Data Lake, Synapse/ADF, Delta Lake, and messaging platforms (e.g., event hubs, service … pipelines, APIs, and microservices. Hands-on experience with cloud platforms (Azure preferred; AWS or GCP also valued) and MLOps tools (e.g., MLflow, Azure ML, Databricks, SageMaker or Vertex) plus observability practices. Familiarity with higher education processes and integrations across SIS, LMS, CRM, and ERP environments. Knowledge of data privacy, accessibility ...

Lead Data Engineer - Azure & Databricks Lakehouse Glasgow (3/4 days onsite) | Exclusive Role with a Leading UK Consumer Business A rapidly scaling UK consumer brand is undertaking a major data modernisation programme-moving away from legacy systems, manual Excel reporting and fragmented data sources into a fully automated Azure … Enterprise Landing Zone + Databricks Lakehouse . They are building a modern data platform from the ground up using Lakeflow Declarative Pipelines , Unity Catalog , and Azure Data Factory , and this role sits right at the heart of that transformation. This is a rare opportunity to join early, influence architecture ...

will initially be for 6 months. It is also fully remote. Key Responsibilities • Design, develop, and maintain batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers …/CD, version control, and automated testing for data pipelines Required Qualifications • 3+ years of experience as a Data Engineer • Strong experience with Databricks and Apache Spark • Proficiency in Python (required); SQL (advanced) • Hands-on experience with AWS or Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda ...

data pipelines that directly underpin operational decision-making and analytics for live energy assets. Key responsibilities Design, build, and maintain scalable data pipelines using Databricks (including Delta Live Tables). Develop robust ETL/ELT workflows ingesting data from operational, telemetry, and third-party systems. Optimise pipeline performance, reliability … operational outputs from these platforms. Technical requirements Proven experience as a Data Engineer in production environments. Strong Python and SQL skills. Hands-on Databricks experience (DLT, Delta Lake; Unity Catalog desirable). Solid understanding of data modelling, data warehousing, and distributed systems. Experience with cloud data platforms (Azure preferred ...

data pipelines that directly underpin operational decision-making and analytics for live energy assets. Key responsibilities Design, build, and maintain scalable data pipelines using Databricks (including Delta Live Tables). Develop robust ETL/ELT workflows ingesting data from operational, telemetry, and third-party systems. Optimise pipeline performance, reliability … operational outputs from these platforms. Technical requirements Proven experience as a Data Engineer in production environments. Strong Python and SQL skills. Hands-on Databricks experience (DLT, Delta Lake; Unity Catalog desirable). Solid understanding of data modelling, data warehousing, and distributed systems. Experience with cloud data platforms (Azure preferred ...

data platforms and ETL/ELT pipelines in Azure and AWS Implementing serverless, batch, and streaming data architectures Working hands-on with Spark, Python, Databricks, and SQL-based analytics platforms Designing Lakehouse-style architectures and analytical data models Feeding behavioural and analytical data back into production systems Supporting architecture reviews … Fabric AWS experience with Redshift, Lambda, and SQL-based analytics services Strong Python skills and experience using Apache Spark Hands-on experience with Databricks Experience designing and maintaining ETL/ELT pipelines Solid understanding of data modelling techniques Experience working in cross-functional teams on cloud-based data platforms Ability ...

Power BI Report Engineer (Azure/Databricks) Glasgow based only | 4 days onsite | No visa restrictions please Are you a Power BI specialist who loves clean, governed data and high-performance semantic models Do you want to work with a business that's rebuilding its entire BI estate the right … most modern, forward-thinking Power BI engineering roles in Scotland. Our Glasgow-based client is transforming its reporting platform using Azure + Databricks , with Power BI sitting on top of a fully curated Gold Layer. They develop everything using PBIP + Git + Tabular Editor 3 , and semantic modelling ...

Senior Power BI Report Engineer (Azure/Databricks) Glasgow based only | 4 days onsite | No visa restrictions please Are you a Senior Power BI specialist who loves clean, governed data and high-performance semantic models Do you want to work with a business that's rebuilding its entire BI estate … most modern, forward-thinking Power BI engineering roles in Scotland. Our Glasgow-based client is transforming its reporting platform using Azure + Databricks , with Power BI sitting on top of a fully curated Gold Layer. They develop everything using PBIP + Git + Tabular Editor 3 , and semantic modelling ...

Data Architect We are currently partnered with a a UK-based financial services organisation providing banking and insurance products to millions of customers nationwide. The business has a strong heritage in retail-focused financial services ...

Contract MLOps Engineer | MLflow | Databricks | Production ML Duration: Initially 3 months Day rate: £500 - £550, Inside IR35 Workplace: Remote, with occasional travel to client-site Inara are supporting a consultancy-led team delivering production-grade machine learning platforms for a range of end clients, and they're looking … with Data Scientists to move models from notebooks into production Establishing best practices around model governance, monitoring, retraining, and environments Integrating ML platforms with Databricks and cloud-native services What we're looking for Strong, real-world MLOps experience (this is not a theoretical role) Deep hands-on MLflow experience ...

data standards, principles, and best practices to improve consistency and reuse. ** Support a modern cloud-based data platform using Microsoft technologies such as Azure Databricks and Fabric. ** Enable data governance, metadata management, and lineage through tools like Microsoft Purview. ** Work closely with Risk and Compliance teams to meet legal, regulatory … Data Architect within complex, enterprise environments. ** Strong hands-on experience in conceptual, logical, and physical data modelling. ** Experience with Azure data services, particularly Databricks, Fabric, and Purview. ** Solid understanding of data governance, metadata, and information lifecycle management. ** Familiarity with enterprise architecture frameworks such as TOGAF or similar. ** Ability to communicate ...