1 to 25 of 30 Databricks Jobs in Scotland

equivalent experience in computer science engineering, or a related field.Strong programming skills in languages such as Python, Java, or Scala.Hands-on experience with Databricks, SQL, and data modelling. Proficiency with big data tools (e.g., Apache Spark, Apache Kafka, Presto, etc.) and cloud services (e.g., Azure, AWS, GCP).Familiarity with data ...

Flexible First options availableThe RoleAs a Data Engineer, you will focus on designing, developing, and optimising data ingestion, transformation, and serving layers across Azure Databricks, Delta Lake, and Databricks SQL. Your work will enable reliable data products and insights for stakeholders, and you’ll collaborate with data architects, analysts … apply best practices in security and data quality.Working within the Data & AI team, you will contribute to developing our new Renewables Data Platform on Databricks and migrating existing data solutions from Synapse. This role is hands-on and collaborative, combining pipeline development, data modelling, and quality and security practices ...

related field, with a focus on building scalable data systems and platforms.Expertise in modern streaming data tools and frameworks such as Kafka, Spark, Databricks, and cloud-native services (AWS, GCP, or Azure).Deep understanding of streaming architectures, distributed systems, ETL/ELT pipelines, infrastructure-as-code, and build processes.Proficiency ...

Microsoft Azure . Understanding of data integration patterns , APIs, ETL/ELT processes, and database technologies. Experience working with enterprise data platforms such as Databricks , PostgreSQL , or similar technologies. Strong stakeholder management and communication skills. Desirable Skills Knowledge of analytics and reporting platforms (e.g., Power BI). Experience with DevOps ...

solutions, preferably Azure & Databricks. Knowledge of data governance, security, and master data management. Experience with relational and analytical data models. Desirable Skills Experience with Databricks, PostgreSQL, and Power BI. Knowledge of modern data mesh or data lakehouse architectures. Disclaimer: This vacancy is being advertised by either Advanced Resource Managers Limited ...

solutions, preferably Azure & Databricks. Knowledge of data governance, security, and master data management. Experience with relational and analytical data models. Desirable Skills Experience with Databricks, PostgreSQL, and Power BI. Knowledge of modern data mesh or data lakehouse architectures. Disclaimer: This vacancy is being advertised by either Advanced Resource Managers Limited ...

including testing, version control, code quality and secure development practices.Exposure to cloud technologies and DevOps ways of working, with experience of Azure and ideally Databricks, CI/CD pipelines and automation considered highly beneficial.Strong communication and collaboration skills, with the ability to work effectively across technical teams and business stakeholders ...

Integrate automated testing into CI/CD pipelines Raise and track defects through to resolution Essential skills Strong Python and SQL, ideally with PySpark Databricks or a similar cloud data platform Pytest, plus integration, end-to-end and regression testing Software quality assurance and functional testing Data validation ...

dimensional design dbt or equivalent transformation tooling Power BI dataset and semantic-model development Experience with a modern cloud data platform such as Databricks If this role sounds of interest, please apply or send your CV to (url removed) for a confidential chat to find out more. ...

colleagues within machine learning engineering or software development teams Experience with cloud platforms such as AWS, Azure, or GCP, or ML platforms such as Databricks Exposure to evaluating LLM-based applications, including AI-as-a-judge approaches Experience with Generative AI techniques such as retrieval-augmented generation, fine-tuning ...

engineering leader with demonstrated experience in vector-based data processingExperience leading global, distributed engineering teams through production system transformationStrong cloud data infrastructure background — AWS, Databricks, KubernetesCross-team technical influence — demonstrated ability to facilitate constructive discussions around complex technical and organisational issues and drive architectural decisions across team boundariesData-driven prioritisation ...

experience[Preferred] Specific experience with LLMs and agentic systems[Preferred] Hands-on experience with technologies in the modern AI/LLM ecosystem, such as Databricks, Langchain, or MLFlow[Preferred] Advanced understanding of the probabilistic systems underpinning modern LLMs[Preferred] Experience building AI products in highly accuracy-sensitive domains such ...

work effectively with senior stakeholders across Engineering, Product, Legal, Security and Data Governance. Familiarity with privacy and consent technologies, experimentation, personalisation, advertising measurement, Databricks, OpenTelemetry or SQL is valuable but not essential - as is practical experience using AI tools to make engineering work smarter. What it's like here ...

audiences. Demonstrated capability to guide engineering teams and influence technical strategy. Some other highly valued skills may include: Experience with MLOps platforms such as Databricks or SageMaker, and familiarity with hybrid cloud strategies (Azure, on-prem Kubernetes). Strong understanding of AI infrastructure for scalable model serving, distributed training ...

will work across the following:Building and operating cloud data and platform solutions across modern cloud and data platforms including Azure, AWS, GCP, Databricks, Microsoft Fabric and Snowflake Developing and maintaining scalable batch and streaming data pipelines, applying ETL/ELT patterns to ingest, validate, normalise, cleanse and transform data … meet both technical and business needs We are looking for experience in the following:Cloud engineering across one or more of: Azure, AWS, GCP, Databricks, Microsoft Fabric or Snowflake Python and SQL, with strong engineering fundamentals Batch and/or streaming pipeline development, or cloud infrastructure and platform engineering ...

will work across the following: Building and operating cloud data and platform solutions across modern cloud and data platforms including Azure, AWS, GCP, Databricks, Microsoft Fabric and Snowflake Developing and maintaining scalable batch and streaming data pipelines, applying ETL/ELT patterns to ingest, validate, normalise, cleanse and transform data … meet both technical and business needs We are looking for experience in the following: Cloud engineering across one or more of: Azure, AWS, GCP, Databricks, Microsoft Fabric or Snowflake Python and SQL, with strong engineering fundamentals Batch and/or streaming pipeline development, or cloud infrastructure and platform engineering ...

changing Digital-First world we live in. We foster strong partnerships with leading technology giants including Anthropic, Microsoft, AWS, Oracle, Red Hat, OutSystems, and Databricks, ensuring that our customers are provided with the highest quality solutions and services.We’re an award-winning employer reflecting how our employees ...

changing Digital-First world we live in. We foster strong partnerships with leading technology giants including Anthropic, Microsoft, AWS, Oracle, Red Hat, OutSystems, and Databricks, ensuring that our customers are provided with the highest quality solutions and services.We’re an award-winning employer reflecting how our employees ...

build ingestion pipelines from client source systems including SCADA, asset registers, geospatial, climate, environmental and utilities data into cloud platforms such as Snowflake, Databricks and Azure.Develop robust, layered data architectures including raw, staging and curated data models using dbt or equivalent frameworks.Build, validate and deploy statistical and machine learning models … maintainable code design.Advanced SQL skills with experience in optimisation, data modelling, metric development and complex transformations.Production experience with cloud data platforms such as Snowflake, Databricks, Azure Data Services or equivalent AWS technologies.Experience with modern transformation and orchestration tools including dbt, Airflow, Azure Data Factory or similar.A solid understanding of statistics ...

DescriptionSenior AI Architect and Engineer LeadDescriptionDo you want to work to make Power for Good We're the world's largest independent renewable energy company, guided by a simple yet powerful vision to create a ...

experience[Preferred] Specific experience with LLMs and agentic systems[Preferred] Hands-on experience with technologies in the modern AI/LLM ecosystem, such as Databricks, Langchain, or MLFlow[Preferred] Advanced understanding of the probabilistic systems underpinning modern LLMs[Preferred] Experience building AI products in highly accuracy-sensitive domains such ...

role for you.As a Data Engineering Manager, you will:Lead delivery of cloud-scale data engineering programmes and platform migration initiatives across Azure, Databricks, Microsoft Fabric, Snowflake, AWS and GCPDrive AI-assisted pipeline development as standard engineering practice — setting team norms around the use of GenAI tooling for pipeline build … engagementsWe are looking for significant experience in the following:Design and delivery of cloud-scale data engineering solutions across one or more of: Azure, Databricks, Microsoft Fabric, Snowflake, AWS or GCPAI-assisted pipeline development — proven experience using GenAI tooling to accelerate engineering delivery and governing the quality of outputsData quality ...

role for you. As a Data Engineering Manager, you will: Lead delivery of cloud-scale data engineering programmes and platform migration initiatives across Azure, Databricks, Microsoft Fabric, Snowflake, AWS and GCP Drive AI-assisted pipeline development as standard engineering practice setting team norms around the use of GenAI tooling … looking for significant experience in the following: Design and delivery of cloud-scale data engineering solutions across one or more of: Azure, Databricks, Microsoft Fabric, Snowflake, AWS or GCP AI-assisted pipeline development proven experience using GenAI tooling to accelerate engineering delivery and governing the quality of outputs Data quality ...

maintain cloud infrastructure on AWS using Terraform, including networking, security, compute, storage, and managed services, following infrastructure-as-code best practices Develop and manage Databricks platform capabilities including workspaces, clusters, policies, jobs, libraries, and integrations to support production-grade data workloads Build automation around platform provisioning and operations using Python … relevant to cloud data platforms, such as VPC, IAM, S3, EC2/ECS/EKS, RDS, KMS, CloudWatch, and load balancing Working experience with Databricks, including platform administration and/or building and supporting production workloads Proficiency in Python (preferred) or Java, with demonstrated ability to build automation, tooling ...

firm Build and operate reliable data pipelines that ingest, transform, validate, and publish metric datasets to power analytics experiences, integrating with platforms such as Databricks as needed Design, build, and maintain secure, scalable backend services and REST APIs that enable metric consumption and power the user interface Define and validate … handling, and performance optimization Experience deploying and operating services on cloud or container platforms (e.g., AWS, Kubernetes, or equivalent enterprise platforms) Experience integrating with Databricks to produce curated, dashboard-ready datasets, including layered data product patterns (e.g., bronze/silver/gold or equivalent) with clear contracts and quality controls ...