12 of 12 Databricks Jobs in Scotland

versioning and experiment tracking using MLflow, along with controlled releases, rollback strategies, and continuous improvement workflows. Design, build, and optimize robust data pipelines in Databricks, feeding ML models and analytics workloads. Develop and maintain scalable data architectures including Azure Data Lake, Azure SQL Data Warehouse, and Synapse Analytics. Build … software, data, and ML workflows using tools such as Azure DevOps, Git, and Jenkins. Automate model training, testing, validation, and deployment using MLflow and Databricks Jobs. Automate infrastructure provisioning, environment management, and deployment using Terraform, ARM templates, or Ansible. Essential Technical Skills: Programming: Python, SQL, PySpark, Bash ML Frameworks: TensorFlow ...

Architectures: Cloud expertise (AWS/Azure/GCP); emerging LLM architectures. GenAI Frameworks & Platforms: Proficient with Data & AI platforms (Azure AI, Vertex AI, Databricks, Hugging Face), advanced GenAI frameworks (LangChain, HF Transformers, LlamaIndex) & Agentic architectures (LangGraph, SmolAgents, PydanticAI) Vector DBs & RAG: Designed solutions using vector DBs & Retrieval Augmented GenAI ...

will help shape the way Specsavers uses data across the organisation. You'll be hands-on with modern tools like Azure Data Factory, Azure Databricks, and Azure SQL, and you'll play a key role in ensuring our data is accurate, accessible, and trusted. We're looking for someone ...

Must-Have Skills: Strong experience with Python/Spark Expertise in AWS Cloud Hands-on with Terraform/CloudFormation (IaC) Experience with Snowflake/Databricks/Airflow/DBT Solid understanding of DevOps practices (GitOps, Kubernetes, Docker) Experience building distributed data systems ⭐ Nice to Have: Strong background in Data Engineering ...

Investment Banking - UX and Data Integration Engineer - Snowflake, Databricks, Kafka, Python, SQL, ETL, Power BI, Contract What will you be doing? The ENS UX and Data Integration Engineer is responsible for integrating diverse data sources into enterprise analytics platforms and translating business and user requirements into scalable, well designed data … analytics use cases is structured, performant, and well understood by downstream consumers. The role requires strong hands on experience with Snowflake and Databricks, as well as the ability to collaborate closely with developers, data owners, and UX stakeholders. Key Responsibilities: Partner with developers, data owners, and stakeholders to capture requirements ...

stakeholder Data modelling techniques - e.g. DataVault, Kimball etc. Strong experience in SQL/Python Data Cloud Tech experience - e.g. Snowflake/BigQuery/Databricks Data transformation experience using DBT THE BENEFITS: You will receive a salary, dependent on experience. Salary is up to £75,000 On top of the salary ...

integration, and user experience-supporting advanced analytics and AI-driven solutions. Key Responsibilities Integrate diverse data sources into enterprise platforms such as Snowflake and Databricks Design scalable, high-performance data models for analytics and AI use cases Build and maintain robust ETL/ELT pipelines using modern tooling Collaborate with … flows, schemas, and integration patterns Monitor and optimise data performance, resolving issues as needed Required Skills & Experience Strong hands-on experience with Snowflake and Databricks in production environments Proficiency in Python and SQL Experience with Kafka and modern data pipeline frameworks Solid understanding of data modelling, big data, and analytics ...

environments and a solid understanding of core SRE principles such as SLA, SLO, SLI, error budgets, and golden signals. Exposure to Snowflake or Databricks is preferred. Key Responsibilities: Design, develop, and maintain Grafana dashboards to provide actionable insights into platform health, performance, and reliability. Build and enhance observability solutions ...

Databricks Data Engineer | Edinburgh | £60,000 - £75,000 🧱 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. As a trusted Microsoft Partner, my client are leaders in the industry, with a diverse portfolio of clients and projects. … data engineering/BI skills, with a focus on having delivered in Microsoft Azure or AWS Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication skills, effectively participating with Senior Stakeholders Nice ...

Delivery: Design, build, and maintain scalable AI and LLM-based pipelines using AWS or Azure services (e.g., SageMaker, Azure ML, Databricks, OpenAI integrations). Contribute across AI model lifecycles from data preprocessing and prompt engineering through to deployment and continuous monitoring in production environments. Collaboration & Stakeholder Management: Work with cross …/ML code. LLMOps & AI Model Management: Familiarity with tools like MLFlow, LangChain, Hugging Face, Kubeflow, or similar platforms. Data Processing: Working knowledge of Databricks/Spark or comparable large-scale data processing tools. SQL: Solid capabilities in data querying and preparation. Data Architectures: Understanding of modern data infrastructure (lakehouses ...

Lakehouse Owning the transformation from enriched to curated datasets, enabling trusted reporting and insight Developing and maintaining robust SQL and PySpark transformation pipelines in Databricks Embedding data quality, testing, reliability and performance into the curated layer Working closely with data engineers, BI teams and business stakeholders to translate complex requirements … data platform Excellent data modelling capability, including dimensional and semantic modelling Advanced SQL skills and strong hands on experience with PySpark Experience working with Databricks and Lakehouse architectures A solid grounding in engineering best practices, testing and data quality Confidence mentoring others and taking ownership of technical decisions An engineering ...

Lakehouse Owning the transformation from enriched to curated datasets, enabling trusted reporting and insight Developing and maintaining robust SQL and PySpark transformation pipelines in Databricks Embedding data quality, testing, reliability and performance into the curated layer Working closely with data engineers, BI teams and business stakeholders to translate complex requirements … data platform Excellent data modelling capability, including dimensional and semantic modelling Advanced SQL skills and strong hands on experience with PySpark Experience working with Databricks and Lakehouse architectures A solid grounding in engineering best practices, testing and data quality Confidence mentoring others and taking ownership of technical decisions An engineering ...