8 of 8 Permanent Databricks Jobs in Scotland

versioning and experiment tracking using MLflow, along with controlled releases, rollback strategies, and continuous improvement workflows. Design, build, and optimize robust data pipelines in Databricks, feeding ML models and analytics workloads. Develop and maintain scalable data architectures including Azure Data Lake, Azure SQL Data Warehouse, and Synapse Analytics. Build … software, data, and ML workflows using tools such as Azure DevOps, Git, and Jenkins. Automate model training, testing, validation, and deployment using MLflow and Databricks Jobs. Automate infrastructure provisioning, environment management, and deployment using Terraform, ARM templates, or Ansible. Essential Technical Skills: Programming: Python, SQL, PySpark, Bash ML Frameworks: TensorFlow ...

Architectures: Cloud expertise (AWS/Azure/GCP); emerging LLM architectures. GenAI Frameworks & Platforms: Proficient with Data & AI platforms (Azure AI, Vertex AI, Databricks, Hugging Face), advanced GenAI frameworks (LangChain, HF Transformers, LlamaIndex) & Agentic architectures (LangGraph, SmolAgents, PydanticAI) Vector DBs & RAG: Designed solutions using vector DBs & Retrieval Augmented GenAI ...

stakeholder Data modelling techniques - e.g. DataVault, Kimball etc. Strong experience in SQL/Python Data Cloud Tech experience - e.g. Snowflake/BigQuery/Databricks Data transformation experience using DBT THE BENEFITS: You will receive a salary, dependent on experience. Salary is up to £75,000 On top of the salary ...

environments and a solid understanding of core SRE principles such as SLA, SLO, SLI, error budgets, and golden signals. Exposure to Snowflake or Databricks is preferred. Key Responsibilities: Design, develop, and maintain Grafana dashboards to provide actionable insights into platform health, performance, and reliability. Build and enhance observability solutions ...

Databricks Data Engineer | Edinburgh | £60,000 - £75,000 🧱 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. As a trusted Microsoft Partner, my client are leaders in the industry, with a diverse portfolio of clients and projects. … data engineering/BI skills, with a focus on having delivered in Microsoft Azure or AWS Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication skills, effectively participating with Senior Stakeholders Nice ...

Delivery: Design, build, and maintain scalable AI and LLM-based pipelines using AWS or Azure services (e.g., SageMaker, Azure ML, Databricks, OpenAI integrations). Contribute across AI model lifecycles from data preprocessing and prompt engineering through to deployment and continuous monitoring in production environments. Collaboration & Stakeholder Management: Work with cross …/ML code. LLMOps & AI Model Management: Familiarity with tools like MLFlow, LangChain, Hugging Face, Kubeflow, or similar platforms. Data Processing: Working knowledge of Databricks/Spark or comparable large-scale data processing tools. SQL: Solid capabilities in data querying and preparation. Data Architectures: Understanding of modern data infrastructure (lakehouses ...

Lakehouse Owning the transformation from enriched to curated datasets, enabling trusted reporting and insight Developing and maintaining robust SQL and PySpark transformation pipelines in Databricks Embedding data quality, testing, reliability and performance into the curated layer Working closely with data engineers, BI teams and business stakeholders to translate complex requirements … data platform Excellent data modelling capability, including dimensional and semantic modelling Advanced SQL skills and strong hands on experience with PySpark Experience working with Databricks and Lakehouse architectures A solid grounding in engineering best practices, testing and data quality Confidence mentoring others and taking ownership of technical decisions An engineering ...

Lakehouse Owning the transformation from enriched to curated datasets, enabling trusted reporting and insight Developing and maintaining robust SQL and PySpark transformation pipelines in Databricks Embedding data quality, testing, reliability and performance into the curated layer Working closely with data engineers, BI teams and business stakeholders to translate complex requirements … data platform Excellent data modelling capability, including dimensional and semantic modelling Advanced SQL skills and strong hands on experience with PySpark Experience working with Databricks and Lakehouse architectures A solid grounding in engineering best practices, testing and data quality Confidence mentoring others and taking ownership of technical decisions An engineering ...