1 to 25 of 32 Databricks Jobs in Edinburgh

to ongoing initiatives. This can include contributing to knowledge-sharing activities and data services. Essential technical experience you will demonstrate Strong experience designing and delivering data solutions in the Databricks Data Intelligence platform, either on Azure or AWS. Good working knowledge of Databricks components: DeltaLake, Unity Catalog, ML Flow, etc. Expertise in SQL, Python and Spark (Scala or Python). More ❯

MySQL) Understanding of ETL/ELT principles , data architecture, and data warehouse concepts Familiarity with APIs, RESTful services, and JSON/XML data handling Experience with Azure Data Factory , Databricks , or AWS Glue Familiarity with CI/CD , version control (Git), and DevOps practices Knowledge of cloud platforms (Azure, AWS, or GCP) Basic understanding of data governance , security, and GDPR More ❯

design. Experience architecting and building data applications using Azure, specifically a Data Warehouse and/or Data Lake. Technologies : Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and data transformations including the creation of supplementary … with APIs and integrating them into data pipelines. Strong programming skills in Python. Experience of data wrangling such as cleansing, quality enforcement and curation e.g. using Azure Synapse notebooks, Databricks, etc. Experience of data modelling to describe the data landscape, entities and relationships. Experience with data migration from legacy systems to the cloud. Experience with Infrastructure as Code (IaC) particularly More ❯

We work with some of the UK’s biggest companies and government departments to provide a pragmatic approach to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best More ❯

delivery and business decision-making. About You: Deep expertise in data engineering, data pipelines, and semantic models. Hands-on experience building data platforms on Microsoft Azure (Data Factory, Synapse, Databricks, Purview). Skilled in deploying machine learning models and generative AI applications in production. Strong programming skills in Python, SQL, YAML. Experience with CI/CD and infrastructure-as-code More ❯

RFP responses as well as thought leadership articles that we issue to the market. Experience in Data Platform Technologies, including some of the following capabilities: Understanding of Snowflake/Databricks architecture, including basic data warehousing concepts and data sharing capabilities The ability to write SQL and/or Python queries for the purposes of transforming, joining and aggregating data Ability … to analyse datasets and generate insights using Snowflake and/or Databricks analytical tools and features Practical knowledge of common data engineering and BI/data visualisation integrations such as dbt, Azure Data Factory, PowerBI and Sigma Experience using native functionality to deploy and interact with Large Language Models Ability to develop, test and deploy machine learning models Work to … Some hands-on coding experience with SQL, Python or Scala would be advantageous but not compulsory Relevant experience in Data Platform Technologies (knowledge of any or all including Snowflake, Databricks, Microsoft Fabric would be beneficial) Previous consulting experience would be a plus, but so would the curiosity and ambition to develop your career with a consulting role What we look More ❯

engineering or a related field, with a focus on building scalable data systems and platforms. Strong expertise with modern data tools and frameworks such as Spark , dbt , Airflow , Kafka , Databricks , and cloud-native services (AWS, GCP, or Azure). Deep understanding of data modeling , distributed systems , streaming architectures , and ETL/ELT pipelines . Proficiency in SQL and at least More ❯

technical documentation for all solutions and processes. Technical Skills Programming: Proficiency in Python, Java, Scala, or similar languages. Big Data Technologies: Hands-on experience with big data tools e.g. (Databricks, Apache Spark, Hadoop). Cloud Platforms: Familiarity with AWS, Azure, GCP, or other cloud ecosystems for data engineering tasks. Expertise in relational databases (e.g. postgres, sql server) Data Integration Tools More ❯

data engineering or a related field, with a focus on building scalable data systems and platforms. Expertise in modern data tools and frameworks such as Spark, dbt, Airflow, Kafka, Databricks, and cloud-native services (AWS, GCP, or Azure) Understanding of data modeling, distributed systems, ETL/ELT pipelines, and streaming architectures Proficiency in SQL and at least one programming language More ❯

engineering or a related field, with a focus on building scalable data systems and platforms. Strong expertise with modern data tools and frameworks such as Spark , dbt , Airflow , Kafka , Databricks , and cloud-native services (AWS, GCP, or Azure). Deep understanding of data modeling , distributed systems , streaming architectures , and ETL/ELT pipelines . Proficiency in SQL and at least More ❯

data management best practices including demonstrated experience with data profiling, sourcing, and cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching. Good knowledge of Databricks, Snowflake, Azure/AWS/Oracle cloud, R, Python. Additional Information At Version 1, we believe in providing our employees with a comprehensive benefits package that prioritises their well-being More ❯

technical documentation for all solutions and processes. Technical Skills Programming: Proficiency in Python, Java, Scala, or similar languages. Big Data Technologies: Hands-on experience with big data tools e.g. (Databricks, Apache Spark, Hadoop). Cloud Platforms: Familiarity with AWS, Azure, GCP, or other cloud ecosystems for data engineering tasks. Expertise in relational databases (e.g. postgres, sql server) Data Integration Tools More ❯

modelling and data structure design across Royal London’s Enterprise Data Platform (EDP) which is being built on Azure Databricks. The EDP is a Data Lakehouse built using the Databricks Medalion architecture and consists of a relational core ‘silver’ layer with a variety of dimensional, de-normalised and relational structured data products being exposed for consumption through the ‘Gold’ layer. … data models using data modelling tools (Idera ER/Studio or similar). Data engineering/data pipeline experience, with hands-on experience on integration tools such as Azure Databricks Notebooks, Azure Data Factory or PySpark. Python extremely beneficial. About Royal London We’re the UK’s largest mutual life, pensions, and investment company, offering protection, long-term savings and More ❯

engineering or a related field, with a focus on building scalable data systems and platforms. Strong expertise in modern data tools and frameworks such as Spark, dbt, Airflow, Kafka, Databricks, and cloud-native services (AWS, GCP, or Azure) Deep understanding of data modeling, distributed systems, ETL/ELT pipelines, and streaming architectures Proficiency in SQL and at least one programming More ❯

success • Experience in designing cloud data platform solutions • In depth knowledge of the Snowflake platform and capabilities • Relevant experience of working with other cloud data platform solutions such as Databricks, GCP BigQuery, Microsoft Azure or AWS offerings would also be advantageous • Practical knowledge of GenAI and LLM offerings in the market • Skilled in working on large scale agile transformation projects More ❯

. Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with modern data tools and technologies such as Spark, Databricks, Kafka, or Snowflake (bonus). Knowledge of cloud security, networking, and cost optimization as it relates to data platforms. Experience in total cost of ownership estimation and managing its impact More ❯

AWS Glue, Azure Data Factory, or Google Cloud Dataflow Working with platform services such as Amazon S3, Azure Synapse, Google BigQuery, and Snowflake Implementing Lakehouse architectures using tools like Databricks or Snowflake Collaborating closely with engineers, analysts, and client teams to deliver value-focused data solutions We'd love to talk to you if: You’ve got solid experience working More ❯

. Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with modern data tools and technologies such as Spark, Databricks, Kafka, or Snowflake (bonus). Knowledge of cloud security, networking, and cost optimization as it relates to data platforms. Experience in total cost of ownership estimation and managing its impact More ❯

.NET, dbt, Airflow and cloud-native data tools (AWS, GCP or Azure) You have strong knowledge of data architecture patterns - including Lakehouse and modern warehouse design (e.g. Snowflake, BigQuery, Databricks) You know how to build with performance, security and maintainability in mind You can comfortably influence and guide both technical and non-technical stakeholders You're passionate about helping others More ❯

EXPERIENCE A successful Data Engineering Consultant will have the following: Solid technical ability in Python , SQL & Azure (essential). Strong proficiency in Microsoft Azure and relevant tools/technologies ( Databricks, Azure Data Factory, Azure Data Lake, Azure Synapse ). Proven understanding of DevOps best practices: CI/CD (Azure DevOps is ). Solid communication skills and business-facing/stakeholder More ❯

documents, and ensuring best practices in solution delivery. Qualifications and Skills: Proficiency in SQL Server Business Intelligence Development Studio, SSRS, SSIS, SQL Server, Visual Studio, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Microsoft Fabric, and PySpark. Experience in developing reusable and dynamic ADF/Fabric pipelines. Strong communication skills for interaction with clients and technical teams. Bachelor's Degree More ❯

EXPERIENCE A successful Data Engineering Consultant will have the following: Solid technical ability in Python , SQL & Azure (essential). Strong proficiency in Microsoft Azure and relevant tools/technologies ( Databricks, Azure Data Factory, Azure Data Lake, Azure Synapse ). Proven understanding of DevOps best practices: CI/CD (Azure DevOps is preferred). Solid communication skills and business-facing/ More ❯

Data Engineering. We are looking for: Demonstratable data engineering skills, with a focus on having delivered in Microsoft Azure Strong experience designing and delivering data solutions in Fabric, Azure Databricks or Azure Synapse Proficient with SQL and Python Great communication skills, effectively participating with Senior Stakeholders A record of managing and leading small teams Must have some consulting experience Nice More ❯

maturity assessments and alignment of gaps to enabling technology solutions Appreciation/Experience in designing and governing data platform architectures (e.g. broad understanding of Informatica, Collibra, Ab Initio, Snowflake, Databricks) Appreciation of and interest in attaining end-to-end data skills e.g., data quality, metadata, data-mesh, data security, privacy & compliance Experience with Enterprise/platform/application (e.g. cloud More ❯

A highly successful Data Consultancy is seeking a Technical Databricks Architect to design and deliver innovative solutions using Databricks on Azure. This consultancy is both a Microsoft Partner and a Databricks Partner , specializing in helping clients leverage data and analytics effectively. Responsibilities include: Designing and implementing data solutions using Databricks on Azure. Collaborating with clients to understand their data needs. … Providing technical leadership in data architecture projects. Qualifications: Experience with Databricks and Azure cloud platform. Strong understanding of data architecture and engineering. Excellent communication and decision-making skills. #J-18808-Ljbffr More ❯