2 of 2 Permanent Databricks Jobs in Glasgow

Implement Data Solutions**:o Design & Build scalable pipelines (Batch and real-time) using cloud-native tools/frameworks (DIHOP, DIHOC, AWS Glue, DBT, Snowflake, Databricks).o Apply architectural patterns for data lakes, streaming, and batch processing.o Exposure to cloud technologies – Snowflake, Redshift, Apache Flink and Apache Kafka.**Technical POCs ...

around projects and IT teams to deliver these data pipelines and models effectively into production. This role will focus on python development on the Databricks and Streamlit platforms to deliver operational tools and process efficiencies. You will: Architect, create, improve, and operationalise integrated and reusable data pipelines, tools and processes. … SQL.Data engineering experience - via data preparation, transformation & conversion to allow for rapid processing of system data across a number of different formats & structuresExperience in Databricks, Azure, ADF, Streamlit or alternatives.Excellent technical computing, analysis, design and development skills to a proven professional level.Good understanding of data streaming concepts with experience designing ...