2 of 2 Remote/Hybrid Apache Spark Jobs in Edinburgh

Senior Azure Data Engineer (Databricks) - Real-Time Pipelines

Location
City of Edinburgh, Scotland, United Kingdom
contribute to best practice engineering across cross-functional teams. Based in Scotland with hybrid work from Edinburgh or Glasgow, you’ll work with DeltaLake, Spark, Kafka, and Unity Catalog, applying DevOps ideas to CI/CD pipelines and GDPR-compliant data #J-18808-Ljbffr ...

Senior Azure Data Engineer (Databricks)

Location
City of Edinburgh, Scotland, United Kingdom
need to potentially work in either Edinburgh or Glasgow depending on client expectations. What You’ll Do Design and develop robust pipelines using DeltaLake, Spark Structured Streaming, and Unity Catalog Build real‐time event‐driven solutions with tools such as Kafka and Azure Event Hubs Apply DevOps principles … knowledge of DevOps tools and CI/CD processes Bonus Points For Development experience in Scala or Java Familiarity with Cloudera, Hadoop, HIVE, and Spark ecosystem Understanding of data privacy regulations, including GDPR, and experience working with sensitive data Ability to learn and adapt new technologies quickly to meet ...