/CD pipelines. Expertise in Unity Catalog for data governance and security. Proven ability to optimize Databricks data transformation workloads. Experience with Azure Data Lake, DeltaLake, and cloud-based data solutions. All profiles will be reviewed against the required skills and experience. Due to the high More ❯
City of London, London, United Kingdom Hybrid / WFH Options
83zero Ltd
is a MUST! Key expertise and experience we're looking for: Data Engineering in Databricks - Spark programming with Scala, Python, SQL Ideally experience with DeltaLake Databricks workflows, jobs, etc. Familiarity with Azure Data Lake: experience with data ingestion and ETL/ELT frameworks Data Governance experience More ❯
writing queries to basic database operations Exposure to cloud infrastructure, ideally AWS Bonus: Experience with streaming/data tools such as Kafka, Spark, or DeltaLake Technology Stack & Environment You'll be working with: AWS, Kubernetes, Kafka, Argo Java 17, Python 3, HDF5 Distributed systems processing large volumes More ❯
writing queries to basic database operations Exposure to cloud infrastructure, ideally AWS Bonus: Experience with streaming/data tools such as Kafka, Spark, or DeltaLake Technology Stack & Environment You'll be working with: AWS, Kubernetes, Kafka, Argo Java 17, Python 3, HDF5 Distributed systems processing large volumes More ❯