3 of 3 Delta Lake Jobs in Edinburgh

This is hands‐on delivery in a regulated iGaming environment: production pipelines, not notebooks. Key responsibilities Migrate ML data pipelines from Databricks (Spark/Delta Lake) to the SageMaker-based "golden template" architecture, working to the pattern set by the Lead ML Ops Engineer Build and amend feature … engineering pipelines, feature store integrations, and data access layers (S3, Glue, Lake Formation) supporting migrated models Implement parity and statistical testing to prove migrated pipelines/models match Databricks outputs Handle data migration/integration between Databricks and AWS: storage, permissions, IAM alignment Work within CI/ ...

time streaming, and CI/CD pipelines (Git, Terraform, Databricks Asset Bundles). Deep knowledge of Databricks/Snowflake environments, including Unity Catalog, workspaces, Delta Lake, and networking/security (VPNs, Private Links, Firewalls) and/or Snowflake Platform including Cortex, Horizon and Snowpark. Advanced proficiency in Azure ...

grade data pipelines, and strong experience with Python, Scala, or similar programming languages. Experience working with modern cloud data platforms such as Databricks (preferred), Delta Lake, Snowflake, or BigQuery. Proven experience driving complex cross‐functional initiatives from concept through production. Experience leading technical architecture discussions and engineering design ...