Senior Data Engineer
- Hiring Organisation
- Primus Core
- Location
- London Area, United Kingdom
implement Centralised governance • Leveraging Databricks Workflows/Jobs for orchestration • Building CI/CD pipelines for data & platform deployments (Terraform, GitHub Actions, Azure DevOps etc.) • Enabling real-time and streaming pipelines (Structured Streaming, Auto Loader) • Contributing to MLOps workflows, integrating models into production pipelines • Collaborating with Data Scientists, Analysts … experience with: Unity Catalog (governance & security), Spark Declarative Pipelines, Databricks Workflows/Jobs • Strong understanding of Lakehouse architecture principles • Performance & Optimisation • Platform/DevOps Engineering, Infrastructure as Code, CI/CD pipelines • Strong experience in at least one - Azure, AWS Very Nice to Have: • Databricks certifications (Data Engineer Associate/ ...