Business Consultant - Databricks
- Hiring Organisation
- NTT DATA
- Location
- London, United Kingdom
- Salary
- £ 80 K
Collaborate with data scientists and platform teams to improve query performance on Delta Lake.• Develop automated monitoring and alerting mechanisms using Databricks REST APIs, Prometheus, or Azure Monitor.• Maintain best practices for data engineering performance, testing, and documentation.Technical Skills Required• Strong proficiency with Databricks, Apache Spark (SQL, PySpark, Scala … trade-offs.• Version control (Git, GitHub Actions, DevOps pipelines) and CI/CD practices for Databricks.Desirable Skills• Experience with Databricks monitoring and observability (Ganglia, Prometheus, or Datadog).• Understanding of serverless Databricks clusters.• Familiarity with Terraform and infrastructure as code for Databricks resource management.• Exposure to MLflow and model-serving ...