Databricks Engineer
London, United Kingdom
Tenth Revolution Group
and resource consumption. Continuously monitor and improve pipeline performance, addressing bottlenecks and optimizing for cost efficiency in Azure. Automation & Monitoring: Automate data pipeline deployment and management using tools like Terraform, ensuring consistency across environments. Set up monitoring and alerting mechanisms for pipelines using Databricks built-in features and Azure Monitor to detect and resolve issues proactively. Requirements Data Pipeline Expertise More ❯
Employment Type: Contract
Rate: £400 - £500/day
Posted: