Director, Data Engineering
- Hiring Organisation
- Kroll
- Location
- Cambridge, Cambridgeshire, UK
- Employment Type
- Full-time
/ELT pipelines and data services using Chainsys, Azure Data Factory, Airflow, Databricks, and Delta Lake. Advanced proficiency in Python and the Spark ecosystem (PySpark, Spark SQL), with demonstrated capability to set and enforce best practices. Skilled in object-oriented and functional programming, asynchronous … Hands-on knowledge of observability practices — monitoring, alerting, and incident response with Prometheus, Grafana, or Datadog, or equivalent. Performance, Optimization & Scalability Expertise in SQL/Spark query tuning, data pipeline optimization, and distributed system performance engineering. Experienced in scaling fault-tolerant pipelines for petabyte-level workloads ...