Senior Data Engineer - Databricks
- Hiring Organisation
- Falcon Chase International
- Location
- Leeds, United Kingdom
- Employment Type
- Permanent
- Salary
- GBP Annual
expertise to support the modernisation and optimisation of enterprise data platforms. The successful candidate will work on migrating and improving data pipelines, enhancing processing performance, implementing automated data quality checks, and safely retiring redundant workloads. The role requires strong Python, PySpark and SQL skills, alongside practical experience delivering reliable … data, deletes, backfills and safe reruns while preserving business logic. Ensure data processing remains accurate, reliable and maintainable throughout migration and modernisation activities. Databricks Performance and Cost Optimisation Investigate slow-running or expensive workloads using Spark UI, query plans and job metrics. Optimise joins, partitioning, data skew, shuffles, file ...