Lead Azure Databricks Platform Engineer / Architect
- Hiring Organisation
- TXP Technology x People
- Location
- London, South East England, United Kingdom
- Employment Type
- Full-Time
- Salary
- £500.00 - £501.00 per day
reduce technology sprawl while improving security, supportability and delivery speed. 4. Data Engineering and Integration Design and build reliable ingestion and transformation pipelines using Python, PySpark, SQL and Delta Lake. Implement full and incremental ingestion, CDC where appropriate, schema evolution, reconciliation, error handling and data quality controls. Design reusable integration … troubleshooting Databricks Serverless and compute/workload optimisation Azure identity, networking, security, secrets, monitoring and private connectivity Databricks SQL, Delta Lake and performance optimisation Python, PySpark and SQL Jobs/workflows, incremental processing, CDC and data quality REST/API and external data integration patterns FinOps, cost attribution, tagging, budgets ...