Data Engineer - Tech Lead (Databricks, Pyspark)
- Hiring Organisation
- EPAM Systems
- Location
- London, United Kingdom
- Salary
- £ 80 K
services such as Data Factory, Synapse and Blob StorageMentor data engineers, promote modern engineering practices and perform technical reviewsDrive adoption of CI / CD, Infrastructure as Code and automated testing in data engineering environmentsImplement observability and monitoring using tools like Databricks Workflows and related frameworksContribute … driven initiatives by leveraging Databricks ML / MosaicML to integrate Generative AI and LLM-based solutionsRequirementsBachelor’s or Master’s degree in Computer Science, Software Engineering or related fieldExtensive experience designing and implementing production-grade platforms using Azure DatabricksExpertise in PySpark, including advanced optimization, data skew mitigation and query ...