Developer (PySpark + Fabric)
- Hiring Organisation
- Tata Consultancy Services
- Location
- London Area, United Kingdom
through Microsoft Fabric and downstream platforms. Implement data quality controls and validation frameworks to ensure data accuracy, consistency, and reliability. Develop and maintain unit, integration, and end-to-end test suites using PyTest and related frameworks. Support CI/CD processes for application deployment, infrastructure provisioning, and automated testing. … large-scale data processing and mastering pipelines using PySpark. Strong experience working with complex and nested data structures in distributed data environments. Experience implementing API integrations, including secure HTTPS services, authentication, and retry mechanisms. Hands-on experience with Azure Cosmos DB, including data modelling, partitioning, indexing, throughput optimisation ...