Developer (PySpark + Fabric)
- Hiring Organisation
- Tata Consultancy Services
- Location
- London Area, United Kingdom
PyTest and related frameworks. Support CI/CD processes for application deployment, infrastructure provisioning, and automated testing. Define and maintain configuration-driven solutions using YAML and JSON-based frameworks. Monitor, troubleshoot, and optimise production pipelines using observability, telemetry, and logging tools. Develop dataflows, ETL processes, semantic models, and analytics-ready … frameworks, and code coverage tools. Experience with Git-based CI/CD platforms such as GitLab CI, Azure DevOps, or similar. Experience working with YAML and JSON configuration files and Infrastructure-as-Code concepts. Strong experience with Spark for large-scale data processing using DataFrames, RDDs, and Spark SQL. Hands ...