SC Cleared Python Data Engineer – Azure & PySpark
- Hiring Organisation
- Montash
- Location
- England, United Kingdom
data processing solutions using Python, PySpark, Delta Lake, and containerised workloads. This opportunity sits within a fast-paced engineering environment working closely with cloud, DevOps, and data science teams. Key Responsibilities Develop and maintain ingestion, transformation, and validation pipelines using Python and PySpark Implement unit and BDD testing with Behave … driven, modular, and reusable engineering solutions Integrate Azure services including Azure Functions, Key Vault, and Blob Storage Collaborate with cloud architects, data scientists, and DevOps teams on CI/CD processes and environment configuration Tune and troubleshoot PySpark jobs for performance in production workloads Maintain documentation and follow best practices ...