Lead Test Engineer (SC Cleared)
- Hiring Organisation
- scrumconnect ltd
- Location
- City, Newcastle Upon Tyne, United Kingdom
- Employment Type
- Permanent
- Salary
- GBP 55,000 Annual
datasets Validate large-scale data ingestion, transformation, and processing workflows Ensure data integrity, transformation accuracy, reconciliation, and performance under load Oversee PySpark-based data validation and interrogation activities on AWS EMR Support testing and monitoring of workflows orchestrated through Apache Airflow Drive root cause analysis for production data issues … engineering teams to improve release quality and deployment confidence Ensure automated test execution within GitLab CI/CD pipelines Support infrastructure testing and validation within Terraform-managed cloud environments Contribute to continuous improvement initiatives across testing and delivery processes Technology Stack Apache Airflow, Amazon Athena, AWS S3, AWS Glue ...