Data QA - Test Engineer
- Location
- City Of London, England, United Kingdom
undertaking a core data migration from eFront Invest FIA into an Azure Databricks Lakehouse . We are seeking a hands-on Senior Data QA / Data Quality Engineer to lead automated migration testing, source-to-target reconciliation, and pipeline validation. You will be responsible for ensuring that all data … Data Quality Frameworks: Develop automated test suites using Python (PyTest) , PySpark , and advanced SQL to catch discrepancies, nulls, and duplicate records. CI / CD Quality Gates: Integrate automated testing and data validation checks into Azure DevOps (ADO) deployment pipelines. Schema Drift & Anomaly Detection: Monitor ...