Data Engineer (SQL and PySpark)
- Hiring Organisation
- Matchtech
- Location
- Dunstable, Bedfordshire, United Kingdom
- Employment Type
- Contract
- Contract Rate
- £549/day
development. Key Responsibilities Design and develop end-to-end data pipelines using reusable frameworks Build scalable data solutions using Python, SQL, and PySpark Create modular frameworks separating configuration from orchestration Implement robust automated testing (unit, integration, regression) Establish and enforce data quality controls (schema, nulls, row counts, integrity checks … based workflows Troubleshoot and optimise data pipelines for reliability and performance Required Experience Strong Data Engineering background Advanced Python and SQL skills Experience with PySpark or distributed processing tools Proven track record building reusable data frameworks Strong testing experience (pytest, mock data, data validation techniques) Solid understanding of data ...