Senior Data Engineer
- Hiring Organisation
- Morson Edge
- Location
- Corsham, Wiltshire, South West, United Kingdom
- Employment Type
- Contract
- Contract Rate
- £0.00 - 62.40 per hour
IR35. What you will do as a Senior Data Engineer Design, build and maintain secure, scalable data solutions across the full lifecycle, including acquisition, integration, storage, processing and analysis. Develop and maintain data ingestion and transformation pipelines using Apache NiFi, Python and SQL. Design data models, schemas and data … contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate data from REST APIs and other source systems, working with Parquet and S3-compatible object storage. Implement data validation, assurance, metadata management and traceability to ensure data is accurate, complete and fit for purpose. Develop tools ...