2 of 2 Data Ingestion Jobs in Wiltshire

site travel as well. Opportunity to condense the hours of work. This role is inside IR35. What you will do as a Senior Data Engineer Design, build and maintain secure, scalable data solutions across the full lifecycle, including acquisition, integration, storage, processing and analysis. Develop and maintain data ingestion and transformation pipelines using Apache NiFi, Python and SQL. Design data models, schemas and data contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate data from REST APIs and other source systems, working with Parquet and S3-compatible object storage. ...

deployment of AI/ML solutions aligned to Army training objectives and enterprise architecture principles. Support the development and maintenance of ML pipelines including data pre-processing, feature engineering, model training, validation, and performance evaluation. Support integration of AI capabilities into secure operational environments, ensuring compatibility with DevSecOps pipelines … platform constraints. Monitor deployed models, analyse performance metrics, and implement tuning or retraining strategies to maintain operational effectiveness. Collaborate with data engineers and software teams to support scalable, maintainable, and secure AI components. Review and apply ethical AI principles including bias mitigation, data governance, and regulatory compliance ...