3 of 3 Data Ingestion Jobs in Wiltshire

site travel as well. Opportunity to condense the hours of work. This role is inside IR35. What you will do as a Senior Data Engineer Design, build and maintain secure, scalable data solutions across the full lifecycle, including acquisition, integration, storage, processing and analysis. Develop and maintain data ingestion and transformation pipelines using Apache NiFi, Python and SQL. Design data models, schemas and data contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate data from REST APIs and other source systems, working with Parquet and S3-compatible object storage. ...

Senior Data Engineer Location: Wiltshire Contract: 2 months Pay: Up to 62.50p/h Inside IR35 (DOE) Due to the nature of the work, we require candidates who already hold active MOD DV clearance . Responsibilities: Design, build and maintain secure, scalable data solutions across the full lifecycle … including acquisition, integration, storage, processing and analysis. Develop and maintain data ingestion and transformation pipelines using Apache NiFi, Python and SQL. Design data models, schemas and data contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate data from REST APIs ...

deployment of AI/ML solutions aligned to Army training objectives and enterprise architecture principles. Support the development and maintenance of ML pipelines including data pre-processing, feature engineering, model training, validation, and performance evaluation. Support integration of AI capabilities into secure operational environments, ensuring compatibility with DevSecOps pipelines … platform constraints. Monitor deployed models, analyse performance metrics, and implement tuning or retraining strategies to maintain operational effectiveness. Collaborate with data engineers and software teams to support scalable, maintainable, and secure AI components. Review and apply ethical AI principles including bias mitigation, data governance, and regulatory compliance ...