4 of 4 Batch Processing Jobs in the South West

analytics capabilities across complex secure systems. The successful candidate will play a key role in architecting resilient data platforms, optimising real-time and batch processing pipelines, and ensuring compliance with strict governance and security standards. KEY RESPONSIBILITIES Data Architecture & Engineering - Design and implement scalable, resilient data pipeline architectures … using Elastic Stack and Apache NiFi - Develop secure frameworks for data ingestion, transformation and integration - Build and maintain batch and real-time data processing pipelines - Ensure high standards of data quality, integrity and traceability across all systems Elastic Stack & Platform Management - Configure, optimise and maintain Elasticsearch clusters ...

experienced AWS Data Engineer to help design, build, and maintain a secure, scalable data platform for a government client - supporting real-time and batch processing that underpins critical analytics and decision-making. What you'll be doing: Building, testing, and maintaining robust data pipelines Designing logical and physical … data models Scaling the data platform to meet evolving use cases Analysing data flows and improving processing performance Ensuring data architecture aligns with agreed standards Troubleshooting issues and driving continuous improvement What we're looking for: Essential: Proven experience building data pipelines Strong understanding of data modelling and structures ...

function, setting standards, mentoring engineers, and working closely with both internal teams and external delivery partners. The Role Data Engineering & Pipeline Development Transform legacy batch processes into scalable, observable data pipelines Build and deliver high-quality data products in line with architectural designs Work across modern cloud platforms including ...

experienced AWS Data Engineer to help design, build, and maintain a secure, scalable data platform for a government client - supporting real-time and batch processi... WKCL1_UKTJ ...