Data Engineer (DV Security Clearance)
- Hiring Organisation
- CGI
- Location
- Chippenham, Wiltshire, UK
- Employment Type
- Full-time
data platform by documenting designs, improving data flows and supporting operational teams through clear runbooks and shared knowledge. Key responsibilities include: • Design & build Logstash pipelines for ingesting data into Elasticsearch • Develop & manage Apache NiFi flows for routing, transformation and enrichment • Parse & transform diverse log formats including JSON, CEF, Syslog … operate. Essential qualifications and experience: • 3+ years' experience in data engineering or a related development role • Proven hands-on experience with Elastic SIEM (Elasticsearch, Logstash, Kibana) • Strong experience working with log formats such as JSON, CEF, Syslog and Avro • Proficiency in designing and optimising data flows in large-scale environments ...