DV Cleared - Data Engineer - ELK & NiFi
Bath, Somerset, UK
Defence
Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi Implement data ingestion, transformation, and integration processes, ensuring data quality and security Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards Manage and monitor large-scale data flows in real-time … for building and managing complex data flows and integration processes. Knowledge of security practices for handling sensitive data, including encryption, anonymization, and access control. Familiarity with data governance, data quality management, and compliance standards in secure environments. Experience in managing large-scale, real-time data pipelines and ensuring their performance and reliability. Strong scripting and programming skills in … on data security and infrastructure as code. Excellent communication skills with the ability to collaborate effectively with cross-functional teams. Detail-oriented with a focus on ensuring data accuracy, quality, and security. Proactive problem-solving mindset and ability to troubleshoot complex data pipeline issues Desirable skills: Experience working in government, defence, or highly regulated industries with knowledge of relevant More ❯
Posted: