Senior Data and Security Engineer
- Hiring Organisation
- Hackajob Ltd
- Location
- Bristol, South West, United Kingdom
- Employment Type
- Permanent Contract, Remote
extractions mapped to OCSF, ensuring fast query performance and portable detection logic. Troubleshooting Pipeline Bottlenecks: Diagnose and resolve systemic transport failure modes: SQS/S3 ingestion lag, universal forwarder dropouts, unparsed JSON structures, Cribl pipeline backpressure, and source type schema mismatches. Advanced Log Management: Optimise log sources by summarising … deduplicating identical logs, and pre-parsing complex regex strings. Storage Architecture: Manage real-time streaming technologies (e.g., Kinesis) and security data storage solutions including S3 buckets and Amazon Security Lake. Data Tiering: Support the classification of data into appropriate storage tiers—Hot (security events), Warm (application ...