1 to 25 of 37 Permanent logstash Jobs in the UK excluding London

ensure scalability, resilience, and observability of data pipelines. Database Engineering: Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELK stack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data storage models for unified access and processing. Data Governance & Stewardship: Implement robust data governance , access control … Apache Kafka . Proficiency with Docker and Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with ELK stack (Elasticsearch, Logstash, Kibana) for scalable search and logging. Familiarity with AI models supporting data management. Experience working with Lakehouse systems , data denormalization , and data labeling practices. Preferred Qualifications: Working knowledge of data More ❯

ensure scalability, resilience, and observability of data pipelines. Database Engineering: Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELK stack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data storage models for unified access and processing. Data Governance & Stewardship: Implement robust data governance , access control … Apache Kafka . Proficiency with Docker and Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with ELK stack (Elasticsearch, Logstash, Kibana) for scalable search and logging. Familiarity with AI models supporting data management. Experience working with Lakehouse systems , data denormalization , and data labeling practices. Preferred Qualifications: Working knowledge of data More ❯

ensure scalability, resilience, and observability of data pipelines. Database Engineering: Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELK stack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data storage models for unified access and processing. Data Governance & Stewardship: Implement robust data governance , access control … Apache Kafka . Proficiency with Docker and Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with ELK stack (Elasticsearch, Logstash, Kibana) for scalable search and logging. Familiarity with AI models supporting data management. Experience working with Lakehouse systems , data denormalization , and data labeling practices. Preferred Qualifications: Working knowledge of data More ❯

the most challenging, exciting and critical challenges to the UK’s digital landscape. This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring compliance with strict security standards and regulations. This is a UK based onsite … role with the option of compressed hours. The role will include: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage … Essential: UK DV Clearance or the ability obtain it 3+ years of experience working as a Data Engineer in secure or regulated environments. Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with Apache NiFi for building and managing complex data flows and integration processes. Knowledge of security practices for handling sensitive More ❯

the most challenging, exciting, and critical challenges to the UK’s digital landscape. This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring compliance with strict security standards and regulations. This is a UK-based onsite … role with the option of compressed hours. The role will include: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage … UK DV Clearance or the ability to obtain it 3+ years of experience working as a Data Engineer in secure or regulated environments Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization Strong experience with Apache NiFi for building and managing complex data flows and integration processes Knowledge of security practices for handling sensitive More ❯

ensure scalability, resilience, and observability of data pipelines. Database Engineering : Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELK stack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data storage models for unified access and processing. Data Governance & Stewardship: Implement robust data governance , access control … Apache Kafka . Proficiency with Docker and Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with ELK stack (Elasticsearch, Logstash, Kibana) for scalable search and logging. Familiarity with AI models supporting data management. Experience working with Lakehouse systems , data denormalization , and data labeling practices. Preferred Qualifications: Working knowledge of data More ❯

ensure scalability, resilience, and observability of data pipelines. Database Engineering : Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELK stack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data storage models for unified access and processing. Data Governance & Stewardship: Implement robust data governance , access control … Apache Kafka . Proficiency with Docker and Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with ELK stack (Elasticsearch, Logstash, Kibana) for scalable search and logging. Familiarity with AI models supporting data management. Experience working with Lakehouse systems , data denormalization , and data labeling practices. Preferred Qualifications: Working knowledge of data More ❯

ensure scalability, resilience, and observability of data pipelines. Database Engineering : Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELK stack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data storage models for unified access and processing. Data Governance & Stewardship: Implement robust data governance , access control … Apache Kafka . Proficiency with Docker and Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with ELK stack (Elasticsearch, Logstash, Kibana) for scalable search and logging. Familiarity with AI models supporting data management. Experience working with Lakehouse systems , data denormalization , and data labeling practices. Preferred Qualifications: Working knowledge of data More ❯

and container orchestration, automating deployment, scaling, and management of containerized applications. Implement best practices for Kubernetes configuration and security. Work with log Collection Tools and Technologies (Beats, Elastic Agent, Logstash), syslog and other data collection protocols. DevOps/SysOps Engineering collaborating with cross-functional teams (development, operations, and QA) to streamline software delivery and automating deployment pipelines using CI/ More ❯

applications. Implement best practices for Kubernetes configuration and security. Configuration, deployment and maintenance of Elastic Stack on Kubernetes (ECK) Work with log Collection Tools and Technologies (Beats, Elastic Agent, Logstash), syslog and other data collection protocols DevOps/SysOps Engineering collaborating with cross-functional teams (development, operations, and QA) to streamline software delivery and automating deployment pipelines using CI/ More ❯

Instana, Splunk, Honeycomb, Jaeger Hands-on experience with Infrastructure as a Code (Terraform/Ansible) Hands-on experience in technical integrations (OpenTelemetry/fluentd/fluentbit/filebeat/logstash) Hands-on experience with complex troubleshooting of Kubernetes and Docker container Good knowledge of Regex, Lucene, PromQL Good knowledge of Linux Experience in customer facing positions and excellent high energy More ❯

Instana, Splunk, Honeycomb, Jaeger Hands-on experience with Infrastructure as a Code (Terraform/Ansible) Hands-on experience in technical integrations (OpenTelemetry/fluentd/fluentbit/filebeat/logstash) Hands-on experience with complex troubleshooting of Kubernetes and Docker container Good knowledge of Regex, Lucene, PromQL Good knowledge of Linux Experience in customer facing positions and excellent high energy More ❯

Instana, Splunk, Honeycomb, Jaeger Hands-on experience with Infrastructure as a Code (Terraform/Ansible) Hands-on experience in technical integrations (OpenTelemetry/fluentd/fluentbit/filebeat/logstash) Hands-on experience with complex troubleshooting of Kubernetes and Docker container Good knowledge of Regex, Lucene, PromQL Good knowledge of Linux Experience in customer facing positions and excellent high energy More ❯

DV Clearance , Key Responsibilities: Design, develop, and manage complex, large-scale data pipelines in secure or regulated environments Ingest, process, index, and visualise data using the Elastic Stack (Elasticsearch, Logstash, Kibana) Build and maintain robust data flows with Apache NiFi Implement best practices for handling sensitive data, including encryption, anonymisation, and access control Monitor and troubleshoot real-time data pipelines … technical and operational requirements Essential Skills and Experience: 3+ years’ experience as a Data Engineer in secure, regulated, or mission-critical environments Proven expertise with the Elastic Stack (Elasticsearch, Logstash, Kibana) Solid experience with Apache NiFi Strong understanding of data security, governance, and compliance requirements Experience building real-time, large-scale data pipelines Working knowledge of cloud platforms (AWS, Azure More ❯

DV Clearance , Key Responsibilities: Design, develop, and manage complex, large-scale data pipelines in secure or regulated environments Ingest, process, index, and visualise data using the Elastic Stack (Elasticsearch, Logstash, Kibana) Build and maintain robust data flows with Apache NiFi Implement best practices for handling sensitive data, including encryption, anonymisation, and access control Monitor and troubleshoot real-time data pipelines … technical and operational requirements Essential Skills and Experience: 3+ years’ experience as a Data Engineer in secure, regulated, or mission-critical environments Proven expertise with the Elastic Stack (Elasticsearch, Logstash, Kibana) Solid experience with Apache NiFi Strong understanding of data security, governance, and compliance requirements Experience building real-time, large-scale data pipelines Working knowledge of cloud platforms (AWS, Azure More ❯

DV Clearance , Key Responsibilities: Design, develop, and manage complex, large-scale data pipelines in secure or regulated environments Ingest, process, index, and visualise data using the Elastic Stack (Elasticsearch, Logstash, Kibana) Build and maintain robust data flows with Apache NiFi Implement best practices for handling sensitive data, including encryption, anonymisation, and access control Monitor and troubleshoot real-time data pipelines … technical and operational requirements Essential Skills and Experience: 3+ years’ experience as a Data Engineer in secure, regulated, or mission-critical environments Proven expertise with the Elastic Stack (Elasticsearch, Logstash, Kibana) Solid experience with Apache NiFi Strong understanding of data security, governance, and compliance requirements Experience building real-time, large-scale data pipelines Working knowledge of cloud platforms (AWS, Azure More ❯

DV Clearance , Key Responsibilities: Design, develop, and manage complex, large-scale data pipelines in secure or regulated environments Ingest, process, index, and visualise data using the Elastic Stack (Elasticsearch, Logstash, Kibana) Build and maintain robust data flows with Apache NiFi Implement best practices for handling sensitive data, including encryption, anonymisation, and access control Monitor and troubleshoot real-time data pipelines … technical and operational requirements Essential Skills and Experience: 3+ years’ experience as a Data Engineer in secure, regulated, or mission-critical environments Proven expertise with the Elastic Stack (Elasticsearch, Logstash, Kibana) Solid experience with Apache NiFi Strong understanding of data security, governance, and compliance requirements Working knowledge of cloud platforms (AWS, Azure, or GCP), particularly in secure deployments Experience using More ❯

others. Implement load balancing and CDN solutions using multiple cloud vendors (e.g., Azure Load Balancer and Application Gateway). Support the installation and maintenance of a logging cluster using Logstash, ElasticSearch, and Kibana. Perform initial analysis on incidents and escalate issues to the appropriate support level when necessary. Manage Application ID and provide cloud elasticity by auto-scaling resources based More ❯

Frontend Frameworks: Vue.js Scripting & Automation: Bash, Ansible DevOps & CI/CD: Jenkins, GitLab CI/CD, Terraform Cloud & Infrastructure: AWS Testing & Quality: Cucumber, SonarQube Monitoring & Logging: ELK Stack (Elasticsearch, Logstash, Kibana), Grafana Dataflow & Integration: Apache NiFi Experience across multiple areas is desirable; we don't expect you to know everything but a willingness to learn and contribute across the stack More ❯

Automation: Proficiency in Python, and bash shell for automation. •Problem-Solving: Strong troubleshooting skills for diagnosing monitoring and performance issues. Additional Skills: • Knowledge of Prometheus, Grafana, or ELK (Elasticsearch, Logstash, Kibana). • Experience with Kafka and Kubernetes. #J-18808-Ljbffr More ❯

Rule Development: Ability to create, test, and optimise detection rules to identify suspicious activities and potential threats based on the MITRE ATT&CK Framework Performance Tuning with Elasticsearch and Logstash: Fine-tune query performance using Elasticsearch indices and mappings. Monitor Logstash pipelines and optimize resource utilization. Kibana Visualization and Monitoring: Leverage Kibana for data visualization, dashboards, and real-time monitoring. … Create custom visualizations to track data quality metrics and system performance. Elastic integration Integration of the SIEM with critical systems to provide alerting, monitoring, data enrichment. ETL Processes with Logstash: Design, develop, and maintain data pipelines using Logstash, part of the Elastic Stack. Automate data ingestion, transformation, and loading tasks. Beats for Data Collection: Agent and Agent Policy Management: Proficiency More ❯

performance monitoring and optimisation strategies to improve page load times, identify, diagnose and resolve issues and enhance customer experience. Enhancing system observability through logging, monitoring, and alerting (Elastic Search, Logstash, Kibana, New Relic, PRTG, ScienceLogic etc). Implementing and managing caching solutions, including Squid Cache, to optimise performance and reduce latency. Collaborating with software architects, engineers QA teams and digital More ❯

the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and … security protocols to ensure smooth operational handover and audit readiness. Experience required: Experience working as a Data Engineer in secure or regulated environments. Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with Apache NiFi for building and managing complex data flows and integration processes. Familiarity with containerization and orchestration tools such More ❯

the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and … security protocols to ensure smooth operational handover and audit readiness. Experience required: Experience working as a Data Engineer in secure or regulated environments. Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with Apache NiFi for building and managing complex data flows and integration processes. Familiarity with containerization and orchestration tools such More ❯

the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and … security protocols to ensure smooth operational handover and audit readiness. Experience required: Experience working as a Data Engineer in secure or regulated environments. Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with Apache NiFi for building and managing complex data flows and integration processes. Familiarity with containerization and orchestration tools such More ❯