to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the ElasticStack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure … and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana to enable data-driven decision-making. Ensure high availability and disaster recovery for data systems, implementing appropriate backup and replication strategies. Document data architecture, workflows … audit readiness. Experience required: Experience working as a Data Engineer in secure or regulated environments. Expertise in the ElasticStack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with Apache NiFi for building and managing complex data flows and integration processes. Familiarity with More ❯
Wakefield, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
complex, large-scale data pipelines in secure or regulated environments Ingest, process, index, and visualise data using the ElasticStack (Elasticsearch, Logstash, Kibana) Build and maintain robust data flows with Apache NiFi Implement best practices for handling sensitive data, including encryption, anonymisation, and access control Monitor and … 3+ years’ experience as a Data Engineer in secure, regulated, or mission-critical environments Proven expertise with the ElasticStack (Elasticsearch, Logstash, Kibana) Solid experience with Apache NiFi Strong understanding of data security, governance, and compliance requirements Working knowledge of cloud platforms (AWS, Azure, or GCP), particularly More ❯
York, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
complex, large-scale data pipelines in secure or regulated environments Ingest, process, index, and visualise data using the ElasticStack (Elasticsearch, Logstash, Kibana) Build and maintain robust data flows with Apache NiFi Implement best practices for handling sensitive data, including encryption, anonymisation, and access control Monitor and … 3+ years’ experience as a Data Engineer in secure, regulated, or mission-critical environments Proven expertise with the ElasticStack (Elasticsearch, Logstash, Kibana) Solid experience with Apache NiFi Strong understanding of data security, governance, and compliance requirements Working knowledge of cloud platforms (AWS, Azure, or GCP), particularly More ❯
Stockport, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
complex, large-scale data pipelines in secure or regulated environments Ingest, process, index, and visualise data using the ElasticStack (Elasticsearch, Logstash, Kibana) Build and maintain robust data flows with Apache NiFi Implement best practices for handling sensitive data, including encryption, anonymisation, and access control Monitor and … 3+ years’ experience as a Data Engineer in secure, regulated, or mission-critical environments Proven expertise with the ElasticStack (Elasticsearch, Logstash, Kibana) Solid experience with Apache NiFi Strong understanding of data security, governance, and compliance requirements Working knowledge of cloud platforms (AWS, Azure, or GCP), particularly More ❯
Liverpool, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
complex, large-scale data pipelines in secure or regulated environments Ingest, process, index, and visualise data using the ElasticStack (Elasticsearch, Logstash, Kibana) Build and maintain robust data flows with Apache NiFi Implement best practices for handling sensitive data, including encryption, anonymisation, and access control Monitor and … 3+ years’ experience as a Data Engineer in secure, regulated, or mission-critical environments Proven expertise with the ElasticStack (Elasticsearch, Logstash, Kibana) Solid experience with Apache NiFi Strong understanding of data security, governance, and compliance requirements Working knowledge of cloud platforms (AWS, Azure, or GCP), particularly More ❯
Chester, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
complex, large-scale data pipelines in secure or regulated environments Ingest, process, index, and visualise data using the ElasticStack (Elasticsearch, Logstash, Kibana) Build and maintain robust data flows with Apache NiFi Implement best practices for handling sensitive data, including encryption, anonymisation, and access control Monitor and … 3+ years’ experience as a Data Engineer in secure, regulated, or mission-critical environments Proven expertise with the ElasticStack (Elasticsearch, Logstash, Kibana) Solid experience with Apache NiFi Strong understanding of data security, governance, and compliance requirements Working knowledge of cloud platforms (AWS, Azure, or GCP), particularly More ❯
Doncaster, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
complex, large-scale data pipelines in secure or regulated environments Ingest, process, index, and visualise data using the ElasticStack (Elasticsearch, Logstash, Kibana) Build and maintain robust data flows with Apache NiFi Implement best practices for handling sensitive data, including encryption, anonymisation, and access control Monitor and … 3+ years’ experience as a Data Engineer in secure, regulated, or mission-critical environments Proven expertise with the ElasticStack (Elasticsearch, Logstash, Kibana) Solid experience with Apache NiFi Strong understanding of data security, governance, and compliance requirements Working knowledge of cloud platforms (AWS, Azure, or GCP), particularly More ❯
Bolton, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
complex, large-scale data pipelines in secure or regulated environments Ingest, process, index, and visualise data using the ElasticStack (Elasticsearch, Logstash, Kibana) Build and maintain robust data flows with Apache NiFi Implement best practices for handling sensitive data, including encryption, anonymisation, and access control Monitor and … 3+ years’ experience as a Data Engineer in secure, regulated, or mission-critical environments Proven expertise with the ElasticStack (Elasticsearch, Logstash, Kibana) Solid experience with Apache NiFi Strong understanding of data security, governance, and compliance requirements Working knowledge of cloud platforms (AWS, Azure, or GCP), particularly More ❯
pipelines. Database Engineering : Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELKstack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data storage models for unified access and processing. Data Governance & Stewardship: Implement … Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow diagrams , and operational procedures . Continuously evaluate and improve the data engineering stack by adopting new technologies and automation strategies. Required Skills & Qualifications: 8+ years of experience in data engineering within a production environment. Advanced knowledge of … Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with ELKstack (Elasticsearch, Logstash, Kibana) for scalable search and logging. Familiarity with AI models supporting data management. Experience working with Lakehouse systems , data denormalization , and data labeling practices. Preferred More ❯
pipelines. Database Engineering : Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELKstack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data storage models for unified access and processing. Data Governance & Stewardship: Implement … Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow diagrams , and operational procedures . Continuously evaluate and improve the data engineering stack by adopting new technologies and automation strategies. Required Skills & Qualifications: 8+ years of experience in data engineering within a production environment. Advanced knowledge of … Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with ELKstack (Elasticsearch, Logstash, Kibana) for scalable search and logging. Familiarity with AI models supporting data management. Experience working with Lakehouse systems , data denormalization , and data labeling practices. Preferred More ❯
pipelines. Database Engineering : Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELKstack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data storage models for unified access and processing. Data Governance & Stewardship: Implement … Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow diagrams , and operational procedures . Continuously evaluate and improve the data engineering stack by adopting new technologies and automation strategies. Required Skills & Qualifications: 8+ years of experience in data engineering within a production environment. Advanced knowledge of … Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with ELKstack (Elasticsearch, Logstash, Kibana) for scalable search and logging. Familiarity with AI models supporting data management. Experience working with Lakehouse systems , data denormalization , and data labeling practices. Preferred More ❯
pipelines. Database Engineering : Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELKstack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data storage models for unified access and processing. Data Governance & Stewardship: Implement … Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow diagrams , and operational procedures . Continuously evaluate and improve the data engineering stack by adopting new technologies and automation strategies. Required Skills & Qualifications: 8+ years of experience in data engineering within a production environment. Advanced knowledge of … Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with ELKstack (Elasticsearch, Logstash, Kibana) for scalable search and logging. Familiarity with AI models supporting data management. Experience working with Lakehouse systems , data denormalization , and data labeling practices. Preferred More ❯
pipelines. Database Engineering : Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELKstack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data storage models for unified access and processing. Data Governance & Stewardship: Implement … Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow diagrams , and operational procedures . Continuously evaluate and improve the data engineering stack by adopting new technologies and automation strategies. Required Skills & Qualifications: 8+ years of experience in data engineering within a production environment. Advanced knowledge of … Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with ELKstack (Elasticsearch, Logstash, Kibana) for scalable search and logging. Familiarity with AI models supporting data management. Experience working with Lakehouse systems , data denormalization , and data labeling practices. Preferred More ❯
pipelines. Database Engineering : Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELKstack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data storage models for unified access and processing. Data Governance & Stewardship: Implement … Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow diagrams , and operational procedures . Continuously evaluate and improve the data engineering stack by adopting new technologies and automation strategies. Required Skills & Qualifications: 8+ years of experience in data engineering within a production environment. Advanced knowledge of … Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with ELKstack (Elasticsearch, Logstash, Kibana) for scalable search and logging. Familiarity with AI models supporting data management. Experience working with Lakehouse systems , data denormalization , and data labeling practices. Preferred More ❯
pipelines. Database Engineering : Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELKstack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data storage models for unified access and processing. Data Governance & Stewardship: Implement … Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow diagrams , and operational procedures . Continuously evaluate and improve the data engineering stack by adopting new technologies and automation strategies. Required Skills & Qualifications: 8+ years of experience in data engineering within a production environment. Advanced knowledge of … Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with ELKstack (Elasticsearch, Logstash, Kibana) for scalable search and logging. Familiarity with AI models supporting data management. Experience working with Lakehouse systems , data denormalization , and data labeling practices. Preferred More ❯
pipelines. Database Engineering : Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELKstack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data storage models for unified access and processing. Data Governance & Stewardship: Implement … Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow diagrams , and operational procedures . Continuously evaluate and improve the data engineering stack by adopting new technologies and automation strategies. Required Skills & Qualifications: 8+ years of experience in data engineering within a production environment. Advanced knowledge of … Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with ELKstack (Elasticsearch, Logstash, Kibana) for scalable search and logging. Familiarity with AI models supporting data management. Experience working with Lakehouse systems , data denormalization , and data labeling practices. Preferred More ❯
pipelines. Database Engineering : Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELKstack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data storage models for unified access and processing. Data Governance & Stewardship: Implement … Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow diagrams , and operational procedures . Continuously evaluate and improve the data engineering stack by adopting new technologies and automation strategies. Required Skills & Qualifications: 8+ years of experience in data engineering within a production environment. Advanced knowledge of … Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with ELKstack (Elasticsearch, Logstash, Kibana) for scalable search and logging. Familiarity with AI models supporting data management. Experience working with Lakehouse systems , data denormalization , and data labeling practices. Preferred More ❯
pipelines. Database Engineering : Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELKstack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data storage models for unified access and processing. Data Governance & Stewardship: Implement … Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow diagrams , and operational procedures . Continuously evaluate and improve the data engineering stack by adopting new technologies and automation strategies. Required Skills & Qualifications: 8+ years of experience in data engineering within a production environment. Advanced knowledge of … Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with ELKstack (Elasticsearch, Logstash, Kibana) for scalable search and logging. Familiarity with AI models supporting data management. Experience working with Lakehouse systems , data denormalization , and data labeling practices. Preferred More ❯
pipelines. Database Engineering : Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELKstack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data storage models for unified access and processing. Data Governance & Stewardship: Implement … Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow diagrams , and operational procedures . Continuously evaluate and improve the data engineering stack by adopting new technologies and automation strategies. Required Skills & Qualifications: 8+ years of experience in data engineering within a production environment. Advanced knowledge of … Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with ELKstack (Elasticsearch, Logstash, Kibana) for scalable search and logging. Familiarity with AI models supporting data management. Experience working with Lakehouse systems , data denormalization , and data labeling practices. Preferred More ❯
pipelines. Database Engineering : Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELKstack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data storage models for unified access and processing. Data Governance & Stewardship: Implement … Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow diagrams , and operational procedures . Continuously evaluate and improve the data engineering stack by adopting new technologies and automation strategies. Required Skills & Qualifications: 8+ years of experience in data engineering within a production environment. Advanced knowledge of … Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with ELKstack (Elasticsearch, Logstash, Kibana) for scalable search and logging. Familiarity with AI models supporting data management. Experience working with Lakehouse systems , data denormalization , and data labeling practices. Preferred More ❯
in Knutsford. The ELK Development Lead will be responsible for overseeing and guiding the development team in the design, implementation, and maintenance of ELK (Elasticsearch, Logstash, Kibana) stacks. Daily tasks will include developing and optimizing ELK solutions, ensuring system performance, troubleshooting issues, and collaborating with other teams to integrate ELK … will be responsible for mentoring junior developers and ensuring adherence to best practices and industry standards. Qualifications Proficiency in ELKstack (Elasticsearch, Logstash, Kibana) Experience in system architecture, performance tuning, and troubleshooting Strong skills in scripting languages such as Python or Shell scripting Knowledge of data serialization formats More ❯
Bradford, Yorkshire, United Kingdom Hybrid / WFH Options
Freemans Grattan Holdings (fgh)
improve page load times, identify, diagnose and resolve issues and enhance customer experience. Enhancing system observability through logging, monitoring, and alerting (Elastic Search, Logstash, Kibana, New Relic, PRTG, ScienceLogic etc). Implementing and managing caching solutions, including Squid Cache, to optimise performance and reduce latency. Collaborating with software architects More ❯
Manchester, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
preferred). Maintain configuration management using tools like Ansible, Chef, or Puppet. Monitor application performance, uptime, and logs using tools like Splunk, ELKStack, or Prometheus/Grafana. Work with cloud platforms (Azure preferred, AWS or GCP a plus) to ensure scalable and secure environments. Ensure compliance with More ❯
York, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
preferred). Maintain configuration management using tools like Ansible, Chef, or Puppet. Monitor application performance, uptime, and logs using tools like Splunk, ELKStack, or Prometheus/Grafana. Work with cloud platforms (Azure preferred, AWS or GCP a plus) to ensure scalable and secure environments. Ensure compliance with More ❯
Bradford, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
preferred). Maintain configuration management using tools like Ansible, Chef, or Puppet. Monitor application performance, uptime, and logs using tools like Splunk, ELKStack, or Prometheus/Grafana. Work with cloud platforms (Azure preferred, AWS or GCP a plus) to ensure scalable and secure environments. Ensure compliance with More ❯