must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance … Experience working as a Data Engineer in secure or regulated environments. Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with ApacheNiFi for building and managing complex data flows and integration processes. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with monitoring and alerting tools More ❯
must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance … Experience working as a Data Engineer in secure or regulated environments. Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with ApacheNiFi for building and managing complex data flows and integration processes. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with monitoring and alerting tools More ❯
must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance … Experience working as a Data Engineer in secure or regulated environments. Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with ApacheNiFi for building and managing complex data flows and integration processes. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with monitoring and alerting tools More ❯
must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance … Experience working as a Data Engineer in secure or regulated environments. Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with ApacheNiFi for building and managing complex data flows and integration processes. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with monitoring and alerting tools More ❯
months Key Skills: Proficient in the use of Linux, Git, MongoDB, and OpenSearch. Exposure to cloud platforms (AWS or Azure), containerisation technologies (Docker, Kubernetes) and data processing solutions (ApacheNiFi). Defence experience. * Please only apply if you have active MOD DV Clearance * Seniority level Entry level Employment type Full-time Job function Information Technology Industries Technology, Information More ❯
Manchester, England, United Kingdom Hybrid / WFH Options
Gaming Innovation Group
You're really awesome at: Object-oriented programming (Java) Data modeling using various database technologies ETL processes (transferring data in-memory, moving away from traditional ETLs) and experience with Apache Spark or ApacheNiFi Applied understanding of CI/CD in change management Dockerized applications Using distributed version control systems Being an excellent team player Meticulous and More ❯
Newcastle upon Tyne, England, United Kingdom Hybrid / WFH Options
Gaming Innovation Group
Platform. You're really awesome at: Object oriented programming (Java) Data modelling using any database technologies ETL processes (ETLs are oldschool, we transfer in memory now) and experience with Apache Spark or ApacheNiFi Applied understanding of CI\CD in change management Dockerised applications Used distributed version control systems Excellent team player Meticulous and passionate about your More ❯
of automation IT WOULD BE NICE FOR THE SENIOR SOFTWARE ENGINEER TO HAVE. Cloud based experience Microservice architecture or server-less architecture Big Data/Messaging technologies such as ApacheNifi/MiNiFi/Kafka TO BE CONSIDERED. Please either apply by clicking online or emailing me directly to For further information please call me on More ❯
of automation IT WOULD BE NICE FOR THE SENIOR SOFTWARE ENGINEER TO HAVE.... Cloud based experience Microservice architecture or server-less architecture Big Data/Messaging technologies such as ApacheNifi/MiNiFi/Kafka TO BE CONSIDERED.... Please either apply by clicking online or emailing me directly to dominic.barbet@searchability.comFor further information please call me on More ❯
pipelines Hands-on experience with Agile (Scrum) methodologies Database experience with Oracle and/or MongoDB Experience using the Atlassian suite : Bitbucket, Jira, and Confluence Desirable Skills Knowledge of ApacheNiFi Front-end development with React (JavaScript/TypeScript) Working knowledge of Elasticsearch and Kibana Experience developing for cloud environments, particularly AWS (EC2, EKS, Fargate, IAM, S3, Lambda More ❯
Bristol, England, United Kingdom Hybrid / WFH Options
Ripjar
python (specifically pyspark) and Node.js for processing data, backed by various Hadoop stack technologies such as HDFS and HBase. MongoDB and Elasticsearch are used for indexing smaller datasets. Airflow & Nifi are used to co-ordinate the processing of data, while Jenkins, Jira, Confluence and Github are used as support tools. We use ansible to manage configuration and deployments. Most … processing data You will be using Hadoop stack technologies such as HDFS and HBase Experience using MongoDB and Elasticsearch for indexing smaller datasets would be beneficial Experience using Airflow & Nifi to co-ordinate the processing of data would be beneficial You will be using Ansible to manage configuration and deployments Salary And Benefits Salary DOE 25 days annual leave More ❯
London, England, United Kingdom Hybrid / WFH Options
Ripjar
python (specifically pyspark) and Node.js for processing data, backed by various Hadoop stack technologies such as HDFS and HBase. MongoDB and Elasticsearch are used for indexing smaller datasets. Airflow & Nifi are used to co-ordinate the processing of data, while Jenkins, Jira, Confluence and Github are used as support tools. We use ansible to manage configuration and deployments. Most … processing data You will be using Hadoop stack technologies such as HDFS and HBase Experience using MongoDB and Elasticsearch for indexing smaller datasets would be beneficial Experience using Airflow & Nifi to co-ordinate the processing of data would be beneficial You will be using Ansible to manage configuration and deployments Salary And Benefits Salary DOE 25 days annual leave More ❯
understanding of TCP/IP and OSI models in the design and troubleshooting of networked systems. Data Pipeline Support: Manage and optimize data pipelines and orchestration tools such as NiFi and Airflow. Scalable System Design: Design scalable big data systems with a focus on security, GDPR compliance, and privacy Hybrid Cloud Management: Leverage hybrid cloud experience to manage on … ensuring seamless tool integration. In-depth knowledge of Linux internals and system administration. Understanding of TCP/IP and OSI models. Hands-on experience with data pipeline tools like NiFi and Airflow. Proven ability to design scalable big data systems with a focus on security and GDPR compliance. Hybrid cloud experience, specifically with on-premise and AWS cloud environments. More ❯
City of London, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
Data Engineering and Data Science, with experience covering tasks such as: Data Engineering tasks Manage integrations between data warehouse and other systems. Create deployable data pipelines using technologies like Nifi, Spark. Build analytics tools to provide insights into client requirements and operational metrics. Conduct onsite client visits and provide customer support. Problem-solve pragmatically, offering technical support and agile More ❯
Social network you want to login/join with: National Security Business Be part of a growing and highly trusted supplier into the NS domain working to deliver mission critical solutions helping to keep the nation safe, secure and prosperous. More ❯
CD pipelines. What you’ll do as a Solution Architect: • Act as the technical Product Owner, shaping architecture and delivery. • Design and implement scalable, secure solutions using Elasticsearch, RabbitMQ, NiFi, and .NET Core. • Lead DevOps practices with Docker, Jenkins, Bitbucket, and more. • Guide teams through agile delivery, automation, and deployment pipelines. Your necessary toolkit as a Solution Architect: • Elasticsearch … Stack, Kibana, RabbitMQ, ApacheNiFi • ASP.NET Core, C#, SQL Server, JavaScript (jQuery, Bootstrap) • DevOps: Docker, Jenkins, SonarQube, Nexus, AWX • Secure cloud hosting, VMware, Linux (RHEL/CentOS), Windows Server • Networking, DNS, Active Directory, High Availability systems • Advantage: Kubernetes, SIEM tools, Central Government experience Ready to architect the future of secure digital services? Apply now and bring your expertise More ❯
automation IT WOULD BE NICE FOR THE SENIOR SOFTWARE ENGINEER TO HAVE . Cloud based experience Microservice architecture or server-less architecture Big Data/Messaging technologies such as ApacheNifi/MiNiFi/Kafka TO BE CONSIDERED . Please either apply by clicking online or emailing me directly to For further information please call me on or More ❯
Gloucester, Gloucestershire, South West, United Kingdom Hybrid / WFH Options
Omega Resource Group
GitLab) Contributing across the software development lifecycle from requirements to deployment Tech Stack Includes: Java, Python, Linux, Git, JUnit, GitLab CI/CD, Oracle, MongoDB, JavaScript/TypeScript, React, ApacheNiFi, Elasticsearch, Kibana, AWS, Hibernate, Atlassian Suite What's on Offer: Hybrid working and flexible schedules (4xFlex) Ongoing training and career development Exciting projects within the UK's More ❯
suck as Splunk/ELK stack Ability to pro-actively manage own tasking and react to higher priority tasks Experience of Linux server administration Experience in technologies such as ApacheNiFi, MinIO/AWS S3 Experience managing and patching Java and Python applications Experience with containerisation technologies such as Docker/Podman and deployment technologies such Kubernetes/ More ❯
Scala Hands-on experience with Microsoft Fabric and familiarity with tools like Synapse, Spark, and Kafka Good knowledge of data integration/ETL platforms such as Talend, Informatica, or NiFi An analytical mindset with the ability to interpret large, complex datasets Previous experience in a collaborative, data-driven team Bonus Points For: Experience working with D365 F&O Background More ❯
with experience writing technical documentation Comfortable working with Agile, TOGAF, or similar frameworks Desirable Experience with Python and data libraries (Pandas, Scikit-learn) Knowledge of ETL tools (Airflow, Talend, NiFi) Familiarity with analytics platforms (SAS, Posit) Prior work in high-performance or large-scale data environments Why Join? This is more than a job, it's an opportunity to More ❯
Snowflake, Elastic, Redshift, Data Bricks, Splunk, etc.). Strong and demonstrable experience writing regular expressions and/or JSON parsing, etc. Strong experience in log processing (Cribl, Splunk, Elastic, ApacheNiFi etc.). Expertise in the production of dashboard/insight delivery. Be able to demonstrate a reasonable level of security awareness (An understanding of basic security best More ❯
data-driven performance analysis and optimization Strong communication skills and ability to work in a team Strong analytical and problem-solving skills PREFERRED QUALIFICATIONS Experience with Kubernetes deployment architectures ApacheNiFi experience Experience building trading controls within an investment bank ABOUT GOLDMAN SACHS At Goldman Sachs, we commit our people, capital, and ideas to help our clients, shareholders More ❯
driven performance analysis and optimizations. Strong communication skills and the ability to work in a team. Strong analytical and problem-solving skills. PREFERRED QUALIFICATIONS Experience with Kubernetes deployment architectures ApacheNiFi experience Experience building trading controls within an investment bank ABOUT GOLDMAN SACHS At Goldman Sachs, we commit our people, capital and ideas to help our clients, shareholders More ❯
physical), metadata management, and master data management (MDM). Deep understanding of data integration, transformation, and ingestion techniques using modern tools (e.g., Azure Data Factory, Boomi, Informatica, Talend, dbt, ApacheNiFi). Strong familiarity with data warehousing, data lake/lakehouse architectures, and cloud-native analytics platforms. Hands-on experience with SQL and cloud data platforms (e.g., Snowflake More ❯