Governance concepts and experience. 11. (Desired) Demonstrated experience maintaining, supporting, and improving the ETL process through the implementation and standardization of data flows with ApacheNifi and other ETL tools. 12. (Desired) Demonstrated experience with Apache Spark MUST be a US Citizen with a U.S. Government clearance More ❯
Governance concepts and experience. 11. (Desired) Demonstrated experience maintaining, supporting, and improving the ETL process through the implementation and standardization of data flows with ApacheNifi and other ETL tools. 12. (Desired) Demonstrated experience with Apache Spark B4CORP Company Information B4Corp is a small defense contracting company More ❯
WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as ApacheNifi/RabbitMQ TO BE CONSIDERED.... Please either apply by clicking online or emailing me directly to dominic.barbet@searchability.comFor further information please call … DEVELOPPED VETTING/DEVELOPED VETTED/DEEP VETTING/DEEP VETTED/SC CLEARED/SC CLEARANCE/SECURITY CLEARED/SECURITY CLEARANCE/NIFI/CLOUDERA/HADOOP/KAFKA/ELASTIC SEARCH/LEAD BIG DATA ENGINEER/LEAD BIG DATA DEVELOPER #J-18808-Ljbffr More ❯
NICE FOR THE LEAD BIG DATA ENGINEER TO HAVE... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as ApacheNifi/RabbitMQ TO BE CONSIDERED... Please either apply by clicking online or emailing me directly at dominic.barbet@searchability.com. For further information, please More ❯
Cheltenham, England, United Kingdom Hybrid / WFH Options
Babcock
with frameworks like JUnit or Jest and using Git for version control. Experience with CI/CD tools like GitLab , Jenkins , Concourse , or even ApacheNiFi , Elasticsearch , or Kibana . Agile development experience ( SCRUM , Kanban ). Building software for the cloud (we're especially keen if you know More ❯
essential to accommodate any changes in the schedule. Preferred Requirements A current TS/SCI is preferred. CI Poly is a plus. Experience with NiFi, Kafka, AWS Infrastructure, and K8's. Experience in cloud based technologies (AWS, Azure). Experience in distributed databases, NoSQL databases, full text-search engines More ❯
essential to accommodate any changes in the schedule. Preferred Requirements A current TS/SCI is preferred. CI Poly is a plus. Experience with NiFi, Kafka, AWS Infrastructure, and K8's. Experience in cloud based technologies (AWS, Azure). Experience in distributed databases, NoSQL databases, full text-search engines More ❯
London, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
and other systems. Create deployable data pipelines that are tested and robust using a variety of technologies and techniques depending on the available technologies (Nifi, Spark) Build analytics tools that utilise the data pipeline to provide actionable insights into client requirements, operational efficiency, and other key business performance metrics. More ❯
to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with … Engineer in secure or regulated environments. Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with ApacheNiFi for building and managing complex data flows and integration processes. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience More ❯
to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with … Engineer in secure or regulated environments. Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with ApacheNiFi for building and managing complex data flows and integration processes. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience More ❯
to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with … Engineer in secure or regulated environments. Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with ApacheNiFi for building and managing complex data flows and integration processes. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience More ❯
to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with … Engineer in secure or regulated environments. Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with ApacheNiFi for building and managing complex data flows and integration processes. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience More ❯
to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with … Engineer in secure or regulated environments. Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with ApacheNiFi for building and managing complex data flows and integration processes. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience More ❯
in the use of Linux, Git, MongoDB, and OpenSearch. Exposure to cloud platforms (AWS or Azure), containerisation technologies (Docker, Kubernetes) and data processing solutions (ApacheNiFi). Defence experience. * Please only apply if you have active MOD DV Clearance * Seniority level Entry level Employment type Full-time Job More ❯
NICE FOR THE SENIOR SOFTWARE ENGINEER TO HAVE. Cloud based experience Microservice architecture or server-less architecture Big Data/Messaging technologies such as ApacheNifi/MiNiFi/Kafka TO BE CONSIDERED. Please either apply by clicking online or emailing me directly to For further information please More ❯
NICE FOR THE SENIOR SOFTWARE ENGINEER TO HAVE.... Cloud based experience Microservice architecture or server-less architecture Big Data/Messaging technologies such as ApacheNifi/MiNiFi/Kafka TO BE CONSIDERED.... Please either apply by clicking online or emailing me directly to dominic.barbet@searchability.comFor further information More ❯
Agile (Scrum) methodologies Database experience with Oracle and/or MongoDB Experience using the Atlassian suite : Bitbucket, Jira, and Confluence Desirable Skills Knowledge of ApacheNiFi Front-end development with React (JavaScript/TypeScript) Working knowledge of Elasticsearch and Kibana Experience developing for cloud environments, particularly AWS (EC2 More ❯
degree plus 4 years experience, Associates degree plus 10 years experience, or a minimum of 12 years experience, in relevant field Preferred: AWS CDK ApacheNiFi experience ElasticSearch experience AWS Server Less, SQS/SNS, Lambda, ECS, EC2 NGA imagery and Data Repositories More ❯
provisioning, and use of cloud technologies (i.e. AWS) particularly with application of data science approaches in the cloud. 6. Demonstrated experience deploying and tuning ApacheNiFi or other ETL workflows. 7. Demonstrated experience hosting and managing Structured Query Language (SQL) databases within cloud based relational databases. 8. Demonstrated More ❯
years of relevant experience in software development, ranging from work in a DevOps environment to full stack engineering • Proficiency in the following technologies: • Java • ApacheNiFi workflow configuration and deployment • Databases such as PostgreSQL and MongoDB • Python and machine learning • Docker • Kubernetes • Cloud-like infrastructure • Experience with Jenkins More ❯
network virtualization, and security services. Working understanding of data Extraction, Transformation, and Loading (ETL) techniques and tools such as Azure Data Factory, AWS Glue, ApacheNiFi/CFM, etc. Working understanding of network infrastructure, concepts of operation, and protocols such as TCP/IP, DNS, DHCP, SNMP, Syslog More ❯
City of London, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
with experience covering tasks such as: Data Engineering tasks Manage integrations between data warehouse and other systems. Create deployable data pipelines using technologies like Nifi, Spark. Build analytics tools to provide insights into client requirements and operational metrics. Conduct onsite client visits and provide customer support. Problem-solve pragmatically More ❯
using Jenkins, Cypress testing, GitHub and Jira tools Knowledge and experience with design paradigms such as Microservice architecture, GraphQL, Restful Design and Stream processing (NiFi, Kinesis, etc.) Experience working with SQL Databases (e.g., PostgreSQL, SQL Server) and writing Stored Procedures, Functions and Triggers Experience troubleshooting existing code to resolve More ❯
do as a Solution Architect: • Act as the technical Product Owner, shaping architecture and delivery. • Design and implement scalable, secure solutions using Elasticsearch, RabbitMQ, NiFi, and .NET Core. • Lead DevOps practices with Docker, Jenkins, Bitbucket, and more. • Guide teams through agile delivery, automation, and deployment pipelines. Your necessary toolkit … as a Solution Architect: • Elasticsearch Stack, Kibana, RabbitMQ, ApacheNiFi • ASP.NET Core, C#, SQL Server, JavaScript (jQuery, Bootstrap) • DevOps: Docker, Jenkins, SonarQube, Nexus, AWX • Secure cloud hosting, VMware, Linux (RHEL/CentOS), Windows Server • Networking, DNS, Active Directory, High Availability systems • Advantage: Kubernetes, SIEM tools, Central Government experience More ❯