1 to 25 of 47 Remote Permanent Apache NiFi Jobs

hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe … complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse sources, maintaining data integrity. Maintain … maintain optimal operation. The Data Engineer Should Have: Active eDV clearance (West) Willingness to work full time on site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply by clicking online More ❯

as Spring Boot and Quarkus Experience with Python, C++ Experience with Docker, AWS and/or Azure, and Kubernetes for containerization, cloud services, and orchestration Hands-on experience with Apache Kafka, Apache NiFi Experience developing software interfaces for Link 16 and JREAP-C messages Experience developing applications that interface with multiple message types, such as xml, and … tackling complex problems, and continuously learning and adopting new technologies MUST live within 1 hour of Colorado Springs, CO. Relocation assistance will not be offered. Desired Qualifications: Experience with Apache Artimis, ActiveMQ, or other IoT message brokers Experience developing software solutions for DoD accredited systems Experience developing software for communication systems Working knowledge of MIL-STD-6016 and MIL More ❯

data prep and labeling to enable data analytics. Familiarity with various log formats such as JSON, XML, and others. Experience with data flow, management, and storage solutions (i.e. Kafka, NiFi, and AWS S3 and SQS solutions) Ability to decompose technical problems and troubleshoot both system and dataflow issues. Must be certified DoD IAT II or higher Willingness to do … with Java, including unit and integration testing. Python: Experience with Python is desired. SQL: Familiarity with SQL schemas and statements. Tools and Technologies: Data Flow Solutions: Experience with Kafka, NiFi, AWS S3, and SQS. Version Control and Build Tools: Proficiency with Maven and GitLab. Data Formats: Familiarity with JSON, XML, SQL, and compressed file formats. Configuration Files: Experience using … YAML files for data model and schema configuration. Apache NiFi: Significant experience with NiFi administrationand building/troubleshooting data flows. AWS S3: bucket administration. IDE: VSCode, Intellij/Pycharm, or other suitable Technical Expertise : ETL creation and processing expertise. Experience with code debugging concepts Expertise in data modeling design, troubleshooting, and analysis from ingest to visualization. Conducted More ❯

rather huge and includes Python (Pandas, numpy, scipy, scikit-learn, standard libraries, etc.), Python packages that wrap Machine Learning (packages for NLP, Object Detection, etc.), Linux, AWS/C2S, Apache NiFi, Spark, pySpark, Hadoop, Kafka, ElasticSearch, Solr, Kibana, neo4J, MariaDB, Postgres, Docker, Puppet, and many others. Work on this program takes place in Chantilly, VA, McLean, VA and … standards. Develop and deliver documentation for each project including ETL mappings, code use guide, code location and access instructions. Design and optimize Data Pipelines using tools such as Spark, Apache Iceberg, Trino, OpenSearch, EMR cloud services, NiFi and Kubernetes containers Ensure the pedigree and provenance of the data is maintained such that the access to data is protected … services Cloud and on-prem data storage and processing solutions Python, SQL, Spark and other data engineering programming COTS and open source data engineering tools such as ElasticSearch and NiFi Processing data within the Agile Lifecycle Desired Skills (Optional) Experience using AI/LLMs to accelerate the processing and transformation of data Why Choose The DarkStar Group, a GRVTY More ❯

rather huge and includes Python (Pandas, numpy, scipy, scikit-learn, standard libraries, etc.), Python packages that wrap Machine Learning (packages for NLP, Object Detection, etc.), Linux, AWS/C2S, Apache NiFi, Spark, pySpark, Hadoop, Kafka, ElasticSearch, Solr, Kibana, neo4J, MariaDB, Postgres, Docker, Puppet, and many others. Work on this program takes place in Chantilly, VA, McLean, VA and … standards. Develop and deliver documentation for each project including ETL mappings, code use guide, code location and access instructions. Design and optimize Data Pipelines using tools such as Spark, Apache Iceberg, Trino, OpenSearch, EMR cloud services, NiFi and Kubernetes containers Ensure the pedigree and provenance of the data is maintained such that the access to data is protected … services Cloud and on-prem data storage and processing solutions Python, SQL, Spark and other data engineering programming COTS and open source data engineering tools such as ElasticSearch and NiFi Processing data within the Agile Lifecycle Desired Skills (Optional) Experience using AI/LLMs to accelerate the processing and transformation of data Why Choose The DarkStar Group, a GRVTY More ❯

us even more if you have some of these skills: Active Security+ certification Active CE certification Ability to obtain Privileged User Account (PUA) certification by the Government GraphQL Service Apache NiFi Experience with systems at scale Kafka or other message passing systems Experience of a production/enterprise system Appian low-code application development platform Experience with any More ❯

self-starter who can work on their own Desired Skills: Active Security+ certification Active CE certification Ability to obtain Privileged User Account (PUA) certification by the Government GraphQL Service Apache NiFi Experience with systems at scale Kafka or other message passing systems Experience of a production/enterprise system Appian low-code application development platform Experience with any More ❯

with Collaboration tools, such as, Jira and Confluence Preferred Qualifications: Working knowledge with software platforms and services, such as, Docker, Kubernetes, JMS/SQS/SNS, Kafka, AWS Lambda, NiFi, Working knowledge with public keys and digital certificates Experience with automated testing patterns and tools, such as, Mocha/Chai, JUnit, NUnit, TestNG Experience with DevOps environments Expertise in More ❯

of experience in software development Advanced proficiency with: Multiple programming languages and frameworks Message brokers such as RabbitMQ, Kafka, and Redis Lucene-based search/indexing platforms: Elasticsearch and Apache Solr Data streaming and integration technologies such as Apache Nifi Containerization and orchestration technologies (Docker, Kubernetes) Cloud platforms (AWS GovCloud, SC2S, C2S) API design, versioning, and integration … TS/SCI with CI Polygraph Bachelor's degree in Computer Science , Engineering, or related field Experience with: Data processing, automation and ETL workflow orchestration GraphQL Server side technologies (Apache Tomcat) Log analytics and observability platforms, particularly Splunk SAFe Agile methodologies Working in classified environments Overview Noblis and our wholly owned subsidiaries, Noblis ESI , and Noblis MSD tackle the More ❯

observable, and secure systems. You will work closely with the team on the following key tasks Design, develop, test, and maintain Python microservices Implement message consumers and producers with Apache Kafka Integrate with Elasticsearch for real-time and batch data indexing and querying Write unit and integration tests; ensure high code coverage and reliability Build CI/CD pipelines … User Account (PUA) certification by the Government Elasticsearch certifications or other program stack related certifications Familiarity with authentication and authorization products such as Keycloak GraphQL familiarity and/or Apache NiFi experience Experience of a production/enterprise systems at scale Knowledge of distributed systems concepts (e.g., idempotency, eventual consistency) Familiarity with schema registries and Kafka streaming patterns More ❯

patterns Familiarity with authentication and authorization products such as Keycloak Experience with security best practices for services: authN/Z, secrets management, data protection GraphQL familiarity and/or Apache NiFi experience Hardware on-prem and cloud-based deployments using Kubernetes Proficiency with infrastructure-as-code (i.e. CloudFormation, Terraform, Pulumi) Experience of a production/enterprise systems at More ❯

Poly (eligible) Desired Skills/Experience: Programming Languages: Python, Java, C++, NodeJS Object-Oriented (OO) Programming skills with modern development languages Cloud, DevOps, Open Source technologies (AWS, VMware, Docker, NiFi, Kibana, Grafana, CDK - AWS Cloud Development Kit, Terraform) Databases (Elasticsearch, PostgreSQL) Agile Development processes and tools (Scrum, JIRA) Continuous Integration/Continuous Delivery (CI/CD) (GitLab CI, GitLab More ❯

task automation, provision managed services, and leveraging Python, Ansible, and Terraform programming languages. Patching, hardening, and maintaining compliance of RHEL Install, configure, and provide performance support for Kubernetes, Docker, Nifi, and cloud metrics collection tools. Managing CI/CD pipelines to automate building, testing, and deploying code utilizing GitLab. Managing commercial cloud computing platforms (AWS). Communicate and collaborate More ❯

average of 2-3 days per week at our customer location in Columbia, MD. However, flexibility is essential to accommodate any changes in the schedule. Preferred Requirements Experience with NiFi, Kafka, AWS Infrastructure, and K8's. Experience in cloud based technologies (AWS, Azure). Experience in distributed databases, NoSQL databases, full text-search engines (e.g. Elasticsearch, MongoDB, Solr) Scripting More ❯

MD about 2-3 days/week. However, flexibility is essential to accommodate any changes in the schedule. Preferred Requirements A current CI Poly is a plus. Experience with NiFi, Kafka, AWS Infrastructure, and K8's. Experience in cloud based technologies (AWS, Azure). Experience in distributed databases, NoSQL databases, full text-search engines (e.g. Elasticsearch, MongoDB, Solr) Scripting More ❯

Meade, MD. However, flexibility is essential to accommodate any changes in the schedule. Preferred Requirements A current TS/SCI is preferred. CI Poly is a plus. Experience with NiFi, Kafka, AWS Infrastructure, and K8's. Experience in cloud based technologies (AWS, Azure). Experience in distributed databases, NoSQL databases, full text-search engines (e.g. Elasticsearch, MongoDB, Solr) Scripting More ❯

software development methodologies and use of standard software development tool suites Desired Technical Skills Security+ certification is highly desired. Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with containers, EKS, Diode, CI/CD, and Terraform are a plus. Work could possibly require some on-call More ❯

both independently as well as in a team setting Experience with the Linux operating system Experience with configuration management tools (e.g. Git, Nexus, Maven) Desired Technical Skills Experience with NiFi, Kafka, AWS Infrastructure, and K8's. Experience in cloud based technologies (AWS, Azure). Experience in distributed databases, NoSQL databases, full text-search engines (e.g. Elasticsearch, MongoDB, Solr) Scripting More ❯

independently as well as in a team setting. Experience with the Linux operating system. Experience with configuration management tools (e.g. Git, Nexus, Maven). Desired Technical Skills Experience with NiFi, Kafka, AWS Infrastructure, and K8's. Experience in cloud based technologies (AWS, Azure). Experience in distributed databases, NoSQL databases, full text-search engines (e.g. Elasticsearch, MongoDB, Solr) Scripting More ❯

to accommodate any schedules changes per the customer and team in place. Preferred Requirements Security+ certification is highly desired. Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with containers, EKS, Diode, CI/CD, and Terraform are a plus. Work could possibly require some on-call More ❯

to accommodate any schedules changes per the customer and team in place. Preferred Requirements Security+ certification is highly desired. Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with containers, EKS, Diode, CI/CD, and Terraform are a plus. Work could possibly require some on-call More ❯

to accommodate any schedules changes per the customer and team in place. Preferred Requirements Security+ certification is highly desired. Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with containers, EKS, Diode, CI/CD, and Terraform are a plus. Work could possibly require some on-call More ❯

rather huge and includes Python (Pandas, numpy, scipy, scikit-learn, standard libraries, etc.), Python packages that wrap Machine Learning (packages for NLP, Object Detection, etc.), Linux, AWS/C2S, Apache NiFi, Spark, pySpark, Hadoop, Kafka, ElasticSearch, Solr, Kibana, neo4J, MariaDB, Postgres, Docker, Puppet, and many others. Work on this program takes place in Chantilly, VA, McLean, VA and More ❯

rather huge and includes Python (Pandas, numpy, scipy, scikit-learn, standard libraries, etc.), Python packages that wrap Machine Learning (packages for NLP, Object Detection, etc.), Linux, AWS/C2S, Apache NiFi, Spark, pySpark, Hadoop, Kafka, ElasticSearch, Solr, Kibana, neo4J, MariaDB, Postgres, Docker, Puppet, and many others. Work on this program takes place in Chantilly, VA, McLean, VA and More ❯

rather huge and includes Python (Pandas, numpy, scipy, scikit-learn, standard libraries, etc.), Python packages that wrap Machine Learning (packages for NLP, Object Detection, etc.), Linux, AWS/C2S, Apache NiFi, Spark, pySpark, Hadoop, Kafka, ElasticSearch, Solr, Kibana, neo4J, MariaDB, Postgres, Docker, Puppet, and many others. Work on this program takes place in Chantilly, VA, McLean, VA and More ❯