1 to 25 of 257 Apache NiFi Jobs

Data Engineer McLean or Chantilly, Virginia Required Skills: Experience using data processing technologies (e.g. Python, SPARK, Java, SQL, Jenkins, PyPi, Terraform, Cloudera, ElasticSearch, Pentaho, Apache NiFi, Apache Hop) Experience performing data processing to develop, validate, and use methodologies to support analytic requirements in Clustered Computing environments. Experience … techniques and tools to perform analytic support. Developing and using data processing technologies such as Python, SPARK, Java SQL, ECL Jenkins, PyPi, Terraform, Cloudera, Apache NiFi, Apache Hop, and ElasticSearch to perform data processing. Developing, validating, and using methodologies to support analytic requirements in Clustered Computing environments. More ❯

Site Full-TIme FJM Innovative Technologies is looking for a highly skilled Software Engineer to support dynamic development efforts in Herndon, VA. Java and Apache NiFi are must-have skills for this role. The ideal candidate will bring a strong foundation in backend development, data pipeline engineering, and … applications using Java (required) and other languages such as Python, C, C++, Swift, and Shell • Design and implement dataflow automation and ETL pipelines using Apache NiFi (required) • Build full-stack web applications using HTML, CSS, JavaScript, Bootstrap, Angular, Node, Ruby, PHP, XML/XSLT, and JSON •. Develop … and services using RESTful APIs, JDBC, JPA, Java Beans, and frameworks such as Spring, Hibernate, and Django • Work with web/application servers including Apache Tomcat and Apache Ant •. Utilize tools like Maven, Gradle, Jenkins, Git, BitBucket, Eclipse, and Android Studio for development and CI/CD More ❯

on a contract basis. You will help design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi These roles are supporting our clients team in Worcester (fully onsite), and requires active UK DV clearance. Key Responsibilities: Design, develop, and … maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi Implement data ingestion, transformation, and integration processes, ensuring data quality and security Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards Manage and monitor … Engineer in secure or regulated environments. Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with Apache NiFi for building and managing complex data flows and integration processes. Knowledge of security practices for handling sensitive data, including encryption, anonymization, and More ❯

Responsibilities: Develop, optimize, and maintain data ingest flows using Apache Kafka, Apache Nifi and MySQL/PostGreSQL Develop within the components in the AWS cloud platform using services such as RedShift, SageMaker, API Gateway, QuickSight, and Athena Communicate with data owners to set up and ensure configuration … of programming languages like Python, R, and Java Expertise in building modern data pipelines and ETL (extract, transform, load) processes using tools such as Apache Kafka and Apache Nifi Proficient in programming languages like Java, Scala, or Python Experience or expertise using, managing, and/or testing More ❯

quickly and apply new skills Desirable Solid understanding of microservices development SQL and NoSQL databases working set Familiar with or able to quickly learn Apache NiFi, Apache Airflow, Apache Kafka, KeyCloak, Serverless Computing, GraphQL, APIs, APIM Good skills working with JSON, XML, YAML files Knowledge in More ❯

/SCI w/appropriate level Polygraph required Experience using the Unix CLI Experience creating, managing, and troubleshooting complex operational data flows Experience using Apache NiFi canvas to process and distribute data Experience with Corporate data flow processes and tools Experience with Corporate data security and compliance procedures … related discipline Five (5) years of additional SE experience may be substituted for a bachelors degree. Desired Skills & Abilities: SQL querying experience Experience using Apache NiFi canvas to process and distribute data General HPC technical knowledge regarding compute, network, memory, and storage components Experience with the Elastic Stack More ❯

Ansible , PowerShell , and Python . Build, configure, and maintain Kubernetes clusters , ensuring high availability, scalability, and security. Deploy and support key applications such as Apache NiFi , Elastic ECK , and JFrog Artifactory . Develop and manage Helm Charts to standardise application deployment. Integrate with and manage HashiCorp Vault for … configuration, and operations in production environments. Experience managing applications with Helm Charts and supporting microservices-based architecture. Applications & Services: Direct experience deploying and supporting Apache NiFi , Elastic ECK (ElasticSearch on Kubernetes) , and Artifactory . Familiarity with container image management and application lifecycle support. Security & Infrastructure: Use of HashiCorp More ❯

modular, reusable services and features within a modern service-oriented architecture Work independently with minimal supervision in an Agile team environment Deploy and maintain Apache NiFi clusters Develop ETL (Extract, Transform, Load) processes for mission-critical data systems Create and maintain Ansible playbooks and roles for software-driven … deployment of NiFi and Zookeeper clusters Use AWS EC2 instances for infrastructure needs Develop dashboard visualizations in Kibana based on data from Elasticsearch Integrate and interact with RESTful services via REST APIs Requirements: Active Full-Scope Polygraph Expertise with Apache NiFi and equivalent IC technologies General understanding More ❯

in both classified and unclassified environments to understand and achieve mission outcomes. Knowledge of web-based architectures, NoSQL database technology, data ingest tools (e.g., Apache NiFi), search tools, and/or web-UI frameworks. Understand & improve existing PAI collection workflows and work with SA/SE teams to …/MVC) Desired Qualifications NoSql DBs (Mongo, ElasticSearch, Redis, Graph DB, etc.) Data wrangling (Discovery, Mining, Cleaning, Exploration, Modeling, Structuring, Enriching, and Validating) with Apache NiFi or similar tools CI/CD (e.g., Jenkins), Junit testing or similar DevOps experience Containerization experience (Docker, Kubernetes, etc.) Scripting with bash More ❯

Qualifications: Willingness to be a committer/contributor to open source applications Java programming for distributed systems, with experience in networking and multi-threading. Apache Hadoop Apache Accumulo Apache NiFi Agile development experience Well-grounded in Linux fundamentals and knowledge in at least one scripting language More ❯

distributed systems, with proficiency in networking, multi-threading and implementation of REST APIs Experience with the Spring framework, messaging frameworks (Kafka, RabbitMQ), streaming analytics (Apache Flink, Spark), management of containerized applications (Kubernetes). Experience with Enabling tools (Git, Maven, Jira), DevOps (Bamboo, Jenkins, GitLab Cl/Pipelines), Continuous Monitoring … ELK Stack (ElasticSearch, Logstash and Kibana), Nagios) Experience with Apache Hadoop, Apache Accumulo and Apache NiFi Well-grounded in Linux fundamentals and familiarity with scripting languages (e.g., Python, Ruby, Perl, BASH, etc.) Experience with AWS Cloud architecture, Infrastructure as Code (IaC), Cloud security, and Automation (AWS More ❯

design patterns to ensure the product's scalability, maintainability, and long-term success. • Understand API-driven microservice design patterns, NoSQL databases, data ingest tools (Apache NiFi), and modern web frameworks. • Maintain a team player mentality as a collaborative member of a fast-paced, structured 10-14 person team. … Nice to Haves: • NoSQL DBs (Mongo, ElasticSearch, Redis, Graph DB, etc.). • Data wrangling (Discovery, Mining, Cleaning, Exploration, Modeling, Structuring, Enriching, and Validating) with Apache NiFi or similar tools. • CI/CD (e.g., Jenkins), Junit testing or similar. • Scripting with Bash, Python, and/or Groovy. YOE Requirement More ❯

to enterprise operations, and supporting Analysis of Alternatives (AoA) assessments. Technical expertise with Linux/Unix command line, Jupyter Notebook, JSON, XML, Elk Stack, Apache NiFi, Confluence, Jira, and the MS Office suite is required. Tasks Performed: • Develop comprehensive SOA solutions • Develop operational view, technical standards view, and … transferring prototype applications from forward-deployed teams to enterprise solutions teams. • Linux/Unix command line • Jupyter Notebook • JSON, XML • Elk Stack • Splunk architect • Apache NiFi • Confluence • Jira • MS Office suite - PowerPoint and Excel Other Job Requirements: • Minimum Active Top Secret/SCI security clearance with a Full More ❯

speed disk, high density multi-CPU architectures, and extreme memory footprints. You will be working with the latest technologies including Java, Kafka, Kubernetes, Docker, Apache Accumulo, Apache Spark, Spring, Apache NiFi and more! We have multiple opportunities to build systems with capabilities that include machine learning More ❯

role-this is your chance to engineer solutions that truly matter. Key Responsibilities: Design, develop, and optimize scalable data pipelines using technologies such as Apache Spark, Apache Iceberg, Trino, OpenSearch, AWS EMR, NiFi, and Kubernetes containers. Ingest and move structured and unstructured data using approved methods into … of working with diverse data types and formats, including structured, semi-structured, and unstructured data. Familiarity with data ingestion tools and platforms such as Apache NiFi, Spark, and related open-source technologies. Demonstrated ability to collaborate across teams, including data scientists, software engineers, data stewards, and mission partners. More ❯

a variety of technologies depending on customer requirements. Required Skills: s Java programming for distributed systems, with experience in networking and multi-threading s Apache Hadoop s Apache Accumulo s Apache NiFi s Agile development experience s Well-grounded in Linux fundamentals and knowledge in at More ❯

Skills: Backend Development: Gradle, Liquibase Frontend Development: React, Typescript Cloud & DevOps: Deep knowledge of DevOps principles and GitOps practices, Linux (in a containerized environment), Apache Zookeeper, Apache Nifi Data: Redis, GIS Architecture: API Spec (Swagger OpenAPI) **PLEASE DO NOT APPLY IF YOU ARE NOT PRE-CLEARED TO More ❯

with big data frameworks (Hadoop, Spark, Flink etc.) Experience with ML lifecycle management tools (MLflow, Kubeflow, etc.) Familiarity with data pipelining and streaming technologies (Apache Kafka, Apache Nifi, etc.) Demonstrated contributions to open-source software repositories (github, kaggle, etc.) Experience deploying ML models on cloud platforms (AWS More ❯

products (JIRA, Confluence, Service Desk, etc.) Experience with ELK stack, OpenSearch, SonarQube, Cypress, PowerShell, C#, and Databricks Experience with Docker, SQL, Angular, Spring Boot, Nifi, AWS, python, scala, shell scripting, and XML processing Experience in AWS solu?on architecture Maintaining the Apache Hadoop Ecosystem, especially u?lizing HBase … MapReduce, and Spark. ETL processes u?lizing Linux shell scrip?ng, Perl, Python, and Apache Airflow. AWS services such as CloudWatch, CloudTrail, ELB, EMR, KMS, SQS, SNS, and Systems Manager. Experience in mobile pla?orm development, such as web mobile, Android, microservices Working knowledge using proxies and proxy crea … and Lakehouse architectures AWS OpenSearch Experience with AWS, Splunk, Databricks, and other Oracle/SQL based platforms. Experience with python, Microsoft VBA, and Databricks Apache Niagra Files (NiFi) Apache TIKA Databricks and Lakehouse architecture Elas?cSearch AWS SQS Informatica and custom software components Elas?cSearch and OpenSearch More ❯

Development: Alfresco/Activiti/Camunda Frontend Development: React Cloud & DevOps: Deep knowledge of DevOps principles and GitOps practices, Linux (in a containerized environment), Apache Zookeeper, Apache Nifi Data: GIS Architecture: API Spec (Swagger OpenAPI) **PLEASE DO NOT APPLY IF YOU ARE NOT PRE-CLEARED TO SC More ❯

Confluence, Service Desk, etc.) Provide end user case support as needed Provide dataset analysis, development, error handling, version upgrades, and API enhancement Maintaining the Apache Hadoop Ecosystem, especially u?lizing HBase, MapReduce, and Spark. ETL processes u?lizing Linux shell scrip?ng, Perl, Python, and Apache Airflow. AWS … maintaining components in AWS SpringBoot framework Experience with ELK stack, OpenSearch, SonarQube, Cypress, PowerShell, C#, and Databricks Experience with Docker, SQL, Angular, Spring Boot, Nifi, AWS, python, scala, shell scripting, and XML processing Experience in AWS solu?on architecture Linux Admin, VMWare vSphere 6/7 experience, SPLUNK Server … and queries on an Oracle database platform Experience installing, troubleshooting, and administering Oracle databases. Experience with Oracle u?li?es, administration, and OEM management. Apache Niagra Files (NiFi) Apache TIKA Databricks and Lakehouse architecture ElasticSearch AWS SQS So?ware development and maintenance of internal/external interfaces More ❯

Five or more years of experience in a Data Science, Data Engineering, or Data Analysis role. Familiarity with data pipelining and streaming technologies (ex. Apache Kafka, Apache Nifi, etc.) Experience generating synthetic test/training data. Experience communicating research results in written, visual, and spoken forms to More ❯

enable data analytics. Familiarity with various log formats such as JSON, XML, and others. Experience with data flow, management, and storage solutions (i.e. Kafka, NiFi, and AWS S3 and SQS solutions) Ability to decompose technical problems and troubleshoot both system and dataflow issues. Must be certified DoD IAT II … integration testing. Python: Experience with Python is desired. SQL: Familiarity with SQL schemas and statements. Tools and Technologies: Data Flow Solutions: Experience with Kafka, NiFi, AWS S3, and SQS. Version Control and Build Tools: Proficiency with Maven and GitLab. Data Formats: Familiarity with JSON, XML, SQL, and compressed file … formats. Configuration Files: Experience using YAML files for data model and schema configuration. Apache NiFi: Significant experience with NiFi administrationand building/troubleshooting data flows. AWS S3: bucket administration. IDE: VSCode, Intellij/Pycharm, or other suitable Technical Expertise : ETL creation and processing expertise. Experience with code More ❯

Splunk, Databricks, and other Oracle/SQL based platforms. Experience with python, Microsoft VBA, and Databricks Databricks Alteryx Designer Cloud (previously Trifacta) Microso? PowerBI Apache Niagra Files (NiFi) Apache TIKA Databricks and Lakehouse architecture Elas?cSearch AWS SQS Elas?cSearch and OpenSearch .NET, C#, Javascript, and Java … maintaining components in AWS SpringBoot framework Experience with ELK stack, OpenSearch, SonarQube, Cypress, PowerShell, C#, and Databricks Experience with Docker, SQL, Angular, Spring Boot, Nifi, AWS, python, scala, shell scripting, and XML processing Experience in AWS solu?on architecture Experience in Elas?cSearch, Vue.js, Java Spring Framework, and .NET More ❯

HIGHER REQUIRED THIS IS AN ON-SITE POSITION Required Skills may include: Experience with Atlassian Software products (JIRA, Confluence, Service Desk, etc.) Maintaining the Apache Hadoop Ecosystem, especially u?lizing HBase, MapReduce, and Spark. ETL processes u?lizing Linux shell scrip?ng, Perl, Python, and Apache Airflow. AWS … Perl Oracle, API Architecture (SOAP/REST), Git Solr, Bash Shell Oracle Label Security, PL/SQL HTML, Vue Framework, Javascript, Java and .NET Apache Solr Experience in En?ty Resolu?on, developing and implemen?ng methods to iden?fy and link records across different data sources that represent … Natural Language Genera?on (NLG) models for tasks like text summariza?on. Databricks, Spark, PyTorch, Tensorflow, Python, Scala, CoreNLP, and Transformer founda?onal models Apache Niagra Files (NiFi) Apache TIKA Databricks and Lakehouse architecture Elas?cSearch AWS SQS Software development and maintenance of internal/external interfaces More ❯