126 to 150 of 322 Permanent Apache NiFi Jobs

hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe … complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse sources, maintaining data integrity. Maintain … maintain optimal operation. The Data Engineer Should Have: Active eDV clearance (West) Willingness to work full time on site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply by clicking online More ❯

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience required in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe … complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse sources, maintaining data integrity. Maintain … maintain optimal operation. The Data Engineer Should Have: Active eDV clearance (West) Willingness to work full time on site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply by clicking online More ❯

hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe … complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse sources, maintaining data integrity. Maintain … maintain optimal operation. The Data Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply by clicking online More ❯

isn't just another data role-this is your chance to engineer solutions that truly matter. Key Responsibilities: Design, develop, and optimize scalable data pipelines using technologies such as Apache Spark, Apache Iceberg, Trino, OpenSearch, AWS EMR, NiFi, and Kubernetes containers. Ingest and move structured and unstructured data using approved methods into enterprise or local storage systems. … AWS, Kubernetes). Deep understanding of working with diverse data types and formats, including structured, semi-structured, and unstructured data. Familiarity with data ingestion tools and platforms such as Apache NiFi, Spark, and related open-source technologies. Demonstrated ability to collaborate across teams, including data scientists, software engineers, data stewards, and mission partners. Knowledge of data governance principles More ❯

to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply by clicking online or emailing me directly to dominic.barbet@searchability.comFor further information please call me on 07704 152 640. … CLEARED/DV CLEARANCE/DEVELOPPED VETTING/DEVELOPED VETTED/DEEP VETTING/DEEP VETTED/SC CLEARED/SC CLEARANCE/SECURITY CLEARED/SECURITY CLEARANCE/NIFI/CLOUDERA/HADOOP/KAFKA/ELASTIC SEARCH/LEAD BIG DATA ENGINEER/LEAD BIG DATA DEVELOPER #J-18808-Ljbffr More ❯

Trip to either Nassau Bahamas, Singer Island Florida, Paradise Island Bahamas, or the Cambridge Hyatt Resort Desired Skills: • Proficient in Java • Comfortable working in a Linux environment • Experience with Apache Open Source Hadoop, Apache Open Source Accumulo, Apache Open Source NiFi • Familiarity with Context chaining and Graph theory • Experience with Containerization - Docker, Kubernetes • Experience with Enabling More ❯

Java stack IT WOULD BE NICE FOR THE LEAD BIG DATA ENGINEER TO HAVE... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED... Please either apply by clicking online or emailing me directly at dominic.barbet@searchability.com. For further information, please call me on More ❯

MongoDB . Building and testing with frameworks like JUnit or Jest and using Git for version control. Experience with CI/CD tools like GitLab , Jenkins , Concourse , or even Apache NiFi , Elasticsearch , or Kibana . Agile development experience ( SCRUM , Kanban ). Building software for the cloud (we're especially keen if you know AWS , or have worked with More ❯

and maintenance of scalable platforms for your clients. Join us. The world can't wait. You Have: Experience using Python, SQL, and PySpark Experience deploying and maintaining Cloudera or Apache Spark clusters Experience designing and maintaining Data Lakes or Data Lakehouses Experience with big data tools such as Spark, NiFi, Kafka, Flink, or at multi-petabyte scale Experience More ❯

platforms (Elastic, Datadog, etc) to configure monitoring for data pipelines to ensure high availability and throughput, low latency, and alerting • Knowledge of stream processing pipelines and analytics. • Experience with Apache NiFi, multi-cluster or containerized environment experience preferred. • Knowledge of cybersecurity concepts, including threats, vulnerabilities, security operations, encryption, boundary defense, auditing, authentication, and supply chain risk management. • Experience More ❯

Required Qualifications • Extensive familiarity with AWS services to include CloudFormation, EC2, S3, and RDS • CloudFormation, Ansible, Git, Jenkins, Bash • Programming Languages: Python, Java or Scala • Processing Tools: Elasticsearch, Spark, Nifi, and/or Docker • Datastore Types: Graph, NoSQL, and/or Relational • Active TS/SCI clearance with polygraph required Preferred Qualifications • Familiarity with AWS CDK • Terraform, Packer • Design More ❯

python (specifically pyspark) and Node.js for processing data, backed by various Hadoop stack technologies such as HDFS and HBase. MongoDB and Elasticsearch are used for indexing smaller datasets. Airflow & Nifi are used to co-ordinate the processing of data, while Jenkins, Jira, Confluence and Github are used as support tools. We use ansible to manage configuration and deployments. Most … processing data You will be using Hadoop stack technologies such as HDFS and HBase Experience using MongoDB and Elasticsearch for indexing smaller datasets would be beneficial Experience using Airflow & Nifi to co-ordinate the processing of data would be beneficial You will be using Ansible to manage configuration and deployments Salary And Benefits Salary DOE 25 days annual leave More ❯

join their team. Relevant qualifications: -Bachelor's Degree in Computer Science or similar -8+ years of professional experience -Experience with Java, JavaScript, and Python -Experience with Elasticsearch, Kubernetes, NiFi, and RabbitMQ -Experience with building and deploying cloud infrastructure (CloudFormation, Ansible, Puppet) -Experience building APIs (REST, Hadoop, Spark) or automation (Jenkins, Maven) or monitoring technologies (ELK, Grafana, Prometheus) This More ❯

cyber and/or network security operations within a large enterprise, as either an analyst, engineer, architect, or developer. Experience with data flow, management, and storage solutions (i.e. Kafka, NiFi, and AWS S3 and SQS solutions). Familiarity with Agile Project team and task management environment. Good communication skills Experience with Zoom/Teams/Meet style team meetings More ❯

Columbia, MD. However, flexibility is essential to accommodate any changes in the schedule. Preferred Requirements A current TS/SCI is preferred. CI Poly is a plus. Experience with NiFi, Kafka, AWS Infrastructure, and K8's. Experience in cloud based technologies (AWS, Azure). Experience in distributed databases, NoSQL databases, full text-search engines (e.g. Elasticsearch, MongoDB, Solr) Scripting More ❯

spending an average of 1-2 days per week at our Columbia, MD office. However, flexibility is essential to accommodate any changes in the schedule. Preferred Requirements Experience with NiFi, Kafka, AWS Infrastructure, and K8's. Experience in cloud based technologies (AWS, Azure). Experience in distributed databases, NoSQL databases, full text-search engines (e.g. Elasticsearch, MongoDB, Solr) Scripting More ❯

at our Columbia, MD office. However, flexibility is essential to accommodate any changes in the schedule. Preferred Requirements A current Secret or TS/SCI is preferred. Experience with NiFi, Kafka, AWS Infrastructure, and K8's. Experience in cloud based technologies (AWS, Azure). Experience in distributed databases, NoSQL databases, full text-search engines (e.g. Elasticsearch, MongoDB, Solr) Scripting More ❯

integrations between the data warehouse and other systems. Create deployable data pipelines that are tested and robust using a variety of technologies and techniques depending on the available technologies (Nifi, Spark) Build analytics tools that utilise the data pipeline to provide actionable insights into client requirements, operational efficiency, and other key business performance metrics. Complete onsite client visits and More ❯

integrations between the data warehouse and other systems. Create deployable data pipelines that are tested and robust using a variety of technologies and techniques depending on the available technologies (Nifi, Spark) Build analytics tools that utilise the data pipeline to provide actionable insights into client requirements, operational efficiency, and other key business performance metrics. Complete onsite client visits and More ❯

with cloud platform technologies, preferably AWS. Experience in Java application development, EMC VNX, network monitoring, user provisioning and continuous integration. Familiarity with big data tools such as Elasticsearch, Splunk, NiFi, Kafka, etc. Background in Agile/Scrum methodologies for iterative development. Strong familiarity with NoSQL/SQL databases (MongoDB, PostgreSQL, etc.). Experience working with REST APIs, including secure More ❯

with cloud platform technologies, preferably AWS. Experience in Java application development, EMC VNX, network monitoring, user provisioning and continuous integration. Familiarity with big data tools such as Elasticsearch, Splunk, NiFi, Kafka, etc. Background in Agile/Scrum methodologies for iterative development. Strong familiarity with NoSQL/SQL databases (MongoDB, PostgreSQL, etc.). Experience working with REST APIs, including secure More ❯

Groovy, Python, and/or shell scripting Javascript development experience with Angular, React, ExtJS and/or Node.js Experience with distributed computing technologies including Hadoop, HBase, Cassandra, Elasticsearch and Apache Spark a plus Hands-on experience working with Elastic Search, Mongo DB, Node, Hadoop, Map Reduce, Spark, Rabbit MQ, and NiFi. DevOps experience building and deploying cloud infrastructure with More ❯

Antonio, TX. However, flexibility is essential to accommodate any changes in the schedule. Preferred Requirements A current TS/SCI is preferred. CI Poly is a plus. Experience with NiFi, Kafka, AWS Infrastructure, and K8's. Experience in cloud based technologies (AWS, Azure). Experience in distributed databases, NoSQL databases, full text-search engines (e.g. Elasticsearch, MongoDB, Solr) Scripting More ❯

Antonio, TX. However, flexibility is essential to accommodate any changes in the schedule. Preferred Requirements A current TS/SCI is preferred. CI Poly is a plus. Experience with NiFi, Kafka, AWS Infrastructure, and K8's. Experience in cloud based technologies (AWS, Azure). Experience in distributed databases, NoSQL databases, full text-search engines (e.g. Elasticsearch, MongoDB, Solr) Scripting More ❯

Columbia, MD. However, flexibility is essential to accommodate any changes in the schedule. Preferred Requirements A current TS/SCI is preferred. CI Poly is a plus. Experience with NiFi, Kafka, AWS Infrastructure, and K8's. Experience in cloud based technologies (AWS, Azure). Experience in distributed databases, NoSQL databases, full text-search engines (e.g. Elasticsearch, MongoDB, Solr) Scripting More ❯