London, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
Familiarity with legacy systems (e.g. C#) and willingness to interact with them where necessary. Exposure to Cloudera Data Platform or similar big data environments. Experience with tools such as Apache Hive, NiFi, Airflow, Azure Blob Storage, and RabbitMQ. Background in investment management or broader financial services, or a strong willingness to learn the domain. The Role Offers The More ❯
Slough, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
Familiarity with legacy systems (e.g. C#) and willingness to interact with them where necessary. Exposure to Cloudera Data Platform or similar big data environments. Experience with tools such as Apache Hive, NiFi, Airflow, Azure Blob Storage, and RabbitMQ. Background in investment management or broader financial services, or a strong willingness to learn the domain. The Role Offers The More ❯
London, England, United Kingdom Hybrid / WFH Options
Opus Recruitment Solutions
set high standards. What You’ll Bring: Strong experience in AWS cloud platform architecture and solving complex business issues. Proficiency in Java programming and Linux, with desirable knowledge of ApacheNiFi, Node.js, JSON/XML, Jenkins, Maven, BitBucket, or JIRA. Hands-on experience with scripting (Shell, Bash, Python) and a solid understanding of Linux, networking, routing, and firewalls. More ❯
AWS/C2S. Experience with one or more of the following is desired, but not required: Kubernetes, Docker Swarm, ELK stack, Python, Shell Scripting, Java, Spring, Kafka, Pega, Nexus, Nifi, Ansible, Terraform. More ❯
Groovy, Python, and/or shell scripting • Javascript development experience with Angular, React, ExtJS and/or Node.js • Experience with distributed computing technologies including Hadoop, HBase, Cassandra, Elasticsearch and Apache Spark a plus • Hands-on experience working with Elastic Search, Mongo DB, Node, Hadoop, Map Reduce, Spark, Rabbit MQ, and NiFi. • DevOps experience building and deploying cloud infrastructure with More ❯
Groovy, Python, and/or shell scripting • Javascript development experience with Angular, React, ExtJS and/or Node.js • Experience with distributed computing technologies including Hadoop, HBase, Cassandra, Elasticsearch and Apache Spark a plus • Hands-on experience working with Elastic Search, Mongo DB, Node, Hadoop, Map Reduce, Spark, Rabbit MQ, and NiFi. • DevOps experience building and deploying cloud infrastructure with More ❯
enterprise Continuous Integration/Continuous Deployment processes and best practices. Codify software development best practices across the enterprise. Develop automated testing frameworks within DevOps processes. Basic Qualifications: Experience with NiFi, Spark/MapReduce, Python, Java, and Elasticsearch. Experience coding within the last 3 years. Candidate must have a BS with 4-8 years of prior relevant experience or an More ❯
Data Engineering Extensive familiarity with AWS services to include CloudFormation, EC2, S3, and RDS CloudFormation, Ansible, Git, Jenkins, Bash Programming Languages: Python, Java or Scala Processing Tools: Elasticsearch, Spark, NiFi, and/or Docker Datastore Types: Graph, NoSQL, and/or Relational US Citizenship and an active TS/SCI with Polygraph security clearance required Desired Qualifications: Familiarity with More ❯
IT/math) or equivalent experience The following additional qualifications are a significant plus: Kubernetes knowledge and operating experience Experience with big data stack components like Hadoop, Spark, Kafka, Nifi, Experience with data science/data analysis Knowledge of SRE/DevOP stacks - monitoring/system management tools (Prometheus, Ansible, ELK, ) Version control using git A day in your More ❯
XPath, HTML/XHTML, CSS, Shell Scripting, JSON, Java/J2EE Experience developing and maintaining microservices in a docker/Kubernetes environment Experience building and maintaining data flows in NiFi Knowledge of servers operating systems: Linux, windows Nice to haves (preferred): Strong problem-solving skills Focus on continual process improvement with a proactive approach to problem solving Ability to More ❯
Colorado Springs, Colorado, United States Hybrid / WFH Options
Metronome LLC
Colorado Springs, CO. Flexibility is essential to adapt to schedule changes as needed. Must be able to travel CONUS up to 25% of the time. Desired Skills Experience with NiFi, Kafka, AWS Infrastructure, and K8's. Experience in cloud based technologies (AWS, Azure). Experience in distributed databases, NoSQL databases, full text-search engines (e.g. Elasticsearch, MongoDB, Solr) Scripting More ❯
Systems Engineer/Architect Clearance: DoD Secret Location: Fort Meade, MD and Scott AFB, IL Work Schedule: Hybrid - 25% on site and 75% remote Systems Engineer/Architect: This position is located virtually in the Ft. Meade, MD or Scott More ❯
significantly enhance existing software Build modular, reusable services and features within a modern service-oriented architecture Work independently with minimal supervision in an Agile team environment Deploy and maintain ApacheNiFi clusters Develop ETL (Extract, Transform, Load) processes for mission-critical data systems Create and maintain Ansible playbooks and roles for software-driven deployment of NiFi and … for infrastructure needs Develop dashboard visualizations in Kibana based on data from Elasticsearch Integrate and interact with RESTful services via REST APIs Requirements: Active Full-Scope Polygraph Expertise with ApacheNiFi and equivalent IC technologies General understanding and ability to work with Zookeeper Expert-level experience developing ETL processes 5+ years of experience with scripting languages such as More ❯
Gloucester, Gloucestershire, South West, United Kingdom Hybrid / WFH Options
NSD
hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe … complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse sources, maintaining data integrity. Maintain … maintain optimal operation. The Data Engineer Should Have: Active eDV clearance (West) Willingness to work full time on site in Gloucester when required. Required technical experience in the following: Apache Kafka ApacheNiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply by clicking online More ❯
London, England, United Kingdom Hybrid / WFH Options
Searchability
working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience required in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe … complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse sources, maintaining data integrity. Maintain … maintain optimal operation. The Data Engineer Should Have: Active eDV clearance (West) Willingness to work full time on site in Gloucester when required. Required technical experience in the following: Apache Kafka ApacheNiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply by clicking online More ❯
gloucester, south west england, united kingdom Hybrid / WFH Options
Searchability NS&D
hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe … complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse sources, maintaining data integrity. Maintain … maintain optimal operation. The Data Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required technical experience in the following: Apache Kafka ApacheNiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply by clicking online More ❯
cheltenham, south west england, united kingdom Hybrid / WFH Options
Searchability NS&D
hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe … complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse sources, maintaining data integrity. Maintain … maintain optimal operation. The Data Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required technical experience in the following: Apache Kafka ApacheNiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply by clicking online More ❯
to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as ApacheNifi/RabbitMQ TO BE CONSIDERED.... Please either apply by clicking online or emailing me directly to dominic.barbet@searchability.comFor further information please call me on 07704 152 640. … CLEARED/DV CLEARANCE/DEVELOPPED VETTING/DEVELOPED VETTED/DEEP VETTING/DEEP VETTED/SC CLEARED/SC CLEARANCE/SECURITY CLEARED/SECURITY CLEARANCE/NIFI/CLOUDERA/HADOOP/KAFKA/ELASTIC SEARCH/LEAD BIG DATA ENGINEER/LEAD BIG DATA DEVELOPER #J-18808-Ljbffr More ❯
Trip to either Nassau Bahamas, Singer Island Florida, Paradise Island Bahamas, or the Cambridge Hyatt Resort Desired Skills: • Proficient in Java • Comfortable working in a Linux environment • Experience with Apache Open Source Hadoop, Apache Open Source Accumulo, Apache Open Source NiFi • Familiarity with Context chaining and Graph theory • Experience with Containerization - Docker, Kubernetes • Experience with Enabling More ❯
Java stack IT WOULD BE NICE FOR THE LEAD BIG DATA ENGINEER TO HAVE... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as ApacheNifi/RabbitMQ TO BE CONSIDERED... Please either apply by clicking online or emailing me directly at dominic.barbet@searchability.com. For further information, please call me on More ❯
Cheltenham, England, United Kingdom Hybrid / WFH Options
Babcock
MongoDB . Building and testing with frameworks like JUnit or Jest and using Git for version control. Experience with CI/CD tools like GitLab , Jenkins , Concourse , or even ApacheNiFi , Elasticsearch , or Kibana . Agile development experience ( SCRUM , Kanban ). Building software for the cloud (we're especially keen if you know AWS , or have worked with More ❯
Manchester, England, United Kingdom Hybrid / WFH Options
Ripjar
python (specifically pyspark) and Node.js for processing data, backed by various Hadoop stack technologies such as HDFS and HBase. MongoDB and Elasticsearch are used for indexing smaller datasets. Airflow & Nifi are used to co-ordinate the processing of data, while Jenkins, Jira, Confluence and Github are used as support tools. We use ansible to manage configuration and deployments. Most … processing data You will be using Hadoop stack technologies such as HDFS and HBase Experience using MongoDB and Elasticsearch for indexing smaller datasets would be beneficial Experience using Airflow & Nifi to co-ordinate the processing of data would be beneficial You will be using Ansible to manage configuration and deployments Salary And Benefits Salary DOE 25 days annual leave More ❯
Columbia, MD. However, flexibility is essential to accommodate any changes in the schedule. Preferred Requirements A current TS/SCI is preferred. CI Poly is a plus. Experience with NiFi, Kafka, AWS Infrastructure, and K8's. Experience in cloud based technologies (AWS, Azure). Experience in distributed databases, NoSQL databases, full text-search engines (e.g. Elasticsearch, MongoDB, Solr) Scripting More ❯
Columbia, MD. However, flexibility is essential to accommodate any changes in the schedule. Preferred Requirements A current TS/SCI is preferred. CI Poly is a plus. Experience with NiFi, Kafka, AWS Infrastructure, and K8's. Experience in cloud based technologies (AWS, Azure). Experience in distributed databases, NoSQL databases, full text-search engines (e.g. Elasticsearch, MongoDB, Solr) Scripting More ❯