physical), metadata management, and master data management (MDM). Deep understanding of data integration, transformation, and ingestion techniques using modern tools (e.g., Azure Data Factory, Boomi, Informatica, Talend, dbt, ApacheNiFi). Strong familiarity with data warehousing, data lake/lakehouse architectures, and cloud-native analytics platforms. Hands-on experience with SQL and cloud data platforms (e.g., Snowflake More ❯
logical, physical), metadata management, and master data management (MDM) Deep understanding of data integration, transformation, and ingestion techniques using modern tools (e.g., Azure Data Factory, Boomi, Informatica, Talend, dbt, ApacheNiFi) Strong familiarity with data warehousing, data lake/lakehouse architectures, and cloud-native analytics platforms Hands-on experience with SQL and cloud data platforms (e.g., Snowflake, Azure More ❯
or PCF) and Microservices. Expertise in RESTful Web Services, authentication techniques, and security best practices . Strong troubleshooting skills, proactive mindset, and excellent communication skills. Bonus: Experience with Databricks, NiFi, and Hadoop is a plus. *For this position, you need to be based within commutable distance to Dublin and hold an EU/UK passport ot Stamp More ❯
DB, Node, and Docker • Hands-on experience with AWS cloud • Active TS/SCI clearance with polygraph required Preferred Qualifications • Experience with Hadoop, Map Reduce, Spark, Rabbit MQ, and NiFi a plus • Experience with Sequalize and Umzug • Familiarity with or ability to learn Git, Jenkins, FontAwesome, and LeftHook • Bachelor's and/or Master's degree in a technical More ❯
/SCI Experience: 4-8 Education: Bachelors Degree Required Skills: Working knowledge with software platforms and services, such as, Docker, Kubernetes, JMS/SQS/SNS, Kafka, AWS Lambda, NiFi, Working knowledge with public keys and digital certificates, Experience with automated testing patterns and tools, such as, Mocha/Chai, JUnit, NUnit, TestNG, Experience with DevOps environments, Expertise in More ❯
requirements analysis and synthesis from system level to individual software components. Required Skills: Focus will be on CONTRAOCTAVE. AWS DevOps Java Spring/SpringBoot Kubernetes Linux GitLab MongoDB Postgres NiFi PRESSUREWAVE Testing and analytical experience Here's What You'll Need: Analyze user requirements to derive software design and performance requirements. Debug existing software and correct defects. Provide recommendations More ❯
/Spring Boot: Experience in developing applications using Spring/Spring Boot. • Database & JPA: Experience with PostgreSQL and the Java Persistence API. Additional Desirable Skills • Workflow Automation: Familiarity with NiFi or similar technologies. • Orchestration: Experience with Temporal or similar orchestration tools. • Messaging & Streaming: Exposure to RabbitMQ or similar message/streaming broker technologies. • Advanced Technologies: Interest or experience in More ❯
Bachelors/Masters degree or 13 years of relevant work experience. Experience working in a DevOps environment Experience integrating and automating diverse data streams with data transfer tools (Ex: NiFi, Cribl, etc) Experience in one or more cloud computing services and technologies including but not limited to: AWS, Microsoft Azure, Nutanix, VMware Experience with one or more application development More ❯
experience briefing technical projects to peers and senior management. Demonstrated experience creating, building and maintaining containers. Demonstrated experience deploying and maintaining Amazon Web Services. Demonstrated experience developing and maintaining NiFi clusters. Desirable Skills Demonstrated experience providing consulting and advisory services for senior IT stakeholders. Demonstrated experience implementing and maintaining ElasticSearch environments. Demonstrated experience building, maintaining and operating terraform for More ❯
Experience working in an Agile environment • Must be willing to work on-site An Excellent Candidate for this position will meet most of the following experience requirements: • Experience with NiFi configuration, workflow development, and deployment • Experience with cloud infrastructures and integrating backend systems in hybrid cloud environments • Proficiency in Python for scripting, data processing, and automation tasks • Understanding of More ❯
Data Analytic exposure is a big plus. Java is a must, but these will strengthen your case: Data Analytic development experience Agile development experience Familiarity with/interest in Apache Hadoop MapReduce Python experience AWS Lambdas experience Jira experience Confluence experience Gitlab experience Exposure or experience with NiFi Willingness/desire to work on high visibility tasking Willingness More ❯
data architecture ii. SQL databases (e.g. Oracle, PostgeSQL, or MySQL) iii. Python programming language Experience in the following: i. Data integration and ETL tools (e.g., Talend, Informatica, Knime, or ApacheNiFi) ii. Data visualization tools (e.g., Tableau or Power BI). iii. Agile methodologies and project management tools and utilization of project management tools (e.g., JIRA). iv. More ❯
premises and Cloud environments. Develop and maintain ingestion algorithms and schemas for large datasets. Analyze new large-volume datasets to optimize the data ingest processes. Support the creation of ApacheNiFi schemas for new data loads. Develop software tools that efficiently preprocess, modify, aggregate, load, index, and archive large data collections into clusters in near real-time. Ensure … options, and cloud-based database services. Demonstrated experience working with Databricks. Demonstrated experience understanding SQL database structures and mapping them between different SQL databases. Demonstrated professional experience working with Apache NiFi. Demonstrated professional experience working with large data and high performance compute clusters such as Hadoop or similar. Demonstrated experience with API development techniques. Demonstrated experience developing and deploying … systems, preferably Git. Demonstrated experience testing the development of software solutions for the extraction, transformation, and loading of data using the most efficient languages for the task such as NiFi, Python, and SQL. Demonstrated experience implementing multiprocessing data-flows to parallelize ingest operations. Demonstrated experience exhibiting strong coordination and collaboration skills. Demonstrated experience working with full-stack developers to More ❯
Data Analytic exposure is a big plus. Java is a must, but these will strengthen your case: Data Analytic development experience Agile development experience Familiarity with/interest in Apache Hadoop MapReduce Python experience AWS Lambdas experience Jira experience Confluence experience Gitlab experience Exposure or experience with NiFi Willingness/desire to work on high visibility tasking Willingness More ❯
also involves contributing to system-level architecture, resolving software issues, and integrating Commercial and Government Off-the-Shelf solutions to meet mission objectives. This position requires expertise in Java, ApacheNiFi, Linux/Unix environments, and familiarity with collaborative tools such as Jira, Confluence, and SharePoint. Tasks Performed: • Recommend new technologies and processes for complex software projects. • Serve … performing requirements analysis and synthesis from system level to individual software components. • Experience with Linux/Unix command-line. • Experience as an Agile developer. • Experience with Java. • Experience with Apache NiFi. • Experience with Jira. • Experience with Confluence, SharePoint, or similar. Other Job Requirements: • Minimum Active Top Secret/SCI security clearance with a Full Scope Polygraph. • U.S. Citizenship, and More ❯
Hourly on W2 Duration: 12 months Active secret clearance required. Skill Matrix: Primary Skills Year(s) of Experience Job Level Cloudera 5 Years Expert Linux 5 Years Expert Nifi 2 Years Intermediate Job Description: The work location is in the Fort Worth, TX facility, supporting closed program areas for F-35 and ADP. Duties and responsibilities include, but are … properly up and running. • Supporting Hadoop clusters running on Cloudera by applying critical security patches, remediating vulnerabilities, and pro-actively planning to ensure clusters have sufficient storage. • Familiarity with Nifi, and the ability to partner with developers and architects to ensure its capabilities are properly managed and exploited. Basic Qualifications: • US Citizenship required due to having a DoD Secret More ❯
with DevOps tools and concepts Experience with either Ansible, SALT, GitLab CI/CD Optional Skills and experience: Experience with Python, Java Experience with Amazon Web Services Experience with NiFi Experience with logging software/dashboards (ELK stack, Grafana, OpenSearch, ) Experience with Full-Stack Development Need a Bachelor's degree in a related field. More ❯
with DevOps tools and concepts Experience with either Ansible, SALT, GitLab CI/CD Optional Skills and experience: Experience with Python, Java Experience with Amazon Web Services Experience with NiFi Experience with logging software/dashboards (ELK stack, Grafana, OpenSearch, ) Experience with Full-Stack Development Need 6 years of experience with a Bachelor's degree in a related field More ❯
Leverage AWS best practices to optimize code for cloud deployment with cost-conscious development and deployment strategies Requirements Minimum of 3-5 years' experience with Java Springboot, Management of NiFi Workflows and clusters, Python Regex & Parsing, Data Engineering & ETL , AWS (Lambdas, EC2, EKS, RDS) Developing software within Agile methodologies Preferred Experience developing web APIs to interface with cloud applications More ❯
London, England, United Kingdom Hybrid / WFH Options
EDF Trading Ltd
such as DataBricks, GCP, AWS and familiarity with the available data governance tools. Good knowledge on SQL databases Experience in data quality monitoring, ideally with event streams such as NiFi/Alteryx or similar Good knowledge of data architecture and data modelling, as well as tools used to support these processes e.g. data catalogues, data quality tooling, data lineage … multitask, switch focus and prioritise own tasks being comfortable to work under pressure with demanding front office users Desirable Skills and Experience Data Catalogue tools and implementation Alteryx/NiFi Familiarity with data visualization tools e.g. PowerBI or Tableau Data extraction and manipulation languages e.g. SQL, Python Knowledge of statistical software and packages such as R, Matlab, Pandas, NumPy More ❯
Windows Operating Systems, Cloud Services Technologies. - Exhibiting expert level work experience developing and integrating systems and applications using the following listed technologies: XML SOAP/REST, JSON, Niagra Files (NiFi) o Elastic Search/Log Stash/Kibana (ELK), Splunk, Java, Java Script, Python, Perl, IBM Sterling Connect Direct, Microsoft Power Shell scripting, KShell, BASH, etc. Requirements: - Seven More ❯
of distributed storage networks, routing and application messaging frameworks. • Demonstrated knowledge of analytical needs and requirements, query syntax, data flows, and traffic manipulation. • Experience with Splunk Dashboards • Experience with NiFi, HA Proxy, Docker, Kubernetes, and ElasticSearch/OpenSearch • Experience with Certification & Accreditation processes Benefits: Complete Insurance Coverage Blue Cross Medical, Delta Dental, Vision, Life 401k with Company Contribute Tuition More ❯
and problem-solving with strong collaboration abilities To succeed in this role, we imagine the right candidate to have... Technical Skills: Experience with data integration tools, such as NodeRed, Apache Nifi. Familiarity with APIs and AI services (e.g., using AI/ML APIs for data processing tasks). Knowledge of JSON, XML, and other data formats. Experience: Proven experience More ❯
internal engineering and strategy team meetings. Build direct customer relationships to improve organizational feedback loop. Required Skills: Extensive RedHat (RHEL), CentOs Linux, and/or UNIX experience. Experience managing NiFi data flows. Experience with VMWare or associate technologies (ESX, NSX, VSAN, KVM, Nutanix or other). Ansible or other automation platform/methodology experience. System scanning/hardening - STIGS More ❯
Information Technology or Engineer Bachelor's or Master's Degrees are preferred. Specific skills should include the following: Experience integrating diverse data streams Experience with data transfer tools (Ex: NiFi, Cribl, etc) Establishes data standards and acts as custodian of IT and service delivery data sets and streams Experience in analyzing complex networks and systems Experience in analyzing log More ❯