1 to 25 of 27 Apache NiFi Jobs

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical … business intelligence platforms. Responsibilities include: Design, build, and maintain data pipelines, including ingestion, orchestration, and enrichment Develop data-streaming and ETL solutions (e.g. NiFi) Model databases and integrate data from diverse sources Ensure data quality, consistency, and security Monitor and optimise system performance Write clean, secure, reusable, test-driven ...

when required Must hold active Enhanced DV Clearance (West) Circa £700 p/d inside IR35 Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse ...

Proven track record with data governance, quality, lineage, and security practices. Experience with real-time/streaming data technologies, data Ingestion/ETL (e.g., Apache Kafka, Apache NiFi, Kinesis, Pub/Sub). Experience in, or knowledge of, DevSecOps Tooling and Processes. Self-starter with the ability ...

Azure, GCP, VMware Cloud Foundation Kubernetes and Helm Containerisation technologies Linux and Windows administration Data & Integration Elastic MySQL/MariaDB SQL Server Kafka NiFi Security Security by Design Zero Trust IAM, OAuth/OIDC Keycloak HashiCorp Vault TLS/SSL and PKI What We're Looking For Strong engineering ...

Data Engineer in secure government, defence, or intelligence settings. * Strong Python and SQL development skills. * Hands-on experience with data integration tools like Airflow, NiFi, Azure Data Factory, or AWS Glue. * Expertise in Elasticsearch management, indexing, and query optimisation. * Knowledge of data modelling, warehousing, and modern data platform architectures. ...

platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable ...

platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable ...

Title: NiFi Data Engineer Location: Hybrid (up to 3 days per week on-site, across offices in London & South England) Contract Length: 8 Months (with scope to extend) Start Date: September 2026 IR35: Outside Interview Process: 1 Stage, MS Teams Clearance Required Before Applying: SC (with eligibility for higher … levels of clearance) We are supporting a public sector client in hiring a NiFi Data Engineer to join a collaborative development team delivering a data Lakehouse architecture across both cloud and on-premises platforms. This is a hands-on data engineering role working within Agile sprints across a full ...

Description \n Job Title: NiFi Data Engineer \n Location: Hybrid (up to 3 days per week on-site, across offices in London & South England) \n Contract Length: 8 Months (with scope to extend) \n Start Date: September 2026 \n IR35: Outside \n Interview Process: 1 Stage, MS Teams … Clearance Required Before Applying: SC (with eligibility for higher levels of clearance) \n We are supporting a public sector client in hiring a NiFi Data Engineer to join a collaborative development team delivering a data Lakehouse architecture across both cloud and on-premises platforms. \n This is a hands ...

NICE FOR THE SENIOR SOFTWARE ENGINEER TO HAVE. Cloud based experience Microservice architecture or server-less architecture Big Data/Messaging technologies such as Apache Nifi/MiNiFi/Kafka SENIOR SOFTWARE ENGINEER - DV CLEARED KEY SKILLS: SENIOR SOFTWARE ENGINEER/SENIOR SOFTWARE DEVELOPER//LEAD SOFTWARE ...

troubleshoot batch and real-time data processing jobs. Your Skills: Hadoop Ecosystem: HDFS, Hive, Spark, MapReduce, YARN, HBase Data Integration: Sqoop, Kafka, Flume, NiFi Programming: Python, Scala, Java, Shell Scripting Databases: Oracle, SQL Server, MySQL, PostgreSQL Cloud: AWS, Azure, GCP Workflow Tools: Oozie, Airflow We are a Disability Confident ...

Bash, Ansible, Puppet) Familiarity with containerisation (Docker, Kubernetes) Nice to have: Experience with CI/CD pipelines (GitLab, Jenkins) Exposure to data tooling (Airflow, NiFi, Elasticsearch) Experience with Cloudera/Hadoop ecosystems (Spark, Hive, HDFS) Why join? Work on modern data platforms at scale Collaborate with data scientists ...

Elastic Cloud Enterprise. Knowledge of Elastic products, including ECE. Experience with Ansible and Bash scripting. Experience using Terraform. Knowledge of PKI. Awareness of Apache NiFi. Application If you are interested in this opportunity, please apply now with your updated CV in Microsoft Word/PDF format. Disclaimer Notwithstanding ...

with large-scale and unstructured datasets. Python development experience, including technologies such as PySpark, Pandas and PyArrow. Expertise in distributed data processing frameworks, particularly Apache Spark. Experience building and maintaining ETL pipelines using technologies such as Apache Airflow, AWS Step Functions or Apache NiFi. Cloud platform experience ...

with cloud platforms (AWS, Azure, GCP). Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow). Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have ...

monitor and optimize our big data platform in AWS cloud Manage and maintain services in Cloudera on-cloud PaaS & AWS-native like Kafka, Flink, NiFi, Iceberg Tables & DynamoDB IaaC deployment in AWS cloud via Terraform & ArgoCD Update, upgrade & incident management of all platform components Advise our data platform developers ...

monitor and optimize our big data platform in AWS cloud Manage and maintain services in Cloudera on-cloud PaaS & AWS-native like Kafka, Flink, NiFi, Iceberg Tables & DynamoDB IaaC deployment in AWS cloud via Terraform & ArgoCD Update, upgrade & incident management of all platform components Advise our data platform developers ...

monitor and optimize our big data platform in AWS cloud Manage and maintain services in Cloudera on-cloud PaaS & AWS-native like Kafka, Flink, NiFi, Iceberg Tables & DynamoDB IaaC deployment in AWS cloud via Terraform & ArgoCD Update, upgrade & incident management of all platform components Advise our data platform developers ...

monitor and optimize our big data platform in AWS cloud Manage and maintain services in Cloudera on-cloud PaaS & AWS-native like Kafka, Flink, NiFi, Iceberg Tables & DynamoDB IaaC deployment in AWS cloud via Terraform & ArgoCD Update, upgrade & incident management of all platform components Advise our data platform developers ...

experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise‐scale applications. You have team lead ...

work on-site in Leatherhead at least 1 day per week Desirable skills: Experience with GIS technologies Experience with workflow tools such as NiFi Experience with orchestration tools such as Temporal About Us FDM is an award-winning global leader in tech and business talent solutions, backed by more ...

Develop database schemas and data models. Integrate and enrich data from multiple sources, ensuring quality and consistency. Design and implement ETL processes (e.g. using NiFi). Write clean, secure, test-driven code that is reusable by default. Maintain and enhance data ingestion and storage architectures. Investigate and resolve data … security controls. Monitor, maintain and optimise data platforms to ensure performance and reliability. Skills and Experience Required: ETL development using Python or similar languages Apache Spark, NiFi, or Kafka Relational (PostgreSQL, MySQL) and NoSQL (MongoDB, Cassandra) databases AWS and cloud-based data services Palantir Foundry Stakeholder Engagement ...