13 of 13 Remote/Hybrid Apache NiFi Jobs in England

replay, backfill, recoverability and schema evolution Define and enhance operational telemetry, monitoring and platform observability Streaming & Distributed Data Processing Build and optimise solutions using:Apache Kafka Apache NiFi Apache Spark/PySpark Hadoop ecosystem technologies Hive and large-scale data storage platforms Develop scalable matching, enrichment … interested in engineers who can demonstrate strong expertise across several of the following areas: Core Technical Skills Python development in enterprise environments Apache Spark/PySpark Apache Kafka Apache NiFi Hadoop and Hive Advanced SQL REST API integration and development Data modelling and data lineage Distributed ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse ...

Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...

Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...

related field Experience influencing technical decisions and supporting capability growth. Experience with CI/CD practices Experience with big data tools e.g. Spark, Hadoop, NiFi Exposure to infrastructure scaling e.g. Kubernetes Exposure to Ansible and Terraform Understanding of ML algorithms and deployment Experience with SQL Server high-availability technologies ...

NoSQL) Experience with cloud technologies Experience with cloud platforms Experience with CI/CD practices Experience with big data tools e.g. Spark, Hadoop, NiFi Experience managing direct reports, providing regular guidance and performance feedback Ability to create delivery plans with estimated timelines for personal and team workloads Experience supporting ...

specialist metrics for the evaluation of the performance of LLMs in different contexts. Trials test databases and reporting tools using technologies such as ElasticSearch, Nifi and Camunda. Accountabilities: Understands the technical aspects of the project and the wider customer business model. Creates and maintains the solution design and/ ...

configuration management and an interest in migrating to Ansible and cloud-native tooling. Experience managing Kubernetes platforms and deploying containerised applications. Knowledge of GitLab, Apache NiFi, HashiCorp Vault, Trend Micro Deep Security Manager, Ivanti device control, and Ansible Tower/AWX. Windows Infrastructure Experience with Windows Server administration ...

Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool ...

Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool ...

Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool ...

Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool ...

Node.js Distributed/data platforms: HDFS, HBase, Spark, plus increasing use of Kubernetes and cloud services Storage/search: MongoDB, OpenSearch Orchestration: Airflow, Dagster, NiFi Tooling: GitHub, GitHub Actions, Rundeck, Jira, Confluence Deployment/config: Ansible (physical), Terraform/Argo CD/Helm (Kubernetes) Development environment: MacBook (typical) Essential … testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code Degree in Computer Science or numerical degree Competitive salary DOE 25 days annual leave ...