1 to 25 of 54 Apache NiFi Jobs

developers, engineers, architects, and platform specialists, contributing to both business-as-usual services and innovative technology initiatives. The role offers exposure to Kubernetes, OpenShift, Apache NiFi, Identity Platforms, DevOps tooling, and open-source technologies. Key Responsibilities As an IdAM Application Developer, you will: Design, develop, test, and deploy … enhance in-house Kubernetes clusters supporting application delivery across multiple environments. Develop and maintain Ansible automation roles, enabling users to independently deploy and manage Apache NiFi clusters. Provide technical guidance, support, and training on Apache NiFi and related technologies. Collaborate with engineering teams to deliver secure ...

secure, scalable data solutions across the full lifecycle, including acquisition, integration, storage, processing and analysis. Develop and maintain data ingestion and transformation pipelines using Apache NiFi, Python and SQL. Design data models, schemas and data contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate … take ownership of customer-facing deliverables. Strong Python and SQL skills, with experience building, testing and optimising data pipelines. Hands-on experience with Apache NiFi for data ingestion, routing, transformation and orchestration. Experience of data modelling and schema design, including defining data contracts or Interface Control Documents (ICDs ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse ...

secure, scalable data solutions across the full lifecycle, including acquisition, integration, storage, processing and analysis. Develop and maintain data ingestion and transformation pipelines using Apache NiFi, Python and SQL. Design data models, schemas and data contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate … outputs. Experience required Proven experience delivering data engineering solutions in a project or production environment. Strong Python and SQL skills. Hands-on experience with Apache NiFi and data pipeline orchestration. Experience with data modelling and schema design. Experience with Parquet and S3-compatible object storage. Experience with REST ...

secure, scalable data solutions across the full lifecycle, including acquisition, integration, storage, processing and analysis. Develop and maintain data ingestion and transformation pipelines using Apache NiFi, Python and SQL. Design data models, schemas and data contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate … outputs. Experience required Proven experience delivering data engineering solutions in a project or production environment. Strong Python and SQL skills. Hands-on experience with Apache NiFi and data pipeline orchestration. Experience with data modelling and schema design. Experience with Parquet and S3-compatible object storage. Experience with REST ...

bespoke integration approaches for source-system onboarding. Define conceptual, logical and physical data models, including data flows, data domains and data ownership considerations. Specify Apache NiFi architecture patterns, flow standards, interface contracts and reusable ingestion components. Define governance, metadata, lineage, auditability, security monitoring and data quality requirements. Produce … lake architectures on AWS. Strong knowledge of AWS security, IAM, networking, storage and data platform services relevant to secure data engineering. Extensive experience with Apache NiFi architecture, flow design, governance and operational considerations. Experience designing integrations using REST APIs, SOAP services, file transfers, batch ingestion, legacy adapters ...

Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...

Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...

Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...

related field Experience influencing technical decisions and supporting capability growth. Experience with CI/CD practices Experience with big data tools e.g. Spark, Hadoop, NiFi Exposure to infrastructure scaling e.g. Kubernetes Exposure to Ansible and Terraform Understanding of ML algorithms and deployment Experience with SQL Server high-availability technologies ...

NoSQL)* Experience with cloud technologies* Experience with cloud platforms* Experience with CI/CD practices* Experience with big data tools e.g. Spark, Hadoop, NiFi* Experience managing direct reports, providing regular guidance and performance feedback* Ability to create delivery plans with estimated timelines for personal and team workloads* Experience supporting ...

NoSQL) Experience with cloud technologies Experience with cloud platforms Experience with CI/CD practices Experience with big data tools e.g. Spark, Hadoop, NiFi Experience managing direct reports, providing regular guidance and performance feedback Ability to create delivery plans with estimated timelines for personal and team workloads Experience supporting ...

processes. Technical Skills Programming: Proficiency in Python, Java, Scala, or similar languages. Big Data Technologies: Hands-on experience with big data tools e.g. (Databricks, Apache Spark, Hadoop). Cloud Platforms: Familiarity with AWS, Azure, GCP, or other cloud ecosystems for data engineering tasks. Expertise in relational databases (e.g. postgres … server) Data Integration Tools: Knowledge of platforms like Airflow, Apache NiFi, or Talend. Data Storage and Modelling: Experience with data warehousing tools (e.g. Snowflake, Redshift, BigQuery) and schema design. Version Control and CI/CD: Familiarity with Git, Docker, and CI/CD pipelines for deployment. Experience 2+ ...

have Programming: Proficiency in Python, Java, Scala, or similar languages for data processing. Big Data Technologies: Hands-on experience with tools such as Databricks, Apache Spark, and Hadoop. Cloud Platforms: Familiarity with AWS, Azure, GCP, or other cloud ecosystems for data engineering tasks. Database Management: Expertise in relational databases … e.g. Postgres, SQL Server). Data Integration Tools: Knowledge of platforms like Airflow, Apache NiFi, or Talend. Data Storage and Modelling: Experience with data warehousing tools (e.g. Snowflake, Redshift, BigQuery) and schema design. Version Control and CI/CD: Familiarity with Git, Docker, and CI/CD pipelines ...

short-term engagement in Wiltshire. The role requires active MOD DV clearance, strong Python and SQL skills, and hands-on experience with Apache NiFi, data modelling and OpenShift/Kubernetes to deliver end-to-end data pipelines and resilient data contracts. #J-18808-Ljbffr ...

cloud migration. Relational and NoSQL databases, data integration and search technologies. Web and application frameworks such as React, Express and Next.js. Tools including Gitlab, NiFi, Elasticsearch, Kibana, Jira and Confluence. AI coding assistants, agentic coding and ML tooling. While experience in certain domains is highly valuable, this role ...

Databricks, Object/Relational Mapping, Query performance tuning. Cloud-based development and management: Azure, Kubernetes, Docker. Web Services: REST. Frameworks: Spring Framework, Spring Boot, Apache Kafka. Front-end: Thyme leaf, NodeJS, HTML, CSS, Angular. Build/deployment tools: Gradle, Terraform, Helm, Kustomize, GitHub Actions. Other DevOps Toolchain: Slack, GitHub … Fluentbit, Apache NiFi, Dynatrace, Microsoft Teams, Grafana. Other: Linux/Unix shell scripting, Disaster Recovery. Proficiency in object-oriented design techniques and principles. Proficiency in Microsoft Office Tools (Project, Excel, Word, PowerPoint, etc.). Experience in Agile methodologies such as SCRUM. Experience in DevOps Toolchain methodologies, including Continuous ...

Experience of working with MOD Accreditors; and Knowledge of Onsite/project tech stack includes but is not limited to Azure, AWS, Docker, Kubernetes, Apache (NiFi, Kafka), NodeJS, Typescript, MongoDB, AI, Machine Learning etc. Just as important are curiosity, strong problem solving ability, and the motivation to continuously ...

Layer: Design and implementation for governed reusable data views. Data Governance Tools: Collibra, Alation, Talend or equivalent. Expertise in ETL tools and processes (e.g., Apache NiFi, Talend, Informatica)Security: Data Privacy, Data Protection & Encryption frameworks & governanceEnterprise Architecture Frameworks: TOGAF, Zachman; familiarity with ITIL processes. Additional Helpful Skills: Cloud ...

cleared) to design and deliver secure, scalable data platforms for critical operations in the SW England region. You will craft data pipelines with NiFi, Python and SQL, define data models and ICDs, and ensure governance across complex environments. The role requires strong stakeholder engagement and hands-on experience with ...

problem‐solving skills Excellent communication and stakeholder skills Desirable GitLab/CI/CD REST APIs IIS Jira/Confluence Keycloak, Grafana, Elasticsearch or NiFi #J-18808-Ljbffr ...

problem-solving skills - Excellent communication and stakeholder skills Desirable - GitLab/CI/CD - REST APIs - IIS - Jira/Confluence - Keycloak, Grafana, Elasticsearch or NiFi ...

cloud migration. Relational and NoSQL databases, data integration and search technologies. Web and application frameworks such as React, Express and Next.js Tools including Gitlab, NiFi, Elasticsearch, Kibana, Jira and Confluence AI coding assistants, agentic coding and ML tooling Experience in some of these areas is advantageous, but this ...

strong skills in several of the following Modern JavaScript GitLab CI/CD Observability Technologies Web API Integration GitLab Version Control Database Technologies OpenShift Apache NiFi Message Broker Technologies Java Web Auth Distributed Architecture Kubernetes SecDevOps Cloud Native Technologies The Interview Process We believe in keeping the interview ...