20 of 20 Apache NiFi Jobs in the South West

secure, scalable data solutions across the full lifecycle, including acquisition, integration, storage, processing and analysis. Develop and maintain data ingestion and transformation pipelines using Apache NiFi, Python and SQL. Design data models, schemas and data contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate … take ownership of customer-facing deliverables. Strong Python and SQL skills, with experience building, testing and optimising data pipelines. Hands-on experience with Apache NiFi for data ingestion, routing, transformation and orchestration. Experience of data modelling and schema design, including defining data contracts or Interface Control Documents (ICDs ...

Responsibilities Design, build and maintain secure and scalable data engineering solutions. Develop and maintain data ingestion and transformation pipelines using Python, SQL and Apache NiFi . Design data models, schemas and data contracts/Interface Control Documents (ICDs) . Integrate data from REST APIs and other source systems. … maintainable. Essential Experience Proven commercial experience delivering Data Engineering solutions in project or production environments. Strong Python and SQL skills. Hands-on experience with Apache NiFi and data pipeline orchestration. Data modelling and schema design. Parquet and S3-compatible object storage . REST API integration. OpenShift or Kubernetes ...

data solutions across the full life cycle, including data acquisition, integration, storage, processing and analysis. Develop and maintain data ingestion and transformation pipelines using Apache NiFi, Python and SQL . Design data models, schemas, data contracts and Interface Control Documents (ICDs) to support reliable system integration. Integrate data … Data engineering within a project or production environment. Strong Python and SQL skills, including developing, testing and optimising data pipelines. Hands-on experience with Apache NiFi for data ingestion, routing, transformation and orchestration. Data modelling and schema design, including data contracts or Interface Control Documents (ICDs). Parquet ...

What You'll Do Design, build and maintain secure, scalable data platforms across ingestion, storage, processing and analytics workloads. Develop robust data pipelines using Apache NiFi, Python and SQL, integrating complex data from APIs and enterprise systems. Define and implement data models, schemas, data contracts and Interface Control … engineering solutions within complex project or production environments. Strong hands-on experience with Python and SQL, building and optimising scalable data pipelines. Expertise with Apache NiFi and data orchestration across multiple sources and systems. Experience designing data models, schemas, data contracts and integration frameworks. Strong understanding of REST ...

when required Must hold active Enhanced DV Clearance (West) Circa £700 p/d inside IR35 Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse ...

secure, scalable data solutions across the full lifecycle, including acquisition, integration, storage, processing and analysis. Develop and maintain data ingestion and transformation pipelines using Apache NiFi, Python and SQL. Design data models, schemas and data contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate … outputs. Experience required Proven experience delivering data engineering solutions in a project or production environment. Strong Python and SQL skills. Hands-on experience with Apache NiFi and data pipeline orchestration. Experience with data modelling and schema design. Experience with Parquet and S3-compatible object storage. Experience with REST ...

secure, scalable data solutions across the full lifecycle, including acquisition, integration, storage, processing and analysis. Develop and maintain data ingestion and transformation pipelines using Apache NiFi, Python and SQL. Design data models, schemas and data contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate … outputs. Experience required Proven experience delivering data engineering solutions in a project or production environment. Strong Python and SQL skills. Hands-on experience with Apache NiFi and data pipeline orchestration. Experience with data modelling and schema design. Experience with Parquet and S3-compatible object storage. Experience with REST ...

NoSQL) Experience with cloud technologies Experience with cloud platforms Experience with CI/CD practices Experience with big data tools e.g. Spark, Hadoop, NiFi Experience managing direct reports, providing regular guidance and performance feedback Ability to create delivery plans with estimated timelines for personal and team workloads Experience supporting ...

Data Engineer in secure government, defence, or intelligence settings. Strong Python and SQL development skills. Hands-on experience with data integration tools like Airflow, NiFi, Azure Data Factory, or AWS Glue. Expertise in Elasticsearch management, indexing, and query optimisation. Knowledge of data modelling, warehousing, and modern data platform architectures. ...

cloud migration. Relational and NoSQL databases, data integration and search technologies. Web and application frameworks such as React, Express and Next.js Tools including Gitlab, NiFi, Elasticsearch, Kibana, Jira and Confluence AI coding assistants, agentic coding and ML tooling Experience in some of these areas is advantageous, but this ...

limited to: C#/.NET, SPython FastAPI/Django, TypeScript, Angular, Vue.js, PostgreSQL, MongoDB, Redis/Valkey, RabbitMQ, Kafka, Azure, S3-compatible storage, Talend, NiFi, Docker, Podman, Kubernetes, Power Platform, and Office document automation tools such as Aspose. ð Join Assystem and play a key role in delivering enterprise ...

strong skills in several of the following Modern JavaScript GitLab CI/CD Observability Technologies Web API Integration GitLab Version Control Database Technologies OpenShift Apache NiFi Message Broker Technologies Java Web Auth Distributed Architecture Kubernetes SecDevOps Cloud Native Technologies The Interview Process We believe in keeping the interview ...

cloud migration. Relational and NoSQL databases, data integration and search technologies. Web and application frameworks such as React, Express and Next.js. Tools including Gitlab, NiFi, Elasticsearch, Kibana, Jira and Confluence. AI coding assistants, agentic coding and ML tooling. While experience in certain domains is highly valuable, this role ...

Engineer with the following skills: The Fundamentals: Modern JavaScript GitLab CI/CD Observability Technologies Java GitLab Version Control Database Technologies Web API Integration Apache NiFi Message Broker Technologies OpenShift Web Auth Distributed Architecture Kubernetes SecDevOps Cloud Native Technologies Required Clearance: DV or recently active DV Key Benefits ...

experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team lead ...

with cloud platforms (AWS, Azure, GCP) Well-versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have external ...

with cloud platforms (AWS, Azure, GCP) Well versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team lead ...

Node.js Distributed/data platforms: HDFS, HBase, Spark, plus increasing use of Kubernetes and cloud services Storage/search: MongoDB, OpenSearch Orchestration: Airflow, Dagster, NiFi Tooling: GitHub, GitHub Actions, Rundeck, Jira, Confluence Deployment/config: Ansible (physical), Terraform/Argo CD/Helm (Kubernetes) Development environment: MacBook (typical) Essential … testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code Degree in Computer Science or numerical degree Competitive salary DOE 25 days annual leave ...

As our next Data Engineer, you'll be managing and developing data pipelines that transform raw data into valuable insights for Roke's National Security customers, enabling downstream analytics and reporting. You'll be working ...