1 to 25 of 38 Apache NiFi Jobs in England

secure, scalable data solutions across the full lifecycle, including acquisition, integration, storage, processing and analysis. Develop and maintain data ingestion and transformation pipelines using Apache NiFi, Python and SQL. Design data models, schemas and data contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate … take ownership of customer-facing deliverables. Strong Python and SQL skills, with experience building, testing and optimising data pipelines. Hands-on experience with Apache NiFi for data ingestion, routing, transformation and orchestration. Experience of data modelling and schema design, including defining data contracts or Interface Control Documents (ICDs ...

Responsibilities Design, build and maintain secure and scalable data engineering solutions. Develop and maintain data ingestion and transformation pipelines using Python, SQL and Apache NiFi . Design data models, schemas and data contracts/Interface Control Documents (ICDs) . Integrate data from REST APIs and other source systems. … maintainable. Essential Experience Proven commercial experience delivering Data Engineering solutions in project or production environments. Strong Python and SQL skills. Hands-on experience with Apache NiFi and data pipeline orchestration. Data modelling and schema design. Parquet and S3-compatible object storage . REST API integration. OpenShift or Kubernetes ...

data solutions across the full life cycle, including data acquisition, integration, storage, processing and analysis. Develop and maintain data ingestion and transformation pipelines using Apache NiFi, Python and SQL . Design data models, schemas, data contracts and Interface Control Documents (ICDs) to support reliable system integration. Integrate data … Data engineering within a project or production environment. Strong Python and SQL skills, including developing, testing and optimising data pipelines. Hands-on experience with Apache NiFi for data ingestion, routing, transformation and orchestration. Data modelling and schema design, including data contracts or Interface Control Documents (ICDs). Parquet ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse ...

secure, scalable data solutions across the full lifecycle, including acquisition, integration, storage, processing and analysis. Develop and maintain data ingestion and transformation pipelines using Apache NiFi, Python and SQL. Design data models, schemas and data contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate … outputs. Experience required Proven experience delivering data engineering solutions in a project or production environment. Strong Python and SQL skills. Hands-on experience with Apache NiFi and data pipeline orchestration. Experience with data modelling and schema design. Experience with Parquet and S3-compatible object storage. Experience with REST ...

bespoke integration approaches for source-system onboarding. Define conceptual, logical and physical data models, including data flows, data domains and data ownership considerations. Specify Apache NiFi architecture patterns, flow standards, interface contracts and reusable ingestion components. Define governance, metadata, lineage, auditability, security monitoring and data quality requirements. Produce … lake architectures on AWS. Strong knowledge of AWS security, IAM, networking, storage and data platform services relevant to secure data engineering. Extensive experience with Apache NiFi architecture, flow design, governance and operational considerations. Experience designing integrations using REST APIs, SOAP services, file transfers, batch ingestion, legacy adapters ...

related field* Experience influencing technical decisions and supporting capability growth.* Experience with CI/CD practices* Experience with big data tools e.g. Spark, Hadoop, NiFi* Exposure to infrastructure scaling e.g. Kubernetes* Exposure to Ansible and Terraform* Understanding of ML algorithms and deployment* Experience with SQL Server high-availability technologies ...

NoSQL) Experience with cloud technologies Experience with cloud platforms Experience with CI/CD practices Experience with big data tools e.g. Spark, Hadoop, NiFi Experience managing direct reports, providing regular guidance and performance feedback Ability to create delivery plans with estimated timelines for personal and team workloads Experience supporting ...

Data Engineer in secure government, defence, or intelligence settings. Strong Python and SQL development skills. Hands-on experience with data integration tools like Airflow, NiFi, Azure Data Factory, or AWS Glue. Expertise in Elasticsearch management, indexing, and query optimisation. Knowledge of data modelling, warehousing, and modern data platform architectures. ...

driven approach. Creating code that is open by default and easy for others to reuse. Required Skills Experience with Big Data technologies, such as Apache Hadoop, Spark or Pig AWS Apache NiFi Python or Java Built on over a 70 year heritage, Roke offers specialist knowledge ...

TypeScript), Bash Frontend: Vue CI/CD & Automation: Jenkins, GitLab CI, Ansible, Cucumber Cloud & Platforms: AWS, OpenShift, Linux Infrastructure as Code: Terraform Data & Streaming: Apache NiFi Monitoring & Logging: Grafana, ELK Stack, SonarQube Version Control: GitLab Automation & Infrastructure as Code (IaC) Automate infrastructure provisioning, configuration, and CI/ ...

Docker and containerised environments * Linux and Microsoft Windows * SQL and database technologies * Prometheus, Grafana and ELK * ArgoCD or Flux * Kafka or NiFi * Nexus, Artifactory or Harbor * IAM, OAuth, OIDC and secrets management * Automated testing frameworks * Networking including DNS, TCP/IP, routing, switching, firewalls and VPNs ...

Docker and containerised environments * Linux and Microsoft Windows * SQL and database technologies * Prometheus, Grafana and ELK * ArgoCD or Flux * Kafka or NiFi * Nexus, Artifactory or Harbor * IAM, OAuth, OIDC and secrets management * Automated testing frameworks * Networking including DNS, TCP/IP, routing, switching, firewalls and VPNs ...

NICE FOR THE SENIOR SOFTWARE ENGINEER TO HAVE.... Cloud based experience Microservice architecture or server-less architecture Big Data/Messaging technologies such as Apache Nifi/MiNiFi/Kafka TO BE CONSIDERED.... Please either apply by clicking online or emailing me directly to For further information please ...

cloud migration. Relational and NoSQL databases, data integration and search technologies. Web and application frameworks such as React, Express and Next.js. Tools including Gitlab, NiFi, Elasticsearch, Kibana, Jira and Confluence. AI coding assistants, agentic coding and ML tooling. While experience in certain domains is highly valuable, this role ...

Experience of working with MOD Accreditors; and Knowledge of Onsite/project tech stack includes but is not limited to Azure, AWS, Docker, Kubernetes, Apache (NiFi, Kafka), NodeJS, Typescript, MongoDB, AI, Machine Learning etc. Just as important are curiosity, strong problem solving ability, and the motivation to continuously ...

cloud migration. Relational and NoSQL databases, data integration and search technologies. Web and application frameworks such as React, Express and Next.js Tools including Gitlab, NiFi, Elasticsearch, Kibana, Jira and Confluence AI coding assistants, agentic coding and ML tooling Experience in some of these areas is advantageous, but this ...

limited to: C#/.NET, SPython FastAPI/Django, TypeScript, Angular, Vue.js, PostgreSQL, MongoDB, Redis/Valkey, RabbitMQ, Kafka, Azure, S3-compatible storage, Talend, NiFi, Docker, Podman, Kubernetes, Power Platform, and Office document automation tools such as Aspose. ð Join Assystem and play a key role in delivering enterprise ...

strong skills in several of the following Modern JavaScript GitLab CI/CD Observability Technologies Web API Integration GitLab Version Control Database Technologies OpenShift Apache NiFi Message Broker Technologies Java Web Auth Distributed Architecture Kubernetes SecDevOps Cloud Native Technologies The Interview Process We believe in keeping the interview ...

will also value previous experience, and knowledge in: Spring/Spring Boot. PostgreSQL and Java Persistence API (JPA).Cucumber and Gherkin for automated testing. NiFi or similar workflow automation technology. Temporal or similar orchestration technology. RabbitMQ or similar message/streaming broker technology. Big data technologies such as HBase ...

cloud migration. Relational and NoSQL databases, data integration and search technologies. Web and application frameworks such as React, Express and Next.js. Tools including Gitlab, NiFi, Elasticsearch, Kibana, Jira and Confluence. AI coding assistants, agentic coding and ML tooling. While experience in certain domains is highly valuable, this role ...

Engineer with the following skills: The Fundamentals: Modern JavaScript GitLab CI/CD Observability Technologies Java GitLab Version Control Database Technologies Web API Integration Apache NiFi Message Broker Technologies OpenShift Web Auth Distributed Architecture Kubernetes SecDevOps Cloud Native Technologies Required Clearance: DV or recently active DV Key Benefits ...

Strong incident identification, investigation, resolution and recovery skills. - Experience working to service level agreements and established service management processes. ITIL 4 Foundation. Linux experience. Apache NiFi experience. Strong problem-solving, communication and interpersonal skills. A proactive, independent and adaptable approach. Ability to work with minimal supervision and take ...