1 to 25 of 42 Permanent Apache NiFi Jobs in the UK

Responsibilities Design, build and maintain secure and scalable data engineering solutions. Develop and maintain data ingestion and transformation pipelines using Python, SQL and Apache NiFi . Design data models, schemas and data contracts/Interface Control Documents (ICDs) . Integrate data from REST APIs and other source systems. … maintainable. Essential Experience Proven commercial experience delivering Data Engineering solutions in project or production environments. Strong Python and SQL skills. Hands‐on experience with Apache NiFi and data pipeline orchestration. Data modelling and schema design. Parquet and S3‐compatible object storage . REST API integration. OpenShift or Kubernetes ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse ...

secure, scalable data solutions across the full lifecycle, including acquisition, integration, storage, processing and analysis. Develop and maintain data ingestion and transformation pipelines using Apache NiFi, Python and SQL. Design data models, schemas and data contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate … outputs. Experience required Proven experience delivering data engineering solutions in a project or production environment. Strong Python and SQL skills. Hands-on experience with Apache NiFi and data pipeline orchestration. Experience with data modelling and schema design. Experience with Parquet and S3-compatible object storage. Experience with REST ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse ...

Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...

Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...

Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...

related field* Experience influencing technical decisions and supporting capability growth.* Experience with CI/CD practices* Experience with big data tools e.g. Spark, Hadoop, NiFi* Exposure to infrastructure scaling e.g. Kubernetes* Exposure to Ansible and Terraform* Understanding of ML algorithms and deployment* Experience with SQL Server high-availability technologies ...

NoSQL) Experience with cloud technologies Experience with cloud platforms Experience with CI/CD practices Experience with big data tools e.g. Spark, Hadoop, NiFi Experience managing direct reports, providing regular guidance and performance feedback Ability to create delivery plans with estimated timelines for personal and team workloads Experience supporting ...

driven approach. Creating code that is open by default and easy for others to reuse. Required Skills Experience with Big Data technologies, such as Apache Hadoop, Spark or Pig AWS Apache NiFi Python or Java Built on over a 70 year heritage, Roke offers specialist knowledge ...

processes. Technical Skills Programming: Proficiency in Python, Java, Scala, or similar languages. Big Data Technologies: Hands-on experience with big data tools e.g. (Databricks, Apache Spark, Hadoop). Cloud Platforms: Familiarity with AWS, Azure, GCP, or other cloud ecosystems for data engineering tasks. Expertise in relational databases (e.g. postgres … server) Data Integration Tools: Knowledge of platforms like Airflow, Apache NiFi, or Talend. Data Storage and Modelling: Experience with data warehousing tools (e.g. Snowflake, Redshift, BigQuery) and schema design. Version Control and CI/CD: Familiarity with Git, Docker, and CI/CD pipelines for deployment. Experience 2+ ...

have Programming: Proficiency in Python, Java, Scala, or similar languages for data processing. Big Data Technologies: Hands-on experience with tools such as Databricks, Apache Spark, and Hadoop. Cloud Platforms: Familiarity with AWS, Azure, GCP, or other cloud ecosystems for data engineering tasks. Database Management: Expertise in relational databases … e.g. Postgres, SQL Server). Data Integration Tools: Knowledge of platforms like Airflow, Apache NiFi, or Talend. Data Storage and Modelling: Experience with data warehousing tools (e.g. Snowflake, Redshift, BigQuery) and schema design. Version Control and CI/CD: Familiarity with Git, Docker, and CI/CD pipelines ...

short-term engagement in Wiltshire. The role requires active MOD DV clearance, strong Python and SQL skills, and hands-on experience with Apache NiFi, data modelling and OpenShift/Kubernetes to deliver end-to-end data pipelines and resilient data contracts. #J-18808-Ljbffr ...

Experience of working with MOD Accreditors; and Knowledge of Onsite/project tech stack includes but is not limited to Azure, AWS, Docker, Kubernetes, Apache (NiFi, Kafka), NodeJS, Typescript, MongoDB, AI, Machine Learning etc. Just as important are curiosity, strong problem solving ability, and the motivation to continuously ...

cleared) to design and deliver secure, scalable data platforms for critical operations in the SW England region. You will craft data pipelines with NiFi, Python and SQL, define data models and ICDs, and ensure governance across complex environments. The role requires strong stakeholder engagement and hands-on experience with ...

limited to: C#/.NET, SPython FastAPI/Django, TypeScript, Angular, Vue.js, PostgreSQL, MongoDB, Redis/Valkey, RabbitMQ, Kafka, Azure, S3-compatible storage, Talend, NiFi, Docker, Podman, Kubernetes, Power Platform, and Office document automation tools such as Aspose. ð Join Assystem and play a key role in delivering enterprise ...

strong skills in several of the following Modern JavaScript GitLab CI/CD Observability Technologies Web API Integration GitLab Version Control Database Technologies OpenShift Apache NiFi Message Broker Technologies Java Web Auth Distributed Architecture Kubernetes SecDevOps Cloud Native Technologies The Interview Process We believe in keeping the interview ...

cloud migration. Relational and NoSQL databases, data integration and search technologies. Web and application frameworks such as React, Express and Next.js Tools including Gitlab, NiFi, Elasticsearch, Kibana, Jira and Confluence AI coding assistants, agentic coding and ML tooling Experience in some of these areas is advantageous, but this ...

need people with skills and expertise in the following areas: Oracle Databases & PL/SQLMicrosoft .NETAPIs & RESTful web servicesInterfacing & integrating multiple systems (e.g. Mirth, Nifi)Real time messaging technologies (e.g. Kafka)Healthcare interoperability standards (i.e. HL7, FHIR)Management of a development teamPlanning, design, articulation, & development of applications and automated ...

Engineer with the following skills: The Fundamentals: Modern JavaScript GitLab CI/CD Observability Technologies Java GitLab Version Control Database Technologies Web API Integration Apache NiFi Message Broker Technologies OpenShift Web Auth Distributed Architecture Kubernetes SecDevOps Cloud Native Technologies Required Clearance: DV or recently active DV Key Benefits ...

build data pipelines for national security projects. You’ll transform raw data from batch, streaming, and unstructured sources into actionable insights using Spark, NiFi, Kafka, and AWS services. Join a mission-driven team that values secure, scalable data solutions, and supports ongoing development with a hybrid working model including ...

cloud migration. Relational and NoSQL databases, data integration and search technologies. Web and application frameworks such as React, Express and Next.js. Tools including Gitlab, NiFi, Elasticsearch, Kibana, Jira and Confluence. AI coding assistants, agentic coding and ML tooling. While experience in certain domains is highly valuable, this role ...

trade booking and life cycle processesKnowledge/experience of FIX in equity order management or request for quote flows.Additional technology experience: React JS, Apache NiFi, MongoDB, Solace or similar messaging middlewareEducation:Bachelor’s degree or equivalent experience requiredMaster’s degree preferredThis job description provides a high-level review ...

booking and life cycle processes Knowledge/experience of FIX in equity order management or request for quote flows. Additional technology experience: React JS, Apache NiFi, MongoDB, Solace or similar messaging middleware Education: Bachelor’s degree or equivalent experience required Master’s degree preferred This job description provides ...