18 of 18 Apache NiFi Jobs in the UK excluding London

Contract Software Data Engineer - Chester - Inside IR35 - Investment Banking

Location
Chester, England, United Kingdom
replay, backfill, recoverability and schema evolution Define and enhance operational telemetry, monitoring and platform observability Streaming & Distributed Data Processing Build and optimise solutions using:Apache Kafka Apache NiFi Apache Spark/PySpark Hadoop ecosystem technologies Hive and large-scale data storage platforms Develop scalable matching, enrichment … interested in engineers who can demonstrate strong expertise across several of the following areas: Core Technical Skills Python development in enterprise environments Apache Spark/PySpark Apache Kafka Apache NiFi Hadoop and Hive Advanced SQL REST API integration and development Data modelling and data lineage Distributed ...

Data Engineer - Gloucester

Hiring Organisation
NSD
Location
Gloucester, South West, United Kingdom
Employment Type
Permanent Contract, Hybrid
Salary
£70,000
hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse ...

Core Data Engineer

Location
City of Edinburgh, Scotland, United Kingdom
processes. Technical Skills Programming: Proficiency in Python, Java, Scala, or similar languages. Big Data Technologies: Hands-on experience with big data tools e.g. (Databricks, Apache Spark, Hadoop). Cloud Platforms: Familiarity with AWS, Azure, GCP, or other cloud ecosystems for data engineering tasks. Expertise in relational databases (e.g. postgres … server) Data Integration Tools: Knowledge of platforms like Airflow, Apache NiFi, or Talend. Data Storage and Modelling: Experience with data warehousing tools (e.g. Snowflake, Redshift, BigQuery) and schema design. Version Control and CI/CD: Familiarity with Git, Docker, and CI/CD pipelines for deployment. Experience 2+ ...

Senior Data Engineer

Location
City of Edinburgh, Scotland, United Kingdom
have Programming: Proficiency in Python, Java, Scala, or similar languages for data processing. Big Data Technologies: Hands-on experience with tools such as Databricks, Apache Spark, and Hadoop. Cloud Platforms: Familiarity with AWS, Azure, GCP, or other cloud ecosystems for data engineering tasks. Database Management: Expertise in relational databases … e.g. Postgres, SQL Server). Data Integration Tools: Knowledge of platforms like Airflow, Apache NiFi, or Talend. Data Storage and Modelling: Experience with data warehousing tools (e.g. Snowflake, Redshift, BigQuery) and schema design. Version Control and CI/CD: Familiarity with Git, Docker, and CI/CD pipelines ...

Data Engineer (early career)

Location
City of Edinburgh, Scotland, United Kingdom
cloud platforms such as AWS, Azure or GCP is desirable. Basic understanding of relational databases and SQL queries. Awareness of tools such as Airflow, Apache NiFi or Talend is helpful. Foundations in data warehousing, modelling and schema design, with an interest in building dashboards using Power BI, QlikView ...

Naimuri - Technical Lead Defence

Location
Salford, England, United Kingdom
specialist metrics for the evaluation of the performance of LLMs in different contexts. Trials test databases and reporting tools using technologies such as ElasticSearch, Nifi and Camunda. Accountabilities: Understands the technical aspects of the project and the wider customer business model. Creates and maintains the solution design and/ ...

Infrastructure Engineer- Manchester – National Security West

Hiring Organisation
Hackajob Ltd
Location
Manchester, North West, United Kingdom
Employment Type
Permanent Contract, Hybrid
configuration management and an interest in migrating to Ansible and cloud-native tooling. Experience managing Kubernetes platforms and deploying containerised applications. Knowledge of GitLab, Apache NiFi, HashiCorp Vault, Trend Micro Deep Security Manager, Ivanti device control, and Ansible Tower/AWX. Windows Infrastructure Experience with Windows Server administration ...

Senior Fullstack Engineer

Location
Cheltenham, England, United Kingdom
strong skills in several of the following Modern JavaScript GitLab CI/CD Observability Technologies Web API Integration GitLab Version Control Database Technologies OpenShift Apache NiFi Message Broker Technologies Java Web Auth Distributed Architecture Kubernetes SecDevOps Cloud Native Technologies The Interview Process We believe in keeping the interview ...

Fullstack Engineer

Location
Cheltenham, England, United Kingdom
Engineer with the following skills: The Fundamentals: Modern JavaScript GitLab CI/CD Observability Technologies Java GitLab Version Control Database Technologies Web API Integration Apache NiFi Message Broker Technologies OpenShift Web Auth Distributed Architecture Kubernetes SecDevOps Cloud Native Technologies Required Clearance: DV or recently active DV Key Benefits ...

Senior Developer - Equity Derivatives Tech (VP)

Location
Belfast City District, Northern Ireland, United Kingdom
booking and life cycle processes Knowledge/experience of FIX in equity order management or request for quote flows. Additional technology experience: React JS, Apache NiFi, MongoDB, Solace or similar messaging middleware Education: Bachelor’s degree or equivalent experience required Master’s degree preferred This job description provides ...

Senior Data Platform Engineer - Compliance & Streaming

Location
Chester, England, United Kingdom
. You will own data lifecycle, building scalable pipelines and ensuring governance in a regulated financial environment. You'll work with Python, Spark, Kafka, NiFi, Hadoop, Hive, and modern data-platform technologies, delivering production-grade controls and observability. #J-18808-Ljbffr ...

ML Engineer

Location
Carlisle, England, United Kingdom
learn, XGBoost), including modeldeployment. Design and develop highly scalable, Real time systemsusing Hadoop ecosystem components(Iceberg, Spark, Ozone, Trino, Hive,Ranger, Kafka, Flink and Nifi) Build robust data ingestion and transformationframeworks using Java, Spark, Python, and shell scripting for ingestingmulti model data(image, audio, video, unstructured documents) with bothbatch ...

Cyber Defence Engineer

Location
West Midlands, England, United Kingdom
trainingof new members of the data engineering team. Requirements Knowledge: A demonstrablenetworking background – experience in system administration. Knowledge of big datatechnologies and ecosystems (e.g. Apache NiFi). Knowledge of currentmarket and emerging tools in data analytical and SIEM platforms. Knowledgeof network security implementations (e.g., IDS, IPS, EDR), including ...

Lead Enterprise Architect

Hiring Organisation
DWP Digital
Location
Sheffield, Yorkshire, United Kingdom
Employment Type
Permanent Contract, Hybrid
Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool ...

Lead Enterprise Architect

Hiring Organisation
DWP Digital
Location
Manchester, North West, United Kingdom
Employment Type
Permanent Contract, Hybrid
Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool ...

Lead Enterprise Architect

Hiring Organisation
DWP Digital
Location
Birmingham, West Midlands, United Kingdom
Employment Type
Permanent Contract, Hybrid
Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool ...

Lead Enterprise Architect

Hiring Organisation
DWP Digital
Location
Newcastle Upon Tyne, North East, United Kingdom
Employment Type
Permanent Contract, Hybrid
Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool ...

Data Engineer

Location
Cheltenham, England, United Kingdom
Node.js Distributed/data platforms: HDFS, HBase, Spark, plus increasing use of Kubernetes and cloud services Storage/search: MongoDB, OpenSearch Orchestration: Airflow, Dagster, NiFi Tooling: GitHub, GitHub Actions, Rundeck, Jira, Confluence Deployment/config: Ansible (physical), Terraform/Argo CD/Helm (Kubernetes) Development environment: MacBook (typical) Essential … testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code Degree in Computer Science or numerical degree Competitive salary DOE 25 days annual leave ...