1 to 25 of 27 Permanent Apache NiFi Jobs in the UK

Contract Software Data Engineer - Chester - Inside IR35 - Investment Banking

Location
Chester, England, United Kingdom
replay, backfill, recoverability and schema evolution Define and enhance operational telemetry, monitoring and platform observability Streaming & Distributed Data Processing Build and optimise solutions using:Apache Kafka Apache NiFi Apache Spark/PySpark Hadoop ecosystem technologies Hive and large-scale data storage platforms Develop scalable matching, enrichment … interested in engineers who can demonstrate strong expertise across several of the following areas: Core Technical Skills Python development in enterprise environments Apache Spark/PySpark Apache Kafka Apache NiFi Hadoop and Hive Advanced SQL REST API integration and development Data modelling and data lineage Distributed ...

Data Engineer - Gloucester

Hiring Organisation
NSD
Location
Gloucester, South West, United Kingdom
Employment Type
Permanent Contract, Hybrid
Salary
£70,000
hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...

Principal Data Engineer

Location
Greater London, England, United Kingdom
Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...

Senior Data Engineer

Location
West of England, England, United Kingdom
related field Experience influencing technical decisions and supporting capability growth. Experience with CI/CD practices Experience with big data tools e.g. Spark, Hadoop, NiFi Exposure to infrastructure scaling e.g. Kubernetes Exposure to Ansible and Terraform Understanding of ML algorithms and deployment Experience with SQL Server high-availability technologies ...

Core Data Engineer

Location
City of Edinburgh, Scotland, United Kingdom
processes. Technical Skills Programming: Proficiency in Python, Java, Scala, or similar languages. Big Data Technologies: Hands-on experience with big data tools e.g. (Databricks, Apache Spark, Hadoop). Cloud Platforms: Familiarity with AWS, Azure, GCP, or other cloud ecosystems for data engineering tasks. Expertise in relational databases (e.g. postgres … server) Data Integration Tools: Knowledge of platforms like Airflow, Apache NiFi, or Talend. Data Storage and Modelling: Experience with data warehousing tools (e.g. Snowflake, Redshift, BigQuery) and schema design. Version Control and CI/CD: Familiarity with Git, Docker, and CI/CD pipelines for deployment. Experience 2+ ...

Senior Data Engineer

Location
City of Edinburgh, Scotland, United Kingdom
have Programming: Proficiency in Python, Java, Scala, or similar languages for data processing. Big Data Technologies: Hands-on experience with tools such as Databricks, Apache Spark, and Hadoop. Cloud Platforms: Familiarity with AWS, Azure, GCP, or other cloud ecosystems for data engineering tasks. Database Management: Expertise in relational databases … e.g. Postgres, SQL Server). Data Integration Tools: Knowledge of platforms like Airflow, Apache NiFi, or Talend. Data Storage and Modelling: Experience with data warehousing tools (e.g. Snowflake, Redshift, BigQuery) and schema design. Version Control and CI/CD: Familiarity with Git, Docker, and CI/CD pipelines ...

Data Engineer

Location
Greater London, England, United Kingdom
designs, explaining technical trade‐offs and reviewing others’ work The knowledge, experience and qualifications that will help Ingestion and orchestration tools such as Ansible, Apache NiFi or Cribl Docker, Kubernetes and AWS services such as S3, Lambda, Step Functions and SageMaker Working with Cyber Security and Infrastructure data ...

Data Engineer (early career)

Location
City of Edinburgh, Scotland, United Kingdom
cloud platforms such as AWS, Azure or GCP is desirable. Basic understanding of relational databases and SQL queries. Awareness of tools such as Airflow, Apache NiFi or Talend is helpful. Foundations in data warehousing, modelling and schema design, with an interest in building dashboards using Power BI, QlikView ...

Naimuri - Technical Lead Defence

Location
Salford, England, United Kingdom
specialist metrics for the evaluation of the performance of LLMs in different contexts. Trials test databases and reporting tools using technologies such as ElasticSearch, Nifi and Camunda. Accountabilities: Understands the technical aspects of the project and the wider customer business model. Creates and maintains the solution design and/ ...

Infrastructure Engineer- Manchester – National Security West

Hiring Organisation
Hackajob Ltd
Location
Manchester, North West, United Kingdom
Employment Type
Permanent Contract, Hybrid
configuration management and an interest in migrating to Ansible and cloud-native tooling. Experience managing Kubernetes platforms and deploying containerised applications. Knowledge of GitLab, Apache NiFi, HashiCorp Vault, Trend Micro Deep Security Manager, Ivanti device control, and Ansible Tower/AWX. Windows Infrastructure Experience with Windows Server administration ...

Senior Fullstack Engineer

Location
Cheltenham, England, United Kingdom
strong skills in several of the following Modern JavaScript GitLab CI/CD Observability Technologies Web API Integration GitLab Version Control Database Technologies OpenShift Apache NiFi Message Broker Technologies Java Web Auth Distributed Architecture Kubernetes SecDevOps Cloud Native Technologies The Interview Process We believe in keeping the interview ...

Site Reliability Engineer - DV Cleared

Hiring Organisation
Stott & May Professional Search Limited (TJ)
Location
United Kingdom
Employment Type
Freelance / Project collaboration
Salary
£
problem-solving skills - Excellent communication and stakeholder skills Desirable - GitLab/CI/CD - REST APIs - IIS - Jira/Confluence - Keycloak, Grafana, Elasticsearch or NiFi ...

Fullstack Engineer

Location
Cheltenham, England, United Kingdom
Engineer with the following skills: The Fundamentals: Modern JavaScript GitLab CI/CD Observability Technologies Java GitLab Version Control Database Technologies Web API Integration Apache NiFi Message Broker Technologies OpenShift Web Auth Distributed Architecture Kubernetes SecDevOps Cloud Native Technologies Required Clearance: DV or recently active DV Key Benefits ...

Knowledge Engineering Senior Manager

Location
Greater London, England, United Kingdom
with cloud platforms (AWS, Azure, GCP) Well-versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have external ...

Senior Developer - Equity Derivatives Tech (VP)

Location
Belfast City District, Northern Ireland, United Kingdom
booking and life cycle processes Knowledge/experience of FIX in equity order management or request for quote flows. Additional technology experience: React JS, Apache NiFi, MongoDB, Solace or similar messaging middleware Education: Bachelor’s degree or equivalent experience required Master’s degree preferred This job description provides ...

Senior Data Platform Engineer - Compliance & Streaming

Location
Chester, England, United Kingdom
. You will own data lifecycle, building scalable pipelines and ensuring governance in a regulated financial environment. You'll work with Python, Spark, Kafka, NiFi, Hadoop, Hive, and modern data-platform technologies, delivering production-grade controls and observability. #J-18808-Ljbffr ...

Support Engineer (SC cleared)

Hiring Organisation
Stott & May Professional Search Limited (TJ)
Location
United Kingdom
Employment Type
Freelance / Project collaboration
Salary
£500 - £800 per day
Identify opportunities for service improvements and manage technical risks. - Provide technical guidance and support to other engineers. Essential Skills & Experience - ITIL 4 Foundation. - Linux. - Apache NiFi. - Strong troubleshooting and problem-solving skills. - Proactive, adaptable and able to work independently with minimal supervision. - Good communication and stakeholder management skills. Desirable ...

Lead SAS Administrator

Location
Greater London, England, United Kingdom
Certified Base Programmer credentials. PowerShell, SAS Macro and SQL pass‐through experience, including query optimisation. Knowledge of Red Hat Enterprise Linux, Azure Synapse, Apache NiFi, SAN or Lustre technologies. Experience in banking, financial services or another environment handling large, business‐critical data volumes. Experience with automation, automated testing ...

ML Engineer

Location
Carlisle, England, United Kingdom
learn, XGBoost), including modeldeployment. Design and develop highly scalable, Real time systemsusing Hadoop ecosystem components(Iceberg, Spark, Ozone, Trino, Hive,Ranger, Kafka, Flink and Nifi) Build robust data ingestion and transformationframeworks using Java, Spark, Python, and shell scripting for ingestingmulti model data(image, audio, video, unstructured documents) with bothbatch ...

Cyber Defence Engineer

Location
West Midlands, England, United Kingdom
trainingof new members of the data engineering team. Requirements Knowledge: A demonstrablenetworking background – experience in system administration. Knowledge of big datatechnologies and ecosystems (e.g. Apache NiFi). Knowledge of currentmarket and emerging tools in data analytical and SIEM platforms. Knowledgeof network security implementations (e.g., IDS, IPS, EDR), including ...

Lead Enterprise Architect

Hiring Organisation
DWP Digital
Location
Sheffield, Yorkshire, United Kingdom
Employment Type
Permanent Contract, Hybrid
Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool ...

Lead Enterprise Architect

Hiring Organisation
DWP Digital
Location
Manchester, North West, United Kingdom
Employment Type
Permanent Contract, Hybrid
Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool ...

Lead Enterprise Architect

Hiring Organisation
DWP Digital
Location
Birmingham, West Midlands, United Kingdom
Employment Type
Permanent Contract, Hybrid
Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool ...

Lead Enterprise Architect

Hiring Organisation
DWP Digital
Location
Newcastle Upon Tyne, North East, United Kingdom
Employment Type
Permanent Contract, Hybrid
Graph, Ledger, Vector). Experience of different data transfer and transformation Extract, Transform, Load (ETL, ELT) tools and processes (e.g., AWS Glue, Informatica, Talend, Apache NiFi) in modern data platforms. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool ...