1 of 1 Remote/Hybrid Spark Streaming Jobs in Northern Ireland

Data Engineering Specialist

Hiring Organisation
BT Group
Location
Belfast, Down, United Kingdom
Salary
£ 60 K
data pipelines using Ab Initio (GDE, PDL, Conduct>IT, Express>IT).Build scalable batch and streaming workloads using Apache Spark (PySpark/Scala).Develop and orchestrate data ingestion flows using Apache NiFi for real-time and near-real-time use cases.Optimize ETL/ELT jobs … expertise in Ab Initio (GDE, PDL, Conduct>IT, Express>IT, EME) with a focus on parallel processing and component optimisation.Hands-on experience with Apache Spark, including Spark SQL, Spark Streaming, and performance tuning.Practical experience with Apache NiFi for flow design, processor tuning ...