6 of 6 Remote/Hybrid Permanent Spark Streaming Jobs

data pipelines using Ab Initio (GDE, PDL, Conduct>IT, Express>IT).Build scalable batch and streaming workloads using Apache Spark (PySpark/Scala).Develop and orchestrate data ingestion flows using Apache NiFi for real-time and near-real-time use cases.Optimize ETL/ELT jobs … expertise in Ab Initio (GDE, PDL, Conduct>IT, Express>IT, EME) with a focus on parallel processing and component optimisation.Hands-on experience with Apache Spark, including Spark SQL, Spark Streaming, and performance tuning.Practical experience with Apache NiFi for flow design, processor tuning ...

delivery. What We’re Looking For Strong proficiency in Python, Scala, or Java with hands-on experience in Big Data technologies including Spark, Hadoop, or similar distributed processing frameworks. Practical experience building real-time event streaming pipelines using technologies such as Kafka, Spark Streaming … Bonus Points For Expertise in data modelling, schema design, and working with structured and semi-structured datasets. Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation. Knowledge of automating cloud-based ingestion and transformation frameworks. Experience delivering data engineering solutions within highly regulated ...

delivery. What We’re Looking For Strong proficiency in Python, Scala, or Java, with hands-on experience of Big Data technologies including Spark, Hadoop, or similar distributed processing frameworks. Experience building real-time event streaming solutions using technologies such as Kafka, Spark Streaming … Bonus Points For Expertise in data modelling, schema design, and working with structured and semi-structured datasets. Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation. Knowledge of automating ingestion and transformation frameworks within cloud-native data platforms. Experience delivering solutions within highly ...

that are measurable and tied to business outcomesBuild — Design and validate solutions on both the customer side and the Treasure AI product sideDesign streaming architectures that handle real-world complexity: late-arriving events, schema drift, backpressure, partial failures, and sub-second SLA requirementsDrive technical decisions with clear rationale … software or data engineering experience, with at least 2 years in a customer-facing, embedded, or solutions engineering capacityStrong hands-on experience with streaming and event-driven architectures — Kafka, Flink, Kinesis, Spark Streaming, or equivalent (DynamoDB and MemoryDB/Redis)AWS Cloud Fluency - understand ...

Networks training.**Nice-to-Have Qualifications*** Experience with telecom digital twin platforms.* Experience with vector databases, embeddings, semantic search, or RAG.* Experience with streaming data platforms such as Kafka, Pub/Sub, Flink, or Spark Streaming.* Experience supporting closed-loop automation, predictive assurance, or self-healing ...

Networks training. Nice-to-Have Qualifications Experience with telecom digital twin platforms. Experience with vector databases, embeddings, semantic search, or RAG. Experience with streaming data platforms such as Kafka, Pub/Sub, Flink, or Spark Streaming. Experience supporting closed-loop automation, predictive assurance, or self-healing ...