51 to 53 of 53 Apache Spark Jobs in the North of England

Kafka Connect, Schema Registry, Cluster Linking and ksqlDB. Other highly valued skills may include Experience with streaming technologies such as Kafka Streams, Flink or Spark Streaming. Experience working with cloud-native technologies and Kubernetes-based platforms in enterprise environments. Effective collaboration, communication and problem-solving skills, with the ability ...

team capability growth and development. What We’re Looking For Experience as a Data Engineer with strong skills in areas such as Python, NumPy, Spark and Apache Pig. Proven experience in designing, developing and deploying scalable systems. Familiarity with CI/CD, containerisation, deployment technologies and cloud platforms ...

SparkMLlib, and Python ML libraries (scikit‐learn, XGBoost), including modeldeployment. Design and develop highly scalable, Real time systemsusing Hadoop ecosystem components(Iceberg, Spark, Ozone, Trino, Hive,Ranger, Kafka, Flink and Nifi) Build robust data ingestion and transformationframeworks using Java, Spark, Python, and shell scripting for ingestingmulti model data ...