2 of 2 Apache Spark Jobs in the East Midlands

delivering high-quality data solutions within an Azure environment. Key Skills & Experience Required Strong hands-on experience with Python, PySpark , and SQL/Spark SQL for building production-grade ETL/ELT pipelines Solid knowledge of Apache Spark , including DataFrames, joins, aggregations, partitioning, caching, and performance optimisation ...

Kafka Connect, Schema Registry, Cluster Linking and ksqlDB.Some other highly valued skills may include: Experience with streaming technologies such as Kafka Streams, Flink or Spark Streaming. Experience working with cloud-native technologies and Kubernetes-based platforms in enterprise environments. Effective collaboration, communication and problem-solving skills, with the ability ...