5 of 5 Apache Spark Jobs in Cheshire

into business processes and decision-making. Technical Skills: Hands-on experience in one or more of the following areas: Programming & Analytics – Python, SQL, R, Spark, machine learning and advanced analytics Cloud & Data Platforms – Microsoft Fabric, Databricks, Snowflake, Azure, AWS and GCP AI Technologies – GenAI frameworks, Agentic AI, vector databases ...

understanding of how Fabric supports governed analytics and data engineering at scale. A good understanding of data processing technologies and tools such as Apache Spark, data lakes, data warehousing and SQL databases. Proficiency in Python and continuous integration and continuous delivery techniques, enabling change to be implemented consistently ...

focus on production reliability. Essential skills and experience Strong hands-on experience developing data engineering solutions using Python and PySpark. Practical experience with Apache Kafka and Apache NiFi for streaming, ingestion and orchestration. Experience working with Hadoop, Hive or comparable enterprise data-lake technologies. Solid knowledge … software development tools. Exposure to agentic AI, workflow orchestration or retrieval-augmented generation. Key responsibilities Design and develop scalable data pipelines using Python, PySpark, Apache Kafka and Apache NiFi. Integrate vendor platforms and enterprise systems through REST APIs and secure authentication mechanisms. Build data processing and storage solutions ...

include: Contributing to disaster recovery, business continuity and platform resilience solutions for streaming environments. Working with streaming technologies such as Kafka Streams, Flink or Spark Streaming and applying real‐time data processing approaches to business requirements. Working collaboratively across engineering, architecture, security and infrastructure teams, sharing knowledge and contributing ...

Kafka Connect, Schema Registry, Cluster Linking and ksqlDB. Other highly valued skills may include Experience with streaming technologies such as Kafka Streams, Flink or Spark Streaming. Experience working with cloud-native technologies and Kubernetes-based platforms in enterprise environments. Effective collaboration, communication and problem-solving skills, with the ability ...