4 of 4 Permanent Spark Streaming Jobs in England

Kafka. • Configuring, deploying, and maintaining Kafka clusters to ensure high availability and scalability. • Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming Schema Registry, Flink and Beam. • Collaborating with cross-functional teams to understand data requirements and design solutions that meet business needs. • Implementing security measures to protect … source kafka experience • Spend a lot of time on Disaster Recovery aspects • Read up and explain new features like KRAFT • Kafka Resiliency • Any Real time tech experience like Spark Required Skills Experience • Extensive Experience with Apache Kafka and real-time architecture including event driven frameworks. • Strong Knowledge of Kafka Streams, Kafka Connect, Spark Streaming More ❯

Kafka. Configuring, deploying, and maintaining Kafka clusters to ensure high availability and scalability. Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming Schema Registry, Flink and Beam. Collaborating with cross-functional teams to understand data requirements and design solutions that meet business needs. Implementing security measures to protect … features, updates and industry practices. Required Skills Experience Extensive Experience with Apache Kafka and real-time architecture including event driven frameworks. Strong Knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink and Beam. Experience with cloud platform such as GCP Pub/Sub. Excellent problem-solving skills. Knowledge & Experience/Qualifications Knowledge of Kafka More ❯

and data warehousing principles. Experience working with cloud platforms such as AWS, Azure, or GCP. Exposure to modern data tools such as Snowflake, Databricks, or BigQuery. Familiarity with streaming technologies (e.g., Kafka, Spark Streaming, Flink) is an advantage. Experience with orchestration and infrastructure tools such as Airflow, dbt, Prefect, CI/CD pipelines, and More ❯

API & Micro services Architecture: Comfortable working with REST APIs and micro services architectures. Real-time Stream Processing: Understanding of real-time stream processing frameworks (e.g., PubSub, Kafka, Flink, Spark Streaming). BI Tools & Visualisation Platforms: Experience supporting BI tools or visualization platforms (e.g. Looker, Grafana, PowerBI etc.). Data Pipelines & APIs: Experience in building and maintaining … both batch and streaming data pipelines and APIs. ETL/ELT Processes: Exposure to ETL/ELT processes in medium-to-large scale data environments (experience handling millions of records/events daily is a plus). Preferred Skills Python: Knowledge for data automation and scripting. Containerization: Familiarity with tools like Docker and Kubernetes. Workflow/Orchestration Tools More ❯