2 of 2 Kafka Jobs in Colchester

Docker) Big Data Technologies (Apache.... Spark, Flink, HDFS, Airflow, Trino, Iceberg, Hive) Dependency injection frameworks (Spring) Observability (Loki/Grafana) Large scale data processing (Kafka) CI/CD Build tools ( Maven, Git, Jenkins ) NoSQL DBs (Cockroach DB, Cassandra, Zookeeper, ArangoDB) Your responsibilities: Design, implement and provide architectural guidance ...

ensure successful project delivery, adhering to client timelines and quality standards. Implement and manage real-time and batch data processing frameworks (e.g., Apache Kafka, Apache Spark, Google Cloud Dataproc) in line with project needs. Build and maintain robust monitoring, logging, and alerting systems for client projects, ensuring system health … designing and optimising data pipelines using frameworks like Apache Airflow or equivalent. Demonstrated experience with real-time and batch data processing frameworks, including Apache Kafka, Apache Spark, or Google Cloud Dataflow. Proficiency in CI/CD tools such as Jenkins, GitLab CI/CD, or Cloud Build, along with ...