architectures, Lambda type architectures - Proficiency in writing and optimizing SQL - Knowledge of AWS services including S3, Redshift, EMR, Kinesis and RDS. - Experience with Open Source Data Technologies (Hadoop, Hive, Hbase, Pig, Spark, etc.) - Ability to write code in Python, Ruby, Scala or other platform-related Big data technology - Knowledge of professional software engineering practices & best practices for the full More ❯
coding test. Job Description: = Scala/Spark Good Big Data resource with the below Skillset: § Spark § Scala § Hive/HDFS/HQL Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.) Experience in Big data technologies, Real Time data processing platform (Spark Streaming) experience would be an advantage. Consistently demonstrates clear and concise written and verbal communication A history More ❯
benefits (e.g. UK pension schema) What do you offer? Strong hands-on experience working with modern Big Data technologies such as Apache Spark, Trino, Apache Kafka, Apache Hadoop, ApacheHBase, Apache Nifi, Apache Airflow, Opensearch Proficiency in cloud-native technologies such as containerization and Kubernetes Strong knowledge of DevOps tools (Terraform, Ansible, ArgoCD, GitOps, etc.) Proficiency in software development More ❯
Linux environments, including process and network diagnostics. Exposure to messaging, monitoring, and container orchestration (Kafka, RabbitMQ, Kubernetes, Docker, etc.). Solid knowledge of SQL/NoSQL databases (MongoDB, Cassandra, HBase, etc.). Desirable Skills and Experience Scala functional or concurrency libraries (ZIO, Akka Streams, Monix). Knowledge of C++ or Rust for performance-critical systems. Experience with CQRS architecture More ❯
Linux environments, including process and network diagnostics. Exposure to messaging, monitoring, and container orchestration (Kafka, RabbitMQ, Kubernetes, Docker, etc.). Solid knowledge of SQL/NoSQL databases (MongoDB, Cassandra, HBase, etc.). Desirable Skills and Experience Scala functional or concurrency libraries (ZIO, Akka Streams, Monix). Knowledge of C++ or Rust for performance-critical systems. Experience with CQRS architecture More ❯
