architectures, Lambda type architectures - Proficiency in writing and optimizing SQL - Knowledge of AWS services including S3, Redshift, EMR, Kinesis and RDS. - Experience with Open Source Data Technologies (Hadoop, Hive, Hbase, Pig, Spark, etc.) - Ability to write code in Python, Ruby, Scala or other platform-related Big data technology - Knowledge of professional software engineering practices & best practices for the full More ❯
coding test. Job Description: = Scala/Spark Good Big Data resource with the below Skillset: § Spark § Scala § Hive/HDFS/HQL Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.) Experience in Big data technologies, Real Time data processing platform (Spark Streaming) experience would be an advantage. Consistently demonstrates clear and concise written and verbal communication A history More ❯
benefits (e.g. UK pension schema) What do you offer? Strong hands-on experience working with modern Big Data technologies such as Apache Spark, Trino, Apache Kafka, Apache Hadoop, ApacheHBase, Apache Nifi, Apache Airflow, Opensearch Proficiency in cloud-native technologies such as containerization and Kubernetes Strong knowledge of DevOps tools (Terraform, Ansible, ArgoCD, GitOps, etc.) Proficiency in software development More ❯
includes experience of analytics area, especially in data warehouse and data lake technologies. Familiar with services and products related to data analysis, for example: Redshift, EMR, ElasticSearch, Flink, Spark, Hbase, Kafka, Kinesis, Trino, Hudi, Iceberg, etc.Experience with Data and AI projects and tool usage will be given priority. About the team Diverse Experiences AWS values diverse experiences. Even if … IT development or implementation/consulting in the software or Internet industries experience - Familiar with services and products related to data analysis, for example: Redshift, EMR, OpenSearch, Flink, Spark, Hbase, Kafka, Kinesis, Trino, Hudi, Iceberg, etc. - Experience in deploying and maintaining big data projects. PREFERRED QUALIFICATIONS - Experience working within software development or Internet-related industries - Experience migrating or transforming More ❯
