2 of 2 Permanent HDFS Jobs

technologies including Kafka, AWS SQS or equivalent cloud-native services. Strong understanding of SQL and NoSQL databases. Experience with modern data storage technologies including HDFS, Iceberg, Elasticsearch, S3 and Data Lake architectures. Containerisation and orchestration experience using Docker, Kubernetes and/or OpenShift. Knowledge of testing frameworks, engineering standards ...

data pipelines, managing big data platforms, and transforming high-volume structured and unstructured financial data into actionable insights. Proficient in Hadoop ecosystem technologies including HDFS, Hive, Spark, Sqoop, Kafka, Oozie, and YARN , along with SQL and cloud-based data platforms Hybrid working: The places that you work from … data marts for reporting, analytics, and machine learning use cases. Monitor and troubleshoot batch and real-time data processing jobs. Your Skills: Hadoop Ecosystem: HDFS, Hive, Spark, MapReduce, YARN, HBase Data Integration: Sqoop, Kafka, Flume, NiFi Programming: Python, Scala, Java, Shell Scripting Databases: Oracle, SQL Server, MySQL, PostgreSQL Cloud ...