15 of 15 HDFS Jobs

environments. Bonus Points ForExpertise in data modelling, schema design, and working with structured and semi-structured datasets. Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation. Knowledge of automating cloud-based ingestion and transformation frameworks. Experience delivering data engineering solutions within highly regulated industries such ...

Points For Expertise in Data Modelling, schema design, and handling both structured and semi-structured data. Familiarity with distributed systems such as Hadoop, Spark, HDFS, Hive, Databricks. Exposure to AWS Lake Formation and automation of ingestion and transformation layers. Background in delivering solutions for highly regulated industries. Passion for mentoring ...

solutions. Bonus Points ForExpertise in data modelling, schema design, and working with structured and semi-structured datasets. Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation. Knowledge of automating ingestion and transformation frameworks within cloud-native data platforms. Experience delivering solutions within highly regulated industries ...

including mappings, workflows, applications, transformations, and reusable components. Support the migration of data assets, ETL pipelines, and workloads from the Cloudera Hadoop platform (HDFS, Hive, Impala, Spark) to AWS Cloud. Design, develop, and optimise data ingestion, transformation, and loading processes into Amazon S3 Data Lake and Amazon Redshift. Develop ...

Owns the architecture, design, and lifecycle management of enterprise Hadoop clusters and supporting data platform services. Leads administration of Hadoop ecosystem components such as HDFS, YARN, Hive, HBase, Spark, Kafka, Oozie, ZooKeeper, Impala , and related tooling. Defines platform standards for availability, performance, capacity planning, disaster recovery, backup, monitoring, and security. ...

Linux, bare metal and virtual machines· Provisioning: Puppet, Kickstart, RPM· Languages: Bash, Ruby, Python, Java, Clojure· Security: Kerberos, SELinux, LDAP· Big Data: HDFS, Flink, Kafka· Containers: Docker, KVM· Schedulers: YARN, KubernetesYou will be joining a progressive and exciting company committed to excellence. They offer an excellent working environment with ongoing ...

least one scripting language — Python is required . Proficiency in at least one object-oriented language. Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto. Experience with AWS, GCP, or Looker (advantageous but not essential). Solid background in data modelling, including ...

least one scripting language — Python is required . Proficiency in at least one object-oriented language. Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto. Experience with AWS, GCP, or Looker (advantageous but not essential). Solid background in data modelling, including ...

cloud-based risk platforms and pricing engines Azure Kubernetes Service (AKS) Azure Data Lake Microservices and event-driven architectures Kafka, Redis, Spark, HBase, and HDFS Market Risk platforms covering VaR, Stress Testing, and FRTB Risk exposure reconciliation and reporting platforms Enterprise scheduling tools such as Control-M What ...

AI. The environment includes: C#/.NET Core Python SQL Server Microsoft Azure Azure Kubernetes Service (AKS) Kubernetes Redis Apache Kafka Spark HBase/HDFS REST APIs Microservices and distributed architectures We're particularly interested in individuals with: Extensive experience within Credit Risk Technology/Risk IT in an investment ...

veterans status, or any other basis protected by law. Build streaming and storage systems at PulsePointPulsePoint processes billions of events daily through Kafka, Hadoop HDFS and Ceph. Our Data Platform team maintains these systems across hybrid infrastructure: bare-metal on-prem, cloud, and the integration between them. ...

operating system resources, including VM's and Docker·Proficient understanding of Oracle database, ability to tune SQLs including AWR analyzes.·Expertise on Hadoop/HDFS infrastructure architectureThis role suits a technical or architect consultant from a software consulting or infrastructure background that is looking to take on serious responsibility. ...

incident retrospectives, and iterative delivery—making pragmatic trade‐offs and documenting them clearly. Technology Stack Languages: Predominantly Python and Node.js Distributed/data platforms: HDFS, HBase, Spark, plus increasing use of Kubernetes and cloud services Storage/search: MongoDB, OpenSearch Orchestration: Airflow, Dagster, NiFi Tooling: GitHub, GitHub Actions, Rundeck, Jira … improving reliability/performance Strong fundamentals: data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code Degree in Computer Science or numerical degree ...

Do you want your voice heard and your actions to count? Discover your opportunity with Mitsubishi UFJ Financial Group (MUFG), one of the world's leading financial groups. Across the globe, we're 150,000 ...

Java Technical Consultant 100,000 Plus Bonus Quant Capital is urgently looking for a Java Technical Consultant to join our high profile client. Our client provides data management platforms to the securities and investment management ...