18 of 18 HDFS Jobs

executive audiences. Drive innovation and adoption of emerging technologies aligned with business strategy. Required Technical Skills Data Platforms Databricks Lakehouse Cloudera Snowflake Hadoop Ecosystem - HDFS, Hive, Spark, YARN Data Lakes & Data Warehouses Delta Lake Data Mesh/Data Fabric Data Engineering ETL/ELT Architecture Enterprise Data Pipelines Apache Spark ...

environments. Bonus Points ForExpertise in data modelling, schema design, and working with structured and semi-structured datasets. Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation. Knowledge of automating cloud-based ingestion and transformation frameworks. Experience delivering data engineering solutions within highly regulated industries such ...

Points For Expertise in Data Modelling, schema design, and handling both structured and semi-structured data. Familiarity with distributed systems such as Hadoop, Spark, HDFS, Hive, Databricks. Exposure to AWS Lake Formation and automation of ingestion and transformation layers. Background in delivering solutions for highly regulated industries. Passion for mentoring ...

solutions. Bonus Points ForExpertise in data modelling, schema design, and working with structured and semi-structured datasets. Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation. Knowledge of automating ingestion and transformation frameworks within cloud-native data platforms. Experience delivering solutions within highly regulated industries ...

Experience Strong experience with at least two of the following platforms: Cloudera Elastic Stack Dataiku DSS Good knowledge of Hadoop ecosystem technologies such as HDFS, YARN, Hive, Spark and Kafka Experience with Elasticsearch, Logstash, Kibana and Beats Experience designing data pipelines, ETL processes and streaming solutions Programming or scripting experience ...

including mappings, workflows, applications, transformations, and reusable components. Support the migration of data assets, ETL pipelines, and workloads from the Cloudera Hadoop platform (HDFS, Hive, Impala, Spark) to AWS Cloud. Design, develop, and optimise data ingestion, transformation, and loading processes into Amazon S3 Data Lake and Amazon Redshift. Develop ...

Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching ...

Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching ...

Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching ...

between different test types (unit test, integration test) and can cite specific examples of what they have written themselves Good understanding of CDP 7.1, HDFS filesystems, Unix, Unix Shell Scripting, Elasticsearch Experience in understanding and analyzing complex business requirements and carry out the system design accordingly Quantexa Data Engineering Certification ...

least one scripting language — Python is required . Proficiency in at least one object-oriented language. Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto. Experience with AWS, GCP, or Looker (advantageous but not essential). Solid background in data modelling, including ...

least one scripting language — Python is required . Proficiency in at least one object-oriented language. Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto. Experience with AWS, GCP, or Looker (advantageous but not essential). Solid background in data modelling, including ...

capital markets. Exposure to Python for more complex data extraction and analysis. Familiarity with the Hadoop and big data ecosystem, including Hive, Impala, HDFS, Apache Spark, Spark-SQL, UDF and Sqoop. Experience with Tableau and reporting best practices. Previous project management or project delivery experience. Exposure to regulatory change ...

cloud-based risk platforms and pricing engines Azure Kubernetes Service (AKS) Azure Data Lake Microservices and event-driven architectures Kafka, Redis, Spark, HBase, and HDFS Market Risk platforms covering VaR, Stress Testing, and FRTB Risk exposure reconciliation and reporting platforms Enterprise scheduling tools such as Control-M What ...

status, or any other basis protected by law. Build streaming and storage systems at PulsePoint PulsePoint processes billions of events daily through Kafka, Hadoop HDFS and Ceph. Our Data Platform team maintains these systems across hybrid infrastructure: bare-metal on-prem, cloud, and the integration between them. ...

operating system resources, including VM's and Docker·Proficient understanding of Oracle database, ability to tune SQLs including AWR analyzes.·Expertise on Hadoop/HDFS infrastructure architectureThis role suits a technical or architect consultant from a software consulting or infrastructure background that is looking to take on serious responsibility. ...

incident retrospectives, and iterative delivery—making pragmatic trade‐offs and documenting them clearly. Technology Stack Languages: Predominantly Python and Node.js Distributed/data platforms: HDFS, HBase, Spark, plus increasing use of Kubernetes and cloud services Storage/search: MongoDB, OpenSearch Orchestration: Airflow, Dagster, NiFi Tooling: GitHub, GitHub Actions, Rundeck, Jira … improving reliability/performance Strong fundamentals: data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code Degree in Computer Science or numerical degree ...

Java Technical Consultant 100,000 Plus Bonus Quant Capital is urgently looking for a Java Technical Consultant to join our high profile client. Our client provides data management platforms to the securities and investment management ...