12 of 12 HDFS Jobs

following is preferred: Advanced Python or Scala CI/CD tools (Jenkins, Ansible, Fortify, DevOps pipelines) Microservices and Big Data (Spark, Hadoop/HDFS) AWS services (EC2, EMR, Lambda, S3, Glue) QA automation (Cucumber, Selenium, Karate) Preferred Domain Knowledge Financial data systems: Equity, Commodities, Forex, Futures, and Options. Index/ ...

Bonus Points For Expertise in data modelling, schema design, and working with structured and semi‐structured datasets. Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation. Knowledge of automating cloud-based ingestion and transformation frameworks. Experience delivering data engineering solutions within highly regulated industries such ...

Bonus Points For Expertise in data modelling, schema design, and working with structured and semi-structured datasets. Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation. Knowledge of automating ingestion and transformation frameworks within cloud-native data platforms. Experience delivering solutions within highly regulated industries ...

Points For Expertise in Data Modelling, schema design, and handling both structured and semi-structured data. Familiarity with distributed systems such as Hadoop, Spark, HDFS, Hive, Databricks. Exposure to AWS Lake Formation and automation of ingestion and transformation layers. Background in delivering solutions for highly regulated industries. Passion for mentoring ...

strong understanding of high-concurrency, high-throughput, mission-critical, and zero-downtime systems. Think in distributed systems: Apply practical knowledge of Spark, Hadoop, HBase, HDFS, Hive, Impala, and adjacent data-processing ecosystems to solve complex customer problems. Win technical evaluations: Guide enterprise prospects through demanding architecture reviews, competitive bake-offs ...

Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching ...

Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching ...

distributed data processing pipelines using Apache Spark and related technologies. Having expertise in Spark Core, Spark SQL and Spark Streaming. Experience with Python, Hadoop, HDFS, Hive and other BigData technologies. Familiarity with Data warehousing and ETL concepts and techniques Working Knowledge in AWS (Glue EMR) etc. is good to have. ...

between different test types (unit test, integration test) and can cite specific examples of what they have written themselves Good understanding of CDP 7.1, HDFS filesystems, Unix, Unix Shell Scripting, Elasticsearch Experience in understanding and analyzing complex business requirements and carry out the system design accordingly Quantexa Data Engineering Certification ...

software design, design patterns, core programming concepts Experience delivering analytical use cases in a cloud-based environment Bonus experience Exposure to Hadoop technologies (e.g., HDFS, Hive, HBase) or experience with high-volume, low-latency data storage and analytics platforms Exposure to GCP cloud tooling (e.g., Cloud DataFlow, BigQuery) Benefits What ...

Python, or functional programming languages like Scala Demonstrated experience in design and development of big data applications using tech stacks like Databricks, Apache Spark, HDFS, HBase and Snowflake Commendable skills in building data products, by integrating large sets of data from hundreds of internal and external sources would be highly ...

incident retrospectives, and iterative delivery—making pragmatic trade‐offs and documenting them clearly. Technology Stack Languages: Predominantly Python and Node.js Distributed/data platforms: HDFS, HBase, Spark, plus increasing use of Kubernetes and cloud services Storage/search: MongoDB, OpenSearch Orchestration: Airflow, Dagster, NiFi Tooling: GitHub, GitHub Actions, Rundeck, Jira … improving reliability/performance Strong fundamentals: data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code Degree in Computer Science or numerical degree ...