9 of 9 HDFS Jobs

Senior Lead, Java Application Developer

Hiring Organisation
S&P Global
Location
New York, United States
Employment Type
Permanent
Salary
USD Annual
following is preferred: Advanced Python or Scala CI/CD tools (Jenkins, Ansible, Fortify, DevOps pipelines) Microservices and Big Data (Spark, Hadoop/HDFS) AWS services (EC2, EMR, Lambda, S3, Glue) QA automation (Cucumber, Selenium, Karate) Preferred Domain Knowledge Financial data systems: Equity, Commodities, Forex, Futures, and Options. Index/ ...

Solutions Engineer, London

Location
Greater London, England, United Kingdom
strong understanding of high-concurrency, high-throughput, mission-critical, and zero-downtime systems. Think in distributed systems: Apply practical knowledge of Spark, Hadoop, HBase, HDFS, Hive, Impala, and adjacent data-processing ecosystems to solve complex customer problems. Win technical evaluations: Guide enterprise prospects through demanding architecture reviews, competitive bake-offs ...

Senior Data Engineer - AWS

Location
Greater London, England, United Kingdom
Points For Expertise in Data Modelling, schema design, and handling both structured and semi-structured data. Familiarity with distributed systems such as Hadoop, Spark, HDFS, Hive, Databricks. Exposure to AWS Lake Formation and automation of ingestion and transformation layers. Background in delivering solutions for highly regulated industries. Passion for mentoring ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching ...

Principal Data Engineer

Location
Greater London, England, United Kingdom
Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching ...

Lead Snowflake and Hadoop Data Engineer

Hiring Organisation
CYNET SYSTEMS
Location
Alpharetta, Georgia, United States
Employment Type
Permanent
Salary
USD Hourly
experience in Snowflake. Strong Hadoop migration experience. Programming Languages: Strong proficiency in Python, Java, and SQL. Big Data Frameworks: Deep understanding of the ecosystem (HDFS, MapReduce, Hive, Spark, PySpark, Snowpark). Cloud Data Warehousing: Expertise in Snowflake architecture, data manipulation, and query optimization. Data Engineering Concepts: Knowledge of data ingestion ...

Data Engineer

Location
Greater London, England, United Kingdom
software design, design patterns, core programming concepts Experience delivering analytical use cases in a cloud-based environment Bonus experience Exposure to Hadoop technologies (e.g., HDFS, Hive, HBase) or experience with high-volume, low-latency data storage and analytics platforms Exposure to GCP cloud tooling (e.g., Cloud DataFlow, BigQuery) Benefits What ...

Lead Data Engineer

Location
Greater London, England, United Kingdom
Python, or functional programming languages like Scala Demonstrated experience in design and development of big data applications using tech stacks like Databricks, Apache Spark, HDFS, HBase and Snowflake Commendable skills in building data products, by integrating large sets of data from hundreds of internal and external sources would be highly ...

Data Engineer

Location
Cheltenham, England, United Kingdom
incident retrospectives, and iterative delivery—making pragmatic trade‐offs and documenting them clearly. Technology Stack Languages: Predominantly Python and Node.js Distributed/data platforms: HDFS, HBase, Spark, plus increasing use of Kubernetes and cloud services Storage/search: MongoDB, OpenSearch Orchestration: Airflow, Dagster, NiFi Tooling: GitHub, GitHub Actions, Rundeck, Jira … improving reliability/performance Strong fundamentals: data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code Degree in Computer Science or numerical degree ...