10 of 10 HDFS Jobs

Senior Lead, Java Application Developer

Hiring Organisation
S&P Global
Location
New York, United States
Employment Type
Permanent
Salary
USD Annual
following is preferred: Advanced Python or Scala CI/CD tools (Jenkins, Ansible, Fortify, DevOps pipelines) Microservices and Big Data (Spark, Hadoop/HDFS) AWS services (EC2, EMR, Lambda, S3, Glue) QA automation (Cucumber, Selenium, Karate) Preferred Domain Knowledge Financial data systems: Equity, Commodities, Forex, Futures, and Options. Index/ ...

Solutions Engineer, London

Location
Greater London, England, United Kingdom
strong understanding of high-concurrency, high-throughput, mission-critical, and zero-downtime systems. Think in distributed systems: Apply practical knowledge of Spark, Hadoop, HBase, HDFS, Hive, Impala, and adjacent data-processing ecosystems to solve complex customer problems. Win technical evaluations: Guide enterprise prospects through demanding architecture reviews, competitive bake-offs ...

Senior Data Engineer - AWS

Location
Greater London, England, United Kingdom
Points For Expertise in Data Modelling, schema design, and handling both structured and semi-structured data. Familiarity with distributed systems such as Hadoop, Spark, HDFS, Hive, Databricks. Exposure to AWS Lake Formation and automation of ingestion and transformation layers. Background in delivering solutions for highly regulated industries. Passion for mentoring ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching ...

Principal Data Engineer

Location
Greater London, England, United Kingdom
Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching ...

Data Engineer

Location
Greater London, England, United Kingdom
software design, design patterns, core programming concepts Experience delivering analytical use cases in a cloud-based environment Bonus experience Exposure to Hadoop technologies (e.g., HDFS, Hive, HBase) or experience with high-volume, low-latency data storage and analytics platforms Exposure to GCP cloud tooling (e.g., Cloud DataFlow, BigQuery) Benefits What ...

Quantexa Lead Developer

Location
Sheffield, England, United Kingdom
between different test types (unit test, integration test) and can cite specific examples of what they have written themselves Good understanding of CDP 7.1, HDFS filesystems, Unix, Unix Shell Scripting, Elasticsearch Experience in understanding and analyzing complex business requirements and carry out the system design accordingly Quantexa Data Engineering Certification ...

Data Engineer

Hiring Organisation
Aditi Consulting
Location
Plano, Texas, United States
Employment Type
Permanent
Salary
USD Hourly
Data Solution Process certification, such as, Six Sigma, CBPP, BPM, ISO 20000, ITIL, CMMI. Technical Skills Required: Any combination of below technical skills Hadoop : HDFS, MapReduce, Hive, Airflow DW : Bigquery, Hive Languages : Python, PySpark, Shell Scripting, SQL Scripting Cloud : GCP Big data native services Any RDBMS/DWBI technologies Spark ...

Lead Data Engineer

Location
Greater London, England, United Kingdom
Python, or functional programming languages like Scala Demonstrated experience in design and development of big data applications using tech stacks like Databricks, Apache Spark, HDFS, HBase and Snowflake Commendable skills in building data products, by integrating large sets of data from hundreds of internal and external sources would be highly ...

Data Engineer

Location
Cheltenham, England, United Kingdom
incident retrospectives, and iterative delivery—making pragmatic trade‐offs and documenting them clearly. Technology Stack Languages: Predominantly Python and Node.js Distributed/data platforms: HDFS, HBase, Spark, plus increasing use of Kubernetes and cloud services Storage/search: MongoDB, OpenSearch Orchestration: Airflow, Dagster, NiFi Tooling: GitHub, GitHub Actions, Rundeck, Jira … improving reliability/performance Strong fundamentals: data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code Degree in Computer Science or numerical degree ...