5 of 5 HDFS Jobs

Senior Data Engineer - AWS

Hiring Organisation
Capco
Location
Borough of Tameside, United Kingdom
Employment Type
Full Time
Points For Expertise in Data Modelling, schema design, and handling both structured and semi-structured data. Familiarity with distributed systems such as Hadoop, Spark, HDFS, Hive, Databricks. Exposure to AWS Lake Formation and automation of ingestion and transformation layers. Background in delivering solutions for highly regulated industries. Passion for mentoring ...

Python Developer

Hiring Organisation
Pinnacle Technical Resources
Location
San Francisco, California, United States
Employment Type
Permanent
Salary
USD 85 Annual
contributor Preferred/Nice-to-Have Skills: Agentic AI frameworks: LangGraph, LangChain, A2A Programming Languages: Java, Scala, SQL, HiveQL Big Data Technologies: Hadoop, Spark, HDFS, Hive, Cloudera, Hortonworks Cloud Platforms: AWS (Glue, Lambda, Redshift, S3, CloudWatch) ETL/ELT Tools: AWS Glue, PySpark, Databricks Data Integration & Migration: Hadoop ecosystems, Kafka ...

Information Security Engineer 3 - Contingent

Hiring Organisation
Pinnacle Technical Resources
Location
Irving, Texas, United States
Employment Type
Permanent
Salary
USD 60 Annual
Data Engineer with hands-on experience building Data Lake in Google Cloud Platform using big data tools and technologies. Experience with Hadoop/HDFS is highly desirable. Detailed requirements are listed below. Strong understanding of Google Cloud architecture, including bucket structuring, naming standards, lifecycle management policies, and access control mechanisms. ...

Hadoop Spark Scala Data Engineer

Hiring Organisation
Capgemini
Location
Northampton, England, United Kingdom
with strong expertise in designing and implementing scalable big data solutions using Scala and Apache Spark. Experienced in working with the Hadoop ecosystem, including HDFS, Hive, and YARN, to process and analyze large datasets efficiently. Skilled in building robust ETL pipelines, real-time data processing, and optimizing distributed systems … processes using tools like Hive Pig and Spark. Develop and maintain data ingestion processes using Sqoop Flume or Kafka. Optimize MapReduce jobs and manage HDFS storage. Collaborate with data scientists and analysts to support data needs. Ensure data security and compliance with organizational policies. Create and maintain technical documentation ...

Hadoop Spark Data Engineer

Hiring Organisation
Capgemini
Location
Greater London, United Kingdom
Employment Type
Full Time
with strong expertise in designing and implementing scalable big data solutions using Scala and Apache Spark. Experienced in working with the Hadoop ecosystem, including HDFS, Hive, and YARN, to process and analyze large datasets efficiently. Skilled in building robust ETL pipelines, real-time data processing, and optimizing distributed systems … processes using tools like Hive Pig and Spark. Develop and maintain data ingestion processes using Sqoop Flume or Kafka. Optimize MapReduce jobs and manage HDFS storage. Collaborate with data scientists and analysts to support data needs. Ensure data security and compliance with organizational policies. Create and maintain technical documentation ...