Hadoop Developer

Role Title: Hadoop(Spark/Scala) Developer

Location: Northampton

Duration: 31/12/2026

Days on site: 2-3

Role Description:

• In general, the resource should be able to comfortably debug and develop Spark jobs in Scala.
• Alternatively, comfortability in Java Bigdata development and exposure is acceptable.
• Python is also nice to have.
• Looking for Hadoop, Spark, Scala / Python developer.
• Candidate should be conversant with concept of Hadoop core (Mapreduce), Hive, Pig HBase

Key Responsibilities:

• Design and develop Hadoop-based applications and data pipelines.
• Build, operate, monitor, and troubleshoot Hadoop clusters.
• Write scalable ETL processes using tools like Hive, Pig, and Spark.
• Develop and maintain data ingestion processes using Sqoop, Flume, or Kafka.
• Optimize MapReduce jobs and manage HDFS storage.
• Collaborate with data scientists and analysts to support data needs.
• Ensure data security and compliance with organizational policies.
• Create and maintain technical documentation and playbooks.
• Evaluate and integrate cloud-based big data solutions (AWS, GCP, Azure).