Hadoop Spark Scala Data Engineer
- Hiring Organisation
- Capgemini
- Location
- Northampton, England, United Kingdom
considering: Results-driven Hadoop Spark Data Engineer with strong expertise in designing and implementing scalable big data solutions using Scala and Apache Spark. Experienced in working with the Hadoop ecosystem, including HDFS, Hive, and YARN, to process and analyze large datasets efficiently. Skilled in building robust ETL pipelines, real … Design and develop Hadoop based applications and data pipelines. Build operate monitor and troubleshoot Hadoop clusters. Write scalable ETL processes using tools like Hive Pig and Spark. Develop and maintain data ingestion processes using Sqoop Flume or Kafka. Optimize MapReduce jobs and manage HDFS storage. Collaborate with data scientists ...