1 of 1 Remote/Hybrid Distributed Systems Jobs in Northampton

Hadoop Spark Scala Data Engineer

Hiring Organisation
Capgemini
Location
Northampton, England, United Kingdom
including HDFS, Hive, and YARN, to process and analyze large datasets efficiently. Skilled in building robust ETL pipelines, real-time data processing, and optimizing distributed systems for performance and reliability. Proficient in SQL, data modeling, and integrating data from multiple sources in cloud and on-prem environments. Hybrid … strong expertise in functional programming concepts for building scalable data applications. Extensive experience in Apache Spark (Core, SQL, and Streaming) for processing large-scale distributed data efficiently Strong knowledge of Hadoop ecosystem components including HDFS, YARN, Hive, and HBase. Skilled in designing and developing ETL pipelines and handling structured ...