Spark Architect
Sheffield, Yorkshire, United Kingdom
Pyramid Consulting Europe Ltd
days/week, onsite) Job Type: 6+ month and possibility of extension Looking for an enthusiastic Spark Architect with deep component understanding around Spark Data Integration (PySpark, Scripting, variable setting etc.), Spark SQL, Spark Explain plans. Also able to analyse Spark code failures through Spark Plans and make … correcting recommendations; able to review PySpark and Spark SQL jobs and make performance improvement recommendations; able to understand Data Frames/Resilient Distributed Data Sets and understand any memory related problems and make corrective recommendations; and able to monitor Spark jobs using wider tools such as Grafana to … senior leadership stakeholders, guiding technical team and drive overall program objectives. Your responsibilities: As a Spark Architect you will be working for - GDT (Global Data Technology) Team, you will be responsible for: Working on an Enterprise scale Cloud infrastructure and Cloud Services in one of the Clouds (GCP). more »
Employment Type: Contract
Rate: GBP Annual
Posted: