Spark SQL Jobs in the North of England

3 Spark SQL Jobs in the North of England

Spark Architect

Leeds, England, United Kingdom
PRACYVA
Spark Architect/SME Contract Role- 6 months to begin with & its extendable Location: Leeds, UK (min 3 days onsite) Context: Legacy ETL code for example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance … issues. Skills: Spark Architecture – component understanding around Spark Data Integration (PySpark, scripting, variable setting etc.), Spark SQL, Spark Explain plans. Spark SME – Be able to analyse Spark code failures through Spark Plans and make … correcting recommendations. Spark SME – Be able to review PySpark and Spark SQL jobs and make performance improvement recommendations. Spark – SME Be able to understand Data Frames/Resilient Distributed Data Sets and understand any memory related problems and make corrective recommendations. Monitoring more »
Posted:

Spark Architect

Leeds, England, United Kingdom
PRACYVA
example DataStage is being refactored into PySpark using Prophecy low-code no-code and available converters.Converted code is causing failures/performance issues.Skills:Spark Architecture – component understanding around Spark Data Integration (PySpark, scripting, variable setting etc.), Spark SQL, Spark Explain … plans.Spark SME – Be able to analyse Spark code failures through Spark Plans and make correcting recommendations.Spark SME – Be able to review PySpark and Spark SQL jobs and make performance improvement recommendations.Spark – SME Be able to understand Data Frames/Resilient Distributed Data … Sets and understand any memory related problems and make corrective recommendations.Monitoring – Be able to monitor Spark jobs using wider tools such as Grafana to see whether there are Cluster level failures.Cloudera (CDP) – Knowledge of understanding how Cloudera Spark is set up and how the run time more »
Posted:

Database Developer

Knutsford, Cheshire, North West
LA International Computer Consultants Ltd
DB Developer: * Minimum of 8 years' development and experience in MySQL/Oracle comprehending the existing SQL queries and writing medium to complex SQL queries. * Minimum of 3 years' experience in Unix and shell scripting. * Minimum of 1 year experience in investment banking or the financial … sector. * Performance Tuning of Oracle/MySQL/Hive SQL Queries/Spark SQL Statements. * Experience in working with large databases - multi terabytes (3+ Terabytes). * Minimum of 5 years' experience in Big Data Space (Hive, Impala, Spark Sql, HDFS more »
Employment Type: Contract
Rate: £350 - £350
Posted: