Period
to 16 December 2018

The following table provides summary statistics for contract job vacancies advertised in Tyne and Wear with a requirement for Apache Spark skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Spark over the 6 months to 16 December 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Spark
North East > Tyne and Wear
6 months to
16 Dec 2018
Same period 2017 Same period 2016
Rank 82 83 150
Rank change year-on-year +1 +67 -
Contract jobs citing Apache Spark 7 7 2
As % of all contract IT jobs advertised in Tyne and Wear 0.73% 0.76% 0.090%
As % of the Application Platforms category 3.87% 3.03% 0.35%
Number of daily rates quoted 3 17 2
Tyne and Wear median daily rate £500 £400 £500
Median daily rate % change year-on-year +25.00% -20.00% -
North East median daily rate £500 £400 £500
% change year-on-year +25.00% -20.00% -
Number of hourly rates quoted 0 0 0
Tyne and Wear median hourly rate - - -
North East median hourly rate - - -

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Tyne and Wear with a requirement for application platform skills.

All Application Platform Skills
Tyne and Wear
Contract vacancies with a requirement for application platform skills 181 231 564
As % of all contract IT jobs advertised in Tyne and Wear 18.85% 25.11% 25.41%
Number of daily rates quoted 120 177 396
Tyne and Wear median daily rate £419 £375 £336
Median daily rate % change year-on-year +11.67% +11.52% -24.23%
10th Percentile £315 £267 £239
90th Percentile £551 £607 £525
North East median daily rate £400 £375 £335
% change year-on-year +6.67% +11.94% -21.18%
Number of hourly rates quoted 6 7 32
Tyne and Wear median hourly rate £16.00 £10.00 £27.75
Median hourly rate % change year-on-year +60.00% -63.96% +18.46%
10th Percentile £11.63 £7.89 £15.00
90th Percentile £21.50 £20.45 £36.00
North East median hourly rate £13.75 £11.75 £27.00
% change year-on-year +17.02% -56.48% +33.00%

Apache Spark
Job Vacancy Trend in Tyne and Wear

Job postings citing Apache Spark as a percentage of all IT jobs advertised in Tyne and Wear.

Job vacancy trend for Apache Spark in Tyne and Wear

Apache Spark
Contractor Daily Rate Trend in Tyne and Wear

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Apache Spark in Tyne and Wear.

Contractor daily rate trend for Apache Spark in Tyne and Wear

Apache Spark
Contractor Daily Rate Histogram in Tyne and Wear

The daily rate distribution of IT jobs citing Apache Spark in Tyne and Wear over the 6 months to 16 December 2018.

Contractor daily rate histogram for Apache Spark in Tyne and Wear

Apache Spark
Contract Job Locations in Tyne and Wear

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Spark within the Tyne and Wear region over the 6 months to 16 December 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Newcastle upon Tyne +4 7 £500 +25.00% 3
Apache Spark
North East

For the 6 months to 16 December 2018, IT contractor jobs citing Apache Spark also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Tyne and Wear region with a requirement for Apache Spark.

1 6 (85.71%) Amazon AWS
1 6 (85.71%) HBase
1 6 (85.71%) Big Data
1 6 (85.71%) Kafka
1 6 (85.71%) HDFS
2 5 (71.43%) Data Centre
2 5 (71.43%) Thought Leadership
2 5 (71.43%) Apache Flume
2 5 (71.43%) NoSQL
2 5 (71.43%) Sqoop
2 5 (71.43%) Data Transformation
2 5 (71.43%) Apache Hive
2 5 (71.43%) Cloud Computing
2 5 (71.43%) Scala
2 5 (71.43%) Hadoop
2 5 (71.43%) SQL
2 5 (71.43%) Python
2 5 (71.43%) Agile Software Development
3 4 (57.14%) ETL
3 4 (57.14%) Business Intelligence
3 4 (57.14%) Java
3 4 (57.14%) MongoDB
3 4 (57.14%) Apache Cassandra
3 4 (57.14%) Cloudera
3 4 (57.14%) Data Engineering
3 4 (57.14%) Data Ingestion
3 4 (57.14%) Spark SQL
3 4 (57.14%) Spark Streaming
4 2 (28.57%) Analytics
4 2 (28.57%) Apache Solr

Apache Spark
Co-occurring IT Skills in Tyne and Wear by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 2 (28.57%) Apache Solr
2 1 (14.29%) Apache Pig
Cloud Services
1 6 (85.71%) Amazon AWS
2 5 (71.43%) Cloud Computing
3 2 (28.57%) Amazon S3
4 1 (14.29%) Amazon EC2
4 1 (14.29%) Amazon EMR
4 1 (14.29%) Google Cloud Platform
4 1 (14.29%) Microsoft Azure
Communications & Networking
1 1 (14.29%) Kerberos
Database & Business Intelligence
1 6 (85.71%) Big Data
1 6 (85.71%) HBase
2 5 (71.43%) Apache Hive
2 5 (71.43%) Hadoop
2 5 (71.43%) NoSQL
2 5 (71.43%) Sqoop
3 4 (57.14%) Apache Cassandra
3 4 (57.14%) MongoDB
3 4 (57.14%) Spark SQL
4 2 (28.57%) Data Warehouse
5 1 (14.29%) Amazon RDS
5 1 (14.29%) Amazon Redshift
5 1 (14.29%) Data Mart
5 1 (14.29%) HCatalog
5 1 (14.29%) Pentaho
5 1 (14.29%) Snowflake Schema
5 1 (14.29%) SQL Server
Job Titles
1 4 (57.14%) Architect
1 4 (57.14%) Big Data Architect
1 4 (57.14%) Big Data Engineer
2 2 (28.57%) Business Intelligence Architect
2 2 (28.57%) Data Engineer
2 2 (28.57%) ETL Architect
3 1 (14.29%) Cloud Architect
3 1 (14.29%) Data Architect
3 1 (14.29%) Developer
3 1 (14.29%) Hadoop Architect
Libraries, Frameworks & Software Standards
1 6 (85.71%) Kafka
2 4 (57.14%) Spark Streaming
Miscellaneous
1 5 (71.43%) Data Centre
2 1 (14.29%) Analytical Skills
2 1 (14.29%) Public Cloud
Processes & Methodologies
1 5 (71.43%) Agile Software Development
1 5 (71.43%) Data Transformation
1 5 (71.43%) Thought Leadership
2 4 (57.14%) Business Intelligence
2 4 (57.14%) Data Engineering
2 4 (57.14%) Data Ingestion
2 4 (57.14%) ETL
3 2 (28.57%) Analytics
4 1 (14.29%) Coaching
4 1 (14.29%) Dashboard Development
4 1 (14.29%) Data Architecture
4 1 (14.29%) Data Cleansing
4 1 (14.29%) Data Development
4 1 (14.29%) Machine Learning
4 1 (14.29%) Mentoring
4 1 (14.29%) Migration
4 1 (14.29%) Software Architecture
4 1 (14.29%) Technical Leadership
4 1 (14.29%) User Stories
Programming Languages
1 5 (71.43%) Python
1 5 (71.43%) Scala
1 5 (71.43%) SQL
2 4 (57.14%) Java
Quality Assurance & Compliance
1 2 (28.57%) QA
System Software
1 6 (85.71%) HDFS
2 5 (71.43%) Apache Flume
3 1 (14.29%) Apache ZooKeeper
Systems Management
1 1 (14.29%) Oozie
Vendors
1 4 (57.14%) Cloudera
2 1 (14.29%) Google
2 1 (14.29%) Talend