Period
to 16 January 2019

The following table provides summary statistics for contract job vacancies with a requirement for MLlib skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited MLlib over the 6 months to 16 January 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Spark Machine Learning Library (MLlib)
UK
6 months to
16 Jan 2019
Same period 2018 Same period 2017
Rank 849 870 854
Rank change year-on-year +21 -16 -
Contract jobs citing MLlib 29 19 19
As % of all contract IT jobs advertised in the UK 0.029% 0.019% 0.020%
As % of the Libraries, Frameworks & Software Standards category 0.085% 0.059% 0.063%
Number of daily rates quoted 25 18 14
UK median daily rate £550 £605 £556
Median daily rate % change year-on-year -9.09% +8.76% -
10th Percentile £513 £453 £475
90th Percentile £611 £667 £625
UK excluding London median daily rate £538 £610 -
% change year-on-year -11.89% - -
Number of hourly rates quoted 1 0 0
UK median hourly rate £55.00 - -
UK excluding London median hourly rate - - -

MLlib is in the Software Libraries and Frameworks category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for technical specification, industry standards, software libraries and framework skills.

All Software Libraries and Frameworks
UK
Contract vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 33,987 32,171 30,290
As % of all contract IT jobs advertised in the UK 34.17% 32.09% 31.36%
Number of daily rates quoted 23,928 22,944 20,886
UK median daily rate £475 £460 £425
Median daily rate % change year-on-year +3.26% +8.24% +3.03%
10th Percentile £325 £313 £300
90th Percentile £638 £625 £588
UK excluding London median daily rate £425 £400 £393
% change year-on-year +6.25% +1.78% +4.80%
Number of hourly rates quoted 286 333 342
UK median hourly rate £41.50 £40.00 £40.00
Median hourly rate % change year-on-year +3.75% - +6.67%
10th Percentile £19.25 £18.00 £15.00
90th Percentile £60.00 £52.50 £52.00
UK excluding London median hourly rate £41.53 £40.15 £38.63
% change year-on-year +3.43% +3.95% +3.00%

MLlib
Job Vacancy Trend

Job postings citing MLlib as a percentage of all IT jobs advertised.

Job vacancy trend for MLlib in the UK

MLlib
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing MLlib.

Contractor daily rate trend for MLlib in the UK

MLlib
Top 5 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing MLlib within the UK over the 6 months to 16 January 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England 0 29 £550 -9.09% 5
London +18 21 £550 -8.33% 4
UK excluding London -6 8 £538 -11.89% 1
South East - 7 £538 -
East of England -3 1 £550 -11.65%

For the 6 months to 16 January 2019, IT contractor jobs citing MLlib also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for MLlib.

1 29 (100.00%) SQL
1 29 (100.00%) Python
1 29 (100.00%) Big Data
1 29 (100.00%) Apache Spark
2 28 (96.55%) Hadoop
3 27 (93.10%) Apache Hive
4 26 (89.66%) Amazon AWS
5 25 (86.21%) Cloudera
6 22 (75.86%) Analytics
7 21 (72.41%) Data Science
8 19 (65.52%) Algorithms
8 19 (65.52%) Machine Learning
9 18 (62.07%) Amazon EMR
10 17 (58.62%) Hortonworks
10 17 (58.62%) Analytical Skills
10 17 (58.62%) TensorFlow
10 17 (58.62%) Theano
10 17 (58.62%) Torch
11 16 (55.17%) Performance Optimisation
11 16 (55.17%) Code Optimisation
11 16 (55.17%) Deep Learning
11 16 (55.17%) Statistical Modelling
11 16 (55.17%) Software Engineering
12 15 (51.72%) Predictive Analytics
12 15 (51.72%) Relational Database
13 14 (48.28%) PySpark
14 11 (37.93%) MapReduce
14 11 (37.93%) Scala
15 9 (31.03%) Visualisation
15 9 (31.03%) Data Visualisation

MLlib
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 29 (100.00%) Apache Spark
2 8 (27.59%) Apache Solr
3 1 (3.45%) Apache Airflow
3 1 (3.45%) Apache Pig
3 1 (3.45%) Jupyter
3 1 (3.45%) Luigi
3 1 (3.45%) Oracle Workflow
Cloud Services
1 26 (89.66%) Amazon AWS
2 18 (62.07%) Amazon EMR
3 6 (20.69%) Microsoft Azure
4 2 (6.90%) Amazon Kinesis
5 1 (3.45%) Amazon EC2
5 1 (3.45%) Amazon SageMaker
5 1 (3.45%) Google Cloud Platform
Database & Business Intelligence
1 29 (100.00%) Big Data
2 28 (96.55%) Hadoop
3 27 (93.10%) Apache Hive
4 15 (51.72%) Relational Database
5 9 (31.03%) Apache Cassandra
5 9 (31.03%) Impala
6 8 (27.59%) HBase
6 8 (27.59%) Oracle BI EE
6 8 (27.59%) Power BI
6 8 (27.59%) Qlik Sense
6 8 (27.59%) Spark SQL
6 8 (27.59%) Sqoop
7 4 (13.79%) NoSQL
8 1 (3.45%) Amazon Athena
8 1 (3.45%) Amazon RDS
8 1 (3.45%) Amazon Redshift
8 1 (3.45%) PostgreSQL
General
1 6 (20.69%) Finance
2 3 (10.34%) Banking
3 1 (3.45%) Marketing
Job Titles
1 19 (65.52%) Data Scientist
2 7 (24.14%) Consultant
2 7 (24.14%) Data Consultant
3 6 (20.69%) Big Data Consultant
3 6 (20.69%) Technical Consultant
4 4 (13.79%) Data Engineer
4 4 (13.79%) Research Scientist
5 3 (10.34%) Big Data Engineer
5 3 (10.34%) Senior Data Scientist
6 2 (6.90%) Hadoop Engineer
7 1 (3.45%) AWS Engineer
7 1 (3.45%) Python Engineer
Libraries, Frameworks & Software Standards
1 17 (58.62%) TensorFlow
1 17 (58.62%) Theano
1 17 (58.62%) Torch
2 14 (48.28%) PySpark
3 8 (27.59%) Kafka
3 8 (27.59%) Oracle GoldenGate
4 3 (10.34%) scikit-learn
5 1 (3.45%) Play Framework
Miscellaneous
1 19 (65.52%) Algorithms
2 17 (58.62%) Analytical Skills
3 2 (6.90%) Data Structures
Operating Systems
1 6 (20.69%) Linux
Processes & Methodologies
1 22 (75.86%) Analytics
2 21 (72.41%) Data Science
3 19 (65.52%) Machine Learning
4 16 (55.17%) Code Optimisation
4 16 (55.17%) Deep Learning
4 16 (55.17%) Performance Optimisation
4 16 (55.17%) Software Engineering
4 16 (55.17%) Statistical Modelling
5 15 (51.72%) Predictive Analytics
6 11 (37.93%) MapReduce
7 9 (31.03%) Business Intelligence
7 9 (31.03%) Data Analysis
7 9 (31.03%) Data Visualisation
7 9 (31.03%) Statistics
7 9 (31.03%) Visualisation
8 8 (27.59%) Agile Software Development
8 8 (27.59%) Data Engineering
8 8 (27.59%) Data Strategy
9 6 (20.69%) DevOps
9 6 (20.69%) Use Case
Programming Languages
1 29 (100.00%) Python
1 29 (100.00%) SQL
2 11 (37.93%) Scala
3 9 (31.03%) Java
4 8 (27.59%) Go
5 1 (3.45%) C++
5 1 (3.45%) R
Qualifications
1 9 (31.03%) Degree
2 8 (27.59%) Master's Degree
3 7 (24.14%) PhD
4 1 (3.45%) Numerate Degree
Quality Assurance & Compliance
1 1 (3.45%) Data Quality
1 1 (3.45%) QA
System Software
1 8 (27.59%) Apache Flume
1 8 (27.59%) HDFS
Systems Management
1 8 (27.59%) Hadoop YARN
Vendors
1 25 (86.21%) Cloudera
2 17 (58.62%) Hortonworks
3 9 (31.03%) Oracle
4 8 (27.59%) Tableau
5 3 (10.34%) Google