Period
to 22 February 2019

The following table provides summary statistics for permanent job vacancies with a requirement for MLlib skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited MLlib over the 6 months to 22 February 2019 with a comparison to the same period in the previous 2 years.

Apache Spark Machine Learning Library (MLlib)
UK
6 months to
22 Feb 2019
Same period 2018 Same period 2017
Rank 1085 1130 1186
Rank change year-on-year +45 +56 +93
Permanent jobs citing MLlib 32 71 10
As % of all permanent IT jobs advertised in the UK 0.021% 0.040% 0.006%
As % of the Libraries, Frameworks & Software Standards category 0.053% 0.099% 0.014%
Number of salaries quoted 30 50 5
UK median annual salary £65,000 £55,000 £75,000
Median salary % change year-on-year +18.18% -26.67% +7.14%
10th Percentile £32,500 £37,500 £40,000
90th Percentile £97,500 £99,250 £80,000
UK excluding London median annual salary £35,000 £50,000 £50,000
% change year-on-year -30.00% - +42.86%

MLlib is in the Software Libraries and Frameworks category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for technical specification, industry standards, software libraries and framework skills.

All Software Libraries and Frameworks
UK
Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 60,017 71,380 69,288
As % of all permanent IT jobs advertised in the UK 39.67% 40.54% 39.46%
Number of salaries quoted 49,202 60,288 59,685
UK median annual salary £52,500 £50,000 £47,500
Median salary % change year-on-year +5.00% +5.26% +5.56%
10th Percentile £31,250 £30,000 £29,000
90th Percentile £85,000 £78,750 £76,250
UK excluding London median annual salary £45,000 £42,500 £42,500
% change year-on-year +5.88% - +6.25%

MLlib
Job Vacancy Trend

Job postings citing MLlib as a percentage of all IT jobs advertised.

Job vacancy trend for MLlib in the UK

MLlib
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing MLlib.

Salary trend for MLlib in the UK

MLlib
Salary Histogram

The salary distribution of IT jobs citing MLlib over the 6 months to 22 February 2019.

Salary histogram for MLlib in the UK

MLlib
Top 6 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing MLlib within the UK over the 6 months to 22 February 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +85 32 £65,000 +18.18% 1
London +64 26 £68,750 -27.63% 1
UK excluding London +17 6 £35,000 -30.00% 1
South West -9 5 £35,000 -30.00%
East Midlands - 1 £100,000 -
Midlands - 1 £100,000 -

For the 6 months to 22 February 2019, IT jobs citing MLlib also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for MLlib.

1 31 (96.88%) Apache Spark
2 29 (90.63%) Machine Learning
3 26 (81.25%) Python
4 25 (78.13%) Data Science
5 23 (71.88%) Hadoop
6 19 (59.38%) Apache Hive
6 19 (59.38%) scikit-learn
6 19 (59.38%) Artificial Intelligence
7 18 (56.25%) SQL
7 18 (56.25%) Big Data
8 17 (53.13%) Scala
9 16 (50.00%) Deep Learning
10 13 (40.63%) Algorithms
10 13 (40.63%) Tableau
10 13 (40.63%) R
10 13 (40.63%) PySpark
11 12 (37.50%) Data Visualisation
11 12 (37.50%) Natural Language Processing
11 12 (37.50%) Visualisation
11 12 (37.50%) Pandas
12 11 (34.38%) Amazon AWS
12 11 (34.38%) Degree
12 11 (34.38%) TensorFlow
13 10 (31.25%) Amazon SageMaker
13 10 (31.25%) Google
13 10 (31.25%) Data Analysis
13 10 (31.25%) Google Cloud Platform
13 10 (31.25%) Analytical Skills
14 9 (28.13%) HDFS
14 9 (28.13%) Computer Science

MLlib
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 31 (96.88%) Apache Spark
2 6 (18.75%) Apache Pig
3 5 (15.63%) SAS
4 3 (9.38%) nginx
Cloud Services
1 11 (34.38%) Amazon AWS
2 10 (31.25%) Amazon SageMaker
2 10 (31.25%) Google Cloud Platform
3 2 (6.25%) Microsoft Azure
3 2 (6.25%) SaaS
4 1 (3.13%) Amazon EMR
Database & Business Intelligence
1 23 (71.88%) Hadoop
2 19 (59.38%) Apache Hive
3 18 (56.25%) Big Data
4 9 (28.13%) HBase
5 7 (21.88%) QlikView
5 7 (21.88%) Text Mining
6 4 (12.50%) NoSQL
7 3 (9.38%) Apache Zeppelin
7 3 (9.38%) Couchbase
7 3 (9.38%) Relational Database
8 2 (6.25%) Apache Cassandra
8 2 (6.25%) Data Lake
8 2 (6.25%) Data Mining
8 2 (6.25%) Data Warehouse
8 2 (6.25%) Impala
8 2 (6.25%) MongoDB
8 2 (6.25%) Parquet
8 2 (6.25%) RDBMS
8 2 (6.25%) Sqoop
Development Applications
1 2 (6.25%) Eclipse
1 2 (6.25%) FindBugs
1 2 (6.25%) Git (software)
1 2 (6.25%) IntelliJ
1 2 (6.25%) Jenkins
1 2 (6.25%) JUnit
1 2 (6.25%) Maven
1 2 (6.25%) TeamCity
General
1 9 (28.13%) Law
1 9 (28.13%) Military
2 3 (9.38%) Retail
3 2 (6.25%) Banking
3 2 (6.25%) Finance
3 2 (6.25%) Games
4 1 (3.13%) German Language
4 1 (3.13%) Marketing
Job Titles
1 16 (50.00%) Data Scientist
2 10 (31.25%) Senior Data Scientist
3 8 (25.00%) Data Engineer
3 8 (25.00%) Machine Learning Scientist
4 5 (15.63%) Big Data Engineer
4 5 (15.63%) Hadoop Engineer
5 3 (9.38%) Developer
5 3 (9.38%) Java Developer
5 3 (9.38%) Java Engineer
5 3 (9.38%) Senior Developer
5 3 (9.38%) Senior Java Developer
5 3 (9.38%) Senior Java Engineer
6 2 (6.25%) Architect
6 2 (6.25%) Big Data Architect
6 2 (6.25%) Data Architect
6 2 (6.25%) Junior
6 2 (6.25%) Junior Data Scientist
6 2 (6.25%) Machine Learning Engineer
6 2 (6.25%) Senior Architect
6 2 (6.25%) Senior Data Architect
Libraries, Frameworks & Software Standards
1 19 (59.38%) scikit-learn
2 13 (40.63%) PySpark
3 12 (37.50%) Natural Language Processing
3 12 (37.50%) Pandas
4 11 (34.38%) TensorFlow
5 9 (28.13%) Theano
6 8 (25.00%) NumPy
7 7 (21.88%) SciPy
8 4 (12.50%) Kafka
9 3 (9.38%) Spring
9 3 (9.38%) XGBoost
10 2 (6.25%) Apache Avro
10 2 (6.25%) Apache NiFi
10 2 (6.25%) Keras
11 1 (3.13%) MXNet
11 1 (3.13%) RHadoop
11 1 (3.13%) Torch
Miscellaneous
1 13 (40.63%) Algorithms
2 10 (31.25%) Analytical Skills
3 5 (15.63%) Data Structures
4 4 (12.50%) Self-Motivation
5 2 (6.25%) Mainframe
6 1 (3.13%) Digital Media
Operating Systems
1 3 (9.38%) Linux
1 3 (9.38%) Ubuntu
2 2 (6.25%) Unix
Processes & Methodologies
1 29 (90.63%) Machine Learning
2 25 (78.13%) Data Science
3 19 (59.38%) Artificial Intelligence
4 16 (50.00%) Deep Learning
5 12 (37.50%) Data Visualisation
5 12 (37.50%) Visualisation
6 10 (31.25%) Data Analysis
7 9 (28.13%) Computer Science
8 8 (25.00%) Data Modelling
9 7 (21.88%) Cybersecurity
10 6 (18.75%) Mathematics
11 5 (15.63%) Analytics
11 5 (15.63%) Microservices
11 5 (15.63%) Statistics
12 4 (12.50%) Data Engineering
12 4 (12.50%) Predictive Analytics
12 4 (12.50%) Predictive Modelling
13 3 (9.38%) Software Architecture
13 3 (9.38%) Software Engineering
13 3 (9.38%) Use Case
Programming Languages
1 26 (81.25%) Python
2 18 (56.25%) SQL
3 17 (53.13%) Scala
4 13 (40.63%) R
5 8 (25.00%) Java
6 5 (15.63%) Ruby
7 3 (9.38%) VBA
8 2 (6.25%) Shell Script
9 1 (3.13%) C
9 1 (3.13%) C#
9 1 (3.13%) C++
9 1 (3.13%) MATLAB
Qualifications
1 11 (34.38%) Degree
2 3 (9.38%) Computer Science Degree
2 3 (9.38%) PhD
3 2 (6.25%) Master's Degree
3 2 (6.25%) Numerate Degree
Quality Assurance & Compliance
1 2 (6.25%) QA
System Software
1 9 (28.13%) HDFS
2 5 (15.63%) Docker
Vendors
1 13 (40.63%) Tableau
2 10 (31.25%) Google
3 5 (15.63%) MapR
4 3 (9.38%) Cloudera
4 3 (9.38%) Hortonworks
5 2 (6.25%) Cognizant
5 2 (6.25%) Salesforce.com
5 2 (6.25%) SAP
6 1 (3.13%) Microsoft