Period
to 23 November 2017

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for MLlib skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited MLlib over the 6 months to 23 November 2017 with a comparison to the same period in the previous 2 years.

Apache Spark Machine Learning Library (MLlib)
England > London
6 months to
23 Nov 2017
Same period 2016 Same period 2015
Rank 831 844 894
Rank change year-on-year +13 +50 +25
Permanent jobs citing MLlib 9 6 16
As % of all permanent IT jobs advertised in London 0.012% 0.008% 0.018%
As % of the Libraries, Frameworks & Software Standards category 0.031% 0.020% 0.048%
Number of salaries quoted 7 6 4
London median annual salary £110,000 £80,000 £62,500
Median salary % change year-on-year +37.50% +28.00% +19.05%
10th Percentile £55,250 £72,500 £50,375
90th Percentile £124,000 £80,000 £85,125
England median annual salary £60,000 £75,000 £62,500
% change year-on-year -20.00% +20.00% +35.14%

MLlib is in the Software Libraries and Frameworks category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for technical specification, industry standards, software libraries and framework skills.

All Software Libraries and Frameworks
London
Permanent vacancies with a requirement for technical specification, industry standards, software libraries and framework skills 29292 30564 33375
As % of all permanent IT jobs advertised in London 38.99% 40.20% 37.65%
Number of salaries quoted 23887 26919 28611
London median annual salary £60,000 £58,000 £55,000
Median salary % change year-on-year +3.45% +5.45% +4.76%
10th Percentile £36,250 £35,000 £34,750
90th Percentile £90,000 £86,250 £83,750
England median annual salary £50,000 £47,500 £45,000
% change year-on-year +5.26% +5.56% -

MLlib
Job Vacancy Trend in London

Job postings citing MLlib as a percentage of all IT jobs advertised in London.

Job vacancy trend for MLlib in London

MLlib
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing MLlib in London.

Salary trend for MLlib in London

MLlib
Salary Histogram in London

The salary distribution of IT jobs citing MLlib in London over the 6 months to 23 November 2017.

Salary histogram for MLlib in London

MLlib
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing MLlib within the London region over the 6 months to 23 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London - 5 £110,000 - 1
MLlib
England

For the 6 months to 23 November 2017, IT jobs citing MLlib also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the London region with a requirement for MLlib.

1 9 (100.00%) Apache Spark
2 8 (88.89%) Machine Learning
3 7 (77.78%) SQL
3 7 (77.78%) Python
4 6 (66.67%) Java
4 6 (66.67%) Scala
4 6 (66.67%) Hadoop
4 6 (66.67%) Apache Hive
4 6 (66.67%) Big Data
5 5 (55.56%) R
5 5 (55.56%) scikit-learn
5 5 (55.56%) Pandas
5 5 (55.56%) MongoDB
5 5 (55.56%) Apache Cassandra
5 5 (55.56%) NumPy
5 5 (55.56%) Statistics
6 4 (44.44%) C
6 4 (44.44%) C++
6 4 (44.44%) Apache
6 4 (44.44%) SAS
6 4 (44.44%) MATLAB
6 4 (44.44%) Agile Software Development
6 4 (44.44%) Algorithms
6 4 (44.44%) GraphX
6 4 (44.44%) HBase
6 4 (44.44%) Apache Pig
7 3 (33.33%) Acceptance Criteria
7 3 (33.33%) Analytics
7 3 (33.33%) SPSS
7 3 (33.33%) MapReduce

MLlib
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 9 (100.00%) Apache Spark
2 4 (44.44%) Apache
2 4 (44.44%) Apache Pig
2 4 (44.44%) SAS
3 2 (22.22%) Elasticsearch
4 1 (11.11%) Apache Solr
4 1 (11.11%) Confluence
4 1 (11.11%) Jupyter
Applications
1 3 (33.33%) SPSS
Cloud Services
1 2 (22.22%) Amazon AWS
2 1 (11.11%) Amazon EMR
2 1 (11.11%) CloudBees
2 1 (11.11%) Cortana Intelligence Suite
2 1 (11.11%) Google Cloud Platform
2 1 (11.11%) IaaS
2 1 (11.11%) Microsoft Azure
2 1 (11.11%) PaaS
2 1 (11.11%) SaaS
Database & Business Intelligence
1 6 (66.67%) Apache Hive
1 6 (66.67%) Big Data
1 6 (66.67%) Hadoop
2 5 (55.56%) Apache Cassandra
2 5 (55.56%) MongoDB
3 4 (44.44%) HBase
4 3 (33.33%) Data Mining
4 3 (33.33%) Impala
5 2 (22.22%) Flink
5 2 (22.22%) NoSQL
5 2 (22.22%) Qlik Sense
6 1 (11.11%) Amazon DynamoDB
6 1 (11.11%) Apache Kudu
6 1 (11.11%) Apache Zeppelin
6 1 (11.11%) BigQuery
6 1 (11.11%) IBM BigInsights
6 1 (11.11%) OpenTSDB
6 1 (11.11%) Parquet
6 1 (11.11%) Power BI
6 1 (11.11%) Presto
Development Applications
1 1 (11.11%) Jenkins
1 1 (11.11%) JIRA
1 1 (11.11%) Selenium
1 1 (11.11%) SonarQube
1 1 (11.11%) Talend Open Studio
General
1 2 (22.22%) Banking
1 2 (22.22%) Retail
2 1 (11.11%) Finance
2 1 (11.11%) Investment Banking
Job Titles
1 4 (44.44%) Data Engineer
1 4 (44.44%) Data Scientist
2 2 (22.22%) Big Data Engineer
3 1 (11.11%) Developer
3 1 (11.11%) Hadoop Developer
3 1 (11.11%) MapReduce Engineer
3 1 (11.11%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 5 (55.56%) NumPy
1 5 (55.56%) Pandas
1 5 (55.56%) scikit-learn
2 4 (44.44%) GraphX
3 3 (33.33%) Kafka
4 2 (22.22%) D3.js
4 2 (22.22%) JSON
4 2 (22.22%) RESTful
4 2 (22.22%) TensorFlow
4 2 (22.22%) XML
5 1 (11.11%) Apache Avro
5 1 (11.11%) CSS
5 1 (11.11%) Highcharts JS
5 1 (11.11%) HTML
5 1 (11.11%) Matplotlib
5 1 (11.11%) Natural Language Processing
5 1 (11.11%) PySpark
5 1 (11.11%) RabbitMQ
5 1 (11.11%) REST
5 1 (11.11%) SparkR
Miscellaneous
1 4 (44.44%) Algorithms
2 1 (11.11%) Analytical Skills
2 1 (11.11%) Computer Science
Operating Systems
1 2 (22.22%) Linux
2 1 (11.11%) Unix
2 1 (11.11%) Windows
Processes & Methodologies
1 8 (88.89%) Machine Learning
2 5 (55.56%) Statistics
3 4 (44.44%) Agile Software Development
4 3 (33.33%) Acceptance Criteria
4 3 (33.33%) Analytics
4 3 (33.33%) Data Modelling
4 3 (33.33%) E-Commerce
4 3 (33.33%) Kalman Filter
4 3 (33.33%) MapReduce
5 2 (22.22%) CRM
5 2 (22.22%) Data Integration
5 2 (22.22%) Data Visualisation
5 2 (22.22%) Mathematics
5 2 (22.22%) Prototyping
5 2 (22.22%) Visualisation
6 1 (11.11%) Continuous Integration
6 1 (11.11%) Open Source
6 1 (11.11%) Physics
6 1 (11.11%) Test Automation
6 1 (11.11%) Usability Testing
Programming Languages
1 7 (77.78%) Python
1 7 (77.78%) SQL
2 6 (66.67%) Java
2 6 (66.67%) Scala
3 5 (55.56%) R
4 4 (44.44%) C
4 4 (44.44%) C++
4 4 (44.44%) MATLAB
5 3 (33.33%) Fortran
6 1 (11.11%) HiveQL
6 1 (11.11%) JavaScript
Quality Assurance & Compliance
1 1 (11.11%) GCP
System Software
1 2 (22.22%) HDFS
2 1 (11.11%) Docker
Systems Management
1 1 (11.11%) Hadoop YARN
1 1 (11.11%) Kibana
Vendors
1 3 (33.33%) Cloudera
2 2 (22.22%) Google
2 2 (22.22%) Hortonworks
2 2 (22.22%) MapR
2 2 (22.22%) Tableau
3 1 (11.11%) Alteryx
3 1 (11.11%) Atlassian
3 1 (11.11%) Datameer
3 1 (11.11%) Informatica
3 1 (11.11%) Netezza
3 1 (11.11%) Oracle
3 1 (11.11%) Paxata
3 1 (11.11%) Talend
3 1 (11.11%) Teradata