Period
to 24 November 2017

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 24 November 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > London
6 months to
24 Nov 2017
Same period 2016 Same period 2015
Rank 62 67 103
Rank change year-on-year +5 +36 +63
Contract jobs citing Big Data 1807 1638 1067
As % of all contract IT jobs advertised in London 3.84% 3.63% 2.27%
As % of the Database & Business Intelligence category 16.10% 15.55% 9.44%
Number of daily rates quoted 1339 1131 765
London median daily rate £550 £550 £550
10th Percentile £411 £413 £363
90th Percentile £700 £713 £700
England median daily rate £550 £525 £520
% change year-on-year +4.76% +0.96% +0.97%
Number of hourly rates quoted 0 1 1
London median hourly rate - £100.00 £37.50
Median hourly rate % change year-on-year - +166.67% +25.00%
England median hourly rate £30.50 £43.00 £46.50
% change year-on-year -29.07% -7.53% +41.98%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 11224 10533 11308
As % of all contract IT jobs advertised in London 23.83% 23.35% 24.09%
Number of daily rates quoted 8334 7458 8062
London median daily rate £500 £475 £450
Median daily rate % change year-on-year +5.26% +5.56% +5.88%
10th Percentile £353 £325 £305
90th Percentile £663 £638 £625
England median daily rate £460 £425 £413
% change year-on-year +8.24% +3.03% +3.13%
Number of hourly rates quoted 60 40 75
London median hourly rate £26.88 £30.94 £22.50
Median hourly rate % change year-on-year -13.11% +37.51% -14.29%
10th Percentile £18.23 £15.25 £14.85
90th Percentile £58.75 £82.58 £92.00
England median hourly rate £32.00 £27.75 £27.64
% change year-on-year +15.32% +0.40% +12.82%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in London.

Contractor daily rate trend for Big Data in London

Big Data
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Big Data in London over the 6 months to 24 November 2017.

Contractor daily rate histogram for Big Data in London

Big Data
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in London.

Contractor hourly rate trend for Big Data in London

Big Data
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the London region over the 6 months to 24 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +1 304 £575 +1.10% 76
South London +49 130 £545 +23.86% 1
East London -5 22 £650 +13.04% 10
West London -25 17 £500 -7.41% 15
North London -8 3 £500 - 4
Big Data
England

For the 6 months to 24 November 2017, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the London region with a requirement for Big Data.

1 1024 (56.67%) Hadoop
2 820 (45.38%) Java
3 771 (42.67%) Apache Spark
4 653 (36.14%) Agile Software Development
5 530 (29.33%) Python
6 454 (25.12%) SQL
7 453 (25.07%) Analytics
8 452 (25.01%) Kafka
9 442 (24.46%) Finance
10 385 (21.31%) Scala
10 385 (21.31%) Amazon AWS
11 369 (20.42%) HBase
12 363 (20.09%) Apache Hive
13 347 (19.20%) Banking
14 331 (18.32%) TDD
15 292 (16.16%) DevOps
16 291 (16.10%) HDFS
17 271 (15.00%) Linux
18 268 (14.83%) Scrum
19 261 (14.44%) NoSQL
20 258 (14.28%) Machine Learning
21 234 (12.95%) REST
22 231 (12.78%) Docker
23 228 (12.62%) BDD
24 223 (12.34%) Security Cleared
25 218 (12.06%) Data Modelling
26 213 (11.79%) Business Intelligence
27 212 (11.73%) Microservices
28 210 (11.62%) Analytical Skills
29 208 (11.51%) ETL

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 771 (42.67%) Apache Spark
2 180 (9.96%) Apache
3 111 (6.14%) Apache Solr
4 110 (6.09%) Elasticsearch
5 105 (5.81%) Confluence
6 89 (4.93%) Apache Pig
7 63 (3.49%) SAS
8 24 (1.33%) OpenStack
8 24 (1.33%) Tomcat
9 20 (1.11%) JBoss
10 9 (0.50%) nginx
10 9 (0.50%) WebSphere
11 8 (0.44%) Oracle Coherence
12 5 (0.28%) Apache Airflow
12 5 (0.28%) CMS
13 4 (0.22%) Jupyter
13 4 (0.22%) Oracle SOA Suite
13 4 (0.22%) SharePoint
13 4 (0.22%) WebLogic
14 3 (0.17%) Jetty
Applications
1 43 (2.38%) Microsoft Excel
2 17 (0.94%) Microsoft PowerPoint
3 16 (0.89%) SPSS
4 7 (0.39%) MS Visio
5 6 (0.33%) Microsoft Office
5 6 (0.33%) Microsoft Project
6 5 (0.28%) Spreadsheet
7 3 (0.17%) Stata
8 2 (0.11%) Photoshop
9 1 (0.055%) Chatbot
9 1 (0.055%) EViews
9 1 (0.055%) Gephi
9 1 (0.055%) Mingle
9 1 (0.055%) Weka
Business Applications
1 5 (0.28%) WebTrends
2 3 (0.17%) Bloomberg TOMS
2 3 (0.17%) Eagle PACE
3 2 (0.11%) Dynamics CRM
3 2 (0.11%) Markit EDM
4 1 (0.055%) Cognos Business Intelligence
4 1 (0.055%) Dynamics NAV
4 1 (0.055%) Hyperion Planning
4 1 (0.055%) Payment Gateway
4 1 (0.055%) SAP BPC
4 1 (0.055%) SAP CO
4 1 (0.055%) SAP FI
4 1 (0.055%) SAP FI/CO
Cloud Services
1 385 (21.31%) Amazon AWS
2 106 (5.87%) Microsoft Azure
3 86 (4.76%) GitHub
4 65 (3.60%) Google Cloud Platform
5 43 (2.38%) SaaS
6 41 (2.27%) Amazon S3
7 40 (2.21%) Amazon EC2
8 35 (1.94%) IBM Cloud
9 33 (1.83%) Bluemix
10 27 (1.49%) Amazon EMR
10 27 (1.49%) Cloud Computing
11 26 (1.44%) PaaS
12 25 (1.38%) Virtual Private Cloud
13 24 (1.33%) Serverless
14 21 (1.16%) IaaS
15 12 (0.66%) Amazon CloudWatch
16 11 (0.61%) AWS CloudFormation
16 11 (0.61%) Google Analytics
17 10 (0.55%) AWS Lambda
18 9 (0.50%) Amazon Kinesis
Communications & Networking
1 121 (6.70%) Kerberos
2 24 (1.33%) HTTP
3 20 (1.11%) Network Security
4 15 (0.83%) Firewall
5 13 (0.72%) Internet
5 13 (0.72%) SSL
6 12 (0.66%) TCP/IP
7 11 (0.61%) DSL
8 8 (0.44%) FIX Connectivity
8 8 (0.44%) HTTPS
9 7 (0.39%) VPN
10 6 (0.33%) DNS
10 6 (0.33%) LAN
10 6 (0.33%) WAN
11 5 (0.28%) GSM
11 5 (0.28%) ICMP
11 5 (0.28%) LDAP
11 5 (0.28%) NAS
11 5 (0.28%) SAN
12 4 (0.22%) SMS
Database & Business Intelligence
1 1024 (56.67%) Hadoop
2 369 (20.42%) HBase
3 363 (20.09%) Apache Hive
4 261 (14.44%) NoSQL
5 184 (10.18%) MongoDB
6 161 (8.91%) Data Warehouse
6 161 (8.91%) PostgreSQL
7 148 (8.19%) Apache Cassandra
8 140 (7.75%) Relational Database
9 93 (5.15%) Impala
10 84 (4.65%) SQL Server
11 76 (4.21%) Sqoop
12 63 (3.49%) RDBMS
13 56 (3.10%) Data Lake
14 48 (2.66%) Data Mining
15 47 (2.60%) MySQL
16 42 (2.32%) BusinessObjects
17 40 (2.21%) Oracle Database
18 39 (2.16%) Amazon Redshift
19 36 (1.99%) Flink
Development Applications
1 176 (9.74%) JIRA
2 164 (9.08%) Jenkins
3 116 (6.42%) Git (software)
4 101 (5.59%) Cucumber
5 46 (2.55%) Maven
6 29 (1.60%) GitLab
7 27 (1.49%) IntelliJ
8 21 (1.16%) Gradle
9 20 (1.11%) JUnit
10 19 (1.05%) Ant
11 18 (1.00%) NUnit
11 18 (1.00%) Selenium
12 15 (0.83%) Artifactory
12 15 (0.83%) Subversion
12 15 (0.83%) TeamCity
13 14 (0.77%) Mockito
13 14 (0.77%) Vagrant
14 13 (0.72%) Mocha
14 13 (0.72%) Talend Open Studio
15 11 (0.61%) WebDriver
General
1 442 (24.46%) Finance
2 347 (19.20%) Banking
3 112 (6.20%) Investment Banking
4 94 (5.20%) Marketing
5 84 (4.65%) Front Office
6 65 (3.60%) Retail
7 64 (3.54%) Telecoms
8 38 (2.10%) Manufacturing
9 32 (1.77%) Electronics
10 27 (1.49%) Publishing
11 22 (1.22%) Legal
12 21 (1.16%) Games
13 16 (0.89%) Financial Institution
13 16 (0.89%) Retail Banking
14 14 (0.77%) French Language
15 13 (0.72%) Advertising
16 9 (0.50%) Law
17 7 (0.39%) Back Office
18 5 (0.28%) Pharmaceutical
18 5 (0.28%) Wholesale Banking
Job Titles
1 656 (36.30%) Developer
2 297 (16.44%) Data Engineer
3 252 (13.95%) Big Data Developer
4 242 (13.39%) Big Data Engineer
5 227 (12.56%) Architect
6 219 (12.12%) Java Developer
7 148 (8.19%) Data Architect
8 132 (7.30%) Analyst
9 115 (6.36%) Scala Developer
10 105 (5.81%) Hadoop Engineer
11 94 (5.20%) Big Data Architect
12 89 (4.93%) Consultant
13 85 (4.70%) Senior Developer
14 84 (4.65%) Data Scientist
15 82 (4.54%) Hadoop Developer
16 75 (4.15%) DevOps Engineer
17 69 (3.82%) Java Engineer
18 62 (3.43%) Apache Spark Developer
19 57 (3.15%) Data Analyst
20 55 (3.04%) Business Analyst
Libraries, Frameworks & Software Standards
1 452 (25.01%) Kafka
2 234 (12.95%) REST
3 187 (10.35%) Spring
4 165 (9.13%) Web Services
5 149 (8.25%) JSON
6 111 (6.14%) RESTful
7 109 (6.03%) Spring Boot
8 99 (5.48%) HTML
9 98 (5.42%) AngularJS
10 82 (4.54%) HTML5
11 74 (4.10%) PySpark
12 73 (4.04%) CSS
12 73 (4.04%) Drools
13 69 (3.82%) React
14 68 (3.76%) Akka
15 67 (3.71%) XML
16 61 (3.38%) Apache Camel
16 61 (3.38%) Hibernate
17 53 (2.93%) .NET
18 52 (2.88%) Samza
Miscellaneous
1 210 (11.62%) Analytical Skills
2 145 (8.02%) Algorithms
3 86 (4.76%) Computer Science
4 56 (3.10%) Greenfield Project
5 53 (2.93%) User Experience
6 49 (2.71%) Data Structures
7 47 (2.60%) Market Risk
8 44 (2.43%) Fintech
9 37 (2.05%) Foreign Exchange (FX)
10 33 (1.83%) Reference Data
11 30 (1.66%) Data Centre
12 29 (1.60%) Management Information System
13 24 (1.33%) Equities
14 22 (1.22%) Credit Risk
14 22 (1.22%) Derivative
15 17 (0.94%) Enterprise Software
15 17 (0.94%) Fixed Income
15 17 (0.94%) Semantic Web
15 17 (0.94%) Virtual Team
16 16 (0.89%) Replication
Operating Systems
1 271 (15.00%) Linux
2 116 (6.42%) Unix
3 28 (1.55%) Windows
4 24 (1.33%) Red Hat Enterprise Linux
5 21 (1.16%) CentOS
6 17 (0.94%) Ubuntu
7 13 (0.72%) Android
7 13 (0.72%) Apple iOS
8 4 (0.22%) AIX
8 4 (0.22%) Solaris
9 3 (0.17%) Windows Vista
10 1 (0.055%) Mac OS X
Processes & Methodologies
1 653 (36.14%) Agile Software Development
2 453 (25.07%) Analytics
3 331 (18.32%) TDD
4 292 (16.16%) DevOps
5 268 (14.83%) Scrum
6 258 (14.28%) Machine Learning
7 228 (12.62%) BDD
8 218 (12.06%) Data Modelling
9 213 (11.79%) Business Intelligence
10 212 (11.73%) Microservices
11 208 (11.51%) ETL
12 181 (10.02%) Data Architecture
13 179 (9.91%) MapReduce
14 163 (9.02%) Visualisation
15 152 (8.41%) Open Source
16 151 (8.36%) Continuous Integration
17 123 (6.81%) Data Analytics
18 119 (6.59%) Test Automation
19 110 (6.09%) Software Engineering
20 103 (5.70%) Kanban
Programming Languages
1 820 (45.38%) Java
2 530 (29.33%) Python
3 454 (25.12%) SQL
4 385 (21.31%) Scala
5 170 (9.41%) JavaScript
6 151 (8.36%) R
7 86 (4.76%) C#
8 55 (3.04%) PL/SQL
9 54 (2.99%) Bash Shell
10 48 (2.66%) Shell Script
11 36 (1.99%) Ruby
12 32 (1.77%) Groovy
12 32 (1.77%) Perl
13 29 (1.60%) Go
14 26 (1.44%) C++
14 26 (1.44%) T-SQL
15 23 (1.27%) SPARQL
15 23 (1.27%) TypeScript
16 21 (1.16%) C
17 20 (1.11%) PHP
Qualifications
1 223 (12.34%) Security Cleared
2 166 (9.19%) SC Cleared
3 117 (6.47%) Degree
4 49 (2.71%) DV Cleared
5 33 (1.83%) Computer Science Degree
6 22 (1.22%) PhD
7 17 (0.94%) Master's Degree
8 16 (0.89%) Numerate Degree
9 7 (0.39%) DBS Check
10 6 (0.33%) CCNA
10 6 (0.33%) Cisco Certification
11 5 (0.28%) CTC Cleared
11 5 (0.28%) PMP
11 5 (0.28%) Postgraduate
12 4 (0.22%) APMP
12 4 (0.22%) BPSS Clearance
12 4 (0.22%) ISTQB
12 4 (0.22%) Microsoft Certification
12 4 (0.22%) PRINCE2 Practitioner
13 3 (0.17%) MCITP
Quality Assurance & Compliance
1 94 (5.20%) Data Quality
2 77 (4.26%) QA
3 20 (1.11%) MiFID
4 19 (1.05%) GCP
5 15 (0.83%) GDPR
6 9 (0.50%) PMO
7 8 (0.44%) Actionable Recommendations
8 5 (0.28%) Dodd-Frank
8 5 (0.28%) IFRS
8 5 (0.28%) IFRS 9
9 2 (0.11%) EMIR
9 2 (0.11%) PSD2
9 2 (0.11%) SLA
10 1 (0.055%) Basel III
10 1 (0.055%) PCI DSS
10 1 (0.055%) Sarbanes-Oxley
System Software
1 291 (16.10%) HDFS
2 231 (12.78%) Docker
3 136 (7.53%) Apache Flume
4 76 (4.21%) Apache ZooKeeper
5 18 (1.00%) Oracle RAC
6 17 (0.94%) Oracle Clusterware
6 17 (0.94%) VMware Infrastructure
7 14 (0.77%) vCloud
8 10 (0.55%) Active Directory
9 8 (0.44%) Virtual Machines
10 5 (0.28%) Hyper-V
11 2 (0.11%) OpenDJ
11 2 (0.11%) OpenIDM
11 2 (0.11%) VMware ESXi
12 1 (0.055%) OpenAM
12 1 (0.055%) PowerHA
12 1 (0.055%) Snort
Systems Management
1 145 (8.02%) Ansible
2 123 (6.81%) Kubernetes
3 122 (6.75%) Terraform
4 104 (5.76%) Oozie
5 97 (5.37%) Hadoop YARN
6 80 (4.43%) Puppet
7 70 (3.87%) Ambari
8 42 (2.32%) Opscode Chef
9 25 (1.38%) Mesos
10 17 (0.94%) Data Guard
10 17 (0.94%) Oracle Flashback
10 17 (0.94%) Oracle RMAN
11 16 (0.89%) ITRS Geneos
12 12 (0.66%) Graphite
13 10 (0.55%) Rancher
14 9 (0.50%) Kibana
14 9 (0.50%) logstash
14 9 (0.50%) Nagios
14 9 (0.50%) Salt
15 7 (0.39%) SCCM
Vendors
1 167 (9.24%) Oracle
2 138 (7.64%) Cloudera
3 129 (7.14%) Tableau
4 115 (6.36%) Hortonworks
5 90 (4.98%) Google
6 74 (4.10%) Splunk
7 72 (3.98%) Microsoft
8 61 (3.38%) SAP
9 60 (3.32%) IBM
10 39 (2.16%) Teradata
11 33 (1.83%) Informatica
12 31 (1.72%) Salesforce.com
13 30 (1.66%) MapR
13 30 (1.66%) VMware
14 23 (1.27%) TIBCO
15 20 (1.11%) Red Hat
16 18 (1.00%) AppDynamics
16 18 (1.00%) SaltStack
17 14 (0.77%) HP
18 13 (0.72%) Ab Initio