Period
to 19 February 2018

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 19 February 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > London
6 months to
19 Feb 2018
Same period 2017 Same period 2016
Rank 69 51 97
Rank change year-on-year -18 +46 +46
Contract jobs citing Big Data 1,681 1,784 1,106
As % of all contract IT jobs advertised in London 3.61% 4.38% 2.49%
As % of the Database & Business Intelligence category 15.34% 18.21% 10.41%
Number of daily rates quoted 1,225 1,215 782
London median daily rate £550 £550 £550
10th Percentile £409 £409 £359
90th Percentile £700 £720 £688
England median daily rate £550 £535 £520
% change year-on-year +2.80% +2.88% +4.00%
Number of hourly rates quoted 0 1 5
London median hourly rate - £100.00 £26.00
Median hourly rate % change year-on-year - +284.62% -
England median hourly rate £31.31 £45.00 £26.93
% change year-on-year -30.42% +67.13% -27.23%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 10,958 9,795 10,621
As % of all contract IT jobs advertised in London 23.52% 24.07% 23.89%
Number of daily rates quoted 8,322 6,972 7,669
London median daily rate £500 £475 £450
Median daily rate % change year-on-year +5.26% +5.56% +5.88%
10th Percentile £356 £325 £313
90th Percentile £652 £650 £638
England median daily rate £475 £438 £425
% change year-on-year +8.57% +2.94% +6.25%
Number of hourly rates quoted 64 45 62
London median hourly rate £27.50 £32.50 £26.46
Median hourly rate % change year-on-year -15.38% +22.82% -6.33%
10th Percentile £17.32 £15.25 £16.03
90th Percentile £43.74 £58.50 £100.00
England median hourly rate £35.00 £25.95 £27.37
% change year-on-year +34.90% -5.21% -0.47%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in London.

Contractor daily rate trend for Big Data in London

Big Data
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Big Data in London over the 6 months to 19 February 2018.

Contractor daily rate histogram for Big Data in London

Big Data
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in London.

Contractor hourly rate trend for Big Data in London

Big Data
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the London region over the 6 months to 19 February 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -35 266 £568 +3.18% 131
South London +21 108 £550 +23.94% 8
East London -7 25 £588 +2.17% 24
West London -36 23 £525 +5.00% 47
North London -6 5 £550 -2.22% 3
Big Data
England

For the 6 months to 19 February 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Big Data.

1 837 (49.79%) Hadoop
2 676 (40.21%) Apache Spark
3 621 (36.94%) Java
4 578 (34.38%) Agile Software Development
5 560 (33.31%) Python
6 486 (28.91%) SQL
7 452 (26.89%) Analytics
8 387 (23.02%) Finance
9 376 (22.37%) Kafka
10 365 (21.71%) Amazon AWS
11 363 (21.59%) Scala
12 310 (18.44%) Apache Hive
13 290 (17.25%) Banking
14 284 (16.89%) NoSQL
15 280 (16.66%) DevOps
16 259 (15.41%) Linux
17 257 (15.29%) Data Science
18 245 (14.57%) ETL
19 239 (14.22%) HBase
20 233 (13.86%) Machine Learning
21 215 (12.79%) Data Warehouse
22 210 (12.49%) Docker
23 201 (11.96%) Business Intelligence
24 200 (11.90%) Data Modelling
24 200 (11.90%) HDFS
25 199 (11.84%) Scrum
26 194 (11.54%) TDD
27 184 (10.95%) Data Analytics
28 174 (10.35%) Apache
29 171 (10.17%) Security Cleared

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 676 (40.21%) Apache Spark
2 174 (10.35%) Apache
3 81 (4.82%) Elasticsearch
4 73 (4.34%) SAS
5 71 (4.22%) Apache Pig
6 55 (3.27%) Confluence
7 52 (3.09%) Apache Solr
8 25 (1.49%) Tomcat
9 20 (1.19%) nginx
10 15 (0.89%) SharePoint
11 10 (0.59%) OpenStack
11 10 (0.59%) Oracle Coherence
11 10 (0.59%) WebSphere
12 8 (0.48%) Apache Airflow
13 7 (0.42%) Jupyter
14 6 (0.36%) CMS
14 6 (0.36%) JBoss
15 3 (0.18%) GeoServer
16 2 (0.12%) IPython
16 2 (0.12%) Tornado
Applications
1 45 (2.68%) Microsoft Excel
2 19 (1.13%) SPSS
3 15 (0.89%) Microsoft PowerPoint
4 11 (0.65%) Spreadsheet
5 9 (0.54%) Microsoft Office
6 7 (0.42%) Microsoft Project
7 6 (0.36%) MS Visio
8 3 (0.18%) Adobe Illustrator
8 3 (0.18%) InVision
9 2 (0.12%) HipChat
10 1 (0.059%) Chatbot
10 1 (0.059%) EViews
10 1 (0.059%) Gephi
10 1 (0.059%) Stata
10 1 (0.059%) Weka
Business Applications
1 4 (0.24%) SAP Oil and Gas
2 3 (0.18%) HiPortfolio
3 2 (0.12%) Dynamics CRM
3 2 (0.12%) Relativity
3 2 (0.12%) Summit
4 1 (0.059%) Adobe Campaign
4 1 (0.059%) Eloqua
4 1 (0.059%) FastStats
4 1 (0.059%) Hyperion Planning
4 1 (0.059%) Oracle Procure-to-Pay
4 1 (0.059%) Payment Gateway
4 1 (0.059%) Revive Adserver
4 1 (0.059%) SAP BPC
4 1 (0.059%) SAP CO
4 1 (0.059%) SAP FI
4 1 (0.059%) SAP FI/CO
4 1 (0.059%) SAP Hybris
4 1 (0.059%) Unica
4 1 (0.059%) WebTrends
Cloud Services
1 365 (21.71%) Amazon AWS
2 158 (9.40%) Microsoft Azure
3 81 (4.82%) Google Cloud Platform
4 56 (3.33%) GitHub
5 38 (2.26%) SaaS
6 37 (2.20%) Amazon S3
7 36 (2.14%) Amazon Kinesis
8 30 (1.78%) Amazon EC2
9 26 (1.55%) Serverless
10 24 (1.43%) Cloud Computing
10 24 (1.43%) PaaS
11 23 (1.37%) Amazon EMR
12 21 (1.25%) Virtual Private Cloud
13 18 (1.07%) AWS Lambda
13 18 (1.07%) Bluemix
13 18 (1.07%) IBM Cloud
14 16 (0.95%) Amazon CloudWatch
15 15 (0.89%) AWS CloudTrail
16 13 (0.77%) Azure Data Factory
17 12 (0.71%) Google Analytics
Communications & Networking
1 71 (4.22%) Kerberos
2 18 (1.07%) Internet
2 18 (1.07%) SSL
3 17 (1.01%) Network Security
4 13 (0.77%) HTTP
5 11 (0.65%) TCP/IP
6 10 (0.59%) Firewall
7 8 (0.48%) HTTPS
8 7 (0.42%) DNS
8 7 (0.42%) VPN
9 6 (0.36%) FIX Connectivity
10 4 (0.24%) ICMP
11 3 (0.18%) GSM
11 3 (0.18%) SMS
11 3 (0.18%) WAN
12 2 (0.12%) LAN
12 2 (0.12%) MPLS
12 2 (0.12%) SMTP
12 2 (0.12%) SNMP
12 2 (0.12%) VLAN
Database & Business Intelligence
1 837 (49.79%) Hadoop
2 310 (18.44%) Apache Hive
3 284 (16.89%) NoSQL
4 239 (14.22%) HBase
5 215 (12.79%) Data Warehouse
6 164 (9.76%) MongoDB
7 147 (8.74%) Relational Database
8 141 (8.39%) PostgreSQL
8 141 (8.39%) SQL Server
9 136 (8.09%) Apache Cassandra
10 103 (6.13%) Data Lake
11 75 (4.46%) Impala
12 73 (4.34%) MySQL
13 68 (4.05%) Sqoop
14 65 (3.87%) RDBMS
15 64 (3.81%) Amazon Redshift
16 50 (2.97%) Data Mining
17 46 (2.74%) Power BI
18 44 (2.62%) Oracle Database
19 39 (2.32%) Flink
Development Applications
1 128 (7.61%) Jenkins
2 102 (6.07%) Git (software)
3 101 (6.01%) JIRA
4 47 (2.80%) Maven
5 36 (2.14%) Cucumber
6 34 (2.02%) JUnit
7 24 (1.43%) Selenium
8 22 (1.31%) Visual Studio
9 20 (1.19%) Subversion
9 20 (1.19%) TeamCity
10 17 (1.01%) GitLab
11 16 (0.95%) Gradle
12 15 (0.89%) Vagrant
13 13 (0.77%) Ant
13 13 (0.77%) ERwin
13 13 (0.77%) Mockito
13 13 (0.77%) NUnit
14 12 (0.71%) Team Foundation Server
14 12 (0.71%) Visual Studio Team System
15 11 (0.65%) WebDriver
General
1 387 (23.02%) Finance
2 290 (17.25%) Banking
3 90 (5.35%) Investment Banking
4 77 (4.58%) Retail
5 75 (4.46%) Marketing
6 53 (3.15%) Telecoms
7 50 (2.97%) Front Office
8 39 (2.32%) Games
9 33 (1.96%) Manufacturing
10 26 (1.55%) Publishing
11 22 (1.31%) Legal
12 17 (1.01%) French Language
12 17 (1.01%) Retail Banking
13 14 (0.83%) Advertising
13 14 (0.83%) Electronics
14 13 (0.77%) Law
15 12 (0.71%) Financial Institution
16 4 (0.24%) Automotive
16 4 (0.24%) German Language
17 3 (0.18%) Back Office
Job Titles
1 501 (29.80%) Developer
2 309 (18.38%) Data Engineer
3 259 (15.41%) Architect
4 228 (13.56%) Big Data Engineer
5 172 (10.23%) Big Data Developer
6 156 (9.28%) Data Architect
7 147 (8.74%) Java Developer
8 120 (7.14%) Analyst
9 91 (5.41%) Big Data Architect
10 88 (5.23%) DevOps Engineer
11 86 (5.12%) Consultant
12 83 (4.94%) Senior Developer
13 82 (4.88%) Hadoop Engineer
14 81 (4.82%) Scala Developer
15 75 (4.46%) Data Scientist
16 55 (3.27%) Data Analyst
17 52 (3.09%) Solutions Architect
18 48 (2.86%) AWS Engineer
19 45 (2.68%) Data Consultant
20 44 (2.62%) Hadoop Developer
Libraries, Frameworks & Software Standards
1 376 (22.37%) Kafka
2 107 (6.37%) REST
3 105 (6.25%) Web Services
4 99 (5.89%) Spring
5 84 (5.00%) AngularJS
6 82 (4.88%) RESTful
7 78 (4.64%) HTML
7 78 (4.64%) JSON
8 74 (4.40%) React
9 64 (3.81%) .NET
9 64 (3.81%) PySpark
10 61 (3.63%) CSS
10 61 (3.63%) HTML5
11 60 (3.57%) XML
12 48 (2.86%) Akka
12 48 (2.86%) Spring Boot
13 46 (2.74%) Node.js
14 44 (2.62%) Natural Language Processing
15 43 (2.56%) Hibernate
16 40 (2.38%) Spark Streaming
Miscellaneous
1 171 (10.17%) Analytical Skills
2 107 (6.37%) Computer Science
3 103 (6.13%) Algorithms
4 58 (3.45%) Greenfield Project
5 48 (2.86%) Data Structures
5 48 (2.86%) User Experience
6 42 (2.50%) Fintech
7 37 (2.20%) Management Information System
8 35 (2.08%) Data Centre
9 29 (1.73%) Foreign Exchange (FX)
10 25 (1.49%) Market Risk
11 17 (1.01%) Virtual Team
12 16 (0.95%) Derivative
13 15 (0.89%) Equities
13 15 (0.89%) Mobile App
13 15 (0.89%) Reference Data
14 14 (0.83%) Cyberthreat
15 13 (0.77%) Enterprise Software
15 13 (0.77%) Public Cloud
15 13 (0.77%) Replication
Operating Systems
1 259 (15.41%) Linux
2 102 (6.07%) Unix
3 44 (2.62%) Windows
4 35 (2.08%) Red Hat Enterprise Linux
5 23 (1.37%) Ubuntu
6 18 (1.07%) CentOS
7 10 (0.59%) Android
7 10 (0.59%) Apple iOS
8 7 (0.42%) Windows Server
9 3 (0.18%) DC/OS
9 3 (0.18%) Windows Server 2008
10 2 (0.12%) Debian
10 2 (0.12%) Windows 10
11 1 (0.059%) Mesosphere
11 1 (0.059%) Windows 7
Processes & Methodologies
1 578 (34.38%) Agile Software Development
2 452 (26.89%) Analytics
3 280 (16.66%) DevOps
4 257 (15.29%) Data Science
5 245 (14.57%) ETL
6 233 (13.86%) Machine Learning
7 201 (11.96%) Business Intelligence
8 200 (11.90%) Data Modelling
9 199 (11.84%) Scrum
10 194 (11.54%) TDD
11 184 (10.95%) Data Analytics
12 158 (9.40%) Open Source
13 145 (8.63%) Data Architecture
14 144 (8.57%) Visualisation
15 133 (7.91%) Data Engineering
16 132 (7.85%) Continuous Integration
17 112 (6.66%) MapReduce
18 110 (6.54%) BDD
18 110 (6.54%) Stakeholder Management
19 106 (6.31%) Microservices
Programming Languages
1 621 (36.94%) Java
2 560 (33.31%) Python
3 486 (28.91%) SQL
4 363 (21.59%) Scala
5 170 (10.11%) JavaScript
6 143 (8.51%) R
7 95 (5.65%) C#
8 61 (3.63%) Bash Shell
9 53 (3.15%) PL/SQL
10 49 (2.91%) Perl
11 48 (2.86%) Shell Script
12 32 (1.90%) Go
13 28 (1.67%) C++
13 28 (1.67%) Ruby
13 28 (1.67%) T-SQL
14 25 (1.49%) C
15 24 (1.43%) PowerShell
16 21 (1.25%) Groovy
17 16 (0.95%) TypeScript
18 15 (0.89%) VBA
Qualifications
1 171 (10.17%) Security Cleared
2 133 (7.91%) SC Cleared
3 127 (7.56%) Degree
4 36 (2.14%) Computer Science Degree
5 34 (2.02%) DV Cleared
6 24 (1.43%) Numerate Degree
7 23 (1.37%) Master's Degree
7 23 (1.37%) PhD
8 5 (0.30%) CISSP
8 5 (0.30%) CTC Cleared
8 5 (0.30%) PMP
8 5 (0.30%) PRINCE2 Practitioner
9 4 (0.24%) APMP
9 4 (0.24%) BPSS Clearance
10 3 (0.18%) DBS Check
10 3 (0.18%) ISTQB
10 3 (0.18%) PMI Certification
11 2 (0.12%) CISM
11 2 (0.12%) IISP
11 2 (0.12%) Microsoft Certification
Quality Assurance & Compliance
1 93 (5.53%) Data Quality
2 56 (3.33%) QA
3 35 (2.08%) GDPR
4 24 (1.43%) GCP
5 16 (0.95%) MiFID
6 10 (0.59%) PMO
7 9 (0.54%) IFRS
7 9 (0.54%) IFRS 9
8 5 (0.30%) EMIR
9 4 (0.24%) Dodd-Frank
9 4 (0.24%) GAAP
10 3 (0.18%) PSD2
10 3 (0.18%) Sarbanes-Oxley
11 2 (0.12%) SLA
12 1 (0.059%) Basel III
12 1 (0.059%) Disclosure Scotland
12 1 (0.059%) HL7
12 1 (0.059%) ISO/IEC 27001
12 1 (0.059%) PCI DSS
12 1 (0.059%) Solvency II
System Software
1 210 (12.49%) Docker
2 200 (11.90%) HDFS
3 119 (7.08%) Apache Flume
4 31 (1.84%) Apache ZooKeeper
5 17 (1.01%) Active Directory
5 17 (1.01%) Oracle Clusterware
5 17 (1.01%) Oracle RAC
5 17 (1.01%) VMware Infrastructure
6 11 (0.65%) vCloud
7 8 (0.48%) Virtual Machines
8 3 (0.18%) NFS
9 2 (0.12%) OpenDJ
9 2 (0.12%) OpenIDM
9 2 (0.12%) VMware NSX
9 2 (0.12%) vSphere
10 1 (0.059%) Ceph
10 1 (0.059%) iptables
10 1 (0.059%) KVM
10 1 (0.059%) oVirt
10 1 (0.059%) RHEV
Systems Management
1 122 (7.26%) Ansible
2 90 (5.35%) Oozie
3 88 (5.23%) Kubernetes
4 74 (4.40%) Terraform
5 69 (4.10%) Hadoop YARN
6 59 (3.51%) Puppet
7 48 (2.86%) Ambari
8 44 (2.62%) Opscode Chef
9 37 (2.20%) Mesos
10 19 (1.13%) Salt
11 17 (1.01%) Data Guard
11 17 (1.01%) ITRS Geneos
11 17 (1.01%) Oracle Flashback
11 17 (1.01%) Oracle RMAN
12 16 (0.95%) Rancher
13 9 (0.54%) Nagios
14 5 (0.30%) HP Quality Center
14 5 (0.30%) Packer
14 5 (0.30%) SCCM
15 4 (0.24%) logstash
Vendors
1 163 (9.70%) Oracle
2 127 (7.56%) Cloudera
3 123 (7.32%) Tableau
4 108 (6.42%) Hortonworks
4 108 (6.42%) Microsoft
5 95 (5.65%) Google
6 74 (4.40%) Splunk
7 42 (2.50%) IBM
8 39 (2.32%) SAP
9 32 (1.90%) Salesforce.com
10 31 (1.84%) Informatica
11 30 (1.78%) MapR
12 28 (1.67%) Teradata
13 27 (1.61%) Talend
14 25 (1.49%) VMware
15 21 (1.25%) SaltStack
16 20 (1.19%) Alteryx
17 18 (1.07%) Red Hat
18 17 (1.01%) AppDynamics
18 17 (1.01%) Sybase