Period
to 22 January 2020

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 22 January 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > London
6 months to
22 Jan 2020
Same period 2019 Same period 2018
Rank 76 71 69
Rank change year-on-year -5 -2 -13
Contract jobs citing Big Data 938 1,581 1,712
As % of all contract IT jobs advertised in London 3.10% 3.55% 3.71%
As % of the Database & Business Intelligence category 13.27% 14.71% 15.59%
Number of daily rates quoted 676 1,199 1,259
London median daily rate £575 £550 £550
Median daily rate % change year-on-year +4.55% - -
10th Percentile £413 £425 £406
90th Percentile £725 £725 £700
England median daily rate £550 £550 £550
Number of hourly rates quoted 1 4 0
London median hourly rate £52.50 £45.00 -
Median hourly rate % change year-on-year +16.67% - -
England median hourly rate £52.50 £45.00 £30.50
% change year-on-year +16.67% +47.54% -32.60%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 7,068 10,746 10,980
As % of all contract IT jobs advertised in London 23.38% 24.13% 23.77%
Number of daily rates quoted 5,048 7,943 8,269
London median daily rate £525 £525 £500
Median daily rate % change year-on-year - +5.00% +5.26%
10th Percentile £363 £363 £351
90th Percentile £700 £675 £650
England median daily rate £475 £483 £475
% change year-on-year -1.66% +1.68% +10.47%
Number of hourly rates quoted 49 46 60
London median hourly rate £35.00 £31.24 £26.69
Median hourly rate % change year-on-year +12.04% +17.06% -19.74%
10th Percentile £20.05 £19.09 £17.25
90th Percentile £54.10 £47.50 £58.75
England median hourly rate £32.50 £35.00 £30.75
% change year-on-year -7.14% +13.82% +11.82%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in London.

Contractor daily rate trend for Big Data in London

Big Data
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Big Data in London over the 6 months to 22 January 2020.

Contractor daily rate histogram for Big Data in London

Big Data
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in London.

Contractor hourly rate trend for Big Data in London

Big Data
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the London region over the 6 months to 22 January 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -21 164 £550 -3.08% 132
West London +7 38 £550 - 29
South London -10 23 £575 +9.52% 5
East London -18 12 £600 +14.29% 23
North London +9 1 £275 -58.49% 1
Big Data
England

For the 6 months to 22 January 2020, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Big Data.

1 390 (41.58%) Python
1 390 (41.58%) Agile Software Development
2 335 (35.71%) Apache Spark
3 323 (34.43%) Hadoop
4 322 (34.33%) AWS
5 276 (29.42%) Java
6 267 (28.46%) SQL
7 252 (26.87%) Finance
8 250 (26.65%) Analytics
9 227 (24.20%) Azure
10 186 (19.83%) DevOps
11 167 (17.80%) Machine Learning
12 163 (17.38%) GCP
13 158 (16.84%) Kafka
14 156 (16.63%) Scala
15 155 (16.52%) Data Science
16 150 (15.99%) ETL
17 132 (14.07%) NoSQL
18 130 (13.86%) Data Modelling
19 128 (13.65%) Data Warehouse
20 126 (13.43%) Kubernetes
21 117 (12.47%) Scrum
22 115 (12.26%) Linux
23 113 (12.05%) Docker
23 113 (12.05%) Data Engineering
24 112 (11.94%) Google
25 108 (11.51%) Apache Hive
26 103 (10.98%) Analytical Skills
27 102 (10.87%) Microservices
28 101 (10.77%) Degree

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 335 (35.71%) Apache Spark
2 55 (5.86%) Apache
3 22 (2.35%) Elasticsearch
4 21 (2.24%) Apache Airflow
5 11 (1.17%) SAS
6 10 (1.07%) Confluence
7 9 (0.96%) Jupyter
8 6 (0.64%) Tomcat
8 6 (0.64%) WebSphere
9 5 (0.53%) Apache Pig
9 5 (0.53%) DNN
9 5 (0.53%) Luigi
10 3 (0.32%) JBoss
10 3 (0.32%) Moodle
10 3 (0.32%) OpenStack
10 3 (0.32%) Oracle HTTP Server
10 3 (0.32%) Oracle SOA Suite
10 3 (0.32%) Skype for Business
10 3 (0.32%) WebLogic
11 2 (0.21%) IIS
Applications
1 22 (2.35%) Microsoft Excel
2 10 (1.07%) MS Visio
3 9 (0.96%) Microsoft Project
4 6 (0.64%) Microsoft PowerPoint
5 5 (0.53%) Spreadsheet
6 2 (0.21%) Microsoft Office
7 1 (0.11%) AutoCAD
7 1 (0.11%) Chatbot
7 1 (0.11%) InVision
7 1 (0.11%) Sketch
7 1 (0.11%) Zeplin
Business Applications
1 4 (0.43%) FINCAD Analytics
1 4 (0.43%) SAP Oil and Gas
2 3 (0.32%) Distributed Ledger
2 3 (0.32%) Oracle BPM
3 2 (0.21%) Adobe Campaign
3 2 (0.21%) Aligne
3 2 (0.21%) PolarLake
4 1 (0.11%) Actimize
4 1 (0.11%) Cognos Business Intelligence
4 1 (0.11%) Dynamics CRM
4 1 (0.11%) Markit EDM
4 1 (0.11%) NetSuite
4 1 (0.11%) SAP CAR
4 1 (0.11%) SAP MDM
4 1 (0.11%) SAP Retail
4 1 (0.11%) SAP S/4HANA
4 1 (0.11%) Sparx Enterprise Architect
Cloud Services
1 322 (34.33%) AWS
2 227 (24.20%) Azure
3 163 (17.38%) GCP
4 52 (5.54%) Power Platform
5 42 (4.48%) Amazon EMR
6 32 (3.41%) GitHub
7 31 (3.30%) Amazon S3
8 26 (2.77%) Serverless
9 23 (2.45%) Amazon Kinesis
10 21 (2.24%) AWS CloudFormation
11 19 (2.03%) OpenShift
12 18 (1.92%) AWS Lambda
12 18 (1.92%) Azure Data Factory
13 14 (1.49%) SaaS
14 13 (1.39%) Amazon EC2
14 13 (1.39%) Cloud Computing
15 12 (1.28%) Amazon CloudWatch
15 12 (1.28%) Azure Machine Learning
16 9 (0.96%) Office 365
17 8 (0.85%) IaaS
Communications & Networking
1 15 (1.60%) Kerberos
2 14 (1.49%) HTTP
3 11 (1.17%) Firewall
4 7 (0.75%) Internet
4 7 (0.75%) VPN
5 6 (0.64%) 3G
5 6 (0.64%) 4G
5 6 (0.64%) 5G
6 5 (0.53%) NetScaler
6 5 (0.53%) TCP/IP
7 4 (0.43%) SSH
7 4 (0.43%) Wi-Fi
8 3 (0.32%) Network Security
8 3 (0.32%) PuTTY
8 3 (0.32%) SSL
8 3 (0.32%) Wireshark
9 2 (0.21%) DNS
9 2 (0.21%) F5 BIG-IP GTM
9 2 (0.21%) F5 BIG-IP LTM
9 2 (0.21%) Software-Defined Networking
Database & Business Intelligence
1 323 (34.43%) Hadoop
2 132 (14.07%) NoSQL
3 128 (13.65%) Data Warehouse
4 108 (11.51%) Apache Hive
5 86 (9.17%) SQL Server
6 77 (8.21%) Data Lake
7 68 (7.25%) Relational Database
8 60 (6.40%) MongoDB
9 52 (5.54%) Power BI
10 49 (5.22%) HBase
11 48 (5.12%) Amazon Redshift
12 44 (4.69%) PostgreSQL
13 38 (4.05%) Impala
13 38 (4.05%) Spark SQL
14 35 (3.73%) Apache Cassandra
15 33 (3.52%) MySQL
15 33 (3.52%) RDBMS
16 32 (3.41%) Amazon Athena
17 27 (2.88%) BigQuery
18 21 (2.24%) SQL Server Integration Services
Development Applications
1 93 (9.91%) Jenkins
2 78 (8.32%) Git (software)
3 48 (5.12%) JIRA
4 22 (2.35%) Selenium
5 21 (2.24%) Maven
6 20 (2.13%) Team Foundation Server
7 14 (1.49%) Visual Studio Team System
8 12 (1.28%) Cucumber
9 10 (1.07%) JUnit
10 7 (0.75%) ERwin
10 7 (0.75%) IntelliJ
10 7 (0.75%) Mercurial
10 7 (0.75%) SonarQube
10 7 (0.75%) Sonatype Nexus
11 6 (0.64%) Gatling
11 6 (0.64%) Gradle
11 6 (0.64%) JMeter
11 6 (0.64%) Mockito
11 6 (0.64%) NeoLoad
11 6 (0.64%) WebDriver
General
1 252 (26.87%) Finance
2 96 (10.23%) Banking
3 58 (6.18%) Retail
4 52 (5.54%) Public Sector
5 37 (3.94%) Telecoms
6 31 (3.30%) Investment Banking
6 31 (3.30%) Marketing
7 30 (3.20%) Front Office
8 21 (2.24%) Manufacturing
9 13 (1.39%) Legal
10 10 (1.07%) Advertising
11 8 (0.85%) Financial Institution
11 8 (0.85%) Retail Banking
12 7 (0.75%) Billing
12 7 (0.75%) Pharmaceutical
13 5 (0.53%) Games
14 4 (0.43%) Music Industry
15 3 (0.32%) Back Office
16 2 (0.21%) Law
16 2 (0.21%) Multimedia
Job Titles
1 210 (22.39%) Developer
2 200 (21.32%) Data Engineer
3 147 (15.67%) Architect
4 95 (10.13%) Big Data Engineer
5 74 (7.89%) Data Architect
6 69 (7.36%) Analyst
7 68 (7.25%) Data Scientist
8 67 (7.14%) DevOps Engineer
9 59 (6.29%) Java Developer
10 57 (6.08%) Python Developer
11 48 (5.12%) Big Data Developer
12 46 (4.90%) Python Engineer
13 38 (4.05%) Cloud Engineer
13 38 (4.05%) Java Engineer
14 35 (3.73%) AWS Engineer
14 35 (3.73%) Big Data Architect
14 35 (3.73%) Senior Developer
15 29 (3.09%) Business Analyst
16 27 (2.88%) Azure Engineer
16 27 (2.88%) Solutions Architect
Libraries, Frameworks & Software Standards
1 158 (16.84%) Kafka
2 75 (8.00%) Web Services
3 62 (6.61%) PySpark
4 47 (5.01%) React
5 42 (4.48%) TensorFlow
6 40 (4.26%) JSON
7 39 (4.16%) REST
8 35 (3.73%) RESTful
9 33 (3.52%) Pandas
10 32 (3.41%) XML
11 31 (3.30%) Spring
12 30 (3.20%) Node.js
13 29 (3.09%) scikit-learn
14 28 (2.99%) .NET
15 23 (2.45%) Natural Language Processing
16 22 (2.35%) Drools
17 19 (2.03%) HTML
17 19 (2.03%) MLlib
17 19 (2.03%) NumPy
17 19 (2.03%) Spark Streaming
Miscellaneous
1 103 (10.98%) Analytical Skills
2 69 (7.36%) Algorithms
3 66 (7.04%) Greenfield Project
4 39 (4.16%) Data Structures
5 25 (2.67%) Self-Motivation
6 22 (2.35%) User Experience
7 18 (1.92%) Public Cloud
8 16 (1.71%) Data Centre
9 15 (1.60%) Management Information System
10 14 (1.49%) Cloud Native
11 10 (1.07%) Fixed Income
11 10 (1.07%) Replication
12 9 (0.96%) Social Media
13 8 (0.85%) Derivative
13 8 (0.85%) Enterprise Software
13 8 (0.85%) Hedge funds
13 8 (0.85%) Hybrid Cloud
14 7 (0.75%) Credit Risk
14 7 (0.75%) PKI
14 7 (0.75%) Virtual Team
Operating Systems
1 115 (12.26%) Linux
2 49 (5.22%) Unix
3 23 (2.45%) Windows
4 17 (1.81%) Red Hat Enterprise Linux
5 8 (0.85%) Apple iOS
6 7 (0.75%) CentOS
7 6 (0.64%) Android
7 6 (0.64%) Windows 10
8 5 (0.53%) VMS
9 3 (0.32%) Debian
9 3 (0.32%) Mac OS X
9 3 (0.32%) Ubuntu
10 2 (0.21%) Embedded Linux
10 2 (0.21%) Windows Server
11 1 (0.11%) AIX
Processes & Methodologies
1 390 (41.58%) Agile Software Development
2 250 (26.65%) Analytics
3 186 (19.83%) DevOps
4 167 (17.80%) Machine Learning
5 155 (16.52%) Data Science
6 150 (15.99%) ETL
7 130 (13.86%) Data Modelling
8 117 (12.47%) Scrum
9 113 (12.05%) Data Engineering
10 102 (10.87%) Microservices
11 100 (10.66%) Artificial Intelligence
12 99 (10.55%) Business Intelligence
13 98 (10.45%) Computer Science
14 82 (8.74%) Continuous Integration
14 82 (8.74%) TDD
15 79 (8.42%) Data Analytics
16 77 (8.21%) Problem-Solving
17 76 (8.10%) Migration
17 76 (8.10%) Visualisation
18 62 (6.61%) Use Case
Programming Languages
1 390 (41.58%) Python
2 276 (29.42%) Java
3 267 (28.46%) SQL
4 156 (16.63%) Scala
5 65 (6.93%) R
6 61 (6.50%) C#
6 61 (6.50%) JavaScript
7 35 (3.73%) Bash Shell
8 26 (2.77%) C++
9 20 (2.13%) Java 8
10 19 (2.03%) C
10 19 (2.03%) Ruby
11 17 (1.81%) Shell Script
12 15 (1.60%) PL/SQL
13 14 (1.49%) Go
13 14 (1.49%) Groovy
13 14 (1.49%) T-SQL
14 13 (1.39%) PowerShell
15 9 (0.96%) PHP
16 5 (0.53%) TypeScript
Qualifications
1 101 (10.77%) Degree
2 60 (6.40%) Security Cleared
3 46 (4.90%) SC Cleared
4 38 (4.05%) Computer Science Degree
5 23 (2.45%) PhD
6 21 (2.24%) Master's Degree
7 11 (1.17%) DV Cleared
8 9 (0.96%) AWS Certification
9 4 (0.43%) ISEB
9 4 (0.43%) PMI Certification
10 3 (0.32%) CCIE
10 3 (0.32%) CCNP
10 3 (0.32%) Cisco Certification
10 3 (0.32%) CISSP
10 3 (0.32%) Numerate Degree
10 3 (0.32%) PMP
10 3 (0.32%) TOGAF Certification
11 2 (0.21%) CISM
12 1 (0.11%) GIAC
12 1 (0.11%) Microsoft Certification
Quality Assurance & Compliance
1 30 (3.20%) QA
2 21 (2.24%) Data Quality
3 9 (0.96%) PMO
4 4 (0.43%) PCI DSS
5 3 (0.32%) COBIT
5 3 (0.32%) ISO/IEC 27001
6 2 (0.21%) GDPR
6 2 (0.21%) ISO 9000
6 2 (0.21%) Sarbanes-Oxley
6 2 (0.21%) SLA
7 1 (0.11%) Basel III
7 1 (0.11%) GLBA
7 1 (0.11%) HIPAA
7 1 (0.11%) IFRS
7 1 (0.11%) IFRS 9
7 1 (0.11%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
7 1 (0.11%) NIST
System Software
1 113 (12.05%) Docker
2 44 (4.69%) HDFS
3 8 (0.85%) Active Directory
4 7 (0.75%) Microsoft App-V
4 7 (0.75%) Virtual Desktop
4 7 (0.75%) VMware Infrastructure
4 7 (0.75%) XenApp
4 7 (0.75%) XenDesktop
5 3 (0.32%) Apache Flume
5 3 (0.32%) Oracle RAC
6 2 (0.21%) Apache ZooKeeper
6 2 (0.21%) BusyBox
6 2 (0.21%) Hyper-V
6 2 (0.21%) Virtual Machines
7 1 (0.11%) Oracle Clusterware
7 1 (0.11%) vSphere
Systems Management
1 126 (13.43%) Kubernetes
2 68 (7.25%) Terraform
3 61 (6.50%) Ansible
4 24 (2.56%) Hadoop YARN
5 18 (1.92%) Opscode Chef
6 12 (1.28%) SCCM
7 11 (1.17%) ITRS Geneos
7 11 (1.17%) Puppet
8 10 (1.07%) Kibana
9 9 (0.96%) Oozie
10 7 (0.75%) Istio
10 7 (0.75%) Nagios
10 7 (0.75%) Single Sign-On
11 6 (0.64%) Prometheus
12 5 (0.53%) CFEngine
12 5 (0.53%) HP SiteScope
12 5 (0.53%) Microsoft Intune
13 4 (0.43%) Ambari
14 3 (0.32%) SELinux
15 2 (0.21%) logstash
Vendors
1 112 (11.94%) Google
2 90 (9.59%) Microsoft
3 74 (7.89%) Oracle
4 60 (6.40%) Tableau
5 59 (6.29%) Cloudera
6 50 (5.33%) Databricks
7 38 (4.05%) Hortonworks
8 24 (2.56%) SAP
9 21 (2.24%) Red Hat
9 21 (2.24%) Splunk
10 18 (1.92%) MapR
10 18 (1.92%) Teradata
11 17 (1.81%) Informatica
11 17 (1.81%) Talend
12 16 (1.71%) Alteryx
12 16 (1.71%) StreamSets
13 13 (1.39%) Ab Initio
14 12 (1.28%) Palantir
15 10 (1.07%) Cisco
15 10 (1.07%) Salesforce.com