Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Job Locations Skill Sets
Period
to 2 June 2020

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 2 June 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > London
6 months to
2 Jun 2020		 Same period 2019 Same period 2018
Rank 65 54 64
Rank change year-on-year -11 +10 -6
Contract jobs citing Big Data 648 1,838 1,796
As % of all contract jobs advertised in London 3.44% 4.59% 3.91%
As % of the Database & Business Intelligence category 14.19% 18.50% 15.57%
Number of daily rates quoted 493 1,401 1,328
Median daily rate £559 £550 £550
Median daily rate % change year-on-year +1.64% - -
10th Percentile £413 £425 £419
90th Percentile £713 £725 £702
England median daily rate £550 £550 £550
Number of hourly rates quoted 6 9 1
Median hourly rate £36.75 £42.50 £15.50
Median hourly rate % change year-on-year -13.53% +174.19% -61.25%
10th Percentile £35.00 £31.05 £15.25
90th Percentile £47.88 £50.80 £15.75
England median hourly rate £35.00 £49.13 £44.50
% change year-on-year -28.76% +10.40% -5.32%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 4,566 9,933 11,534
As % of all contract IT jobs advertised in London 24.22% 24.82% 25.09%
Number of daily rates quoted 3,196 7,193 8,648
Median daily rate £525 £525 £513
Median daily rate % change year-on-year - +2.44% +3.02%
10th Percentile £363 £363 £356
90th Percentile £713 £675 £675
England median daily rate £500 £488 £475
% change year-on-year +2.56% +2.63% +5.56%
Number of hourly rates quoted 50 60 76
Median hourly rate £35.00 £35.00 £30.00
Median hourly rate % change year-on-year - +16.67% -7.69%
10th Percentile £20.36 £19.44 £19.25
90th Percentile £41.50 £56.50 £46.50
Median hourly rate £35.00 £35.00 £33.50
% change year-on-year - +4.48% +11.67%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a proportion of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Big Data in London.

Daily rate trend for Big Data in London

Big Data
Daily Rate Histogram in London

Daily rate distribution for jobs citing Big Data in London over the 6 months to 2 June 2020.

Daily rate histogram for Big Data in London

Big Data
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Big Data in London.

Hourly rate trend for Big Data in London

Big Data
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the London region over the 6 months to 2 June 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
Central London -27 116 £550 - 16
South London -6 28 £525 -12.50% 2
West London +18 17 £513 -2.38% 4
East London -9 5 £498 -5.24% 4
Big Data
England

For the 6 months to 2 June 2020, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Big Data.

1 321 (49.54%) Python
2 252 (38.89%) Agile Software Development
3 246 (37.96%) Apache Spark
4 219 (33.80%) AWS
5 217 (33.49%) SQL
6 201 (31.02%) Analytics
7 195 (30.09%) Hadoop
8 154 (23.77%) Java
9 153 (23.61%) Azure
10 150 (23.15%) DevOps
11 141 (21.76%) GCP
12 134 (20.68%) Data Science
13 132 (20.37%) Machine Learning
14 129 (19.91%) Finance
15 122 (18.83%) Kubernetes
16 116 (17.90%) Docker
16 116 (17.90%) Kafka
17 108 (16.67%) Scala
18 106 (16.36%) NoSQL
19 96 (14.81%) Data Modelling
20 87 (13.43%) ETL
21 85 (13.12%) Jenkins
22 83 (12.81%) Artificial Intelligence
23 78 (12.04%) Microservices
23 78 (12.04%) Security Cleared
24 76 (11.73%) Linux
25 75 (11.57%) Business Intelligence
25 75 (11.57%) Data Warehouse
26 73 (11.27%) Scrum
26 73 (11.27%) Analytical Skills

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 246 (37.96%) Apache Spark
2 45 (6.94%) Apache
3 25 (3.86%) Elasticsearch
4 24 (3.70%) Apache Airflow
5 21 (3.24%) Confluence
6 12 (1.85%) Apache Pig
6 12 (1.85%) Tomcat
7 9 (1.39%) SAS
8 7 (1.08%) Jupyter
9 6 (0.93%) WebSphere
10 3 (0.46%) Apache Pulsar
10 3 (0.46%) nginx
10 3 (0.46%) Oracle Workflow
10 3 (0.46%) SharePoint
10 3 (0.46%) Tornado
11 2 (0.31%) Cloud Foundry
12 1 (0.15%) Apache Solr
12 1 (0.15%) DNN
12 1 (0.15%) Mule
12 1 (0.15%) Skype for Business
Applications
1 5 (0.77%) Microsoft Excel
1 5 (0.77%) Spreadsheet
2 2 (0.31%) Figma
2 2 (0.31%) InVision
2 2 (0.31%) Zeplin
3 1 (0.15%) Chatbot
3 1 (0.15%) Microsoft Project
3 1 (0.15%) MS Visio
Business Applications
1 2 (0.31%) SAP Oil and Gas
1 2 (0.31%) Sparx Enterprise Architect
2 1 (0.15%) FINCAD Analytics
2 1 (0.15%) Markit EDM
2 1 (0.15%) NetSuite
2 1 (0.15%) PolarLake
2 1 (0.15%) SAP LE
Cloud Services
1 219 (33.80%) AWS
2 153 (23.61%) Azure
3 141 (21.76%) GCP
4 28 (4.32%) Serverless
5 26 (4.01%) Amazon Kinesis
6 23 (3.55%) Power Platform
7 21 (3.24%) Amazon S3
7 21 (3.24%) AWS Lambda
8 19 (2.93%) Amazon EC2
8 19 (2.93%) SaaS
9 17 (2.62%) Amazon CloudWatch
9 17 (2.62%) Amazon EMR
10 16 (2.47%) AWS CloudFormation
11 15 (2.31%) Azure Data Factory
12 14 (2.16%) GitHub
13 13 (2.01%) Cloud Computing
14 11 (1.70%) Virtual Private Cloud
15 9 (1.39%) Amazon ECS
15 9 (1.39%) IaaS
15 9 (1.39%) OpenShift
Communications & Networking
1 14 (2.16%) 5G
1 14 (2.16%) Kerberos
2 13 (2.01%) HTTP
3 9 (1.39%) 4G
3 9 (1.39%) RTMP
4 8 (1.23%) 3G
5 7 (1.08%) DNS
5 7 (1.08%) Internet
6 6 (0.93%) Firewall
7 5 (0.77%) VPN
8 4 (0.62%) TCP/IP
9 3 (0.46%) HTTPS
9 3 (0.46%) SSL
10 2 (0.31%) Skype
10 2 (0.31%) Software-Defined Networking
11 1 (0.15%) DSL
11 1 (0.15%) PuTTY
11 1 (0.15%) Unified Communications
Database & Business Intelligence
1 195 (30.09%) Hadoop
2 106 (16.36%) NoSQL
3 75 (11.57%) Data Warehouse
4 67 (10.34%) Apache Hive
4 67 (10.34%) SQL Server
5 57 (8.80%) Data Lake
6 56 (8.64%) Relational Database
7 49 (7.56%) Apache Cassandra
8 48 (7.41%) MongoDB
9 47 (7.25%) HBase
10 36 (5.56%) BigQuery
11 28 (4.32%) PostgreSQL
12 27 (4.17%) Amazon Redshift
13 22 (3.40%) Power BI
14 21 (3.24%) Flink
14 21 (3.24%) MySQL
14 21 (3.24%) Spark SQL
15 20 (3.09%) Amazon Athena
15 20 (3.09%) Impala
15 20 (3.09%) RDBMS
Development Applications
1 85 (13.12%) Jenkins
2 64 (9.88%) Git (software)
3 38 (5.86%) JIRA
4 24 (3.70%) Maven
5 19 (2.93%) GitLab
6 14 (2.16%) Artifactory
7 12 (1.85%) JUnit
7 12 (1.85%) Visual Studio Team System
8 10 (1.54%) CircleCI
8 10 (1.54%) Gradle
8 10 (1.54%) TeamCity
9 9 (1.39%) Mockito
9 9 (1.39%) NUnit
10 7 (1.08%) Bitbucket
11 6 (0.93%) Selenium
11 6 (0.93%) Team Foundation Server
12 5 (0.77%) SonarQube
13 4 (0.62%) ERwin
13 4 (0.62%) Snyk
13 4 (0.62%) webpack
General
1 129 (19.91%) Finance
2 71 (10.96%) Banking
3 51 (7.87%) Public Sector
4 39 (6.02%) Telecoms
5 33 (5.09%) Investment Banking
6 28 (4.32%) Marketing
7 23 (3.55%) Front Office
8 22 (3.40%) Retail
9 12 (1.85%) Legal
9 12 (1.85%) Manufacturing
10 9 (1.39%) Billing
11 6 (0.93%) Electronics
11 6 (0.93%) Pharmaceutical
12 2 (0.31%) Financial Institution
12 2 (0.31%) Games
12 2 (0.31%) Music Industry
12 2 (0.31%) Publishing
12 2 (0.31%) Retail Banking
13 1 (0.15%) Advertising
13 1 (0.15%) Back Office
Job Titles
1 175 (27.01%) Data Engineer
2 143 (22.07%) Developer
3 87 (13.43%) Architect
4 82 (12.65%) Big Data Engineer
5 62 (9.57%) DevOps Engineer
6 61 (9.41%) Data Scientist
7 49 (7.56%) AWS Engineer
8 48 (7.41%) Data Architect
9 39 (6.02%) Python Engineer
10 34 (5.25%) Big Data Developer
10 34 (5.25%) C# Developer
10 34 (5.25%) Java Developer
11 33 (5.09%) Cloud Engineer
12 28 (4.32%) Analyst
13 25 (3.86%) Big Data Architect
13 25 (3.86%) Senior Data Scientist
13 25 (3.86%) Senior DevOps
13 25 (3.86%) Senior DevOps Engineer
14 24 (3.70%) Azure Engineer
15 19 (2.93%) Python Developer
Libraries, Frameworks & Software Standards
1 116 (17.90%) Kafka
2 71 (10.96%) PySpark
3 69 (10.65%) Web Services
4 63 (9.72%) TensorFlow
5 38 (5.86%) REST
6 30 (4.63%) Natural Language Processing
7 29 (4.48%) Pandas
8 27 (4.17%) RESTful
9 26 (4.01%) HTML
9 26 (4.01%) React
9 26 (4.01%) Spring
10 25 (3.86%) .NET
10 25 (3.86%) scikit-learn
11 24 (3.70%) Node.js
11 24 (3.70%) SciPy
12 23 (3.55%) HTML5
13 21 (3.24%) MLlib
13 21 (3.24%) Spring Boot
14 19 (2.93%) JSON
15 18 (2.78%) Spark Streaming
Miscellaneous
1 73 (11.27%) Analytical Skills
2 50 (7.72%) Algorithms
3 38 (5.86%) Greenfield Project
4 22 (3.40%) Enterprise Software
5 20 (3.09%) Data Structures
6 17 (2.62%) Cloud Native
6 17 (2.62%) Self-Motivation
7 15 (2.31%) Credit Risk
8 13 (2.01%) Public Cloud
9 12 (1.85%) Foreign Exchange (FX)
9 12 (1.85%) Social Media
10 11 (1.70%) Management Information System
11 10 (1.54%) User Experience
12 9 (1.39%) Hybrid Cloud
13 8 (1.23%) Fixed Income
13 8 (1.23%) Linux Command Line
13 8 (1.23%) Market Risk
13 8 (1.23%) PMI
14 7 (1.08%) Hedge funds
15 6 (0.93%) Life Science
Operating Systems
1 76 (11.73%) Linux
2 35 (5.40%) Unix
3 8 (1.23%) Windows
4 3 (0.46%) Debian
5 2 (0.31%) CentOS
5 2 (0.31%) Red Hat Enterprise Linux
5 2 (0.31%) Ubuntu
5 2 (0.31%) Windows Server
5 2 (0.31%) Windows Server 2016
6 1 (0.15%) Amazon Linux
6 1 (0.15%) Fedora
6 1 (0.15%) Windows 10
Processes & Methodologies
1 252 (38.89%) Agile Software Development
2 201 (31.02%) Analytics
3 150 (23.15%) DevOps
4 134 (20.68%) Data Science
5 132 (20.37%) Machine Learning
6 96 (14.81%) Data Modelling
7 87 (13.43%) ETL
8 83 (12.81%) Artificial Intelligence
9 78 (12.04%) Microservices
10 75 (11.57%) Business Intelligence
11 73 (11.27%) Scrum
12 70 (10.80%) Data Engineering
13 66 (10.19%) Data Analytics
14 55 (8.49%) Computer Science
15 52 (8.02%) Open Source
16 46 (7.10%) Visualisation
17 44 (6.79%) Use Case
18 43 (6.64%) Software Engineering
19 42 (6.48%) Continuous Integration
20 41 (6.33%) Stakeholder Management
Programming Languages
1 321 (49.54%) Python
2 217 (33.49%) SQL
3 154 (23.77%) Java
4 108 (16.67%) Scala
5 60 (9.26%) C#
6 50 (7.72%) JavaScript
7 40 (6.17%) Bash Shell
8 32 (4.94%) Ruby
9 29 (4.48%) R
10 21 (3.24%) Java 8
11 19 (2.93%) Go
11 19 (2.93%) PowerShell
12 17 (2.62%) C++
13 16 (2.47%) Groovy
14 11 (1.70%) C
14 11 (1.70%) PL/SQL
15 8 (1.23%) T-SQL
16 7 (1.08%) PHP
16 7 (1.08%) TypeScript
17 6 (0.93%) Shell Script
Qualifications
1 78 (12.04%) Security Cleared
2 65 (10.03%) Degree
2 65 (10.03%) SC Cleared
3 29 (4.48%) Computer Science Degree
4 17 (2.62%) Master's Degree
5 13 (2.01%) AWS Certification
6 9 (1.39%) PMI Certification
7 8 (1.23%) DV Cleared
8 7 (1.08%) PhD
9 5 (0.77%) Microsoft Certification
10 3 (0.46%) BPSS Clearance
10 3 (0.46%) CCA
10 3 (0.46%) ISEB
11 2 (0.31%) BC Cleared
11 2 (0.31%) CBAP
11 2 (0.31%) DBS Check
11 2 (0.31%) IIBA
12 1 (0.15%) ITIL Certification
12 1 (0.15%) PgMP
12 1 (0.15%) SSCP
Quality Assurance & Compliance
1 15 (2.31%) Data Quality
1 15 (2.31%) QA
2 5 (0.77%) MiFID
2 5 (0.77%) PCI DSS
3 3 (0.46%) Basel III
3 3 (0.46%) GDPR
System Software
1 116 (17.90%) Docker
2 27 (4.17%) HDFS
3 7 (1.08%) Apache Flume
4 4 (0.62%) Virtual Machines
5 2 (0.31%) Active Directory
5 2 (0.31%) Apache ZooKeeper
5 2 (0.31%) VMware Infrastructure
6 1 (0.15%) Hyper-V
6 1 (0.15%) NFS
6 1 (0.15%) Oracle Clusterware
6 1 (0.15%) Oracle RAC
6 1 (0.15%) Samba
6 1 (0.15%) VirtualBox
6 1 (0.15%) VMware ESXi
6 1 (0.15%) Xen
Systems Management
1 122 (18.83%) Kubernetes
2 69 (10.65%) Terraform
3 58 (8.95%) Ansible
4 19 (2.93%) Puppet
5 17 (2.62%) Nagios
6 16 (2.47%) Hadoop YARN
7 14 (2.16%) Opscode Chef
8 13 (2.01%) Oozie
9 6 (0.93%) Ambari
9 6 (0.93%) Kibana
9 6 (0.93%) SCCM
10 5 (0.77%) CFEngine
10 5 (0.77%) HP SiteScope
10 5 (0.77%) logstash
10 5 (0.77%) Single Sign-On
11 4 (0.62%) Packer
12 3 (0.46%) Grafana
12 3 (0.46%) Kubeflow
13 2 (0.31%) Docker Swarm
14 1 (0.15%) vCenter Server
Vendors
1 68 (10.49%) Google
2 67 (10.34%) Cloudera
3 59 (9.10%) Microsoft
4 40 (6.17%) Oracle
5 39 (6.02%) Tableau
6 31 (4.78%) Databricks
7 30 (4.63%) Hortonworks
8 21 (3.24%) Splunk
8 21 (3.24%) StreamSets
9 20 (3.09%) MapR
10 15 (2.31%) Informatica
11 12 (1.85%) Teradata
12 11 (1.70%) SAP
13 10 (1.54%) Talend
14 8 (1.23%) Ab Initio
15 6 (0.93%) Sybase
16 5 (0.77%) CA
16 5 (0.77%) PeopleSoft
17 4 (0.62%) Confluent
17 4 (0.62%) Red Hat