Period
to 7 August 2020

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 7 August 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > London
6 months to
7 Aug 2020
Same period 2019 Same period 2018
Rank 75 57 65
Rank change year-on-year -18 +8 -6
Contract jobs citing Big Data 498 1,732 1,775
As % of all contract jobs advertised in London 3.26% 4.33% 3.87%
As % of the Database & Business Intelligence category 13.22% 17.54% 15.30%
Number of daily rates quoted 345 1,318 1,324
Median daily rate £563 £575 £550
Median daily rate % change year-on-year -2.17% +4.55% -
10th Percentile £413 £425 £413
90th Percentile £713 £725 £713
England median daily rate £550 £550 £550
Number of hourly rates quoted 7 7 3
Median hourly rate £35.00 £42.50 £27.50
Median hourly rate % change year-on-year -17.65% +54.55% -31.25%
England median hourly rate £35.00 £49.13 £44.00
% change year-on-year -28.76% +11.66% +25.71%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 3,766 9,874 11,599
As % of all contract IT jobs advertised in London 24.64% 24.66% 25.32%
Number of daily rates quoted 2,545 7,188 8,670
Median daily rate £525 £525 £525
10th Percentile £363 £363 £358
90th Percentile £725 £688 £675
England median daily rate £500 £475 £475
% change year-on-year +5.26% - +5.56%
Number of hourly rates quoted 48 63 72
Median hourly rate £35.00 £35.00 £28.75
Median hourly rate % change year-on-year - +21.74% +5.85%
10th Percentile £20.28 £15.73 £19.55
90th Percentile £47.83 £56.50 £47.49
Median hourly rate £35.00 £35.00 £30.00
% change year-on-year - +16.67% -2.44%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a proportion of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Big Data in London.

Daily rate trend for Big Data in London

Big Data
Daily Rate Histogram in London

Daily rate distribution for jobs citing Big Data in London over the 6 months to 7 August 2020.

Daily rate histogram for Big Data in London

Big Data
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Big Data in London.

Hourly rate trend for Big Data in London

Big Data
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the London region over the 6 months to 7 August 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -23 89 £550 - 32
South London -18 11 £573 -4.58% 3
West London +22 9 £500 -7.41% 11
East London +1 3 £498 -11.56% 8
Big Data
England

For the 6 months to 7 August 2020, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Big Data.

1 255 (51.20%) Python
2 209 (41.97%) Apache Spark
3 183 (36.75%) Agile Software Development
4 175 (35.14%) SQL
5 149 (29.92%) Hadoop
6 146 (29.32%) Analytics
7 144 (28.92%) AWS
8 134 (26.91%) Java
9 122 (24.50%) Azure
10 111 (22.29%) Finance
11 109 (21.89%) Data Science
12 104 (20.88%) DevOps
13 100 (20.08%) Machine Learning
14 99 (19.88%) Kafka
15 95 (19.08%) Scala
16 94 (18.88%) Docker
17 90 (18.07%) GCP
18 80 (16.06%) Kubernetes
19 77 (15.46%) Jenkins
20 75 (15.06%) NoSQL
21 72 (14.46%) Analytical Skills
22 70 (14.06%) Scrum
23 67 (13.45%) PySpark
23 67 (13.45%) Security Cleared
23 67 (13.45%) Git (software)
24 66 (13.25%) Data Modelling
25 62 (12.45%) Degree
26 61 (12.25%) Microsoft
27 60 (12.05%) Banking
27 60 (12.05%) Computer Science

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 209 (41.97%) Apache Spark
2 38 (7.63%) Apache
3 20 (4.02%) Elasticsearch
4 18 (3.61%) Apache Airflow
4 18 (3.61%) Tomcat
5 10 (2.01%) Confluence
5 10 (2.01%) SAS
6 7 (1.41%) Apache Pig
6 7 (1.41%) Jupyter
7 5 (1.00%) Tornado
8 3 (0.60%) nginx
8 3 (0.60%) SharePoint
9 2 (0.40%) BizTalk Server
9 2 (0.40%) Cloud Foundry
9 2 (0.40%) IIS
9 2 (0.40%) Luigi
10 1 (0.20%) Apache Solr
10 1 (0.20%) CMS
10 1 (0.20%) Oracle Coherence
10 1 (0.20%) R Markdown
Applications
1 3 (0.60%) Microsoft Excel
1 3 (0.60%) Spreadsheet
2 2 (0.40%) Figma
2 2 (0.40%) InVision
2 2 (0.40%) Microsoft Project
2 2 (0.40%) Zeplin
3 1 (0.20%) Microsoft PowerPoint
3 1 (0.20%) MS Visio
Business Applications
1 2 (0.40%) Dynamics AX
1 2 (0.40%) Dynamics CRM
1 2 (0.40%) SAP Oil and Gas
1 2 (0.40%) Sparx Enterprise Architect
2 1 (0.20%) FINCAD Analytics
Cloud Services
1 144 (28.92%) AWS
2 122 (24.50%) Azure
3 90 (18.07%) GCP
4 19 (3.82%) Serverless
5 17 (3.41%) Amazon CloudWatch
5 17 (3.41%) Power Platform
6 14 (2.81%) Amazon Kinesis
6 14 (2.81%) Cloud Computing
6 14 (2.81%) Datadog
7 13 (2.61%) Azure Data Factory
8 12 (2.41%) Amazon S3
8 12 (2.41%) SaaS
9 11 (2.21%) Amazon EC2
10 9 (1.81%) AWS Lambda
11 7 (1.41%) PaaS
11 7 (1.41%) Virtual Private Cloud
12 6 (1.20%) Amazon EMR
12 6 (1.20%) AWS CloudFormation
12 6 (1.20%) IaaS
12 6 (1.20%) Slack
Communications & Networking
1 11 (2.21%) 5G
2 8 (1.61%) HTTP
3 7 (1.41%) 4G
3 7 (1.41%) DNS
3 7 (1.41%) RTMP
4 6 (1.20%) 3G
5 5 (1.00%) Kerberos
6 4 (0.80%) Internet
6 4 (0.80%) TCP/IP
7 3 (0.60%) Firewall
7 3 (0.60%) Skype
8 1 (0.20%) DSL
8 1 (0.20%) HTTPS
8 1 (0.20%) Network Security
8 1 (0.20%) PuTTY
8 1 (0.20%) SSL
8 1 (0.20%) VPN
8 1 (0.20%) Wi-Fi
Database & Business Intelligence
1 149 (29.92%) Hadoop
2 75 (15.06%) NoSQL
3 52 (10.44%) Data Warehouse
4 50 (10.04%) Apache Hive
5 40 (8.03%) Data Lake
6 37 (7.43%) Relational Database
7 36 (7.23%) MongoDB
8 34 (6.83%) SQL Server
9 31 (6.22%) Apache Cassandra
10 27 (5.42%) BigQuery
11 25 (5.02%) MySQL
12 23 (4.62%) HBase
13 18 (3.61%) PostgreSQL
13 18 (3.61%) RDBMS
14 17 (3.41%) Data Mining
14 17 (3.41%) Impala
15 16 (3.21%) Amazon Redshift
15 16 (3.21%) Flink
15 16 (3.21%) Power BI
16 15 (3.01%) Spark SQL
Development Applications
1 77 (15.46%) Jenkins
2 67 (13.45%) Git (software)
3 20 (4.02%) GitLab
3 20 (4.02%) JIRA
4 16 (3.21%) Maven
5 12 (2.41%) Artifactory
6 9 (1.81%) JUnit
7 8 (1.61%) Gradle
8 7 (1.41%) Mockito
8 7 (1.41%) NUnit
8 7 (1.41%) TeamCity
9 6 (1.20%) Bitbucket
9 6 (1.20%) ProC
9 6 (1.20%) Visual Studio Team System
10 5 (1.00%) Hudson
10 5 (1.00%) Selenium
11 4 (0.80%) CircleCI
12 3 (0.60%) PowerDesigner
12 3 (0.60%) Sonatype Nexus
12 3 (0.60%) Team Foundation Server
General
1 111 (22.29%) Finance
2 60 (12.05%) Banking
3 36 (7.23%) Marketing
4 34 (6.83%) Telecoms
5 29 (5.82%) Investment Banking
5 29 (5.82%) Public Sector
6 25 (5.02%) Front Office
7 23 (4.62%) Retail
8 12 (2.41%) Legal
9 8 (1.61%) Manufacturing
10 7 (1.41%) Billing
11 6 (1.20%) Electronics
11 6 (1.20%) Pharmaceutical
12 5 (1.00%) Games
13 2 (0.40%) Financial Institution
13 2 (0.40%) Publishing
14 1 (0.20%) French Language
14 1 (0.20%) Law
14 1 (0.20%) Retail Banking
14 1 (0.20%) Social Science
Job Titles
1 129 (25.90%) Developer
2 126 (25.30%) Data Engineer
3 69 (13.86%) Big Data Engineer
4 54 (10.84%) Architect
5 46 (9.24%) Data Scientist
6 44 (8.84%) DevOps Engineer
7 34 (6.83%) C# Developer
7 34 (6.83%) Python Engineer
8 33 (6.63%) Data Architect
9 31 (6.22%) AWS Engineer
10 25 (5.02%) Big Data Developer
11 24 (4.82%) Cloud Engineer
12 22 (4.42%) Python Developer
13 21 (4.22%) Azure Engineer
13 21 (4.22%) Java Developer
13 21 (4.22%) Senior Developer
14 19 (3.82%) Analyst
15 18 (3.61%) Azure Developer
16 16 (3.21%) Support Engineer
17 15 (3.01%) Senior Data Scientist
Libraries, Frameworks & Software Standards
1 99 (19.88%) Kafka
2 67 (13.45%) PySpark
3 44 (8.84%) TensorFlow
4 42 (8.43%) Web Services
5 37 (7.43%) HTML
6 35 (7.03%) .NET
7 32 (6.43%) HTML5
8 25 (5.02%) Pandas
8 25 (5.02%) RESTful
9 23 (4.62%) REST
10 21 (4.22%) Spring
11 20 (4.02%) React
11 20 (4.02%) SciPy
11 20 (4.02%) Velocity
12 18 (3.61%) scikit-learn
13 17 (3.41%) H2O
13 17 (3.41%) LAMP
14 16 (3.21%) Natural Language Processing
15 15 (3.01%) AngularJS
15 15 (3.01%) MLlib
Miscellaneous
1 72 (14.46%) Analytical Skills
2 44 (8.84%) Algorithms
3 29 (5.82%) Greenfield Project
4 18 (3.61%) Enterprise Software
5 17 (3.41%) Cloud Native
6 16 (3.21%) Foreign Exchange (FX)
7 14 (2.81%) Credit Risk
8 13 (2.61%) Linux Command Line
9 11 (2.21%) FMCG
10 10 (2.01%) Management Information System
10 10 (2.01%) Public Cloud
11 9 (1.81%) Analytical Mindset
11 9 (1.81%) Data Structures
11 9 (1.81%) Hedge funds
12 8 (1.61%) PMI
12 8 (1.61%) Renewable Energy
12 8 (1.61%) Smart City
12 8 (1.61%) User Experience
13 7 (1.41%) Fixed Income
13 7 (1.41%) Self-Motivation
Operating Systems
1 50 (10.04%) Linux
2 32 (6.43%) Unix
3 7 (1.41%) Windows
4 2 (0.40%) Debian
4 2 (0.40%) Solaris
5 1 (0.20%) Amazon Linux
5 1 (0.20%) CentOS
5 1 (0.20%) Fedora
5 1 (0.20%) Red Hat Enterprise Linux
5 1 (0.20%) Ubuntu
5 1 (0.20%) Windows 10
5 1 (0.20%) Windows Server
Processes & Methodologies
1 183 (36.75%) Agile Software Development
2 146 (29.32%) Analytics
3 109 (21.89%) Data Science
4 104 (20.88%) DevOps
5 100 (20.08%) Machine Learning
6 70 (14.06%) Scrum
7 66 (13.25%) Data Modelling
8 60 (12.05%) Computer Science
9 58 (11.65%) Business Intelligence
10 57 (11.45%) ETL
11 55 (11.04%) Microservices
12 52 (10.44%) Data Engineering
13 51 (10.24%) Artificial Intelligence
14 49 (9.84%) Data Analytics
15 42 (8.43%) Data Architecture
15 42 (8.43%) Problem-Solving
16 38 (7.63%) Open Source
16 38 (7.63%) Visualisation
17 35 (7.03%) Mathematics
18 33 (6.63%) Software Engineering
Programming Languages
1 255 (51.20%) Python
2 175 (35.14%) SQL
3 134 (26.91%) Java
4 95 (19.08%) Scala
5 52 (10.44%) C#
6 42 (8.43%) JavaScript
7 33 (6.63%) Bash Shell
8 32 (6.43%) Ruby
9 26 (5.22%) C++
10 21 (4.22%) Go
11 20 (4.02%) R
12 11 (2.21%) PowerShell
13 10 (2.01%) Java 8
14 9 (1.81%) Groovy
15 8 (1.61%) Haskell
15 8 (1.61%) PL/SQL
16 6 (1.20%) C
16 6 (1.20%) Shell Script
16 6 (1.20%) T-SQL
16 6 (1.20%) TypeScript
Qualifications
1 67 (13.45%) Security Cleared
2 62 (12.45%) Degree
3 55 (11.04%) SC Cleared
4 26 (5.22%) Master's Degree
5 21 (4.22%) Computer Science Degree
6 10 (2.01%) Numerate Degree
7 8 (1.61%) DV Cleared
7 8 (1.61%) PMI Certification
8 7 (1.41%) PhD
9 6 (1.20%) AWS Certification
10 5 (1.00%) Microsoft Certification
11 4 (0.80%) BPSS Clearance
12 3 (0.60%) CCA
12 3 (0.60%) TOGAF Certification
13 2 (0.40%) BC Cleared
13 2 (0.40%) DBS Check
14 1 (0.20%) Linux+ Certification
14 1 (0.20%) MBA
14 1 (0.20%) Network+ Certification
14 1 (0.20%) SSCP
Quality Assurance & Compliance
1 15 (3.01%) Data Quality
1 15 (3.01%) QA
2 9 (1.81%) MiFID
3 6 (1.20%) PCI DSS
4 2 (0.40%) Basel III
4 2 (0.40%) GDPR
5 1 (0.20%) CDISC
5 1 (0.20%) SLA
System Software
1 94 (18.88%) Docker
2 13 (2.61%) HDFS
3 4 (0.80%) Apache Flume
3 4 (0.80%) VMware Infrastructure
4 3 (0.60%) Apache ZooKeeper
4 3 (0.60%) Virtual Machines
5 1 (0.20%) Active Directory
5 1 (0.20%) NFS
5 1 (0.20%) Samba
5 1 (0.20%) VirtualBox
5 1 (0.20%) VMware ESXi
5 1 (0.20%) Xen
Systems Management
1 80 (16.06%) Kubernetes
2 41 (8.23%) Terraform
3 40 (8.03%) Ansible
4 19 (3.82%) Nagios
5 15 (3.01%) Puppet
6 10 (2.01%) Hadoop YARN
7 9 (1.81%) Oozie
7 9 (1.81%) Opscode Chef
8 4 (0.80%) Kibana
9 3 (0.60%) Grafana
9 3 (0.60%) Kubeflow
9 3 (0.60%) Packer
10 2 (0.40%) Ambari
10 2 (0.40%) Docker Swarm
10 2 (0.40%) logstash
11 1 (0.20%) Argo
11 1 (0.20%) Control-M
11 1 (0.20%) ITRS Geneos
11 1 (0.20%) Single Sign-On
11 1 (0.20%) vCenter Server
Vendors
1 61 (12.25%) Microsoft
2 52 (10.44%) Cloudera
3 42 (8.43%) Databricks
4 41 (8.23%) Oracle
5 40 (8.03%) Google
6 35 (7.03%) Tableau
7 30 (6.02%) StreamSets
8 23 (4.62%) Splunk
9 22 (4.42%) Hortonworks
10 12 (2.41%) Teradata
11 9 (1.81%) Informatica
11 9 (1.81%) SAP
12 8 (1.61%) MapR
13 6 (1.20%) CA
13 6 (1.20%) Sybase
14 4 (0.80%) Talend
14 4 (0.80%) VMware
15 3 (0.60%) Atlassian
15 3 (0.60%) IBM
15 3 (0.60%) MicroStrategy