Period
to 11 May 2021

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 11 May 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > London
6 months to
11 May 2021
Same period 2020 Same period 2019
Rank 80 72 55
Rank change year-on-year -8 -17 +13
Contract jobs citing Big Data 716 709 1,890
As % of all contract jobs advertised in London 3.06% 3.34% 4.58%
As % of the Database & Business Intelligence category 13.10% 13.79% 18.34%
Number of daily rates quoted 464 520 1,440
10th Percentile £425 £413 £425
25th Percentile £500 £488 £500
Median daily rate (50th Percentile) £575 £561 £550
Median % change year-on-year +2.54% +1.95% -0.45%
75th Percentile £675 £650 £650
90th Percentile £738 £713 £725
England median daily rate £565 £550 £550
% change year-on-year +2.73% - -
Number of hourly rates quoted 2 3 4
10th Percentile £39.73 £39.25 £31.71
25th Percentile £44.19 £41.50 £42.91
Median hourly rate £55.50 £46.50 £49.57
Median % change year-on-year +19.35% -6.18% -
75th Percentile £62.94 £47.88 £51.88
90th Percentile £65.08 £47.95 £55.25
England median hourly rate £44.50 £46.75 £49.13
% change year-on-year -4.81% -4.84% +10.40%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 5,465 5,143 10,306
As % of all contract IT jobs advertised in London 23.36% 24.22% 25.00%
Number of daily rates quoted 3,880 3,737 7,595
10th Percentile £369 £363 £363
25th Percentile £447 £425 £425
Median daily rate (50th Percentile) £525 £525 £525
75th Percentile £638 £625 £610
90th Percentile £713 £700 £675
England median daily rate £500 £495 £488
% change year-on-year +1.01% +1.54% +2.63%
Number of hourly rates quoted 31 31 46
10th Percentile £14.00 £15.94 £18.53
25th Percentile £20.63 £20.24 £20.63
Median hourly rate £34.88 £26.50 £24.50
Median % change year-on-year +31.62% +8.16% -10.35%
75th Percentile £60.38 £39.00 £43.75
90th Percentile £66.50 £61.00 £54.25
England median hourly rate £24.64 £24.70 £35.00
% change year-on-year -0.24% -29.43% +16.67%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a proportion of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Big Data in London.

Daily rate trend for Big Data in London

Big Data
Daily Rate Histogram in London

Daily rate distribution for jobs citing Big Data in London over the 6 months to 11 May 2021.

Daily rate histogram for Big Data in London

Big Data
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Big Data in London.

Hourly rate trend for Big Data in London

Big Data
Hourly Rate Histogram in London

Hourly rate distribution of jobs citing Big Data in London over the 6 months to 11 May 2021.

Hourly rate histogram for Big Data in London

Big Data
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the London region over the 6 months to 11 May 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -3 92 £585 +6.36% 85
West London +15 12 £574 +11.90% 14
South London +21 6 £505 -3.81% 1
Big Data
England

For the 6 months to 11 May 2021, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Big Data.

1 250 (34.92%) Apache Spark
2 247 (34.50%) Python
3 241 (33.66%) Analytics
4 239 (33.38%) Agile Software Development
5 219 (30.59%) SQL
6 202 (28.21%) Finance
7 200 (27.93%) Hadoop
8 194 (27.09%) AWS
9 191 (26.68%) Azure
10 184 (25.70%) Java
11 165 (23.04%) DevOps
12 160 (22.35%) Kafka
13 141 (19.69%) Social Skills
14 138 (19.27%) Data Warehouse
15 137 (19.13%) GCP
16 131 (18.30%) Data Modelling
17 130 (18.16%) Scala
18 123 (17.18%) Docker
19 118 (16.48%) ETL
20 117 (16.34%) Kubernetes
21 115 (16.06%) Banking
22 107 (14.94%) Data Pipeline
23 101 (14.11%) Apache Hive
24 100 (13.97%) Data Science
25 97 (13.55%) Analytical Skills
26 94 (13.13%) Apache
27 89 (12.43%) Data Lake
28 87 (12.15%) Data Engineering
28 87 (12.15%) Business Intelligence
29 86 (12.01%) Data Management

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 250 (34.92%) Apache Spark
2 94 (13.13%) Apache
3 48 (6.70%) Apache Airflow
4 22 (3.07%) Oracle Coherence
5 21 (2.93%) Confluence
6 11 (1.54%) Jupyter
6 11 (1.54%) SAS
7 9 (1.26%) Elasticsearch
8 6 (0.84%) Apache Pig
9 5 (0.70%) Luigi
10 3 (0.42%) Oracle Workflow
11 2 (0.28%) Apache Solr
11 2 (0.28%) Oracle SOA Suite
11 2 (0.28%) SharePoint
12 1 (0.14%) CMS
12 1 (0.14%) DataSynapse
12 1 (0.14%) MS Project Server
12 1 (0.14%) nginx
12 1 (0.14%) Tornado
12 1 (0.14%) WordPress
Applications
1 4 (0.56%) Microsoft Office
2 3 (0.42%) Microsoft Excel
3 2 (0.28%) Chatbot
3 2 (0.28%) SPSS
4 1 (0.14%) Microsoft PowerPoint
4 1 (0.14%) Microsoft Project
4 1 (0.14%) MS Visio
4 1 (0.14%) Spreadsheet
Business Applications
1 4 (0.56%) Oracle EBS
2 3 (0.42%) NetSuite
3 1 (0.14%) Oracle BPM
3 1 (0.14%) Oracle ERP
3 1 (0.14%) Oracle Payables
3 1 (0.14%) Oracle Receivables
3 1 (0.14%) SAP CRM
3 1 (0.14%) SAP ERP
3 1 (0.14%) SAP IS-U
3 1 (0.14%) SAP MDG
3 1 (0.14%) SAP MDM
Cloud Services
1 194 (27.09%) AWS
2 191 (26.68%) Azure
3 137 (19.13%) GCP
4 80 (11.17%) Serverless
5 45 (6.28%) Amazon S3
6 40 (5.59%) AWS Lambda
7 36 (5.03%) Power Platform
8 28 (3.91%) PaaS
9 27 (3.77%) GitHub
10 26 (3.63%) Amazon EC2
11 25 (3.49%) Amazon EMR
11 25 (3.49%) Azure Synapse Analytics
12 22 (3.07%) Azure Data Factory
13 17 (2.37%) IaaS
14 16 (2.23%) Amazon Kinesis
15 14 (1.96%) Amazon EKS
16 12 (1.68%) Amazon CloudWatch
16 12 (1.68%) Amazon ECS
16 12 (1.68%) Azure Cosmos DB
16 12 (1.68%) iPaaS
Communications & Networking
1 16 (2.23%) HTTP
2 11 (1.54%) Firewall
3 8 (1.12%) Network Security
4 5 (0.70%) Remote Desktop
5 4 (0.56%) Internet
6 3 (0.42%) SMTP
7 2 (0.28%) DNS
8 1 (0.14%) Broadband
8 1 (0.14%) DHCP
8 1 (0.14%) FTP
8 1 (0.14%) Kerberos
8 1 (0.14%) LAN
8 1 (0.14%) Software-Defined Networking
8 1 (0.14%) VPN
8 1 (0.14%) WAN
8 1 (0.14%) Wireshark
Database & Business Intelligence
1 200 (27.93%) Hadoop
2 138 (19.27%) Data Warehouse
3 101 (14.11%) Apache Hive
4 89 (12.43%) Data Lake
5 82 (11.45%) NoSQL
6 65 (9.08%) Relational Database
7 60 (8.38%) BigQuery
8 42 (5.87%) MongoDB
9 35 (4.89%) PostgreSQL
9 35 (4.89%) Power BI
9 35 (4.89%) SQL Server
10 32 (4.47%) HBase
11 31 (4.33%) Amazon Redshift
11 31 (4.33%) Tableau
12 26 (3.63%) Data Mining
13 25 (3.49%) Apache Cassandra
14 23 (3.21%) Amazon RDS
14 23 (3.21%) Snowflake Schema
15 22 (3.07%) Looker
16 21 (2.93%) Impala
Development Applications
1 53 (7.40%) Jenkins
2 45 (6.28%) JIRA
3 36 (5.03%) Git (software)
4 32 (4.47%) PowerDesigner
5 23 (3.21%) kappa
6 17 (2.37%) GitLab
7 15 (2.09%) Maven
7 15 (2.09%) TeamCity
8 11 (1.54%) Visual Studio Team System
9 9 (1.26%) Artifactory
9 9 (1.26%) Bitbucket
10 7 (0.98%) Cucumber
10 7 (0.98%) ERwin
10 7 (0.98%) Gatling
11 6 (0.84%) Selenium
12 5 (0.70%) Gradle
12 5 (0.70%) Protractor
13 4 (0.56%) Oracle APEX
13 4 (0.56%) SQL Server Management Studio (SSMS)
14 3 (0.42%) Subversion
General
1 202 (28.21%) Finance
2 141 (19.69%) Social Skills
3 115 (16.06%) Banking
4 97 (13.55%) Analytical Skills
5 49 (6.84%) Investment Banking
6 28 (3.91%) Retail
7 24 (3.35%) Front Office
8 23 (3.21%) Marketing
9 18 (2.51%) Presentation Skills
10 16 (2.23%) Public Sector
11 15 (2.09%) Telecoms
12 12 (1.68%) Games
13 10 (1.40%) Influencing Skills
14 8 (1.12%) Documentation Skills
14 8 (1.12%) Legal
14 8 (1.12%) Multimedia
14 8 (1.12%) Pharmaceutical
15 6 (0.84%) Manufacturing
16 5 (0.70%) French Language
17 4 (0.56%) Retail Banking
Job Titles
1 173 (24.16%) Data Engineer
2 149 (20.81%) Developer
3 139 (19.41%) Architect
4 86 (12.01%) Data Architect
5 63 (8.80%) Big Data Engineer
6 50 (6.98%) Solutions Architect
7 42 (5.87%) Scala Developer
8 41 (5.73%) DevOps Engineer
9 39 (5.45%) AWS Engineer
10 36 (5.03%) Senior Developer
11 34 (4.75%) Analyst
12 29 (4.05%) Software Engineer
13 28 (3.91%) Cloud Architect
14 26 (3.63%) Java Developer
15 24 (3.35%) Azure Architect
16 22 (3.07%) Cloud Engineer
16 22 (3.07%) Python Engineer
17 21 (2.93%) Big Data Developer
17 21 (2.93%) Data Scientist
18 18 (2.51%) Data Analyst
Libraries, Frameworks & Software Standards
1 160 (22.35%) Kafka
2 40 (5.59%) PySpark
3 27 (3.77%) Web Services
4 24 (3.35%) Akka
4 24 (3.35%) Apache NiFi
5 23 (3.21%) .NET
5 23 (3.21%) HTML
6 22 (3.07%) Velocity
7 20 (2.79%) JSON
8 19 (2.65%) NumPy
8 19 (2.65%) RESTful
9 16 (2.23%) Play Framework
9 16 (2.23%) Spark Streaming
9 16 (2.23%) Spring
10 15 (2.09%) React
11 14 (1.96%) Node.js
11 14 (1.96%) XML
12 13 (1.82%) CSS
13 12 (1.68%) Pandas
14 11 (1.54%) REST
Miscellaneous
1 33 (4.61%) Data Structures
2 32 (4.47%) Algorithms
3 23 (3.21%) Virtual Team
4 22 (3.07%) Cloud Native
5 21 (2.93%) Greenfield Project
5 21 (2.93%) Market Risk
6 20 (2.79%) Self-Motivation
7 17 (2.37%) User Experience
8 14 (1.96%) Hedge funds
9 12 (1.68%) Hybrid Cloud
10 11 (1.54%) Grid Computing
11 10 (1.40%) Foreign Exchange (FX)
12 8 (1.12%) Data Centre
12 8 (1.12%) FMCG
12 8 (1.12%) Reference Data
13 7 (0.98%) Analytical Mindset
13 7 (0.98%) Management Information System
14 6 (0.84%) CMDB
14 6 (0.84%) Enterprise Software
14 6 (0.84%) Linux Command Line
Operating Systems
1 60 (8.38%) Linux
2 19 (2.65%) Unix
3 9 (1.26%) Windows
4 5 (0.70%) Red Hat Enterprise Linux
5 2 (0.28%) AIX
5 2 (0.28%) Apple iOS
5 2 (0.28%) HPUX
5 2 (0.28%) Solaris
5 2 (0.28%) SUSE Linux Enterprise Server
5 2 (0.28%) Ubuntu
5 2 (0.28%) Windows 10
5 2 (0.28%) Windows Server
6 1 (0.14%) Android
6 1 (0.14%) MVS
Processes & Methodologies
1 241 (33.66%) Analytics
2 239 (33.38%) Agile Software Development
3 165 (23.04%) DevOps
4 131 (18.30%) Data Modelling
5 118 (16.48%) ETL
6 107 (14.94%) Data Pipeline
7 100 (13.97%) Data Science
8 87 (12.15%) Business Intelligence
8 87 (12.15%) Data Engineering
9 86 (12.01%) Data Management
10 83 (11.59%) Software Engineering
11 79 (11.03%) Migration
12 76 (10.61%) Data Architecture
13 74 (10.34%) Data Analytics
14 72 (10.06%) SDLC
15 68 (9.50%) Machine Learning
15 68 (9.50%) Microservices
16 63 (8.80%) Data Analysis
17 61 (8.52%) Scrum
18 60 (8.38%) Visualisation
Programming Languages
1 247 (34.50%) Python
2 219 (30.59%) SQL
3 184 (25.70%) Java
4 130 (18.16%) Scala
5 32 (4.47%) JavaScript
6 30 (4.19%) R
7 24 (3.35%) C#
8 18 (2.51%) Shell Script
9 16 (2.23%) C++
10 15 (2.09%) Go
11 14 (1.96%) Bash Shell
12 13 (1.82%) PL/SQL
13 10 (1.40%) Groovy
14 9 (1.26%) C
14 9 (1.26%) Haskell
14 9 (1.26%) T-SQL
15 8 (1.12%) TypeScript
16 7 (0.98%) Ruby
17 6 (0.84%) PowerShell
18 4 (0.56%) VBA
Qualifications
1 85 (11.87%) Security Cleared
2 77 (10.75%) SC Cleared
3 34 (4.75%) Degree
4 33 (4.61%) DV Cleared
5 14 (1.96%) Computer Science Degree
6 8 (1.12%) AWS Certification
7 7 (0.98%) Master's Degree
7 7 (0.98%) PhD
8 3 (0.42%) CISM
8 3 (0.42%) CISSP
9 1 (0.14%) (ISC)2 CCSP
9 1 (0.14%) CESG Certified Professional
9 1 (0.14%) Cisco Certification
9 1 (0.14%) GIAC
9 1 (0.14%) ISEB
9 1 (0.14%) Microsoft Certification
9 1 (0.14%) Numerate Degree
9 1 (0.14%) PMI Certification
9 1 (0.14%) PMP
Quality Assurance & Compliance
1 45 (6.28%) Data Quality
2 28 (3.91%) QA
3 9 (1.26%) SLA
4 7 (0.98%) GDPR
5 4 (0.56%) IFRS
6 3 (0.42%) IFRS 9
6 3 (0.42%) ISO 20022
7 2 (0.28%) MiFID
7 2 (0.28%) PMO
8 1 (0.14%) Basel II
8 1 (0.14%) NCSC
8 1 (0.14%) PCI DSS
8 1 (0.14%) Sarbanes-Oxley
System Software
1 123 (17.18%) Docker
2 35 (4.89%) HDFS
3 7 (0.98%) Apache Flume
4 6 (0.84%) Active Directory
5 1 (0.14%) Apache ZooKeeper
5 1 (0.14%) Platform Symphony
5 1 (0.14%) Virtual Machines
Systems Management
1 117 (16.34%) Kubernetes
2 71 (9.92%) Terraform
3 50 (6.98%) Ansible
4 12 (1.68%) Hadoop YARN
5 11 (1.54%) Puppet
6 10 (1.40%) Control-M
7 9 (1.26%) Oozie
8 7 (0.98%) Packer
9 3 (0.42%) MIIS
9 3 (0.42%) Opscode Chef
9 3 (0.42%) Prometheus
10 2 (0.28%) Rancher
11 1 (0.14%) Ambari
11 1 (0.14%) Docker Swarm
11 1 (0.14%) Grafana
11 1 (0.14%) HP Fortify
11 1 (0.14%) Istio
11 1 (0.14%) ITRS Geneos
11 1 (0.14%) Mesos
11 1 (0.14%) WebInspect
Vendors
1 80 (11.17%) Google
2 79 (11.03%) Oracle
3 73 (10.20%) Databricks
4 58 (8.10%) Cloudera
5 56 (7.82%) Microsoft
6 30 (4.19%) BiZZdesign
7 27 (3.77%) Hortonworks
8 20 (2.79%) SAP
9 17 (2.37%) Alteryx
10 16 (2.23%) IBM
11 15 (2.09%) MuleSoft
12 14 (1.96%) Teradata
13 12 (1.68%) Informatica
14 11 (1.54%) MapR
14 11 (1.54%) Salesforce.com
15 10 (1.40%) Talend
16 9 (1.26%) StreamSets
17 8 (1.12%) Dataiku
17 8 (1.12%) VMware
18 6 (0.84%) Ab Initio