Period
to 4 August 2020

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 4 August 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
Central London > City of London
6 months to
4 Aug 2020
Same period 2019 Same period 2018
Rank 67 45 64
Rank change year-on-year -22 +19 -15
Contract jobs citing Big Data 76 303 264
As % of all contract jobs advertised in the City of London 3.31% 4.65% 3.76%
As % of the Database & Business Intelligence category 12.97% 17.42% 14.59%
Number of daily rates quoted 54 259 225
Median daily rate £525 £550 £575
Median daily rate % change year-on-year -4.55% -4.35% +4.55%
10th Percentile £413 £453 £434
90th Percentile £675 £702 £713
Central London median daily rate £544 £550 £550
% change year-on-year -1.14% - -
Number of hourly rates quoted 4 2 0
Median hourly rate £36.75 £46.85 -
Median hourly rate % change year-on-year -21.55% - -
Central London median hourly rate £36.75 £46.85 -
% change year-on-year -21.55% - -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 586 1,739 1,809
As % of all contract IT jobs advertised in the City of London 25.54% 26.69% 25.75%
Number of daily rates quoted 404 1,379 1,442
Median daily rate £511 £525 £525
Median daily rate % change year-on-year -2.62% - +2.44%
10th Percentile £375 £392 £366
90th Percentile £688 £675 £688
Central London median daily rate £518 £525 £525
% change year-on-year -1.43% - +5.00%
Number of hourly rates quoted 10 11 13
Median hourly rate £35.00 £44.57 £22.00
Median hourly rate % change year-on-year -21.46% +102.57% -4.32%
10th Percentile £21.35 £22.25 £19.50
90th Percentile £40.10 £60.75 £33.00
Median hourly rate £35.00 £35.00 £22.25
% change year-on-year - +57.30% -3.23%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing Big Data in the City of London.

Daily rate trend for Big Data in the City of London

Big Data
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing Big Data in the City of London over the 6 months to 4 August 2020.

Daily rate histogram for Big Data in the City of London

Big Data
Contractor Hourly Rate Trend in the City of London

3-month moving average hourly rates quoted in jobs citing Big Data in the City of London.

Hourly rate trend for Big Data in the City of London

For the 6 months to 4 August 2020, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Big Data.

1 47 (61.84%) Python
2 32 (42.11%) Apache Spark
3 29 (38.16%) AWS
4 25 (32.89%) Java
5 21 (27.63%) SQL
5 21 (27.63%) Hadoop
6 20 (26.32%) Azure
6 20 (26.32%) Analytics
6 20 (26.32%) Finance
7 19 (25.00%) Banking
7 19 (25.00%) GCP
8 18 (23.68%) Kubernetes
8 18 (23.68%) Data Modelling
8 18 (23.68%) Cloudera
9 17 (22.37%) Agile Software Development
9 17 (22.37%) DevOps
10 16 (21.05%) Scala
11 14 (18.42%) Jenkins
12 13 (17.11%) Docker
12 13 (17.11%) Linux
13 12 (15.79%) Apache
13 12 (15.79%) Business Intelligence
14 11 (14.47%) Google
14 11 (14.47%) Security Cleared
14 11 (14.47%) Data Science
15 10 (13.16%) SC Cleared
15 10 (13.16%) Machine Learning
15 10 (13.16%) Software Engineering
15 10 (13.16%) ETL
16 9 (11.84%) JavaScript

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 32 (42.11%) Apache Spark
2 12 (15.79%) Apache
3 6 (7.89%) Elasticsearch
4 4 (5.26%) Tornado
5 3 (3.95%) Apache Airflow
5 3 (3.95%) SAS
6 2 (2.63%) Confluence
6 2 (2.63%) Tomcat
7 1 (1.32%) nginx
7 1 (1.32%) R Markdown
Applications
1 1 (1.32%) Figma
1 1 (1.32%) InVision
1 1 (1.32%) Zeplin
Cloud Services
1 29 (38.16%) AWS
2 20 (26.32%) Azure
3 19 (25.00%) GCP
4 6 (7.89%) Serverless
5 3 (3.95%) Amazon CloudWatch
5 3 (3.95%) Amazon Kinesis
6 2 (2.63%) Amazon EKS
6 2 (2.63%) AWS Lambda
6 2 (2.63%) Cloud Computing
6 2 (2.63%) OpenShift
7 1 (1.32%) Adobe Creative Cloud
7 1 (1.32%) Amazon SageMaker
7 1 (1.32%) AWS CloudFormation
7 1 (1.32%) Azure Data Factory
7 1 (1.32%) Datadog
7 1 (1.32%) Power Platform
Communications & Networking
1 2 (2.63%) TCP/IP
2 1 (1.32%) DNS
2 1 (1.32%) Firewall
2 1 (1.32%) HTTP
2 1 (1.32%) PuTTY
Database & Business Intelligence
1 21 (27.63%) Hadoop
2 9 (11.84%) Apache Hive
2 9 (11.84%) NoSQL
3 6 (7.89%) Data Warehouse
3 6 (7.89%) SQL Server
4 4 (5.26%) Amazon Redshift
5 3 (3.95%) MongoDB
5 3 (3.95%) Parquet
5 3 (3.95%) Relational Database
6 2 (2.63%) Apache Cassandra
6 2 (2.63%) BigQuery
6 2 (2.63%) Data Lake
6 2 (2.63%) Data Mining
6 2 (2.63%) Flink
6 2 (2.63%) MySQL
6 2 (2.63%) Neo4j
6 2 (2.63%) RDBMS
6 2 (2.63%) Spark SQL
6 2 (2.63%) SQL Server Reporting Services
6 2 (2.63%) Star Schema
Development Applications
1 14 (18.42%) Jenkins
2 8 (10.53%) Git (software)
3 5 (6.58%) GitLab
4 4 (5.26%) Hudson
4 4 (5.26%) ProC
5 3 (3.95%) Maven
5 3 (3.95%) TeamCity
6 2 (2.63%) Atlassian Bamboo
6 2 (2.63%) CircleCI
6 2 (2.63%) JIRA
6 2 (2.63%) Travis CI
7 1 (1.32%) Axure RP
7 1 (1.32%) Gradle
General
1 20 (26.32%) Finance
2 19 (25.00%) Banking
3 8 (10.53%) Investment Banking
4 4 (5.26%) Retail
5 2 (2.63%) Front Office
5 2 (2.63%) Marketing
6 1 (1.32%) Pharmaceutical
6 1 (1.32%) Public Sector
Job Titles
1 23 (30.26%) Data Engineer
2 16 (21.05%) Developer
3 10 (13.16%) AWS Engineer
3 10 (13.16%) DevOps Engineer
4 8 (10.53%) Big Data Engineer
5 6 (7.89%) Architect
5 6 (7.89%) AWS DevOps
6 5 (6.58%) Analyst
6 5 (6.58%) AWS DevOps Engineer
6 5 (6.58%) Business Analyst
6 5 (6.58%) Cloud Engineer
6 5 (6.58%) Data Scientist
7 4 (5.26%) Big Data Developer
8 3 (3.95%) Azure Developer
8 3 (3.95%) Consultant
8 3 (3.95%) Data Business Analyst
8 3 (3.95%) Scala Developer
9 2 (2.63%) AWS Architect
9 2 (2.63%) DevOps Consultant
9 2 (2.63%) Senior DevOps Engineer
Libraries, Frameworks & Software Standards
1 8 (10.53%) Web Services
2 7 (9.21%) RESTful
3 6 (7.89%) Anaconda
3 6 (7.89%) Elastic Stack
3 6 (7.89%) PySpark
4 5 (6.58%) CSS
4 5 (6.58%) HTML
4 5 (6.58%) TensorFlow
5 4 (5.26%) CSS3
5 4 (5.26%) Flask
5 4 (5.26%) HTML5
5 4 (5.26%) Kafka
5 4 (5.26%) Spring
5 4 (5.26%) Twisted
6 3 (3.95%) .NET
6 3 (3.95%) Apache Avro
6 3 (3.95%) Node.js
6 3 (3.95%) Pandas
6 3 (3.95%) XML
7 2 (2.63%) JSON
Miscellaneous
1 7 (9.21%) Credit Risk
2 6 (7.89%) Analytical Skills
3 5 (6.58%) Enterprise Software
4 4 (5.26%) Algorithms
5 3 (3.95%) Management Information System
5 3 (3.95%) Market Risk
6 2 (2.63%) Hedge funds
6 2 (2.63%) iPad
6 2 (2.63%) Mobile App
6 2 (2.63%) Public Cloud
6 2 (2.63%) Social Media
7 1 (1.32%) Foreign Exchange (FX)
7 1 (1.32%) Greenfield Project
7 1 (1.32%) Grid Computing
7 1 (1.32%) Hybrid Cloud
7 1 (1.32%) Life Science
7 1 (1.32%) Linux Command Line
7 1 (1.32%) Robotics
7 1 (1.32%) Semantic Web
7 1 (1.32%) User Experience
Operating Systems
1 13 (17.11%) Linux
2 3 (3.95%) Debian
3 2 (2.63%) Unix
4 1 (1.32%) Ubuntu
Processes & Methodologies
1 20 (26.32%) Analytics
2 18 (23.68%) Data Modelling
3 17 (22.37%) Agile Software Development
3 17 (22.37%) DevOps
4 12 (15.79%) Business Intelligence
5 11 (14.47%) Data Science
6 10 (13.16%) ETL
6 10 (13.16%) Machine Learning
6 10 (13.16%) Software Engineering
7 9 (11.84%) Continuous Integration
7 9 (11.84%) Stakeholder Management
8 7 (9.21%) Data Analysis
8 7 (9.21%) Scrum
9 6 (7.89%) Artificial Intelligence
9 6 (7.89%) Microservices
10 5 (6.58%) Configuration Management
10 5 (6.58%) Continuous Deployment
10 5 (6.58%) Data Engineering
10 5 (6.58%) Open Source
10 5 (6.58%) Problem-Solving
Programming Languages
1 47 (61.84%) Python
2 25 (32.89%) Java
3 21 (27.63%) SQL
4 16 (21.05%) Scala
5 9 (11.84%) JavaScript
6 6 (7.89%) C#
7 5 (6.58%) R
7 5 (6.58%) Ruby
8 4 (5.26%) Go
8 4 (5.26%) Groovy
8 4 (5.26%) Java 8
9 2 (2.63%) Bash Shell
9 2 (2.63%) PowerShell
10 1 (1.32%) BeanShell
10 1 (1.32%) C
10 1 (1.32%) C++
10 1 (1.32%) Data Analysis Expressions (DAX)
10 1 (1.32%) PL/SQL
10 1 (1.32%) Shell Script
10 1 (1.32%) T-SQL
Qualifications
1 11 (14.47%) Security Cleared
2 10 (13.16%) SC Cleared
3 5 (6.58%) Degree
4 3 (3.95%) AWS Certification
4 3 (3.95%) Master's Degree
5 2 (2.63%) CBAP
5 2 (2.63%) IIBA
5 2 (2.63%) ISEB
5 2 (2.63%) PhD
Quality Assurance & Compliance
1 1 (1.32%) Basel III
1 1 (1.32%) CDISC
1 1 (1.32%) Data Quality
1 1 (1.32%) QA
System Software
1 13 (17.11%) Docker
2 3 (3.95%) HDFS
3 2 (2.63%) Apache Flume
4 1 (1.32%) Virtual Machines
Systems Management
1 18 (23.68%) Kubernetes
2 9 (11.84%) Ansible
2 9 (11.84%) Terraform
3 3 (3.95%) Kubeflow
3 3 (3.95%) Puppet
4 2 (2.63%) Oozie
5 1 (1.32%) Hadoop YARN
5 1 (1.32%) logstash
5 1 (1.32%) Nagios
5 1 (1.32%) Packer
Vendors
1 18 (23.68%) Cloudera
2 11 (14.47%) Google
3 8 (10.53%) Microsoft
4 5 (6.58%) Hortonworks
5 4 (5.26%) Databricks
5 4 (5.26%) Tableau
6 3 (3.95%) Informatica
6 3 (3.95%) MapR
6 3 (3.95%) Oracle
6 3 (3.95%) Splunk
7 2 (2.63%) New Relic
7 2 (2.63%) Pega
8 1 (1.32%) Adobe
8 1 (1.32%) BMC
8 1 (1.32%) CA
8 1 (1.32%) Red Hat
8 1 (1.32%) SAP
8 1 (1.32%) ServiceNow