Period
to 27 January 2020

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 27 January 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
Central London > City of London
6 months to
27 Jan 2020
Same period 2019 Same period 2018
Rank 83 60 65
Rank change year-on-year -23 +5 -22
Contract jobs citing Big Data 122 252 263
As % of all contract IT jobs advertised in the City of London 2.51% 3.74% 3.72%
As % of the Database & Business Intelligence category 11.08% 15.28% 15.04%
Number of daily rates quoted 91 210 230
City of London median daily rate £550 £550 £575
Median daily rate % change year-on-year - -4.35% -
10th Percentile £413 £456 £462
90th Percentile £725 £714 £689
Central London median daily rate £550 £550 £575
% change year-on-year - -4.35% -
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1,101 1,649 1,749
As % of all contract IT jobs advertised in the City of London 22.61% 24.50% 24.71%
Number of daily rates quoted 858 1,326 1,472
City of London median daily rate £520 £525 £525
Median daily rate % change year-on-year -0.95% - +10.53%
10th Percentile £370 £382 £363
90th Percentile £675 £675 £688
Central London median daily rate £500 £525 £513
% change year-on-year -4.76% +2.44% +7.89%
Number of hourly rates quoted 4 7 6
City of London median hourly rate £25.00 £37.09 £27.75
Median hourly rate % change year-on-year -32.60% +33.66% -38.33%
10th Percentile £22.17 £29.50 £23.38
90th Percentile £46.50 £65.61 £33.25
Central London median hourly rate £35.00 £37.09 £27.50
% change year-on-year -5.63% +34.87% -38.89%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the City of London.

Contractor daily rate trend for Big Data in the City of London

Big Data
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Big Data in the City of London over the 6 months to 27 January 2020.

Contractor daily rate histogram for Big Data in the City of London

Big Data
Contractor Hourly Rate Trend in the City of London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in the City of London.

Contractor hourly rate trend for Big Data in the City of London

Big Data
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the City of London region over the 6 months to 27 January 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge +19 7 £450 -18.18%
Moorgate - 2 - - 1
Big Data
Central London

For the 6 months to 27 January 2020, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Big Data.

1 53 (43.44%) Python
2 47 (38.52%) Agile Software Development
3 43 (35.25%) Hadoop
4 40 (32.79%) Apache Spark
5 38 (31.15%) SQL
6 37 (30.33%) AWS
7 30 (24.59%) Analytics
8 28 (22.95%) Azure
8 28 (22.95%) Java
9 27 (22.13%) Finance
10 26 (21.31%) Machine Learning
10 26 (21.31%) Data Science
11 24 (19.67%) GCP
12 23 (18.85%) DevOps
13 22 (18.03%) Scala
14 21 (17.21%) Kafka
15 19 (15.57%) NoSQL
16 18 (14.75%) Kubernetes
17 15 (12.30%) Scrum
17 15 (12.30%) Apache Hive
17 15 (12.30%) Use Case
18 14 (11.48%) Artificial Intelligence
18 14 (11.48%) Business Intelligence
19 13 (10.66%) Data Modelling
19 13 (10.66%) ETL
19 13 (10.66%) Migration
19 13 (10.66%) Open Source
19 13 (10.66%) Algorithms
20 12 (9.84%) Analytical Skills
20 12 (9.84%) Computer Science

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 40 (32.79%) Apache Spark
2 6 (4.92%) Elasticsearch
3 5 (4.10%) Apache
3 5 (4.10%) Apache Airflow
4 3 (2.46%) Luigi
4 3 (2.46%) SAS
5 2 (1.64%) DNN
6 1 (0.82%) Jupyter
6 1 (0.82%) SharePoint
6 1 (0.82%) Skype for Business
Applications
1 5 (4.10%) Microsoft Project
1 5 (4.10%) MS Visio
2 1 (0.82%) Microsoft Excel
2 1 (0.82%) Spreadsheet
Business Applications
1 1 (0.82%) Aligne
1 1 (0.82%) Cognos Business Intelligence
1 1 (0.82%) SAP Oil and Gas
Cloud Services
1 37 (30.33%) AWS
2 28 (22.95%) Azure
3 24 (19.67%) GCP
4 8 (6.56%) Power Platform
5 7 (5.74%) Amazon S3
6 5 (4.10%) Amazon EMR
7 2 (1.64%) Amazon EC2
7 2 (1.64%) AWS CloudFormation
7 2 (1.64%) Cloud Computing
8 1 (0.82%) Amazon Kinesis
8 1 (0.82%) AWS Lambda
8 1 (0.82%) Azure Data Factory
8 1 (0.82%) GitHub
8 1 (0.82%) IaaS
8 1 (0.82%) NuGet
8 1 (0.82%) OpenShift
8 1 (0.82%) PaaS
8 1 (0.82%) Serverless
Communications & Networking
1 1 (0.82%) 3G
1 1 (0.82%) 4G
1 1 (0.82%) 5G
1 1 (0.82%) PuTTY
Database & Business Intelligence
1 43 (35.25%) Hadoop
2 19 (15.57%) NoSQL
3 15 (12.30%) Apache Hive
4 11 (9.02%) Data Warehouse
5 10 (8.20%) SQL Server
6 9 (7.38%) PostgreSQL
7 8 (6.56%) Data Lake
7 8 (6.56%) Power BI
8 7 (5.74%) MongoDB
8 7 (5.74%) Spark SQL
9 6 (4.92%) Impala
10 5 (4.10%) HBase
11 4 (3.28%) Apache Cassandra
11 4 (3.28%) MySQL
12 3 (2.46%) Azkaban
12 3 (2.46%) Flink
12 3 (2.46%) Relational Database
12 3 (2.46%) SQL Server Analysis Services
13 2 (1.64%) Sisense
13 2 (1.64%) Sqoop
Development Applications
1 9 (7.38%) Git (software)
1 9 (7.38%) Jenkins
2 8 (6.56%) Team Foundation Server
3 6 (4.92%) Maven
4 4 (3.28%) JIRA
5 3 (2.46%) Cucumber
5 3 (2.46%) ERwin
5 3 (2.46%) Selenium
6 2 (1.64%) SpecFlow
6 2 (1.64%) TeamCity
7 1 (0.82%) Atlassian Bamboo
7 1 (0.82%) GitLab
7 1 (0.82%) JUnit
7 1 (0.82%) MSI
7 1 (0.82%) PowerDesigner
7 1 (0.82%) WiX
General
1 27 (22.13%) Finance
2 12 (9.84%) Banking
3 9 (7.38%) Marketing
4 6 (4.92%) Telecoms
5 4 (3.28%) Retail
6 3 (2.46%) Investment Banking
7 2 (1.64%) Advertising
7 2 (1.64%) Billing
8 1 (0.82%) Financial Institution
8 1 (0.82%) Law
8 1 (0.82%) Multimedia
8 1 (0.82%) Public Sector
8 1 (0.82%) Retail Banking
Job Titles
1 29 (23.77%) Data Engineer
2 18 (14.75%) Analyst
2 18 (14.75%) Architect
2 18 (14.75%) Developer
3 11 (9.02%) Business Analyst
4 10 (8.20%) Data Architect
4 10 (8.20%) Data Scientist
5 8 (6.56%) Big Data Developer
6 7 (5.74%) Big Data Engineer
7 5 (4.10%) Agile Business Analyst
7 5 (4.10%) Data Business Analyst
7 5 (4.10%) Python Developer
8 4 (3.28%) Big Data Manager
8 4 (3.28%) DevOps Engineer
8 4 (3.28%) Java Developer
8 4 (3.28%) Machine Learning Scientist
8 4 (3.28%) Python Engineer
8 4 (3.28%) Solutions Architect
9 3 (2.46%) Consultant
9 3 (2.46%) Project Manager
Libraries, Frameworks & Software Standards
1 21 (17.21%) Kafka
2 7 (5.74%) TensorFlow
3 6 (4.92%) .NET
3 6 (4.92%) PySpark
3 6 (4.92%) REST
3 6 (4.92%) Web Services
4 5 (4.10%) SciPy
5 4 (3.28%) JSON
5 4 (3.28%) MLlib
5 4 (3.28%) Pandas
5 4 (3.28%) Spark Streaming
5 4 (3.28%) XML
6 3 (2.46%) Natural Language Processing
6 3 (2.46%) Node.js
6 3 (2.46%) RESTful
6 3 (2.46%) scikit-learn
6 3 (2.46%) Spring
7 2 (1.64%) D3.js
7 2 (1.64%) NumPy
7 2 (1.64%) Samza
Miscellaneous
1 13 (10.66%) Algorithms
2 12 (9.84%) Analytical Skills
3 11 (9.02%) Data Structures
4 5 (4.10%) Greenfield Project
5 4 (3.28%) Public Cloud
6 3 (2.46%) User Experience
7 2 (1.64%) Data Centre
8 1 (0.82%) Clustering
8 1 (0.82%) Credit Risk
8 1 (0.82%) Grid Computing
8 1 (0.82%) Life Science
8 1 (0.82%) Linux Command Line
8 1 (0.82%) Mobile Banking
8 1 (0.82%) Robotics
8 1 (0.82%) Self-Motivation
8 1 (0.82%) Semantic Web
8 1 (0.82%) Video Conferencing
Operating Systems
1 9 (7.38%) Linux
2 6 (4.92%) Unix
3 2 (1.64%) Windows
4 1 (0.82%) CentOS
4 1 (0.82%) Red Hat Enterprise Linux
4 1 (0.82%) Windows Server
Processes & Methodologies
1 47 (38.52%) Agile Software Development
2 30 (24.59%) Analytics
3 26 (21.31%) Data Science
3 26 (21.31%) Machine Learning
4 23 (18.85%) DevOps
5 15 (12.30%) Scrum
5 15 (12.30%) Use Case
6 14 (11.48%) Artificial Intelligence
6 14 (11.48%) Business Intelligence
7 13 (10.66%) Data Modelling
7 13 (10.66%) ETL
7 13 (10.66%) Migration
7 13 (10.66%) Open Source
8 12 (9.84%) Computer Science
9 11 (9.02%) Data Transformation
9 11 (9.02%) Mentoring
10 10 (8.20%) Data Engineering
10 10 (8.20%) Problem-Solving
10 10 (8.20%) Visualisation
11 9 (7.38%) Data Analytics
Programming Languages
1 53 (43.44%) Python
2 38 (31.15%) SQL
3 28 (22.95%) Java
4 22 (18.03%) Scala
5 7 (5.74%) C#
5 7 (5.74%) C++
6 5 (4.10%) R
7 4 (3.28%) Go
8 3 (2.46%) AWK
8 3 (2.46%) Bash Shell
8 3 (2.46%) sed
9 2 (1.64%) Groovy
9 2 (1.64%) Java 8
9 2 (1.64%) MATLAB
9 2 (1.64%) PL/SQL
9 2 (1.64%) PowerShell
10 1 (0.82%) Clojure
10 1 (0.82%) HiveQL
10 1 (0.82%) Kotlin
10 1 (0.82%) T-SQL
Qualifications
1 9 (7.38%) Degree
2 6 (4.92%) PhD
2 6 (4.92%) SC Cleared
2 6 (4.92%) Security Cleared
3 4 (3.28%) Master's Degree
4 2 (1.64%) ISEB
5 1 (0.82%) Computer Science Degree
5 1 (0.82%) TOGAF Certification
Quality Assurance & Compliance
1 4 (3.28%) QA
2 3 (2.46%) Data Quality
3 1 (0.82%) Basel III
3 1 (0.82%) IFRS
3 1 (0.82%) IFRS 9
System Software
1 10 (8.20%) Docker
2 2 (1.64%) HDFS
3 1 (0.82%) Active Directory
3 1 (0.82%) Apache ZooKeeper
3 1 (0.82%) Hyper-V
3 1 (0.82%) Virtual Machines
Systems Management
1 18 (14.75%) Kubernetes
2 8 (6.56%) Terraform
3 7 (5.74%) Ansible
4 5 (4.10%) Hadoop YARN
5 2 (1.64%) Kibana
6 1 (0.82%) Docker Swarm
6 1 (0.82%) Grafana
6 1 (0.82%) ITRS Geneos
6 1 (0.82%) Microsoft Clustering
6 1 (0.82%) Microsoft Data Protection Manager
6 1 (0.82%) Oozie
6 1 (0.82%) Opscode Chef
6 1 (0.82%) Prometheus
6 1 (0.82%) Puppet
6 1 (0.82%) SCOM
6 1 (0.82%) SCOrch
Vendors
1 12 (9.84%) Microsoft
2 9 (7.38%) Cloudera
2 9 (7.38%) Google
3 7 (5.74%) Oracle
4 6 (4.92%) Tableau
5 4 (3.28%) Hortonworks
6 3 (2.46%) Informatica
6 3 (2.46%) Palantir
6 3 (2.46%) Teradata
7 2 (1.64%) MapR
7 2 (1.64%) SAP
7 2 (1.64%) Talend
8 1 (0.82%) Ab Initio
8 1 (0.82%) Alibaba
8 1 (0.82%) Citrix
8 1 (0.82%) Cognos
8 1 (0.82%) F5
8 1 (0.82%) Foundry
8 1 (0.82%) Salesforce.com
8 1 (0.82%) Vertica