Period
to 29 March 2020

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 29 March 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
Central London > City of London
6 months to
29 Mar 2020
Same period 2019 Same period 2018
Rank 76 52 74
Rank change year-on-year -24 +22 -31
Contract jobs citing Big Data 117 293 241
As % of all contract jobs advertised in the City of London 2.72% 4.30% 3.40%
As % of the Database & Business Intelligence category 11.79% 17.00% 13.72%
Number of daily rates quoted 83 250 204
Median daily rate £525 £550 £575
Median daily rate % change year-on-year -4.55% -4.35% +4.55%
10th Percentile £408 £448 £463
90th Percentile £723 £701 £696
Central London median daily rate £550 £550 £563
% change year-on-year - -2.22% +2.27%
Number of hourly rates quoted 3 0 0
Median hourly rate £35.00 - -
Central London median hourly rate £35.00 - -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 992 1,724 1,757
As % of all contract IT jobs advertised in the City of London 23.07% 25.32% 24.78%
Number of daily rates quoted 750 1,370 1,482
Median daily rate £500 £528 £525
Median daily rate % change year-on-year -5.21% +0.48% +5.00%
10th Percentile £363 £400 £363
90th Percentile £675 £675 £688
Central London median daily rate £500 £525 £513
% change year-on-year -4.76% +2.44% +7.89%
Number of hourly rates quoted 6 5 9
Median hourly rate £35.00 £35.00 £22.50
Median hourly rate % change year-on-year - +55.56% +0.74%
10th Percentile £24.50 £32.50 £20.06
90th Percentile £37.13 £56.50 £38.41
Median hourly rate £35.00 £35.00 £27.50
% change year-on-year - +27.27% +23.13%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing Big Data in the City of London.

Daily rate trend for Big Data in the City of London

Big Data
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing Big Data in the City of London over the 6 months to 29 March 2020.

Daily rate histogram for Big Data in the City of London

Big Data
Contractor Hourly Rate Trend in the City of London

3-month moving average hourly rates quoted in jobs citing Big Data in the City of London.

Hourly rate trend for Big Data in the City of London

Big Data
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the City of London region over the 6 months to 29 March 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge 0 1 £450 -18.18%
Big Data
Central London

For the 6 months to 29 March 2020, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Big Data.

1 59 (50.43%) Python
2 39 (33.33%) AWS
3 38 (32.48%) Apache Spark
4 35 (29.91%) Hadoop
5 34 (29.06%) Agile Software Development
6 33 (28.21%) GCP
7 32 (27.35%) Analytics
8 31 (26.50%) DevOps
8 31 (26.50%) Java
9 30 (25.64%) SQL
9 30 (25.64%) Azure
10 26 (22.22%) Data Science
11 24 (20.51%) Machine Learning
12 21 (17.95%) Finance
13 19 (16.24%) NoSQL
14 18 (15.38%) Artificial Intelligence
14 18 (15.38%) Kubernetes
15 17 (14.53%) Banking
15 17 (14.53%) Linux
15 17 (14.53%) Data Modelling
16 16 (13.68%) Kafka
17 15 (12.82%) Jenkins
17 15 (12.82%) Algorithms
17 15 (12.82%) Business Intelligence
17 15 (12.82%) Scala
18 14 (11.97%) Google
18 14 (11.97%) ETL
19 13 (11.11%) Use Case
20 12 (10.26%) Apache Hive
20 12 (10.26%) Analytical Skills

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 38 (32.48%) Apache Spark
2 9 (7.69%) Apache
2 9 (7.69%) Apache Airflow
3 5 (4.27%) Elasticsearch
4 3 (2.56%) Luigi
5 2 (1.71%) DNN
6 1 (0.85%) Apache Pig
6 1 (0.85%) Confluence
6 1 (0.85%) Mule
6 1 (0.85%) nginx
6 1 (0.85%) Oracle Workflow
6 1 (0.85%) SAS
6 1 (0.85%) SharePoint
6 1 (0.85%) Skype for Business
6 1 (0.85%) Tomcat
6 1 (0.85%) Tornado
Applications
1 1 (0.85%) Microsoft Project
1 1 (0.85%) MS Visio
1 1 (0.85%) Spreadsheet
Business Applications
1 1 (0.85%) Aligne
1 1 (0.85%) SAP Oil and Gas
Cloud Services
1 39 (33.33%) AWS
2 33 (28.21%) GCP
3 30 (25.64%) Azure
4 5 (4.27%) Power Platform
5 3 (2.56%) Amazon Kinesis
5 3 (2.56%) OpenShift
6 2 (1.71%) Amazon CloudWatch
6 2 (1.71%) Amazon EKS
6 2 (1.71%) Amazon S3
6 2 (1.71%) Serverless
7 1 (0.85%) Amazon EC2
7 1 (0.85%) Amazon EMR
7 1 (0.85%) Amazon SageMaker
7 1 (0.85%) AWS CloudFormation
7 1 (0.85%) Azure Data Factory
7 1 (0.85%) Cloud Computing
7 1 (0.85%) IaaS
7 1 (0.85%) NuGet
7 1 (0.85%) PaaS
Communications & Networking
1 2 (1.71%) PuTTY
1 2 (1.71%) TCP/IP
2 1 (0.85%) 3G
2 1 (0.85%) 4G
2 1 (0.85%) 5G
2 1 (0.85%) DNS
2 1 (0.85%) Firewall
Database & Business Intelligence
1 35 (29.91%) Hadoop
2 19 (16.24%) NoSQL
3 12 (10.26%) Apache Hive
4 11 (9.40%) Data Warehouse
5 10 (8.55%) SQL Server
6 8 (6.84%) MongoDB
7 6 (5.13%) PostgreSQL
8 5 (4.27%) Apache Cassandra
8 5 (4.27%) Data Lake
8 5 (4.27%) HBase
8 5 (4.27%) Power BI
9 4 (3.42%) Flink
9 4 (3.42%) Relational Database
10 3 (2.56%) Amazon RDS
10 3 (2.56%) Azkaban
10 3 (2.56%) Parquet
11 2 (1.71%) BigQuery
11 2 (1.71%) Impala
11 2 (1.71%) Sisense
11 2 (1.71%) Sqoop
Development Applications
1 15 (12.82%) Jenkins
2 11 (9.40%) Git (software)
3 8 (6.84%) Maven
4 4 (3.42%) Team Foundation Server
4 4 (3.42%) TeamCity
5 3 (2.56%) GitLab
5 3 (2.56%) JIRA
5 3 (2.56%) Selenium
6 2 (1.71%) Atlassian Bamboo
6 2 (1.71%) CircleCI
6 2 (1.71%) Cucumber
6 2 (1.71%) SpecFlow
6 2 (1.71%) Travis CI
7 1 (0.85%) ERwin
7 1 (0.85%) Hudson
7 1 (0.85%) JUnit
7 1 (0.85%) MSI
7 1 (0.85%) PowerDesigner
7 1 (0.85%) ProC
7 1 (0.85%) WiX
General
1 21 (17.95%) Finance
2 17 (14.53%) Banking
3 7 (5.98%) Retail
4 6 (5.13%) Investment Banking
4 6 (5.13%) Telecoms
5 5 (4.27%) Marketing
6 3 (2.56%) Front Office
7 2 (1.71%) Billing
7 2 (1.71%) Public Sector
8 1 (0.85%) Financial Institution
8 1 (0.85%) Law
8 1 (0.85%) Pharmaceutical
8 1 (0.85%) Retail Banking
Job Titles
1 34 (29.06%) Data Engineer
2 15 (12.82%) Developer
3 14 (11.97%) Analyst
4 12 (10.26%) Data Scientist
5 10 (8.55%) Architect
5 10 (8.55%) Big Data Engineer
5 10 (8.55%) DevOps Engineer
6 8 (6.84%) Business Analyst
7 7 (5.98%) AWS Engineer
7 7 (5.98%) Java Developer
8 5 (4.27%) Data Analyst
8 5 (4.27%) Data Architect
9 4 (3.42%) Big Data Manager
9 4 (3.42%) Cloud Engineer
9 4 (3.42%) Consultant
9 4 (3.42%) Data Business Analyst
9 4 (3.42%) Data Manager
9 4 (3.42%) Machine Learning Scientist
9 4 (3.42%) Senior DevOps
9 4 (3.42%) Senior DevOps Engineer
Libraries, Frameworks & Software Standards
1 16 (13.68%) Kafka
2 11 (9.40%) Web Services
3 9 (7.69%) REST
3 9 (7.69%) TensorFlow
4 6 (5.13%) .NET
4 6 (5.13%) JSON
4 6 (5.13%) Pandas
4 6 (5.13%) PySpark
4 6 (5.13%) RESTful
5 5 (4.27%) MLlib
5 5 (4.27%) Node.js
5 5 (4.27%) SciPy
5 5 (4.27%) XML
6 4 (3.42%) Spring
7 3 (2.56%) Apache Avro
7 3 (2.56%) Apache Beam
7 3 (2.56%) Elastic Stack
7 3 (2.56%) Natural Language Processing
7 3 (2.56%) React
7 3 (2.56%) Spark Streaming
Miscellaneous
1 15 (12.82%) Algorithms
2 12 (10.26%) Analytical Skills
3 6 (5.13%) Credit Risk
3 6 (5.13%) Data Structures
4 4 (3.42%) Greenfield Project
5 3 (2.56%) Enterprise Software
5 3 (2.56%) Market Risk
6 2 (1.71%) iPad
6 2 (1.71%) Life Science
6 2 (1.71%) Management Information System
6 2 (1.71%) Mobile App
6 2 (1.71%) Public Cloud
6 2 (1.71%) Semantic Web
7 1 (0.85%) Clustering
7 1 (0.85%) Foreign Exchange (FX)
7 1 (0.85%) Grid Computing
7 1 (0.85%) Hybrid Cloud
7 1 (0.85%) Mobile Banking
7 1 (0.85%) Self-Motivation
7 1 (0.85%) User Experience
Operating Systems
1 17 (14.53%) Linux
2 6 (5.13%) Unix
3 2 (1.71%) Windows
4 1 (0.85%) CentOS
4 1 (0.85%) Debian
4 1 (0.85%) Red Hat Enterprise Linux
4 1 (0.85%) Ubuntu
4 1 (0.85%) Windows Server
Processes & Methodologies
1 34 (29.06%) Agile Software Development
2 32 (27.35%) Analytics
3 31 (26.50%) DevOps
4 26 (22.22%) Data Science
5 24 (20.51%) Machine Learning
6 18 (15.38%) Artificial Intelligence
7 17 (14.53%) Data Modelling
8 15 (12.82%) Business Intelligence
9 14 (11.97%) ETL
10 13 (11.11%) Use Case
11 11 (9.40%) Scrum
12 10 (8.55%) Computer Science
12 10 (8.55%) Open Source
12 10 (8.55%) Software Engineering
13 9 (7.69%) Microservices
13 9 (7.69%) Stakeholder Management
14 8 (6.84%) Data Analysis
14 8 (6.84%) Data Analytics
14 8 (6.84%) Data Transformation
14 8 (6.84%) Migration
Programming Languages
1 59 (50.43%) Python
2 31 (26.50%) Java
3 30 (25.64%) SQL
4 15 (12.82%) Scala
5 9 (7.69%) C#
6 5 (4.27%) Groovy
7 4 (3.42%) C++
7 4 (3.42%) Java 8
7 4 (3.42%) JavaScript
7 4 (3.42%) R
8 3 (2.56%) AWK
8 3 (2.56%) Go
8 3 (2.56%) Ruby
8 3 (2.56%) sed
9 2 (1.71%) Bash Shell
9 2 (1.71%) PL/SQL
9 2 (1.71%) PowerShell
9 2 (1.71%) T-SQL
10 1 (0.85%) C
10 1 (0.85%) PHP
Qualifications
1 8 (6.84%) Degree
2 6 (5.13%) Master's Degree
2 6 (5.13%) PhD
2 6 (5.13%) SC Cleared
2 6 (5.13%) Security Cleared
3 4 (3.42%) ISEB
4 2 (1.71%) CBAP
4 2 (1.71%) IIBA
5 1 (0.85%) AWS Certification
5 1 (0.85%) Computer Science Degree
5 1 (0.85%) TOGAF Certification
Quality Assurance & Compliance
1 5 (4.27%) QA
2 3 (2.56%) Data Quality
3 2 (1.71%) Basel III
4 1 (0.85%) GDPR
4 1 (0.85%) IFRS
4 1 (0.85%) IFRS 9
4 1 (0.85%) MiFID
System Software
1 11 (9.40%) Docker
2 3 (2.56%) Apache Flume
2 3 (2.56%) HDFS
3 2 (1.71%) Virtual Machines
4 1 (0.85%) Active Directory
4 1 (0.85%) Hyper-V
Systems Management
1 18 (15.38%) Kubernetes
2 12 (10.26%) Terraform
3 10 (8.55%) Ansible
4 3 (2.56%) Hadoop YARN
4 3 (2.56%) Puppet
5 2 (1.71%) Kibana
5 2 (1.71%) Oozie
6 1 (0.85%) Grafana
6 1 (0.85%) ITRS Geneos
6 1 (0.85%) Kubeflow
6 1 (0.85%) logstash
6 1 (0.85%) Microsoft Clustering
6 1 (0.85%) Microsoft Data Protection Manager
6 1 (0.85%) Opscode Chef
6 1 (0.85%) Packer
6 1 (0.85%) Prometheus
6 1 (0.85%) SCOM
6 1 (0.85%) SCOrch
Vendors
1 14 (11.97%) Google
2 8 (6.84%) Microsoft
3 6 (5.13%) Oracle
4 5 (4.27%) Cloudera
4 5 (4.27%) MapR
4 5 (4.27%) Tableau
5 3 (2.56%) Splunk
5 3 (2.56%) Teradata
6 2 (1.71%) Hortonworks
6 2 (1.71%) Informatica
6 2 (1.71%) New Relic
6 2 (1.71%) Palantir
6 2 (1.71%) SAP
7 1 (0.85%) Alibaba
7 1 (0.85%) Databricks
7 1 (0.85%) F5
7 1 (0.85%) MuleSoft
7 1 (0.85%) Red Hat
7 1 (0.85%) Salesforce.com
7 1 (0.85%) Talend