Period
to 28 May 2020

The following table provides summary statistics for contract job vacancies advertised in Central London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 28 May 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
London > Central London
6 months to
28 May 2020
Same period 2019 Same period 2018
Rank 65 36 70
Rank change year-on-year -29 +34 -11
Contract jobs citing Big Data 120 470 332
As % of all contract jobs advertised in Central London 3.17% 5.59% 3.64%
As % of the Database & Business Intelligence category 13.00% 21.71% 14.42%
Number of daily rates quoted 90 393 280
Median daily rate £550 £550 £550
10th Percentile £406 £463 £461
90th Percentile £713 £688 £676
London median daily rate £550 £550 £550
Number of hourly rates quoted 4 2 0
Median hourly rate £36.75 £46.85 -
Median hourly rate % change year-on-year -21.55% - -
London median hourly rate £36.75 £42.50 -
% change year-on-year -13.53% - -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Central London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Central London
Contract vacancies with a requirement for database or business intelligence skills 923 2,165 2,303
As % of all contract IT jobs advertised in Central London 24.39% 25.73% 25.26%
Number of daily rates quoted 660 1,694 1,860
Median daily rate £500 £525 £513
Median daily rate % change year-on-year -4.76% +2.44% +4.59%
10th Percentile £363 £388 £363
90th Percentile £675 £675 £650
London median daily rate £525 £525 £513
% change year-on-year - +2.44% +4.06%
Number of hourly rates quoted 13 13 13
Median hourly rate £35.00 £35.00 £30.00
Median hourly rate % change year-on-year - +16.67% +34.32%
10th Percentile £24.50 £20.00 £21.00
90th Percentile £38.40 £56.50 £37.60
Median hourly rate £35.00 £35.00 £30.00
% change year-on-year - +16.67% -3.23%

Big Data
Job Vacancy Trend in Central London

Job postings citing Big Data as a proportion of all IT jobs advertised in Central London.

Job vacancy trend for Big Data in Central London

Big Data
Contractor Daily Rate Trend in Central London

3-month moving average daily rate quoted in jobs citing Big Data in Central London.

Daily rate trend for Big Data in Central London

Big Data
Daily Rate Histogram in Central London

Daily rate distribution for jobs citing Big Data in Central London over the 6 months to 28 May 2020.

Daily rate histogram for Big Data in Central London

Big Data
Contractor Hourly Rate Trend in Central London

3-month moving average hourly rates quoted in jobs citing Big Data in Central London.

Hourly rate trend for Big Data in Central London

Big Data
Contract Job Locations in Central London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the Central London region over the 6 months to 28 May 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
City of London -26 98 £538 -2.27% 19
City of Westminster +24 5 £675 +12.50% 1
West End of London +17 4 £563 -2.17% 1
Camden +4 2 £535 -10.83%
Big Data
London

For the 6 months to 28 May 2020, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Central London region with a requirement for Big Data.

1 68 (56.67%) Python
2 39 (32.50%) AWS
2 39 (32.50%) Apache Spark
3 35 (29.17%) Analytics
4 32 (26.67%) Java
5 30 (25.00%) SQL
5 30 (25.00%) Agile Software Development
5 30 (25.00%) GCP
6 29 (24.17%) Hadoop
6 29 (24.17%) Azure
7 28 (23.33%) DevOps
8 26 (21.67%) Finance
9 23 (19.17%) Linux
10 22 (18.33%) Data Modelling
11 21 (17.50%) Banking
11 21 (17.50%) Kubernetes
11 21 (17.50%) Machine Learning
12 19 (15.83%) Data Science
13 17 (14.17%) Analytical Skills
14 15 (12.50%) SQL Server
14 15 (12.50%) NoSQL
14 15 (12.50%) Security Cleared
15 14 (11.67%) SC Cleared
15 14 (11.67%) Google
15 14 (11.67%) JavaScript
15 14 (11.67%) ETL
15 14 (11.67%) Cloudera
16 13 (10.83%) Kafka
16 13 (10.83%) Jenkins
16 13 (10.83%) Docker

Big Data
Co-occurring IT Skills in Central London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 39 (32.50%) Apache Spark
2 12 (10.00%) Apache
3 7 (5.83%) Apache Airflow
4 5 (4.17%) Elasticsearch
5 4 (3.33%) WebSphere
6 2 (1.67%) Confluence
6 2 (1.67%) Tornado
7 1 (0.83%) Apache Pig
7 1 (0.83%) Apache Pulsar
7 1 (0.83%) DNN
7 1 (0.83%) Mule
7 1 (0.83%) nginx
7 1 (0.83%) Oracle Workflow
7 1 (0.83%) SAS
7 1 (0.83%) SharePoint
7 1 (0.83%) Skype for Business
7 1 (0.83%) Tomcat
Applications
1 1 (0.83%) Figma
1 1 (0.83%) InVision
1 1 (0.83%) Zeplin
Business Applications
1 2 (1.67%) SAP Oil and Gas
Cloud Services
1 39 (32.50%) AWS
2 30 (25.00%) GCP
3 29 (24.17%) Azure
4 4 (3.33%) Amazon Kinesis
4 4 (3.33%) Serverless
5 3 (2.50%) Cloud Computing
5 3 (2.50%) OpenShift
5 3 (2.50%) Power Platform
6 2 (1.67%) Amazon CloudWatch
6 2 (1.67%) Amazon EKS
6 2 (1.67%) AWS Lambda
7 1 (0.83%) Adobe Creative Cloud
7 1 (0.83%) Amazon SageMaker
7 1 (0.83%) AWS CloudFormation
7 1 (0.83%) Azure Data Factory
7 1 (0.83%) IaaS
7 1 (0.83%) NuGet
7 1 (0.83%) PaaS
Communications & Networking
1 3 (2.50%) HTTP
2 2 (1.67%) TCP/IP
3 1 (0.83%) DNS
3 1 (0.83%) Firewall
3 1 (0.83%) PuTTY
Database & Business Intelligence
1 29 (24.17%) Hadoop
2 15 (12.50%) NoSQL
2 15 (12.50%) SQL Server
3 11 (9.17%) Data Warehouse
4 8 (6.67%) Apache Cassandra
4 8 (6.67%) Apache Hive
5 7 (5.83%) Relational Database
6 6 (5.00%) Data Lake
7 5 (4.17%) MongoDB
8 4 (3.33%) BigQuery
8 4 (3.33%) Flink
8 4 (3.33%) RDBMS
9 3 (2.50%) Amazon Redshift
9 3 (2.50%) HBase
9 3 (2.50%) Parquet
9 3 (2.50%) Power BI
9 3 (2.50%) Spark SQL
9 3 (2.50%) SQL Server Analysis Services
10 2 (1.67%) Bigtable
10 2 (1.67%) Neo4j
Development Applications
1 13 (10.83%) Jenkins
2 7 (5.83%) Git (software)
3 5 (4.17%) Maven
4 4 (3.33%) GitLab
4 4 (3.33%) JIRA
4 4 (3.33%) TeamCity
5 3 (2.50%) Team Foundation Server
6 2 (1.67%) Atlassian Bamboo
6 2 (1.67%) CircleCI
6 2 (1.67%) Hudson
6 2 (1.67%) PowerDesigner
6 2 (1.67%) ProC
6 2 (1.67%) Travis CI
7 1 (0.83%) Axure RP
7 1 (0.83%) Gradle
7 1 (0.83%) MSI
7 1 (0.83%) Selenium
7 1 (0.83%) WiX
General
1 26 (21.67%) Finance
2 21 (17.50%) Banking
3 8 (6.67%) Investment Banking
4 7 (5.83%) Retail
5 6 (5.00%) Front Office
6 4 (3.33%) Marketing
7 3 (2.50%) Telecoms
8 2 (1.67%) Manufacturing
8 2 (1.67%) Public Sector
9 1 (0.83%) Law
9 1 (0.83%) Pharmaceutical
9 1 (0.83%) Retail Banking
Job Titles
1 34 (28.33%) Data Engineer
2 25 (20.83%) Developer
3 16 (13.33%) Big Data Engineer
4 12 (10.00%) DevOps Engineer
5 11 (9.17%) Analyst
6 10 (8.33%) Architect
6 10 (8.33%) Data Scientist
7 9 (7.50%) AWS Engineer
7 9 (7.50%) Consultant
8 8 (6.67%) Java Developer
9 7 (5.83%) Business Analyst
9 7 (5.83%) Cloud Engineer
10 5 (4.17%) AWS DevOps
10 5 (4.17%) Big Data Developer
11 4 (3.33%) AWS DevOps Engineer
11 4 (3.33%) Big Data Manager
11 4 (3.33%) Data Architect
11 4 (3.33%) Data Business Analyst
11 4 (3.33%) Senior Developer
11 4 (3.33%) Splunk Consultant
Libraries, Frameworks & Software Standards
1 13 (10.83%) Kafka
1 13 (10.83%) Web Services
2 10 (8.33%) TensorFlow
3 9 (7.50%) REST
4 8 (6.67%) Pandas
5 7 (5.83%) PySpark
5 7 (5.83%) SciPy
6 6 (5.00%) RESTful
6 6 (5.00%) Spring
7 5 (4.17%) Apache Beam
7 5 (4.17%) H2O
7 5 (4.17%) HTML
7 5 (4.17%) JSON
7 5 (4.17%) MLlib
7 5 (4.17%) Node.js
7 5 (4.17%) XML
8 4 (3.33%) Flask
8 4 (3.33%) React
8 4 (3.33%) Regular Expression
8 4 (3.33%) Spring Boot
Miscellaneous
1 17 (14.17%) Analytical Skills
2 9 (7.50%) Algorithms
3 7 (5.83%) Greenfield Project
4 6 (5.00%) Credit Risk
5 5 (4.17%) Enterprise Software
5 5 (4.17%) Hedge funds
5 5 (4.17%) Management Information System
6 3 (2.50%) Equities
6 3 (2.50%) Market Risk
6 3 (2.50%) Public Cloud
7 2 (1.67%) iPad
7 2 (1.67%) Life Science
7 2 (1.67%) Mobile App
7 2 (1.67%) Semantic Web
7 2 (1.67%) Social Media
7 2 (1.67%) Taxonomies
8 1 (0.83%) Data Structures
8 1 (0.83%) Hybrid Cloud
8 1 (0.83%) Mobile Banking
8 1 (0.83%) User Experience
Operating Systems
1 23 (19.17%) Linux
2 5 (4.17%) Unix
3 3 (2.50%) Debian
4 2 (1.67%) Windows
5 1 (0.83%) CentOS
5 1 (0.83%) Red Hat Enterprise Linux
5 1 (0.83%) Ubuntu
5 1 (0.83%) Windows Server
Processes & Methodologies
1 35 (29.17%) Analytics
2 30 (25.00%) Agile Software Development
3 28 (23.33%) DevOps
4 22 (18.33%) Data Modelling
5 21 (17.50%) Machine Learning
6 19 (15.83%) Data Science
7 14 (11.67%) ETL
8 13 (10.83%) Artificial Intelligence
8 13 (10.83%) Business Intelligence
8 13 (10.83%) Data Analysis
8 13 (10.83%) Software Engineering
9 11 (9.17%) Problem-Solving
10 10 (8.33%) Scrum
10 10 (8.33%) Stakeholder Management
11 9 (7.50%) Data Analytics
11 9 (7.50%) Data Engineering
12 8 (6.67%) Use Case
13 7 (5.83%) Continuous Integration
13 7 (5.83%) Data Architecture
13 7 (5.83%) Visualisation
Programming Languages
1 68 (56.67%) Python
2 32 (26.67%) Java
3 30 (25.00%) SQL
4 14 (11.67%) JavaScript
5 13 (10.83%) Scala
6 7 (5.83%) C#
6 7 (5.83%) Groovy
6 7 (5.83%) Ruby
7 6 (5.00%) R
8 5 (4.17%) Java 8
8 5 (4.17%) PHP
9 4 (3.33%) Bash Shell
10 3 (2.50%) PowerShell
11 2 (1.67%) Go
11 2 (1.67%) Perl
11 2 (1.67%) T-SQL
11 2 (1.67%) TypeScript
12 1 (0.83%) C++
12 1 (0.83%) Kotlin
12 1 (0.83%) PL/SQL
Qualifications
1 15 (12.50%) Security Cleared
2 14 (11.67%) SC Cleared
3 7 (5.83%) Degree
4 5 (4.17%) Master's Degree
5 4 (3.33%) PhD
6 3 (2.50%) AWS Certification
7 2 (1.67%) CBAP
7 2 (1.67%) IIBA
7 2 (1.67%) ISEB
Quality Assurance & Compliance
1 3 (2.50%) QA
2 2 (1.67%) MiFID
3 1 (0.83%) Basel III
3 1 (0.83%) Data Quality
3 1 (0.83%) GDPR
System Software
1 13 (10.83%) Docker
2 3 (2.50%) Apache Flume
2 3 (2.50%) HDFS
3 2 (1.67%) Virtual Machines
4 1 (0.83%) Active Directory
4 1 (0.83%) Hyper-V
Systems Management
1 21 (17.50%) Kubernetes
2 13 (10.83%) Terraform
3 10 (8.33%) Ansible
4 7 (5.83%) Puppet
5 5 (4.17%) Opscode Chef
6 4 (3.33%) CFEngine
6 4 (3.33%) HP SiteScope
6 4 (3.33%) Nagios
6 4 (3.33%) SCCM
7 3 (2.50%) Kubeflow
8 2 (1.67%) Hadoop YARN
8 2 (1.67%) Oozie
9 1 (0.83%) Kibana
9 1 (0.83%) logstash
9 1 (0.83%) Microsoft Clustering
9 1 (0.83%) Microsoft Data Protection Manager
9 1 (0.83%) Packer
9 1 (0.83%) SCOM
9 1 (0.83%) SCOrch
Vendors
1 14 (11.67%) Cloudera
1 14 (11.67%) Google
2 13 (10.83%) Microsoft
3 6 (5.00%) Oracle
3 6 (5.00%) Splunk
4 5 (4.17%) MapR
5 4 (3.33%) PeopleSoft
5 4 (3.33%) Tableau
6 3 (2.50%) Hortonworks
6 3 (2.50%) SAP
7 2 (1.67%) Confluent
7 2 (1.67%) Informatica
7 2 (1.67%) New Relic
7 2 (1.67%) Palantir
7 2 (1.67%) StreamSets
7 2 (1.67%) Sybase
7 2 (1.67%) Teradata
8 1 (0.83%) Adobe
8 1 (0.83%) BMC
8 1 (0.83%) Citrix