Period
to 25 January 2020

The following table provides summary statistics for contract job vacancies advertised in Central London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 25 January 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
London > Central London
6 months to
25 Jan 2020
Same period 2019 Same period 2018
Rank 87 70 75
Rank change year-on-year -17 +5 -27
Contract jobs citing Big Data 160 319 293
As % of all contract IT jobs advertised in Central London 2.58% 3.57% 3.33%
As % of the Database & Business Intelligence category 11.17% 15.03% 13.58%
Number of daily rates quoted 120 257 253
Central London median daily rate £550 £550 £575
Median daily rate % change year-on-year - -4.35% -
10th Percentile £413 £456 £425
90th Percentile £726 £700 £688
London median daily rate £575 £550 £550
% change year-on-year +4.55% - -
Number of hourly rates quoted 0 0 0
Central London median hourly rate - - -
London median hourly rate £52.50 £45.00 -
% change year-on-year +16.67% - -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Central London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Central London
Contract vacancies with a requirement for database or business intelligence skills 1,433 2,123 2,157
As % of all contract IT jobs advertised in Central London 23.15% 23.73% 24.54%
Number of daily rates quoted 1,100 1,672 1,795
Central London median daily rate £504 £525 £513
Median daily rate % change year-on-year -4.05% +2.44% +7.89%
10th Percentile £363 £375 £363
90th Percentile £669 £675 £675
London median daily rate £525 £525 £500
% change year-on-year - +5.00% +5.26%
Number of hourly rates quoted 9 7 9
Central London median hourly rate £35.00 £37.09 £27.50
Median hourly rate % change year-on-year -5.63% +34.87% -38.89%
10th Percentile £23.83 £29.50 £20.75
90th Percentile £39.10 £65.61 £33.86
London median hourly rate £35.00 £30.00 £26.78
% change year-on-year +16.67% +12.04% -21.25%

Big Data
Job Vacancy Trend in Central London

Job postings citing Big Data as a percentage of all IT jobs advertised in Central London.

Job vacancy trend for Big Data in Central London

Big Data
Contractor Daily Rate Trend in Central London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in Central London.

Contractor daily rate trend for Big Data in Central London

Big Data
Contractor Daily Rate Histogram in Central London

The daily rate distribution of IT jobs citing Big Data in Central London over the 6 months to 25 January 2020.

Contractor daily rate histogram for Big Data in Central London

Big Data
Contractor Hourly Rate Trend in Central London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in Central London.

Contractor hourly rate trend for Big Data in Central London

Big Data
Contract Job Locations in Central London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the Central London region over the 6 months to 25 January 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
City of London -21 123 £550 - 117
Southwark +14 7 £450 -18.18%
City of Westminster +7 4 £900 +63.64%
West End of London +25 3 £575 +4.55% 1
Camden +3 1 £550 -8.33%
Big Data
London

For the 6 months to 25 January 2020, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Central London region with a requirement for Big Data.

1 73 (45.63%) Python
2 59 (36.88%) Agile Software Development
3 56 (35.00%) Apache Spark
4 53 (33.13%) Hadoop
5 52 (32.50%) SQL
6 48 (30.00%) AWS
7 43 (26.88%) Analytics
8 38 (23.75%) Finance
9 37 (23.13%) Java
10 36 (22.50%) Azure
11 32 (20.00%) Machine Learning
12 31 (19.38%) Data Science
12 31 (19.38%) GCP
13 30 (18.75%) Kafka
14 29 (18.13%) DevOps
15 26 (16.25%) Scala
16 25 (15.63%) Analytical Skills
17 24 (15.00%) ETL
18 22 (13.75%) Scrum
18 22 (13.75%) Kubernetes
19 21 (13.13%) Docker
19 21 (13.13%) NoSQL
19 21 (13.13%) Data Warehouse
19 21 (13.13%) Microsoft
20 20 (12.50%) Computer Science
21 19 (11.88%) Use Case
21 19 (11.88%) Problem-Solving
22 18 (11.25%) Data Structures
22 18 (11.25%) Business Intelligence
22 18 (11.25%) Data Modelling

Big Data
Co-occurring IT Skills in Central London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 56 (35.00%) Apache Spark
2 8 (5.00%) Apache
2 8 (5.00%) Apache Airflow
3 7 (4.38%) Elasticsearch
4 4 (2.50%) WebSphere
5 3 (1.88%) Luigi
5 3 (1.88%) SAS
6 2 (1.25%) DNN
7 1 (0.63%) Jupyter
7 1 (0.63%) SharePoint
7 1 (0.63%) Skype for Business
7 1 (0.63%) Tomcat
Applications
1 5 (3.13%) Microsoft Project
1 5 (3.13%) MS Visio
2 2 (1.25%) Spreadsheet
3 1 (0.63%) Microsoft Excel
Business Applications
1 1 (0.63%) Aligne
1 1 (0.63%) Cognos Business Intelligence
1 1 (0.63%) SAP MDM
1 1 (0.63%) SAP Oil and Gas
Cloud Services
1 48 (30.00%) AWS
2 36 (22.50%) Azure
3 31 (19.38%) GCP
4 11 (6.88%) Amazon S3
5 10 (6.25%) Power Platform
6 7 (4.38%) Amazon EMR
7 2 (1.25%) Amazon EC2
7 2 (1.25%) AWS CloudFormation
7 2 (1.25%) Cloud Computing
8 1 (0.63%) Amazon EKS
8 1 (0.63%) Amazon Kinesis
8 1 (0.63%) AWS Lambda
8 1 (0.63%) Azure Data Factory
8 1 (0.63%) GitHub
8 1 (0.63%) IaaS
8 1 (0.63%) NuGet
8 1 (0.63%) OpenShift
8 1 (0.63%) PaaS
8 1 (0.63%) Serverless
Communications & Networking
1 3 (1.88%) HTTP
2 2 (1.25%) 3G
2 2 (1.25%) 4G
2 2 (1.25%) 5G
3 1 (0.63%) DNS
3 1 (0.63%) Firewall
3 1 (0.63%) PuTTY
3 1 (0.63%) SSH
3 1 (0.63%) TCP/IP
3 1 (0.63%) Wireshark
Database & Business Intelligence
1 53 (33.13%) Hadoop
2 21 (13.13%) Data Warehouse
2 21 (13.13%) NoSQL
3 17 (10.63%) Apache Hive
3 17 (10.63%) SQL Server
4 11 (6.88%) Data Lake
5 10 (6.25%) PostgreSQL
5 10 (6.25%) Power BI
6 7 (4.38%) HBase
6 7 (4.38%) MongoDB
6 7 (4.38%) Spark SQL
7 6 (3.75%) Apache Cassandra
7 6 (3.75%) Impala
8 5 (3.13%) Amazon Redshift
9 4 (2.50%) Amazon Athena
9 4 (2.50%) MySQL
9 4 (2.50%) Relational Database
9 4 (2.50%) SQL Server Integration Services
10 3 (1.88%) Amazon RDS
10 3 (1.88%) SQL Server Analysis Services
Development Applications
1 15 (9.38%) Git (software)
2 14 (8.75%) Jenkins
3 8 (5.00%) Team Foundation Server
4 7 (4.38%) Maven
5 5 (3.13%) JIRA
6 4 (2.50%) ERwin
7 3 (1.88%) Cucumber
7 3 (1.88%) Selenium
8 2 (1.25%) SpecFlow
8 2 (1.25%) TeamCity
9 1 (0.63%) Atlassian Bamboo
9 1 (0.63%) Bitbucket
9 1 (0.63%) ER Studio
9 1 (0.63%) FindBugs
9 1 (0.63%) GitLab
9 1 (0.63%) GoCD
9 1 (0.63%) Mercurial
9 1 (0.63%) SonarQube
9 1 (0.63%) Sonatype Nexus
9 1 (0.63%) WiX
General
1 38 (23.75%) Finance
2 16 (10.00%) Banking
3 10 (6.25%) Marketing
4 7 (4.38%) Telecoms
5 6 (3.75%) Front Office
6 5 (3.13%) Retail
7 3 (1.88%) Advertising
7 3 (1.88%) Billing
7 3 (1.88%) Investment Banking
8 2 (1.25%) Manufacturing
8 2 (1.25%) Public Sector
9 1 (0.63%) Financial Institution
9 1 (0.63%) Law
9 1 (0.63%) Multimedia
9 1 (0.63%) Retail Banking
Job Titles
1 37 (23.13%) Data Engineer
2 32 (20.00%) Developer
3 22 (13.75%) Architect
4 18 (11.25%) Analyst
5 13 (8.13%) Python Developer
6 12 (7.50%) Big Data Developer
6 12 (7.50%) Big Data Engineer
6 12 (7.50%) Data Architect
7 11 (6.88%) Business Analyst
8 10 (6.25%) Data Scientist
9 7 (4.38%) Consultant
9 7 (4.38%) Energy Trading Developer
9 7 (4.38%) JavaScript Developer
10 6 (3.75%) Java Developer
11 5 (3.13%) Agile Business Analyst
11 5 (3.13%) Data Business Analyst
11 5 (3.13%) DevOps Engineer
11 5 (3.13%) Python Engineer
12 4 (2.50%) Senior Architect
12 4 (2.50%) Splunk Consultant
Libraries, Frameworks & Software Standards
1 30 (18.75%) Kafka
2 10 (6.25%) .NET
2 10 (6.25%) XML
3 7 (4.38%) PySpark
3 7 (4.38%) REST
3 7 (4.38%) TensorFlow
3 7 (4.38%) Web Services
4 6 (3.75%) JSON
4 6 (3.75%) Spark Streaming
5 5 (3.13%) Pandas
5 5 (3.13%) SciPy
5 5 (3.13%) Spring
6 4 (2.50%) Apache Beam
6 4 (2.50%) HTML
6 4 (2.50%) MLlib
6 4 (2.50%) Node.js
6 4 (2.50%) Regular Expression
7 3 (1.88%) React
7 3 (1.88%) scikit-learn
7 3 (1.88%) SOAP
Miscellaneous
1 25 (15.63%) Analytical Skills
2 18 (11.25%) Data Structures
3 17 (10.63%) Algorithms
4 9 (5.63%) Greenfield Project
5 5 (3.13%) Public Cloud
5 5 (3.13%) User Experience
6 2 (1.25%) Cloud Native
6 2 (1.25%) Data Centre
6 2 (1.25%) Fixed Income
6 2 (1.25%) Hedge funds
6 2 (1.25%) Linux Command Line
6 2 (1.25%) Taxonomies
7 1 (0.63%) Clustering
7 1 (0.63%) Credit Risk
7 1 (0.63%) Grid Computing
7 1 (0.63%) Life Science
7 1 (0.63%) Mobile Banking
7 1 (0.63%) Robotics
7 1 (0.63%) Semantic Web
7 1 (0.63%) Video Conferencing
Operating Systems
1 14 (8.75%) Linux
2 8 (5.00%) Unix
3 2 (1.25%) CentOS
3 2 (1.25%) Red Hat Enterprise Linux
3 2 (1.25%) Windows
4 1 (0.63%) Debian
4 1 (0.63%) Ubuntu
4 1 (0.63%) Windows Server
Processes & Methodologies
1 59 (36.88%) Agile Software Development
2 43 (26.88%) Analytics
3 32 (20.00%) Machine Learning
4 31 (19.38%) Data Science
5 29 (18.13%) DevOps
6 24 (15.00%) ETL
7 22 (13.75%) Scrum
8 20 (12.50%) Computer Science
9 19 (11.88%) Problem-Solving
9 19 (11.88%) Use Case
10 18 (11.25%) Business Intelligence
10 18 (11.25%) Data Modelling
11 17 (10.63%) Open Source
12 14 (8.75%) Artificial Intelligence
12 14 (8.75%) Data Transformation
12 14 (8.75%) Migration
13 13 (8.13%) Data Analytics
13 13 (8.13%) Mentoring
14 12 (7.50%) Data Engineering
14 12 (7.50%) Visualisation
Programming Languages
1 73 (45.63%) Python
2 52 (32.50%) SQL
3 37 (23.13%) Java
4 26 (16.25%) Scala
5 12 (7.50%) JavaScript
6 11 (6.88%) C#
7 9 (5.63%) C++
8 6 (3.75%) R
9 5 (3.13%) Go
9 5 (3.13%) PHP
9 5 (3.13%) Ruby
10 4 (2.50%) Bash Shell
11 3 (1.88%) AWK
11 3 (1.88%) Groovy
11 3 (1.88%) Java 8
11 3 (1.88%) PL/SQL
11 3 (1.88%) sed
12 2 (1.25%) MATLAB
12 2 (1.25%) PowerShell
12 2 (1.25%) T-SQL
Qualifications
1 17 (10.63%) Degree
2 9 (5.63%) Security Cleared
3 8 (5.00%) SC Cleared
4 7 (4.38%) Master's Degree
5 6 (3.75%) PhD
6 5 (3.13%) Computer Science Degree
7 2 (1.25%) ISEB
8 1 (0.63%) DV Cleared
8 1 (0.63%) TOGAF Certification
Quality Assurance & Compliance
1 9 (5.63%) QA
2 3 (1.88%) Data Quality
3 1 (0.63%) Basel III
3 1 (0.63%) IFRS
3 1 (0.63%) IFRS 9
System Software
1 21 (13.13%) Docker
2 3 (1.88%) HDFS
3 1 (0.63%) Active Directory
3 1 (0.63%) Apache ZooKeeper
3 1 (0.63%) Hyper-V
3 1 (0.63%) Virtual Machines
Systems Management
1 22 (13.75%) Kubernetes
2 12 (7.50%) Terraform
3 11 (6.88%) Ansible
4 5 (3.13%) Hadoop YARN
4 5 (3.13%) Opscode Chef
4 5 (3.13%) Puppet
5 4 (2.50%) CFEngine
5 4 (2.50%) HP SiteScope
5 4 (2.50%) Nagios
5 4 (2.50%) SCCM
6 2 (1.25%) Kibana
7 1 (0.63%) Docker Swarm
7 1 (0.63%) Grafana
7 1 (0.63%) ITRS Geneos
7 1 (0.63%) Microsoft Clustering
7 1 (0.63%) Microsoft Data Protection Manager
7 1 (0.63%) Oozie
7 1 (0.63%) SCOM
7 1 (0.63%) SCOrch
7 1 (0.63%) SELinux
Vendors
1 21 (13.13%) Microsoft
2 15 (9.38%) Google
3 10 (6.25%) Cloudera
4 8 (5.00%) Tableau
5 7 (4.38%) Oracle
6 5 (3.13%) Splunk
7 4 (2.50%) Hortonworks
7 4 (2.50%) Informatica
7 4 (2.50%) PeopleSoft
7 4 (2.50%) Talend
8 3 (1.88%) Databricks
8 3 (1.88%) Palantir
8 3 (1.88%) SAP
8 3 (1.88%) StreamSets
8 3 (1.88%) Teradata
9 2 (1.25%) Ab Initio
9 2 (1.25%) Confluent
9 2 (1.25%) MapR
10 1 (0.63%) Salesforce.com
10 1 (0.63%) Vertica