Period
to 14 October 2019

The following table provides summary statistics for contract job vacancies advertised in Central London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 14 October 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
London > Central London
6 months to
14 Oct 2019
Same period 2018 Same period 2017
Rank 57 67 61
Rank change year-on-year +10 -6 +22
Contract jobs citing Big Data 309 323 314
As % of all contract IT jobs advertised in Central London 4.04% 3.58% 3.93%
As % of the Database & Business Intelligence category 15.48% 14.41% 16.12%
Number of daily rates quoted 261 274 265
Central London median daily rate £550 £575 £575
Median daily rate % change year-on-year -4.35% - +4.55%
10th Percentile £425 £413 £425
90th Percentile £710 £700 £725
London median daily rate £575 £550 £550
% change year-on-year +4.55% - -
Number of hourly rates quoted 2 0 0
Central London median hourly rate £46.85 - -
London median hourly rate £42.50 £27.50 -
% change year-on-year +54.55% - -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Central London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Central London
Contract vacancies with a requirement for database or business intelligence skills 1,996 2,242 1,948
As % of all contract IT jobs advertised in Central London 26.12% 24.88% 24.41%
Number of daily rates quoted 1,591 1,771 1,518
Central London median daily rate £525 £525 £513
Median daily rate % change year-on-year - +2.44% +10.81%
10th Percentile £375 £363 £363
90th Percentile £675 £675 £675
London median daily rate £525 £525 £500
% change year-on-year - +5.00% +5.26%
Number of hourly rates quoted 6 14 11
Central London median hourly rate £46.85 £27.25 £27.50
Median hourly rate % change year-on-year +71.92% -0.91% +44.74%
10th Percentile £21.21 £19.50 £20.75
90th Percentile £81.50 £40.66 £33.25
London median hourly rate £33.00 £27.73 £27.16
% change year-on-year +19.00% +2.10% -15.13%

Big Data
Job Vacancy Trend in Central London

Job postings citing Big Data as a percentage of all IT jobs advertised in Central London.

Job vacancy trend for Big Data in Central London

Big Data
Contractor Daily Rate Trend in Central London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in Central London.

Contractor daily rate trend for Big Data in Central London

Big Data
Contractor Daily Rate Histogram in Central London

The daily rate distribution of IT jobs citing Big Data in Central London over the 6 months to 14 October 2019.

Contractor daily rate histogram for Big Data in Central London

Big Data
Contractor Hourly Rate Trend in Central London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in Central London.

Contractor hourly rate trend for Big Data in Central London

Big Data
Contract Job Locations in Central London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the Central London region over the 6 months to 14 October 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
City of London +5 223 £550 -4.35% 88
Southwark +4 41 £525 - 1
City of Westminster -5 5 £550 +29.41%
West End of London +11 1 £365 -33.64%
Camden - 1 £550 -
Big Data
London

For the 6 months to 14 October 2019, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Central London region with a requirement for Big Data.

1 166 (53.72%) Apache Spark
2 141 (45.63%) Python
3 131 (42.39%) Finance
4 129 (41.75%) Hadoop
5 123 (39.81%) SQL
6 116 (37.54%) AWS
7 97 (31.39%) Agile Software Development
8 94 (30.42%) Apache Hive
9 90 (29.13%) Kafka
9 90 (29.13%) Data Science
10 88 (28.48%) Analytics
11 79 (25.57%) Data Modelling
12 74 (23.95%) Machine Learning
12 74 (23.95%) GCP
13 72 (23.30%) Java
14 71 (22.98%) Data Warehouse
15 70 (22.65%) Azure
16 65 (21.04%) DevOps
17 56 (18.12%) Google
18 54 (17.48%) Scala
19 52 (16.83%) Cloudera
20 51 (16.50%) Data Engineering
21 48 (15.53%) Data Lake
22 41 (13.27%) Migration
23 39 (12.62%) Scrum
24 37 (11.97%) ETL
24 37 (11.97%) Docker
25 36 (11.65%) Problem-Solving
26 34 (11.00%) Apache
26 34 (11.00%) SQL Server

Big Data
Co-occurring IT Skills in Central London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 166 (53.72%) Apache Spark
2 34 (11.00%) Apache
3 27 (8.74%) Apache Airflow
4 16 (5.18%) Elasticsearch
5 4 (1.29%) Apache Solr
5 4 (1.29%) SAS
5 4 (1.29%) SharePoint
6 3 (0.97%) Jupyter
6 3 (0.97%) Luigi
7 2 (0.65%) Confluence
8 1 (0.32%) IIS
Applications
1 16 (5.18%) Microsoft Excel
2 6 (1.94%) MS Visio
3 4 (1.29%) Microsoft Project
4 1 (0.32%) Microsoft Office
Business Applications
1 4 (1.29%) Dynamics AX
1 4 (1.29%) Dynamics CRM
1 4 (1.29%) Dynamics NAV
2 1 (0.32%) Cognos Business Intelligence
2 1 (0.32%) Markit EDM
Cloud Services
1 116 (37.54%) AWS
2 74 (23.95%) GCP
3 70 (22.65%) Azure
4 30 (9.71%) Amazon S3
5 24 (7.77%) Amazon EMR
6 15 (4.85%) Serverless
7 14 (4.53%) Power Platform
8 11 (3.56%) AWS Lambda
9 10 (3.24%) Amazon SageMaker
10 9 (2.91%) Amazon Kinesis
10 9 (2.91%) Cloud Computing
11 8 (2.59%) GitHub
12 7 (2.27%) Amazon EC2
13 6 (1.94%) AWS CloudFormation
13 6 (1.94%) Office 365
14 4 (1.29%) Amazon CloudWatch
14 4 (1.29%) Dynamics 365
15 3 (0.97%) Amazon EKS
15 3 (0.97%) AWS CloudTrail
16 2 (0.65%) Amazon ECS
Communications & Networking
1 6 (1.94%) Firewall
2 4 (1.29%) DNS
3 2 (0.65%) Kerberos
4 1 (0.32%) Internet
4 1 (0.32%) NetScaler
4 1 (0.32%) PuTTY
Database & Business Intelligence
1 129 (41.75%) Hadoop
2 94 (30.42%) Apache Hive
3 71 (22.98%) Data Warehouse
4 48 (15.53%) Data Lake
5 34 (11.00%) SQL Server
6 27 (8.74%) Impala
7 24 (7.77%) NoSQL
8 20 (6.47%) OLAP
9 19 (6.15%) Star Schema
10 18 (5.83%) Amazon Redshift
10 18 (5.83%) Enterprise Data Warehouse
11 17 (5.50%) OLAP Cube
11 17 (5.50%) PostgreSQL
12 16 (5.18%) MySQL
13 14 (4.53%) HBase
13 14 (4.53%) Power BI
14 13 (4.21%) MongoDB
14 13 (4.21%) Spark SQL
15 12 (3.88%) Relational Database
16 10 (3.24%) Apache Cassandra
Development Applications
1 27 (8.74%) Jenkins
2 18 (5.83%) Git (software)
3 9 (2.91%) JIRA
4 8 (2.59%) Atlassian Bamboo
5 6 (1.94%) Sonatype Nexus
5 6 (1.94%) TeamCity
6 5 (1.62%) Maven
6 5 (1.62%) Team Foundation Server
7 4 (1.29%) Octopus Deploy
8 3 (0.97%) ERwin
9 2 (0.65%) Bitbucket
9 2 (0.65%) Cucumber
9 2 (0.65%) Hudson
9 2 (0.65%) Jasmine
9 2 (0.65%) JUnit
9 2 (0.65%) Mocha
9 2 (0.65%) RStudio
9 2 (0.65%) SpecFlow
9 2 (0.65%) Visual Studio
9 2 (0.65%) Visual Studio Team System
General
1 131 (42.39%) Finance
2 31 (10.03%) Banking
3 14 (4.53%) Front Office
4 13 (4.21%) Investment Banking
5 8 (2.59%) Advertising
5 8 (2.59%) Retail
6 5 (1.62%) Financial Institution
6 5 (1.62%) Marketing
7 3 (0.97%) Law
7 3 (0.97%) Public Sector
8 2 (0.65%) Games
8 2 (0.65%) Publishing
9 1 (0.32%) Billing
9 1 (0.32%) Environmental Health
9 1 (0.32%) Multimedia
9 1 (0.32%) Pharmaceutical
9 1 (0.32%) Telecoms
Job Titles
1 137 (44.34%) Data Engineer
2 68 (22.01%) Big Data Engineer
3 62 (20.06%) Developer
4 40 (12.94%) Python Engineer
5 28 (9.06%) Architect
6 25 (8.09%) Hadoop Engineer
7 24 (7.77%) Cloud Engineer
8 21 (6.80%) Python Developer
9 20 (6.47%) Data Architect
10 18 (5.83%) Analyst
11 16 (5.18%) Big Data Developer
12 15 (4.85%) DevOps Engineer
13 14 (4.53%) Senior Developer
14 13 (4.21%) AWS Engineer
14 13 (4.21%) Business Analyst
15 11 (3.56%) Java Developer
16 10 (3.24%) JavaScript Developer
17 9 (2.91%) Data Scientist
17 9 (2.91%) Project Manager
18 8 (2.59%) Software Developer
Libraries, Frameworks & Software Standards
1 90 (29.13%) Kafka
2 32 (10.36%) PySpark
3 21 (6.80%) .NET
4 15 (4.85%) scikit-learn
5 14 (4.53%) React
5 14 (4.53%) Web Services
6 13 (4.21%) Spring
7 12 (3.88%) Play Framework
8 10 (3.24%) MLlib
8 10 (3.24%) XML
9 8 (2.59%) JSON
9 8 (2.59%) REST
10 7 (2.27%) AngularJS
10 7 (2.27%) TensorFlow
11 6 (1.94%) Apache NiFi
11 6 (1.94%) HTML
11 6 (1.94%) HTML5
11 6 (1.94%) Spark Streaming
11 6 (1.94%) Spring Boot
12 5 (1.62%) CSS
Miscellaneous
1 33 (10.68%) Data Structures
2 28 (9.06%) Algorithms
2 28 (9.06%) Analytical Skills
3 24 (7.77%) Greenfield Project
4 9 (2.91%) User Experience
5 8 (2.59%) Cloud Native
6 7 (2.27%) Social Media
7 5 (1.62%) Foreign Exchange (FX)
7 5 (1.62%) Public Cloud
8 4 (1.29%) Fixed Income
8 4 (1.29%) Market Risk
9 3 (0.97%) Equities
9 3 (0.97%) Hedge funds
10 2 (0.65%) Data Centre
10 2 (0.65%) Industry 4.0
10 2 (0.65%) Life Science
10 2 (0.65%) Robotics
10 2 (0.65%) Self-Motivation
11 1 (0.32%) Linux Command Line
11 1 (0.32%) Virtual Team
Operating Systems
1 22 (7.12%) Linux
2 14 (4.53%) Unix
3 9 (2.91%) Windows
4 3 (0.97%) CentOS
5 2 (0.65%) Red Hat Enterprise Linux
6 1 (0.32%) Solaris
6 1 (0.32%) Ubuntu
6 1 (0.32%) Windows Server
Processes & Methodologies
1 97 (31.39%) Agile Software Development
2 90 (29.13%) Data Science
3 88 (28.48%) Analytics
4 79 (25.57%) Data Modelling
5 74 (23.95%) Machine Learning
6 65 (21.04%) DevOps
7 51 (16.50%) Data Engineering
8 41 (13.27%) Migration
9 39 (12.62%) Scrum
10 37 (11.97%) ETL
11 36 (11.65%) Problem-Solving
12 34 (11.00%) Artificial Intelligence
13 32 (10.36%) Business Intelligence
13 32 (10.36%) Mentoring
14 28 (9.06%) Data Analysis
15 27 (8.74%) Data Migration
15 27 (8.74%) SDLC
16 25 (8.09%) Coaching
16 25 (8.09%) Data Cleansing
17 24 (7.77%) Microservices
Programming Languages
1 141 (45.63%) Python
2 123 (39.81%) SQL
3 72 (23.30%) Java
4 54 (17.48%) Scala
5 24 (7.77%) C#
6 19 (6.15%) JavaScript
7 13 (4.21%) R
8 11 (3.56%) C++
9 9 (2.91%) Go
10 7 (2.27%) Shell Script
11 6 (1.94%) TypeScript
12 5 (1.62%) Bash Shell
12 5 (1.62%) ES6
12 5 (1.62%) MATLAB
13 4 (1.29%) Clojure
14 3 (0.97%) Java 8
14 3 (0.97%) Kotlin
14 3 (0.97%) PL/SQL
15 2 (0.65%) JSX
15 2 (0.65%) sed
Qualifications
1 15 (4.85%) Degree
1 15 (4.85%) PMI Certification
1 15 (4.85%) PMP
2 10 (3.24%) Security Cleared
3 6 (1.94%) SC Cleared
4 4 (1.29%) Computer Science Degree
4 4 (1.29%) DV Cleared
5 3 (0.97%) Master's Degree
5 3 (0.97%) PhD
6 1 (0.32%) AWS Certification
6 1 (0.32%) CCA
6 1 (0.32%) CEH
6 1 (0.32%) CISSP
6 1 (0.32%) ISEB
6 1 (0.32%) Numerate Degree
6 1 (0.32%) PRINCE2 Certification
6 1 (0.32%) RHCE
Quality Assurance & Compliance
1 25 (8.09%) Data Quality
2 5 (1.62%) GDPR
3 4 (1.29%) QA
4 1 (0.32%) SLA
System Software
1 37 (11.97%) Docker
2 20 (6.47%) Apache Flume
3 10 (3.24%) HDFS
4 2 (0.65%) Active Directory
4 2 (0.65%) Samba
4 2 (0.65%) VMware ESXi
4 2 (0.65%) VMware Infrastructure
4 2 (0.65%) XenApp
5 1 (0.32%) Apache ZooKeeper
5 1 (0.32%) Hyper-V
5 1 (0.32%) Microsoft App-V
5 1 (0.32%) Virtual Desktop
5 1 (0.32%) XenDesktop
Systems Management
1 25 (8.09%) Kubernetes
2 24 (7.77%) Ansible
3 21 (6.80%) Terraform
4 18 (5.83%) Oozie
5 14 (4.53%) Hadoop YARN
6 5 (1.62%) Opscode Chef
7 3 (0.97%) Kibana
7 3 (0.97%) Puppet
8 2 (0.65%) Ambari
8 2 (0.65%) Docker Swarm
8 2 (0.65%) Grafana
9 1 (0.32%) Istio
9 1 (0.32%) ITRS Geneos
9 1 (0.32%) Microsoft Clustering
9 1 (0.32%) Microsoft Intune
9 1 (0.32%) Prometheus
9 1 (0.32%) SCCM
9 1 (0.32%) Suricata
Vendors
1 56 (18.12%) Google
2 52 (16.83%) Cloudera
3 31 (10.03%) Oracle
4 23 (7.44%) Talend
5 22 (7.12%) Informatica
6 21 (6.80%) Microsoft
7 15 (4.85%) Tableau
8 6 (1.94%) Hortonworks
9 5 (1.62%) Teradata
10 3 (0.97%) Databricks
10 3 (0.97%) Red Hat
10 3 (0.97%) StreamSets
11 2 (0.65%) Ab Initio
11 2 (0.65%) Citrix
11 2 (0.65%) Dataiku
11 2 (0.65%) Splunk
11 2 (0.65%) VMware
12 1 (0.32%) Casewise
12 1 (0.32%) Palantir
12 1 (0.32%) Vertica