Period
to 26 June 2019

The following table provides summary statistics for contract job vacancies advertised in Central London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 26 June 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
London > Central London
6 months to
26 Jun 2019
Same period 2018 Same period 2017
Rank 40 63 59
Rank change year-on-year +23 -4 +38
Contract jobs citing Big Data 441 361 285
As % of all contract IT jobs advertised in Central London 5.22% 3.96% 3.84%
As % of the Database & Business Intelligence category 20.05% 15.72% 15.02%
Number of daily rates quoted 374 307 238
Central London median daily rate £550 £550 £550
10th Percentile £454 £425 £392
90th Percentile £688 £693 £723
London median daily rate £575 £550 £550
% change year-on-year +4.55% - -
Number of hourly rates quoted 2 0 0
Central London median hourly rate £46.85 - -
London median hourly rate £42.50 £27.50 £40.00
% change year-on-year +54.55% -31.25% +64.95%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in Central London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
Central London
Contract vacancies with a requirement for database or business intelligence skills 2,199 2,297 1,898
As % of all contract IT jobs advertised in Central London 26.02% 25.18% 25.59%
Number of daily rates quoted 1,715 1,843 1,470
Central London median daily rate £525 £525 £500
Median daily rate % change year-on-year - +5.00% +5.26%
10th Percentile £388 £363 £325
90th Percentile £675 £675 £650
London median daily rate £525 £513 £500
% change year-on-year +2.44% +2.50% +5.26%
Number of hourly rates quoted 14 13 3
Central London median hourly rate £35.00 £30.00 £21.50
Median hourly rate % change year-on-year +16.67% +39.53% +13.16%
10th Percentile £20.00 £21.00 £20.75
90th Percentile £56.50 £37.60 £22.85
London median hourly rate £35.00 £31.00 £30.50
% change year-on-year +12.90% +1.64% +10.91%

Big Data
Job Vacancy Trend in Central London

Job postings citing Big Data as a percentage of all IT jobs advertised in Central London.

Job vacancy trend for Big Data in Central London

Big Data
Contractor Daily Rate Trend in Central London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in Central London.

Contractor daily rate trend for Big Data in Central London

Big Data
Contractor Daily Rate Histogram in Central London

The daily rate distribution of IT jobs citing Big Data in Central London over the 6 months to 26 June 2019.

Contractor daily rate histogram for Big Data in Central London

Big Data
Contractor Hourly Rate Trend in Central London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in Central London.

Contractor hourly rate trend for Big Data in Central London

Big Data
Contract Job Locations in Central London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the Central London region over the 6 months to 26 June 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
City of London +30 327 £550 -4.35% 50
Southwark +4 89 £525 -
City of Westminster -12 10 £600 +45.45%
West End of London -3 8 £575 +12.20%
Big Data
London

For the 6 months to 26 June 2019, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Central London region with a requirement for Big Data.

1 247 (56.01%) Apache Spark
2 205 (46.49%) Finance
3 196 (44.44%) Python
4 172 (39.00%) Hadoop
5 164 (37.19%) Amazon AWS
6 161 (36.51%) SQL
7 146 (33.11%) Data Science
8 136 (30.84%) Kafka
9 131 (29.71%) Apache Hive
10 128 (29.02%) Analytics
11 126 (28.57%) Data Modelling
12 123 (27.89%) Agile Software Development
13 117 (26.53%) Data Warehouse
14 113 (25.62%) Microsoft Azure
15 104 (23.58%) Machine Learning
16 98 (22.22%) Google Cloud Platform
17 96 (21.77%) Java
18 94 (21.32%) Google
19 84 (19.05%) DevOps
20 82 (18.59%) Data Engineering
21 70 (15.87%) Apache
22 63 (14.29%) PySpark
23 58 (13.15%) Scrum
24 57 (12.93%) Data Cleansing
24 57 (12.93%) Apache Airflow
25 56 (12.70%) Coaching
26 55 (12.47%) Cloudera
27 54 (12.24%) Mentoring
27 54 (12.24%) Data Lake
28 52 (11.79%) Data Quality

Big Data
Co-occurring IT Skills in Central London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 247 (56.01%) Apache Spark
2 70 (15.87%) Apache
3 57 (12.93%) Apache Airflow
4 13 (2.95%) Elasticsearch
5 7 (1.59%) Apache Solr
6 6 (1.36%) Confluence
7 5 (1.13%) Pachyderm
8 4 (0.91%) IIS
9 3 (0.68%) Exchange Server 2013
9 3 (0.68%) SharePoint
9 3 (0.68%) Skype for Business
10 2 (0.45%) Apache Pig
10 2 (0.45%) SAS
11 1 (0.23%) Cloud Foundry
11 1 (0.23%) CMS
11 1 (0.23%) JBoss
11 1 (0.23%) OpenStack
11 1 (0.23%) Oracle Workflow
11 1 (0.23%) WebLogic
11 1 (0.23%) WebSphere
Applications
1 21 (4.76%) Microsoft Excel
2 4 (0.91%) Microsoft Office
3 1 (0.23%) Chatbot
Business Applications
1 7 (1.59%) SAP Oil and Gas
2 4 (0.91%) Dynamics CRM
3 3 (0.68%) Dynamics AX
3 3 (0.68%) Dynamics NAV
4 2 (0.45%) SAP ERP
4 2 (0.45%) SAP S/4HANA
5 1 (0.23%) Distributed Ledger
5 1 (0.23%) Markit EDM
5 1 (0.23%) Oracle BPM
Cloud Services
1 164 (37.19%) Amazon AWS
2 113 (25.62%) Microsoft Azure
3 98 (22.22%) Google Cloud Platform
4 25 (5.67%) Amazon S3
5 19 (4.31%) Amazon EMR
6 18 (4.08%) Serverless
7 15 (3.40%) Power Platform
8 13 (2.95%) Amazon EC2
8 13 (2.95%) Amazon Kinesis
9 11 (2.49%) Amazon SageMaker
9 11 (2.49%) GitHub
9 11 (2.49%) Heroku
10 9 (2.04%) AWS CloudFormation
10 9 (2.04%) Office 365
11 8 (1.81%) Amazon CloudWatch
11 8 (1.81%) Cloud Computing
12 7 (1.59%) Amazon SQS
12 7 (1.59%) AWS CloudTrail
12 7 (1.59%) AWS Lambda
12 7 (1.59%) Virtual Private Cloud
Communications & Networking
1 8 (1.81%) Firewall
2 6 (1.36%) HTTP
3 4 (0.91%) DNS
4 3 (0.68%) Fibre Channel
4 3 (0.68%) Internet
4 3 (0.68%) iSCSI
4 3 (0.68%) Kerberos
4 3 (0.68%) SAN
5 2 (0.45%) Cisco Nexus
5 2 (0.45%) FTP
5 2 (0.45%) SSL
5 2 (0.45%) TCP/IP
6 1 (0.23%) BGP
6 1 (0.23%) Cisco ASA
6 1 (0.23%) Cisco Firepower
6 1 (0.23%) EIGRP
6 1 (0.23%) OSPF
6 1 (0.23%) Sourcefire
6 1 (0.23%) VLAN
6 1 (0.23%) Wi-Fi
Database & Business Intelligence
1 172 (39.00%) Hadoop
2 131 (29.71%) Apache Hive
3 117 (26.53%) Data Warehouse
4 54 (12.24%) Data Lake
5 50 (11.34%) Star Schema
6 45 (10.20%) OLAP
7 44 (9.98%) Enterprise Data Warehouse
8 42 (9.52%) SQL Server
9 41 (9.30%) OLAP Cube
10 32 (7.26%) NoSQL
11 31 (7.03%) Impala
12 24 (5.44%) HBase
12 24 (5.44%) MongoDB
13 23 (5.22%) MySQL
14 20 (4.54%) Amazon Redshift
14 20 (4.54%) PostgreSQL
15 18 (4.08%) Apache Cassandra
16 15 (3.40%) Power BI
17 14 (3.17%) Relational Database
18 13 (2.95%) BigQuery
Development Applications
1 42 (9.52%) Jenkins
2 31 (7.03%) Git (software)
3 14 (3.17%) Atlassian Bamboo
4 12 (2.72%) Sonatype Nexus
5 11 (2.49%) JIRA
5 11 (2.49%) TeamCity
6 9 (2.04%) CircleCI
6 9 (2.04%) Octopus Deploy
7 7 (1.59%) Visual Studio Team System
8 6 (1.36%) Babel
8 6 (1.36%) Jasmine
8 6 (1.36%) Mocha
8 6 (1.36%) Subversion
8 6 (1.36%) webpack
9 4 (0.91%) ERwin
9 4 (0.91%) FishEye
9 4 (0.91%) GitLab
9 4 (0.91%) SonarQube
9 4 (0.91%) SpecFlow
9 4 (0.91%) WiX
General
1 205 (46.49%) Finance
2 37 (8.39%) Banking
3 14 (3.17%) Retail
4 12 (2.72%) Investment Banking
5 11 (2.49%) Front Office
6 6 (1.36%) Law
7 4 (0.91%) Financial Institution
7 4 (0.91%) Pharmaceutical
7 4 (0.91%) Telecoms
8 3 (0.68%) Advertising
8 3 (0.68%) Manufacturing
8 3 (0.68%) Marketing
9 2 (0.45%) Back Office
9 2 (0.45%) Electronics
9 2 (0.45%) Games
9 2 (0.45%) Publishing
10 1 (0.23%) General Ledger
Job Titles
1 205 (46.49%) Data Engineer
2 116 (26.30%) Big Data Engineer
3 93 (21.09%) Developer
4 85 (19.27%) Python Engineer
5 47 (10.66%) Hadoop Engineer
6 29 (6.58%) Architect
7 26 (5.90%) Cloud Engineer
8 23 (5.22%) DevOps Engineer
8 23 (5.22%) Java Developer
9 20 (4.54%) Python Developer
10 19 (4.31%) Data Architect
11 18 (4.08%) Big Data Developer
11 18 (4.08%) Senior Developer
12 13 (2.95%) AWS Engineer
12 13 (2.95%) Data Scientist
12 13 (2.95%) Software Developer
13 12 (2.72%) SQL Developer
14 10 (2.27%) Project Manager
15 9 (2.04%) Big Data Architect
15 9 (2.04%) Consultant
Libraries, Frameworks & Software Standards
1 136 (30.84%) Kafka
2 63 (14.29%) PySpark
3 28 (6.35%) .NET
4 18 (4.08%) HTML
5 16 (3.63%) React
5 16 (3.63%) REST
5 16 (3.63%) scikit-learn
6 15 (3.40%) Apache NiFi
7 14 (3.17%) JSON
8 13 (2.95%) CSS
8 13 (2.95%) Spring
9 11 (2.49%) Play Framework
9 11 (2.49%) Web Services
9 11 (2.49%) XML
10 10 (2.27%) MLlib
10 10 (2.27%) OAuth
10 10 (2.27%) Pandas
11 9 (2.04%) Natural Language Processing
11 9 (2.04%) Node.js
11 9 (2.04%) RESTful
Miscellaneous
1 34 (7.71%) Analytical Skills
2 26 (5.90%) Algorithms
3 24 (5.44%) Data Structures
4 23 (5.22%) Greenfield Project
5 12 (2.72%) User Experience
6 10 (2.27%) Social Media
7 9 (2.04%) Hedge funds
8 7 (1.59%) Self-Motivation
9 5 (1.13%) Enterprise Software
9 5 (1.13%) Virtual Team
10 4 (0.91%) Clustering
10 4 (0.91%) Data Protection Act
10 4 (0.91%) Foreign Exchange (FX)
10 4 (0.91%) Life Science
10 4 (0.91%) Market Risk
10 4 (0.91%) Public Cloud
11 3 (0.68%) Cloud Native
11 3 (0.68%) Management Information System
12 2 (0.45%) Data Centre
12 2 (0.45%) Industry 4.0
Operating Systems
1 37 (8.39%) Linux
2 20 (4.54%) Windows
3 11 (2.49%) Unix
4 5 (1.13%) Windows Server
5 3 (0.68%) CentOS
6 2 (0.45%) Red Hat Enterprise Linux
7 1 (0.23%) Android
7 1 (0.23%) Apple iOS
7 1 (0.23%) Solaris
7 1 (0.23%) Ubuntu
Processes & Methodologies
1 146 (33.11%) Data Science
2 128 (29.02%) Analytics
3 126 (28.57%) Data Modelling
4 123 (27.89%) Agile Software Development
5 104 (23.58%) Machine Learning
6 84 (19.05%) DevOps
7 82 (18.59%) Data Engineering
8 58 (13.15%) Scrum
9 57 (12.93%) Data Cleansing
10 56 (12.70%) Coaching
11 54 (12.24%) Mentoring
12 51 (11.56%) Migration
13 45 (10.20%) ETL
14 42 (9.52%) Business Intelligence
15 41 (9.30%) SQL Optimisation
16 39 (8.84%) Artificial Intelligence
17 33 (7.48%) Problem-Solving
18 32 (7.26%) Microservices
19 31 (7.03%) SDLC
20 30 (6.80%) Data Analysis
Programming Languages
1 196 (44.44%) Python
2 161 (36.51%) SQL
3 96 (21.77%) Java
4 49 (11.11%) Scala
5 30 (6.80%) JavaScript
6 29 (6.58%) C#
7 17 (3.85%) Bash Shell
8 14 (3.17%) Java 8
8 14 (3.17%) R
9 13 (2.95%) ES6
10 12 (2.72%) Shell Script
11 10 (2.27%) PowerShell
12 9 (2.04%) T-SQL
13 7 (1.59%) TypeScript
14 6 (1.36%) C++
14 6 (1.36%) Go
14 6 (1.36%) JSX
14 6 (1.36%) Perl
15 5 (1.13%) PHP
15 5 (1.13%) Ruby
Qualifications
1 34 (7.71%) Security Cleared
2 20 (4.54%) PMI Certification
2 20 (4.54%) PMP
2 20 (4.54%) SC Cleared
3 15 (3.40%) Degree
4 14 (3.17%) DV Cleared
5 3 (0.68%) CTC Cleared
6 2 (0.45%) Computer Science Degree
6 2 (0.45%) Master's Degree
6 2 (0.45%) Numerate Degree
6 2 (0.45%) PhD
6 2 (0.45%) PRINCE2 Certification
7 1 (0.23%) AWS Certification
7 1 (0.23%) CCA
7 1 (0.23%) CEH
7 1 (0.23%) Cisco Certification
7 1 (0.23%) CISSP
7 1 (0.23%) Postgraduate
7 1 (0.23%) RHCE
Quality Assurance & Compliance
1 52 (11.79%) Data Quality
2 7 (1.59%) GDPR
3 1 (0.23%) QA
System Software
1 49 (11.11%) Docker
2 33 (7.48%) Apache Flume
3 11 (2.49%) HDFS
4 6 (1.36%) Oracle RAC
5 4 (0.91%) Active Directory
5 4 (0.91%) Hyper-V
5 4 (0.91%) XenApp
6 3 (0.68%) Virtual Machines
7 2 (0.45%) Samba
7 2 (0.45%) VMware ESXi
7 2 (0.45%) VMware Infrastructure
Systems Management
1 42 (9.52%) Oozie
2 35 (7.94%) Kubernetes
3 33 (7.48%) Ansible
4 18 (4.08%) Terraform
5 11 (2.49%) Hadoop YARN
6 6 (1.36%) Kubeflow
6 6 (1.36%) Puppet
7 4 (0.91%) Microsoft Clustering
8 3 (0.68%) Docker Swarm
8 3 (0.68%) Microsoft Data Protection Manager
8 3 (0.68%) Opscode Chef
8 3 (0.68%) QRadar
8 3 (0.68%) SCOM
8 3 (0.68%) SCOrch
8 3 (0.68%) Symantec Enterprise Vault
9 2 (0.45%) Ambari
10 1 (0.23%) Cacti
10 1 (0.23%) EMC NetWorker
10 1 (0.23%) Kibana
10 1 (0.23%) Tivoli
Vendors
1 94 (21.32%) Google
2 55 (12.47%) Cloudera
3 48 (10.88%) Oracle
4 35 (7.94%) Talend
5 29 (6.58%) Microsoft
6 28 (6.35%) Informatica
7 18 (4.08%) Tableau
8 9 (2.04%) SAP
9 8 (1.81%) Hortonworks
10 7 (1.59%) Databricks
10 7 (1.59%) Splunk
11 6 (1.36%) Alteryx
12 5 (1.13%) IBM
12 5 (1.13%) Teradata
13 4 (0.91%) Citrix
13 4 (0.91%) Sonatype
13 4 (0.91%) StreamSets
14 3 (0.68%) F5
14 3 (0.68%) Symantec
14 3 (0.68%) VMware