Period
to 26 April 2019

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 26 April 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
Central London > City of London
6 months to
26 Apr 2019
Same period 2018 Same period 2017
Rank 42 75 44
Rank change year-on-year +33 -31 +38
Contract jobs citing Big Data 317 229 278
As % of all contract IT jobs advertised in the City of London 4.78% 3.27% 4.56%
As % of the Database & Business Intelligence category 18.53% 13.17% 16.34%
Number of daily rates quoted 265 190 232
City of London median daily rate £550 £575 £550
Median daily rate % change year-on-year -4.35% +4.55% +4.76%
10th Percentile £452 £463 £400
90th Percentile £713 £689 £699
Central London median daily rate £550 £550 £550
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1,711 1,739 1,701
As % of all contract IT jobs advertised in the City of London 25.82% 24.86% 27.89%
Number of daily rates quoted 1,355 1,465 1,355
City of London median daily rate £538 £513 £488
Median daily rate % change year-on-year +4.88% +5.13% +2.63%
10th Percentile £406 £363 £325
90th Percentile £675 £675 £644
Central London median daily rate £525 £513 £475
% change year-on-year +2.44% +7.89% -
Number of hourly rates quoted 8 9 1
City of London median hourly rate £35.00 £22.50 £22.34
Median hourly rate % change year-on-year +55.56% +0.74% +17.55%
10th Percentile £29.43 £20.06 £21.67
90th Percentile £57.78 £40.81 £23.00
Central London median hourly rate £35.00 £30.00 £22.34
% change year-on-year +16.67% +34.32% +17.55%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the City of London.

Contractor daily rate trend for Big Data in the City of London

Big Data
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Big Data in the City of London over the 6 months to 26 April 2019.

Contractor daily rate histogram for Big Data in the City of London

Big Data
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the City of London region over the 6 months to 26 April 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge +6 82 £550 +22.22%
Big Data
Central London

For the 6 months to 26 April 2019, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Big Data.

1 168 (53.00%) Apache Spark
2 144 (45.43%) Finance
3 131 (41.32%) Hadoop
4 123 (38.80%) Python
5 117 (36.91%) SQL
5 117 (36.91%) Data Science
6 112 (35.33%) Amazon AWS
6 112 (35.33%) Analytics
7 101 (31.86%) Kafka
8 85 (26.81%) Microsoft Azure
9 84 (26.50%) Machine Learning
9 84 (26.50%) Data Modelling
10 81 (25.55%) Apache Hive
11 77 (24.29%) Data Warehouse
12 75 (23.66%) Agile Software Development
13 62 (19.56%) Java
14 61 (19.24%) Google Cloud Platform
15 56 (17.67%) Google
16 55 (17.35%) Data Engineering
17 53 (16.72%) Star Schema
18 48 (15.14%) Apache
18 48 (15.14%) Data Quality
19 47 (14.83%) OLAP
20 45 (14.20%) PySpark
21 43 (13.56%) SQL Optimisation
21 43 (13.56%) Apache Airflow
21 43 (13.56%) Enterprise Data Warehouse
21 43 (13.56%) OLAP Cube
21 43 (13.56%) Coaching
21 43 (13.56%) Oozie

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 168 (53.00%) Apache Spark
2 48 (15.14%) Apache
3 43 (13.56%) Apache Airflow
4 14 (4.42%) Elasticsearch
5 11 (3.47%) Confluence
6 4 (1.26%) Apache Pig
6 4 (1.26%) Cloud Foundry
7 3 (0.95%) Apache Solr
7 3 (0.95%) Exchange Server 2013
7 3 (0.95%) IIS
7 3 (0.95%) Skype for Business
8 2 (0.63%) SAS
9 1 (0.32%) CMS
9 1 (0.32%) JBoss
9 1 (0.32%) Jupyter
9 1 (0.32%) OpenStack
9 1 (0.32%) Oracle Workflow
9 1 (0.32%) WebLogic
9 1 (0.32%) WebSphere
Applications
1 4 (1.26%) Microsoft Office
2 2 (0.63%) Microsoft Excel
3 1 (0.32%) Chatbot
Business Applications
1 2 (0.63%) SAP ERP
1 2 (0.63%) SAP Oil and Gas
1 2 (0.63%) SAP S/4HANA
2 1 (0.32%) Actimize
2 1 (0.32%) Distributed Ledger
2 1 (0.32%) Dynamics CRM
2 1 (0.32%) Dynamics NAV
2 1 (0.32%) Oracle BPM
2 1 (0.32%) SAP MDG
Cloud Services
1 112 (35.33%) Amazon AWS
2 85 (26.81%) Microsoft Azure
3 61 (19.24%) Google Cloud Platform
4 19 (5.99%) Serverless
5 18 (5.68%) Heroku
6 13 (4.10%) Amazon EMR
7 11 (3.47%) Amazon Kinesis
7 11 (3.47%) Amazon S3
8 6 (1.89%) Datadog
8 6 (1.89%) GitHub
9 5 (1.58%) Azure Data Factory
9 5 (1.58%) Office 365
10 4 (1.26%) AWS Lambda
10 4 (1.26%) IaaS
10 4 (1.26%) IBM Cloud
11 3 (0.95%) Amazon EC2
11 3 (0.95%) Azure Functions
11 3 (0.95%) Cloud Computing
11 3 (0.95%) Data Lake Analytics
11 3 (0.95%) PaaS
Communications & Networking
1 18 (5.68%) HTTP
2 9 (2.84%) DNS
3 8 (2.52%) FTP
3 8 (2.52%) SSL
3 8 (2.52%) TCP/IP
4 5 (1.58%) Firewall
5 3 (0.95%) Fibre Channel
5 3 (0.95%) iSCSI
5 3 (0.95%) SAN
6 2 (0.63%) Cisco Nexus
6 2 (0.63%) Kerberos
7 1 (0.32%) BGP
7 1 (0.32%) Cisco ASA
7 1 (0.32%) Cisco Firepower
7 1 (0.32%) EIGRP
7 1 (0.32%) Internet
7 1 (0.32%) OSPF
7 1 (0.32%) Sourcefire
7 1 (0.32%) VLAN
7 1 (0.32%) Wi-Fi
Database & Business Intelligence
1 131 (41.32%) Hadoop
2 81 (25.55%) Apache Hive
3 77 (24.29%) Data Warehouse
4 53 (16.72%) Star Schema
5 47 (14.83%) OLAP
6 43 (13.56%) Enterprise Data Warehouse
6 43 (13.56%) OLAP Cube
7 31 (9.78%) NoSQL
8 26 (8.20%) Data Lake
8 26 (8.20%) MongoDB
9 21 (6.62%) SQL Server
10 20 (6.31%) HBase
10 20 (6.31%) MySQL
11 18 (5.68%) PostgreSQL
12 17 (5.36%) Apache Cassandra
13 14 (4.42%) Power BI
14 12 (3.79%) Blockchain
15 11 (3.47%) Impala
16 10 (3.15%) Amazon Redshift
16 10 (3.15%) SQL Server Integration Services
Development Applications
1 39 (12.30%) Git (software)
2 30 (9.46%) Jenkins
3 14 (4.42%) Sonatype Nexus
4 13 (4.10%) JIRA
5 10 (3.15%) CircleCI
6 9 (2.84%) Atlassian Bamboo
6 9 (2.84%) Babel
6 9 (2.84%) Jasmine
6 9 (2.84%) Mocha
6 9 (2.84%) webpack
7 8 (2.52%) GitLab
7 8 (2.52%) Gradle
7 8 (2.52%) gulp
7 8 (2.52%) Subversion
7 8 (2.52%) Visual Studio Team System
8 7 (2.21%) TeamCity
9 6 (1.89%) FishEye
9 6 (1.89%) Octopus Deploy
9 6 (1.89%) SonarQube
10 4 (1.26%) ERwin
General
1 144 (45.43%) Finance
2 25 (7.89%) Banking
3 22 (6.94%) Retail
4 7 (2.21%) Front Office
5 5 (1.58%) Investment Banking
6 4 (1.26%) Financial Institution
6 4 (1.26%) Marketing
7 3 (0.95%) Law
7 3 (0.95%) Pharmaceutical
8 2 (0.63%) Back Office
8 2 (0.63%) Telecoms
9 1 (0.32%) Legal
9 1 (0.32%) Manufacturing
9 1 (0.32%) Retail Banking
Job Titles
1 117 (36.91%) Data Engineer
2 72 (22.71%) Developer
3 59 (18.61%) Big Data Engineer
4 49 (15.46%) Python Engineer
5 45 (14.20%) Hadoop Engineer
6 26 (8.20%) Architect
7 21 (6.62%) Data Scientist
8 20 (6.31%) Java Developer
9 18 (5.68%) Data Architect
10 15 (4.73%) Python Developer
10 15 (4.73%) Senior Developer
11 14 (4.42%) DevOps Engineer
11 14 (4.42%) Technical Leader
12 13 (4.10%) Big Data Developer
13 12 (3.79%) Senior Java Developer
14 10 (3.15%) JavaScript Developer
14 10 (3.15%) React Developer
15 9 (2.84%) Big Data Architect
16 8 (2.52%) SQL Developer
17 7 (2.21%) Data Modeller
Libraries, Frameworks & Software Standards
1 101 (31.86%) Kafka
2 45 (14.20%) PySpark
3 27 (8.52%) HTML
4 24 (7.57%) OAuth
5 22 (6.94%) OAuth2
6 19 (5.99%) CSS
7 16 (5.05%) OpenID
8 15 (4.73%) Spring
9 13 (4.10%) Node.js
9 13 (4.10%) React
9 13 (4.10%) REST
9 13 (4.10%) RESTful
10 12 (3.79%) JSON
10 12 (3.79%) Spring Boot
11 11 (3.47%) AngularJS
11 11 (3.47%) GraphQL
11 11 (3.47%) HTML5
11 11 (3.47%) Natural Language Processing
12 10 (3.15%) SOAP
13 9 (2.84%) JSLint
Miscellaneous
1 27 (8.52%) Analytical Skills
2 19 (5.99%) Algorithms
3 17 (5.36%) Fintech
4 12 (3.79%) Data Structures
4 12 (3.79%) User Experience
5 9 (2.84%) Greenfield Project
6 7 (2.21%) Self-Motivation
7 5 (1.58%) Enterprise Software
8 4 (1.26%) Hedge funds
8 4 (1.26%) iPad
9 3 (0.95%) Clustering
9 3 (0.95%) Foreign Exchange (FX)
9 3 (0.95%) Management Information System
9 3 (0.95%) Public Cloud
9 3 (0.95%) Social Media
9 3 (0.95%) Virtual Team
10 2 (0.63%) Credit Risk
10 2 (0.63%) Market Risk
10 2 (0.63%) Robotics
11 1 (0.32%) Reference Data
Operating Systems
1 26 (8.20%) Linux
2 13 (4.10%) Windows
3 6 (1.89%) Unix
4 4 (1.26%) Windows Server
Processes & Methodologies
1 117 (36.91%) Data Science
2 112 (35.33%) Analytics
3 84 (26.50%) Data Modelling
3 84 (26.50%) Machine Learning
4 75 (23.66%) Agile Software Development
5 55 (17.35%) Data Engineering
6 43 (13.56%) Coaching
6 43 (13.56%) DevOps
6 43 (13.56%) SQL Optimisation
7 42 (13.25%) Data Cleansing
8 41 (12.93%) Mentoring
9 36 (11.36%) Scrum
10 35 (11.04%) Business Intelligence
11 23 (7.26%) Artificial Intelligence
11 23 (7.26%) ETL
12 22 (6.94%) Problem-Solving
13 21 (6.62%) Microservices
14 20 (6.31%) Data Analysis
15 18 (5.68%) Computer Science
15 18 (5.68%) Migration
Programming Languages
1 123 (38.80%) Python
2 117 (36.91%) SQL
3 62 (19.56%) Java
4 35 (11.04%) JavaScript
5 29 (9.15%) Scala
6 21 (6.62%) ES6
7 18 (5.68%) Java 8
8 16 (5.05%) Bash Shell
9 15 (4.73%) R
10 11 (3.47%) PowerShell
10 11 (3.47%) T-SQL
11 10 (3.15%) JSX
11 10 (3.15%) Shell Script
12 9 (2.84%) TypeScript
13 8 (2.52%) C#
14 6 (1.89%) PHP
14 6 (1.89%) PL/SQL
15 4 (1.26%) Groovy
16 3 (0.95%) Kotlin
16 3 (0.95%) VB
Qualifications
1 20 (6.31%) Degree
2 9 (2.84%) Master's Degree
3 6 (1.89%) SC Cleared
3 6 (1.89%) Security Cleared
4 3 (0.95%) Computer Science Degree
4 3 (0.95%) PhD
5 2 (0.63%) PMI Certification
5 2 (0.63%) PMP
6 1 (0.32%) Cisco Certification
6 1 (0.32%) Numerate Degree
6 1 (0.32%) Postgraduate
Quality Assurance & Compliance
1 48 (15.14%) Data Quality
2 2 (0.63%) GDPR
3 1 (0.32%) QA
System Software
1 33 (10.41%) Docker
2 11 (3.47%) Apache Flume
2 11 (3.47%) HDFS
3 7 (2.21%) Oracle RAC
4 3 (0.95%) Active Directory
4 3 (0.95%) Hyper-V
4 3 (0.95%) Virtual Machines
4 3 (0.95%) XenApp
Systems Management
1 43 (13.56%) Oozie
2 21 (6.62%) Ansible
2 21 (6.62%) Kubernetes
3 12 (3.79%) Terraform
4 8 (2.52%) Docker Swarm
5 4 (1.26%) Hadoop YARN
6 3 (0.95%) Microsoft Clustering
6 3 (0.95%) Microsoft Data Protection Manager
6 3 (0.95%) Puppet
6 3 (0.95%) QRadar
6 3 (0.95%) SCOM
6 3 (0.95%) SCOrch
6 3 (0.95%) Symantec Enterprise Vault
7 2 (0.63%) Opscode Chef
7 2 (0.63%) Tivoli
8 1 (0.32%) Cacti
8 1 (0.32%) EMC NetWorker
8 1 (0.32%) Istio
Vendors
1 56 (17.67%) Google
2 35 (11.04%) Microsoft
3 19 (5.99%) Oracle
4 17 (5.36%) Cloudera
5 13 (4.10%) Tableau
6 11 (3.47%) Hortonworks
7 9 (2.84%) Splunk
7 9 (2.84%) Talend
8 8 (2.52%) IBM
9 6 (1.89%) Sonatype
10 3 (0.95%) Alteryx
10 3 (0.95%) Cisco
10 3 (0.95%) Citrix
10 3 (0.95%) Databricks
10 3 (0.95%) F5
10 3 (0.95%) Informatica
10 3 (0.95%) SAP
10 3 (0.95%) Symantec
10 3 (0.95%) Teradata
11 2 (0.63%) CheckPoint