Period
to 17 August 2019

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 17 August 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
Central London > City of London
6 months to
17 Aug 2019
Same period 2018 Same period 2017
Rank 44 62 50
Rank change year-on-year +18 -12 +33
Contract jobs citing Big Data 300 269 299
As % of all contract IT jobs advertised in the City of London 4.61% 3.82% 4.52%
As % of the Database & Business Intelligence category 17.43% 14.76% 17.32%
Number of daily rates quoted 254 228 251
City of London median daily rate £550 £575 £550
Median daily rate % change year-on-year -4.35% +4.55% +4.76%
10th Percentile £455 £429 £413
90th Percentile £710 £713 £725
Central London median daily rate £550 £550 £550
Number of hourly rates quoted 2 0 0
City of London median hourly rate £46.85 - -
Central London median hourly rate £46.85 - -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 1,721 1,823 1,726
As % of all contract IT jobs advertised in the City of London 26.46% 25.88% 26.12%
Number of daily rates quoted 1,371 1,445 1,338
City of London median daily rate £525 £525 £513
Median daily rate % change year-on-year - +2.44% +7.89%
10th Percentile £400 £368 £355
90th Percentile £675 £675 £675
Central London median daily rate £525 £525 £500
% change year-on-year - +5.00% +8.11%
Number of hourly rates quoted 12 12 6
City of London median hourly rate £46.85 £21.75 £22.99
Median hourly rate % change year-on-year +115.39% -5.40% +21.01%
10th Percentile £23.28 £19.50 £20.75
90th Percentile £60.33 £32.70 £31.44
Central London median hourly rate £35.00 £22.00 £24.49
% change year-on-year +59.09% -10.15% +28.87%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the City of London.

Contractor daily rate trend for Big Data in the City of London

Big Data
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Big Data in the City of London over the 6 months to 17 August 2019.

Contractor daily rate histogram for Big Data in the City of London

Big Data
Contractor Hourly Rate Trend in the City of London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in the City of London.

Contractor hourly rate trend for Big Data in the City of London

Big Data
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the City of London region over the 6 months to 17 August 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge +8 70 £525 -
Moorgate - 12 £575 -
Big Data
Central London

For the 6 months to 17 August 2019, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Big Data.

1 167 (55.67%) Apache Spark
2 150 (50.00%) Finance
3 129 (43.00%) Python
4 128 (42.67%) Amazon AWS
5 117 (39.00%) SQL
6 115 (38.33%) Data Science
7 112 (37.33%) Hadoop
8 98 (32.67%) Analytics
9 88 (29.33%) Machine Learning
10 85 (28.33%) Microsoft Azure
11 84 (28.00%) Kafka
11 84 (28.00%) Data Modelling
12 81 (27.00%) Agile Software Development
13 80 (26.67%) Google Cloud Platform
14 76 (25.33%) Apache Hive
15 68 (22.67%) Google
16 67 (22.33%) Data Warehouse
16 67 (22.33%) Java
17 58 (19.33%) Apache
18 55 (18.33%) Data Engineering
19 52 (17.33%) Scala
20 49 (16.33%) Apache Airflow
20 49 (16.33%) PySpark
21 47 (15.67%) Mentoring
22 45 (15.00%) DevOps
23 44 (14.67%) Coaching
24 42 (14.00%) Data Cleansing
25 40 (13.33%) Data Quality
26 38 (12.67%) Artificial Intelligence
27 36 (12.00%) Star Schema

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 167 (55.67%) Apache Spark
2 58 (19.33%) Apache
3 49 (16.33%) Apache Airflow
4 13 (4.33%) Elasticsearch
5 5 (1.67%) Apache Solr
6 4 (1.33%) Confluence
6 4 (1.33%) SharePoint
7 2 (0.67%) IIS
7 2 (0.67%) Jupyter
7 2 (0.67%) Luigi
8 1 (0.33%) Cloud Foundry
8 1 (0.33%) CMS
8 1 (0.33%) Exchange Server 2013
8 1 (0.33%) JBoss
8 1 (0.33%) OpenStack
8 1 (0.33%) Oracle Workflow
8 1 (0.33%) Skype for Business
8 1 (0.33%) WebLogic
8 1 (0.33%) WebSphere
Applications
1 3 (1.00%) Microsoft Office
2 2 (0.67%) MS Visio
3 1 (0.33%) Chatbot
3 1 (0.33%) Microsoft Project
Business Applications
1 5 (1.67%) Dynamics CRM
2 4 (1.33%) Dynamics AX
2 4 (1.33%) Dynamics NAV
3 2 (0.67%) SAP ERP
3 2 (0.67%) SAP Oil and Gas
3 2 (0.67%) SAP S/4HANA
4 1 (0.33%) Cognos Business Intelligence
4 1 (0.33%) Markit EDM
4 1 (0.33%) Oracle BPM
Cloud Services
1 128 (42.67%) Amazon AWS
2 85 (28.33%) Microsoft Azure
3 80 (26.67%) Google Cloud Platform
4 29 (9.67%) Amazon S3
5 23 (7.67%) Amazon EMR
6 18 (6.00%) Serverless
7 14 (4.67%) Power Platform
8 13 (4.33%) Amazon Kinesis
9 11 (3.67%) AWS Lambda
10 10 (3.33%) Amazon SageMaker
10 10 (3.33%) GitHub
11 8 (2.67%) Cloud Computing
11 8 (2.67%) Office 365
12 7 (2.33%) Amazon EC2
13 6 (2.00%) AWS CloudFormation
14 5 (1.67%) Amazon CloudWatch
14 5 (1.67%) Azure Data Factory
15 4 (1.33%) AWS CloudTrail
15 4 (1.33%) Dynamics 365
15 4 (1.33%) Heroku
Communications & Networking
1 5 (1.67%) Firewall
2 2 (0.67%) Internet
3 1 (0.33%) BGP
3 1 (0.33%) Cisco Nexus
3 1 (0.33%) DNS
3 1 (0.33%) EIGRP
3 1 (0.33%) Fibre Channel
3 1 (0.33%) iSCSI
3 1 (0.33%) Kerberos
3 1 (0.33%) NetScaler
3 1 (0.33%) OSPF
3 1 (0.33%) SAN
3 1 (0.33%) Sourcefire
3 1 (0.33%) VLAN
3 1 (0.33%) Wi-Fi
Database & Business Intelligence
1 112 (37.33%) Hadoop
2 76 (25.33%) Apache Hive
3 67 (22.33%) Data Warehouse
4 36 (12.00%) Star Schema
5 35 (11.67%) OLAP
6 32 (10.67%) Enterprise Data Warehouse
7 31 (10.33%) OLAP Cube
8 30 (10.00%) Data Lake
9 29 (9.67%) NoSQL
10 23 (7.67%) SQL Server
11 18 (6.00%) HBase
12 17 (5.67%) MongoDB
12 17 (5.67%) MySQL
13 16 (5.33%) Amazon Redshift
13 16 (5.33%) PostgreSQL
14 14 (4.67%) Power BI
15 10 (3.33%) Apache Cassandra
15 10 (3.33%) BigQuery
15 10 (3.33%) Relational Database
16 9 (3.00%) Impala
Development Applications
1 25 (8.33%) Jenkins
2 21 (7.00%) Git (software)
3 11 (3.67%) JIRA
4 9 (3.00%) Sonatype Nexus
4 9 (3.00%) TeamCity
5 7 (2.33%) Octopus Deploy
6 6 (2.00%) Atlassian Bamboo
6 6 (2.00%) Visual Studio Team System
7 4 (1.33%) CircleCI
7 4 (1.33%) ERwin
7 4 (1.33%) Maven
7 4 (1.33%) SpecFlow
8 3 (1.00%) tSQLt
9 2 (0.67%) Hudson
9 2 (0.67%) Jasmine
9 2 (0.67%) Mocha
9 2 (0.67%) MSI
9 2 (0.67%) Subversion
9 2 (0.67%) Team Foundation Server
9 2 (0.67%) WiX
General
1 150 (50.00%) Finance
2 34 (11.33%) Banking
3 13 (4.33%) Investment Banking
4 11 (3.67%) Retail
5 9 (3.00%) Front Office
6 7 (2.33%) Advertising
7 5 (1.67%) Financial Institution
8 4 (1.33%) Law
8 4 (1.33%) Pharmaceutical
9 2 (0.67%) Back Office
9 2 (0.67%) Games
9 2 (0.67%) Publishing
9 2 (0.67%) Telecoms
10 1 (0.33%) Marketing
Job Titles
1 129 (43.00%) Data Engineer
2 57 (19.00%) Python Engineer
3 56 (18.67%) Developer
4 53 (17.67%) Big Data Engineer
5 36 (12.00%) Hadoop Engineer
6 34 (11.33%) Architect
7 22 (7.33%) Data Architect
8 16 (5.33%) DevOps Engineer
9 15 (5.00%) Java Developer
9 15 (5.00%) Senior Developer
10 14 (4.67%) Big Data Developer
10 14 (4.67%) Python Developer
11 10 (3.33%) Analyst
11 10 (3.33%) Data Scientist
12 9 (3.00%) AWS Engineer
13 7 (2.33%) Project Manager
13 7 (2.33%) Scala Developer
13 7 (2.33%) SQL Developer
14 6 (2.00%) Big Data Architect
14 6 (2.00%) Cloud Engineer
Libraries, Frameworks & Software Standards
1 84 (28.00%) Kafka
2 49 (16.33%) PySpark
3 17 (5.67%) scikit-learn
4 16 (5.33%) .NET
5 13 (4.33%) Web Services
6 11 (3.67%) Play Framework
6 11 (3.67%) React
7 10 (3.33%) AngularJS
7 10 (3.33%) Apache NiFi
7 10 (3.33%) JSON
7 10 (3.33%) MLlib
7 10 (3.33%) REST
7 10 (3.33%) Spring
8 9 (3.00%) Natural Language Processing
8 9 (3.00%) XML
9 7 (2.33%) NumPy
9 7 (2.33%) SciPy
10 6 (2.00%) CSS
10 6 (2.00%) Pandas
10 6 (2.00%) RESTful
Miscellaneous
1 26 (8.67%) Data Structures
2 25 (8.33%) Analytical Skills
3 21 (7.00%) Algorithms
4 17 (5.67%) Greenfield Project
5 9 (3.00%) User Experience
6 7 (2.33%) Data Protection Act
7 6 (2.00%) Cloud Native
7 6 (2.00%) Enterprise Software
7 6 (2.00%) Public Cloud
8 5 (1.67%) Foreign Exchange (FX)
8 5 (1.67%) Market Risk
9 4 (1.33%) Social Media
10 3 (1.00%) Equities
10 3 (1.00%) Fixed Income
10 3 (1.00%) Robotics
10 3 (1.00%) Virtual Team
11 2 (0.67%) Clustering
11 2 (0.67%) Credit Risk
11 2 (0.67%) Industry 4.0
11 2 (0.67%) Self-Motivation
Operating Systems
1 18 (6.00%) Linux
2 10 (3.33%) Unix
3 9 (3.00%) Windows
4 3 (1.00%) Windows Server
5 2 (0.67%) CentOS
5 2 (0.67%) Red Hat Enterprise Linux
6 1 (0.33%) Solaris
6 1 (0.33%) Ubuntu
Processes & Methodologies
1 115 (38.33%) Data Science
2 98 (32.67%) Analytics
3 88 (29.33%) Machine Learning
4 84 (28.00%) Data Modelling
5 81 (27.00%) Agile Software Development
6 55 (18.33%) Data Engineering
7 47 (15.67%) Mentoring
8 45 (15.00%) DevOps
9 44 (14.67%) Coaching
10 42 (14.00%) Data Cleansing
11 38 (12.67%) Artificial Intelligence
12 34 (11.33%) Business Intelligence
13 31 (10.33%) SQL Optimisation
14 27 (9.00%) Problem-Solving
15 26 (8.67%) ETL
16 25 (8.33%) Microservices
17 22 (7.33%) Migration
17 22 (7.33%) Scrum
18 19 (6.33%) Data Architecture
18 19 (6.33%) Open Source
Programming Languages
1 129 (43.00%) Python
2 117 (39.00%) SQL
3 67 (22.33%) Java
4 52 (17.33%) Scala
5 21 (7.00%) C#
6 13 (4.33%) JavaScript
7 9 (3.00%) R
8 7 (2.33%) C++
8 7 (2.33%) Shell Script
8 7 (2.33%) T-SQL
9 6 (2.00%) Go
9 6 (2.00%) Java 8
9 6 (2.00%) Kotlin
9 6 (2.00%) TypeScript
10 5 (1.67%) Clojure
10 5 (1.67%) ES6
11 4 (1.33%) Bash Shell
12 3 (1.00%) PL/SQL
12 3 (1.00%) PowerShell
12 3 (1.00%) U-SQL
Qualifications
1 12 (4.00%) Degree
2 5 (1.67%) SC Cleared
2 5 (1.67%) Security Cleared
3 2 (0.67%) Computer Science Degree
3 2 (0.67%) Master's Degree
3 2 (0.67%) Numerate Degree
3 2 (0.67%) PMI Certification
3 2 (0.67%) PMP
4 1 (0.33%) AWS Certification
4 1 (0.33%) CCA
4 1 (0.33%) CEH
4 1 (0.33%) Cisco Certification
4 1 (0.33%) CISSP
4 1 (0.33%) PhD
4 1 (0.33%) Postgraduate
4 1 (0.33%) RHCE
Quality Assurance & Compliance
1 40 (13.33%) Data Quality
2 3 (1.00%) GDPR
3 1 (0.33%) SLA
System Software
1 30 (10.00%) Docker
2 11 (3.67%) HDFS
3 3 (1.00%) Active Directory
3 3 (1.00%) Apache Flume
3 3 (1.00%) Oracle RAC
3 3 (1.00%) XenApp
4 2 (0.67%) Hyper-V
5 1 (0.33%) Microsoft App-V
5 1 (0.33%) Samba
5 1 (0.33%) Virtual Desktop
5 1 (0.33%) Virtual Machines
5 1 (0.33%) VMware ESXi
5 1 (0.33%) VMware Infrastructure
5 1 (0.33%) XenDesktop
Systems Management
1 32 (10.67%) Oozie
2 23 (7.67%) Kubernetes
3 20 (6.67%) Ansible
4 15 (5.00%) Terraform
5 10 (3.33%) Hadoop YARN
6 4 (1.33%) Puppet
7 2 (0.67%) Docker Swarm
7 2 (0.67%) Grafana
7 2 (0.67%) Istio
7 2 (0.67%) Microsoft Clustering
8 1 (0.33%) Cacti
8 1 (0.33%) Kibana
8 1 (0.33%) Kubeflow
8 1 (0.33%) Microsoft Data Protection Manager
8 1 (0.33%) Prometheus
8 1 (0.33%) QRadar
8 1 (0.33%) SCCM
8 1 (0.33%) SCOM
8 1 (0.33%) SCOrch
8 1 (0.33%) Suricata
Vendors
1 68 (22.67%) Google
2 27 (9.00%) Microsoft
3 22 (7.33%) Oracle
4 10 (3.33%) Cloudera
5 9 (3.00%) Tableau
6 7 (2.33%) Informatica
7 4 (1.33%) Alteryx
7 4 (1.33%) IBM
7 4 (1.33%) Talend
7 4 (1.33%) Teradata
8 3 (1.00%) Citrix
8 3 (1.00%) Splunk
9 2 (0.67%) Cisco
9 2 (0.67%) Dataiku
9 2 (0.67%) MicroStrategy
9 2 (0.67%) Red Hat
9 2 (0.67%) SAP
9 2 (0.67%) StreamSets
10 1 (0.33%) Databricks
10 1 (0.33%) MuleSoft