Period
to 19 July 2019

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 19 July 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > London
6 months to
19 Jul 2019
Same period 2018 Same period 2017
Rank 55 61 57
Rank change year-on-year +6 -4 +40
Contract jobs citing Big Data 1,822 1,827 1,675
As % of all contract IT jobs advertised in London 4.43% 3.96% 4.00%
As % of the Database & Business Intelligence category 17.80% 15.71% 16.53%
Number of daily rates quoted 1,393 1,348 1,241
London median daily rate £575 £550 £550
Median daily rate % change year-on-year +4.55% - -
10th Percentile £425 £420 £400
90th Percentile £725 £713 £700
England median daily rate £550 £550 £533
% change year-on-year - +3.29% +1.43%
Number of hourly rates quoted 5 3 1
London median hourly rate £42.50 £27.50 £40.00
Median hourly rate % change year-on-year +54.55% -31.25% +63.13%
10th Percentile £24.65 £17.45 £38.75
90th Percentile £48.22 £28.75 £41.25
England median hourly rate £46.85 £44.00 £43.50
% change year-on-year +6.47% +1.15% +2.35%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 10,234 11,633 10,133
As % of all contract IT jobs advertised in London 24.90% 25.18% 24.20%
Number of daily rates quoted 7,440 8,714 7,344
London median daily rate £525 £520 £500
Median daily rate % change year-on-year +0.96% +4.00% +5.26%
10th Percentile £363 £356 £326
90th Percentile £688 £675 £650
England median daily rate £483 £475 £450
% change year-on-year +1.58% +5.56% +5.88%
Number of hourly rates quoted 66 74 48
London median hourly rate £35.00 £30.00 £26.88
Median hourly rate % change year-on-year +16.67% +11.60% -0.16%
10th Percentile £17.16 £20.25 £18.05
90th Percentile £56.50 £47.46 £47.88
England median hourly rate £35.00 £33.50 £29.56
% change year-on-year +4.48% +13.33% +3.72%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in London.

Contractor daily rate trend for Big Data in London

Big Data
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Big Data in London over the 6 months to 19 July 2019.

Contractor daily rate histogram for Big Data in London

Big Data
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in London.

Contractor hourly rate trend for Big Data in London

Big Data
Contractor Hourly Rate Histogram in London

The hourly rate distribution of IT jobs citing Big Data in London over the 6 months to 19 July 2019.

Contractor hourly rate histogram for Big Data in London

Big Data
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the London region over the 6 months to 19 July 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +20 437 £550 - 130
South London +31 106 £600 +9.09% 4
East London -12 55 £531 -3.41% 27
West London +25 49 £533 +1.43% 43
North London -2 8 £550 - 10
Big Data
England

For the 6 months to 19 July 2019, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Big Data.

1 747 (41.00%) Apache Spark
2 745 (40.89%) Python
3 683 (37.49%) Amazon AWS
4 682 (37.43%) Hadoop
5 615 (33.75%) Agile Software Development
6 571 (31.34%) SQL
7 555 (30.46%) Finance
8 541 (29.69%) Analytics
9 478 (26.23%) Java
10 451 (24.75%) Kafka
11 398 (21.84%) DevOps
12 390 (21.41%) Microsoft Azure
13 389 (21.35%) Data Science
14 384 (21.08%) Google Cloud Platform
15 322 (17.67%) Machine Learning
16 319 (17.51%) Apache Hive
17 313 (17.18%) Data Warehouse
18 295 (16.19%) Data Modelling
19 294 (16.14%) Kubernetes
20 291 (15.97%) Scala
21 290 (15.92%) Docker
22 287 (15.75%) Google
23 251 (13.78%) ETL
24 224 (12.29%) Jenkins
25 220 (12.07%) Business Intelligence
26 217 (11.91%) Linux
27 215 (11.80%) Scrum
28 208 (11.42%) Migration
29 207 (11.36%) Data Engineering
30 203 (11.14%) NoSQL

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 747 (41.00%) Apache Spark
2 201 (11.03%) Apache
3 111 (6.09%) Apache Airflow
4 94 (5.16%) Elasticsearch
5 30 (1.65%) Apache Solr
6 26 (1.43%) Confluence
7 20 (1.10%) SAS
8 17 (0.93%) Luigi
9 15 (0.82%) Apache Pig
9 15 (0.82%) IIS
10 13 (0.71%) Cloud Foundry
11 12 (0.66%) Tomcat
12 11 (0.60%) WebSphere
13 10 (0.55%) Skype for Business
14 9 (0.49%) Exchange Server 2013
14 9 (0.49%) nginx
14 9 (0.49%) Oracle Coherence
14 9 (0.49%) SharePoint
15 8 (0.44%) Jupyter
16 6 (0.33%) Pachyderm
Applications
1 30 (1.65%) Microsoft Excel
2 24 (1.32%) Microsoft Office
3 9 (0.49%) MS Visio
4 7 (0.38%) Microsoft PowerPoint
5 3 (0.16%) Chatbot
6 2 (0.11%) InVision
6 2 (0.11%) Sketch
7 1 (0.055%) AutoCAD
7 1 (0.055%) LaTeX
7 1 (0.055%) Microsoft Project
7 1 (0.055%) SPSS
Business Applications
1 14 (0.77%) SAP Oil and Gas
2 10 (0.55%) Dynamics CRM
3 9 (0.49%) SAP S/4HANA
4 7 (0.38%) Distributed Ledger
5 6 (0.33%) Dynamics AX
5 6 (0.33%) Dynamics NAV
5 6 (0.33%) SAP ERP
6 5 (0.27%) Oracle BPM
7 1 (0.055%) Actimize
7 1 (0.055%) Markit EDM
7 1 (0.055%) NetSuite
7 1 (0.055%) Oracle Retail
7 1 (0.055%) PeopleSoft Financials
7 1 (0.055%) Salesforce.com CRM
7 1 (0.055%) Sparx Enterprise Architect
Cloud Services
1 683 (37.49%) Amazon AWS
2 390 (21.41%) Microsoft Azure
3 384 (21.08%) Google Cloud Platform
4 115 (6.31%) GitHub
5 99 (5.43%) Serverless
6 96 (5.27%) Amazon EMR
6 96 (5.27%) Amazon S3
7 77 (4.23%) Power Platform
8 61 (3.35%) Amazon Kinesis
9 54 (2.96%) AWS Lambda
10 53 (2.91%) Amazon EC2
11 49 (2.69%) Azure Data Factory
12 44 (2.41%) Amazon CloudWatch
13 41 (2.25%) PaaS
14 39 (2.14%) AWS CloudFormation
15 29 (1.59%) Amazon SageMaker
16 27 (1.48%) Office 365
17 26 (1.43%) Cloud Computing
18 22 (1.21%) IaaS
19 21 (1.15%) Amazon SQS
Communications & Networking
1 32 (1.76%) Firewall
2 23 (1.26%) Kerberos
3 13 (0.71%) TCP/IP
4 12 (0.66%) HTTP
5 11 (0.60%) AMQP
5 11 (0.60%) Cisco Nexus
5 11 (0.60%) Fibre Channel
5 11 (0.60%) Internet
5 11 (0.60%) iSCSI
5 11 (0.60%) SAN
6 9 (0.49%) Cisco ASA
6 9 (0.49%) Cisco Firepower
6 9 (0.49%) DNS
7 4 (0.22%) VPN
7 4 (0.22%) WAN
8 3 (0.16%) SSL
8 3 (0.16%) Unified Communications
9 2 (0.11%) BGP
9 2 (0.11%) Intranet
9 2 (0.11%) OSPF
Database & Business Intelligence
1 682 (37.43%) Hadoop
2 319 (17.51%) Apache Hive
3 313 (17.18%) Data Warehouse
4 203 (11.14%) NoSQL
5 164 (9.00%) Data Lake
6 135 (7.41%) Amazon Redshift
7 127 (6.97%) HBase
8 125 (6.86%) SQL Server
9 104 (5.71%) MongoDB
10 101 (5.54%) Apache Cassandra
11 97 (5.32%) Relational Database
12 96 (5.27%) PostgreSQL
13 91 (4.99%) Impala
14 84 (4.61%) BigQuery
15 77 (4.23%) Power BI
16 69 (3.79%) Star Schema
17 63 (3.46%) MySQL
18 52 (2.85%) OLAP
19 44 (2.41%) Amazon RDS
20 42 (2.31%) Enterprise Data Warehouse
Development Applications
1 224 (12.29%) Jenkins
2 162 (8.89%) Git (software)
3 87 (4.77%) JIRA
4 46 (2.52%) TeamCity
5 43 (2.36%) GitLab
6 36 (1.98%) Maven
7 35 (1.92%) Sonatype Nexus
7 35 (1.92%) Visual Studio Team System
8 32 (1.76%) Atlassian Bamboo
9 31 (1.70%) Selenium
10 19 (1.04%) CircleCI
10 19 (1.04%) Jasmine
11 18 (0.99%) Gradle
12 17 (0.93%) Cucumber
12 17 (0.93%) JUnit
12 17 (0.93%) Travis CI
13 15 (0.82%) Octopus Deploy
14 14 (0.77%) MSI
14 14 (0.77%) SpecFlow
14 14 (0.77%) WiX
General
1 555 (30.46%) Finance
2 201 (11.03%) Banking
3 81 (4.45%) Retail
4 63 (3.46%) Investment Banking
5 47 (2.58%) Front Office
6 44 (2.41%) Marketing
7 42 (2.31%) Financial Institution
8 38 (2.09%) Legal
9 32 (1.76%) Advertising
10 30 (1.65%) Telecoms
11 23 (1.26%) Manufacturing
12 17 (0.93%) Games
13 12 (0.66%) Publishing
14 8 (0.44%) Pharmaceutical
15 6 (0.33%) Law
16 5 (0.27%) Back Office
16 5 (0.27%) Electronics
17 4 (0.22%) General Ledger
18 3 (0.16%) Retail Banking
19 2 (0.11%) Aerospace
Job Titles
1 512 (28.10%) Data Engineer
2 408 (22.39%) Developer
3 281 (15.42%) Big Data Engineer
4 259 (14.22%) Architect
5 156 (8.56%) Python Engineer
6 143 (7.85%) DevOps Engineer
7 129 (7.08%) Java Developer
8 119 (6.53%) Data Architect
9 106 (5.82%) Big Data Developer
10 90 (4.94%) AWS Engineer
11 89 (4.88%) Cloud Engineer
12 84 (4.61%) Data Scientist
13 83 (4.56%) Hadoop Engineer
14 73 (4.01%) Python Developer
15 70 (3.84%) Big Data Architect
16 69 (3.79%) Senior Developer
17 60 (3.29%) Analyst
18 59 (3.24%) AWS Architect
19 44 (2.41%) Senior Data Engineer
20 43 (2.36%) SQL Developer
Libraries, Frameworks & Software Standards
1 451 (24.75%) Kafka
2 100 (5.49%) PySpark
3 85 (4.67%) REST
3 85 (4.67%) Web Services
4 73 (4.01%) .NET
5 70 (3.84%) RESTful
6 65 (3.57%) JSON
7 59 (3.24%) HTML
7 59 (3.24%) React
8 58 (3.18%) Natural Language Processing
8 58 (3.18%) Spring
9 54 (2.96%) AngularJS
9 54 (2.96%) Node.js
10 51 (2.80%) TensorFlow
11 50 (2.74%) Apache NiFi
12 49 (2.69%) CSS
13 42 (2.31%) Spring Boot
13 42 (2.31%) XML
14 38 (2.09%) Spark Streaming
15 37 (2.03%) Elastic Stack
Miscellaneous
1 190 (10.43%) Analytical Skills
2 113 (6.20%) Greenfield Project
3 111 (6.09%) Algorithms
4 76 (4.17%) Data Structures
5 46 (2.52%) User Experience
6 45 (2.47%) Public Cloud
7 38 (2.09%) Data Protection Act
8 36 (1.98%) Self-Motivation
9 32 (1.76%) Cloud Native
10 31 (1.70%) Hedge funds
11 30 (1.65%) Management Information System
12 25 (1.37%) Data Centre
13 24 (1.32%) Enterprise Software
14 21 (1.15%) Market Risk
15 18 (0.99%) Clustering
16 17 (0.93%) Hybrid Cloud
17 15 (0.82%) Foreign Exchange (FX)
18 14 (0.77%) Mobile App
18 14 (0.77%) Social Media
19 13 (0.71%) Virtual Team
Operating Systems
1 217 (11.91%) Linux
2 79 (4.34%) Unix
3 44 (2.41%) Windows
4 31 (1.70%) Red Hat Enterprise Linux
5 16 (0.88%) Windows Server
6 7 (0.38%) Ubuntu
7 6 (0.33%) Android
7 6 (0.33%) Apple iOS
8 4 (0.22%) CentOS
8 4 (0.22%) Solaris
9 2 (0.11%) Windows 10
10 1 (0.055%) AIX
10 1 (0.055%) Fedora
10 1 (0.055%) Mac OS
10 1 (0.055%) VMS
Processes & Methodologies
1 615 (33.75%) Agile Software Development
2 541 (29.69%) Analytics
3 398 (21.84%) DevOps
4 389 (21.35%) Data Science
5 322 (17.67%) Machine Learning
6 295 (16.19%) Data Modelling
7 251 (13.78%) ETL
8 220 (12.07%) Business Intelligence
9 215 (11.80%) Scrum
10 208 (11.42%) Migration
11 207 (11.36%) Data Engineering
12 174 (9.55%) Continuous Integration
13 160 (8.78%) Microservices
14 151 (8.29%) Artificial Intelligence
15 149 (8.18%) Problem-Solving
15 149 (8.18%) TDD
16 147 (8.07%) Software Engineering
17 138 (7.57%) Mentoring
18 132 (7.24%) Data Analytics
19 127 (6.97%) Coaching
Programming Languages
1 745 (40.89%) Python
2 571 (31.34%) SQL
3 478 (26.23%) Java
4 291 (15.97%) Scala
5 122 (6.70%) JavaScript
6 109 (5.98%) C#
7 103 (5.65%) R
8 87 (4.77%) Bash Shell
9 81 (4.45%) Java 8
10 51 (2.80%) Ruby
11 50 (2.74%) C++
12 49 (2.69%) Shell Script
13 43 (2.36%) T-SQL
14 39 (2.14%) PowerShell
15 32 (1.76%) Go
15 32 (1.76%) PL/SQL
16 29 (1.59%) TypeScript
17 27 (1.48%) Perl
18 23 (1.26%) Groovy
19 20 (1.10%) MATLAB
Qualifications
1 183 (10.04%) Security Cleared
2 145 (7.96%) SC Cleared
3 116 (6.37%) Degree
4 42 (2.31%) PhD
5 33 (1.81%) Computer Science Degree
6 27 (1.48%) DV Cleared
7 26 (1.43%) Master's Degree
8 21 (1.15%) PMI Certification
8 21 (1.15%) PMP
9 12 (0.66%) CISSP
10 11 (0.60%) CTC Cleared
11 9 (0.49%) AWS Certification
11 9 (0.49%) CISM
12 7 (0.38%) CEH
12 7 (0.38%) TOGAF Certification
13 6 (0.33%) Cisco Certification
14 5 (0.27%) CCA
14 5 (0.27%) ITIL Certification
15 4 (0.22%) CCSP
15 4 (0.22%) PRINCE2 Certification
Quality Assurance & Compliance
1 98 (5.38%) Data Quality
2 24 (1.32%) QA
3 17 (0.93%) GDPR
4 4 (0.22%) ISO/IEC 27001
4 4 (0.22%) Sarbanes-Oxley
5 3 (0.16%) MiFID
5 3 (0.16%) SLA
6 2 (0.11%) IFRS
6 2 (0.11%) NIST
7 1 (0.055%) EMIR
7 1 (0.055%) IFRS 9
7 1 (0.055%) NCSC
7 1 (0.055%) PCI DSS
7 1 (0.055%) PMO
System Software
1 290 (15.92%) Docker
2 88 (4.83%) HDFS
3 58 (3.18%) Apache Flume
4 22 (1.21%) Virtual Machines
5 19 (1.04%) Active Directory
6 17 (0.93%) VMware Infrastructure
7 15 (0.82%) Hyper-V
8 14 (0.77%) XenApp
9 11 (0.60%) vCloud
10 10 (0.55%) Oracle RAC
11 3 (0.16%) Apache ZooKeeper
11 3 (0.16%) VMware ESXi
12 2 (0.11%) Samba
12 2 (0.11%) VirtualBox
13 1 (0.055%) NFS
13 1 (0.055%) Virtual Servers
13 1 (0.055%) Xen
Systems Management
1 294 (16.14%) Kubernetes
2 175 (9.60%) Terraform
3 173 (9.50%) Ansible
4 90 (4.94%) Puppet
5 60 (3.29%) Opscode Chef
6 49 (2.69%) Oozie
7 42 (2.31%) Hadoop YARN
8 20 (1.10%) Salt
9 18 (0.99%) Kibana
10 15 (0.82%) logstash
11 14 (0.77%) Microsoft Clustering
12 11 (0.60%) Microsoft Data Protection Manager
12 11 (0.60%) SCOM
12 11 (0.60%) SCOrch
12 11 (0.60%) Symantec Enterprise Vault
13 9 (0.49%) QRadar
14 8 (0.44%) Nagios
15 7 (0.38%) Kubeflow
16 6 (0.33%) Docker Swarm
16 6 (0.33%) Enterprise Manager Cloud Control
Vendors
1 287 (15.75%) Google
2 147 (8.07%) Microsoft
3 140 (7.68%) Oracle
4 131 (7.19%) Cloudera
5 76 (4.17%) Hortonworks
6 69 (3.79%) Tableau
7 57 (3.13%) Databricks
8 51 (2.80%) Greenplum
8 51 (2.80%) Talend
9 45 (2.47%) Informatica
10 33 (1.81%) Red Hat
11 30 (1.65%) SAP
12 21 (1.15%) Facebook
13 19 (1.04%) Splunk
14 18 (0.99%) Alteryx
14 18 (0.99%) VMware
15 17 (0.93%) Teradata
16 16 (0.88%) Cisco
16 16 (0.88%) MapR
17 15 (0.82%) IBM