Period
to 20 November 2019

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 20 November 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > London
6 months to
20 Nov 2019
Same period 2018 Same period 2017
Rank 73 74 65
Rank change year-on-year +1 -9 +5
Contract jobs citing Big Data 1,212 1,592 1,808
As % of all contract IT jobs advertised in London 3.39% 3.43% 3.87%
As % of the Database & Business Intelligence category 14.19% 14.10% 16.27%
Number of daily rates quoted 888 1,199 1,355
London median daily rate £575 £575 £550
Median daily rate % change year-on-year - +4.55% -
10th Percentile £425 £425 £411
90th Percentile £725 £725 £700
England median daily rate £550 £550 £550
Number of hourly rates quoted 3 5 0
London median hourly rate £42.50 £27.50 -
Median hourly rate % change year-on-year +54.55% - -
England median hourly rate £42.50 £40.00 £30.91
% change year-on-year +6.25% +29.43% -28.13%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 8,540 11,293 11,114
As % of all contract IT jobs advertised in London 23.86% 24.35% 23.81%
Number of daily rates quoted 6,171 8,422 8,247
London median daily rate £525 £525 £500
Median daily rate % change year-on-year - +5.00% +5.26%
10th Percentile £363 £363 £353
90th Percentile £700 £675 £661
England median daily rate £475 £475 £460
% change year-on-year - +3.26% +8.24%
Number of hourly rates quoted 58 49 59
London median hourly rate £35.00 £27.50 £26.61
Median hourly rate % change year-on-year +27.27% +3.36% -14.01%
10th Percentile £15.57 £16.05 £18.20
90th Percentile £62.10 £49.70 £58.75
England median hourly rate £32.58 £35.00 £31.50
% change year-on-year -6.91% +11.11% +12.50%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in London.

Contractor daily rate trend for Big Data in London

Big Data
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Big Data in London over the 6 months to 20 November 2019.

Contractor daily rate histogram for Big Data in London

Big Data
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in London.

Contractor hourly rate trend for Big Data in London

Big Data
Contractor Hourly Rate Histogram in London

The hourly rate distribution of IT jobs citing Big Data in London over the 6 months to 20 November 2019.

Contractor hourly rate histogram for Big Data in London

Big Data
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the London region over the 6 months to 20 November 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -4 226 £550 -4.35% 115
West London +22 44 £550 - 43
South London 0 40 £586 +11.52% 10
East London -7 32 £600 +14.29% 21
North London -2 2 £275 -53.19% 1
Big Data
England

For the 6 months to 20 November 2019, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Big Data.

1 499 (41.17%) Agile Software Development
2 495 (40.84%) Python
3 440 (36.30%) Apache Spark
4 425 (35.07%) Hadoop
5 413 (34.08%) AWS
6 379 (31.27%) Finance
7 358 (29.54%) SQL
8 355 (29.29%) Java
9 350 (28.88%) Analytics
10 286 (23.60%) Azure
11 281 (23.18%) DevOps
12 259 (21.37%) GCP
13 232 (19.14%) Kafka
14 219 (18.07%) Scala
15 218 (17.99%) Data Science
16 210 (17.33%) Machine Learning
17 190 (15.68%) ETL
18 182 (15.02%) Google
19 175 (14.44%) Docker
20 174 (14.36%) Data Warehouse
21 169 (13.94%) Kubernetes
22 163 (13.45%) Scrum
23 154 (12.71%) Data Modelling
24 153 (12.62%) Business Intelligence
25 148 (12.21%) Linux
25 148 (12.21%) Jenkins
25 148 (12.21%) Apache Hive
26 145 (11.96%) Data Engineering
27 142 (11.72%) NoSQL
28 137 (11.30%) Banking

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 440 (36.30%) Apache Spark
2 99 (8.17%) Apache
3 43 (3.55%) Elasticsearch
4 39 (3.22%) Apache Airflow
5 16 (1.32%) Jupyter
6 15 (1.24%) Confluence
7 12 (0.99%) SAS
8 11 (0.91%) Luigi
9 6 (0.50%) Oracle SOA Suite
9 6 (0.50%) Tomcat
9 6 (0.50%) WebLogic
10 5 (0.41%) Apache Solr
10 5 (0.41%) JBoss
10 5 (0.41%) Oracle HTTP Server
10 5 (0.41%) SharePoint
11 4 (0.33%) IIS
11 4 (0.33%) Skype for Business
12 3 (0.25%) DNN
12 3 (0.25%) Moodle
12 3 (0.25%) Oracle Coherence
Applications
1 27 (2.23%) Microsoft Excel
2 12 (0.99%) MS Visio
3 10 (0.83%) Microsoft PowerPoint
3 10 (0.83%) Microsoft Project
4 7 (0.58%) Microsoft Office
5 2 (0.17%) AutoCAD
5 2 (0.17%) Spreadsheet
6 1 (0.083%) InVision
6 1 (0.083%) Sketch
6 1 (0.083%) Zeplin
Business Applications
1 9 (0.74%) SAP Oil and Gas
2 6 (0.50%) Oracle BPM
3 4 (0.33%) Distributed Ledger
3 4 (0.33%) FINCAD Analytics
3 4 (0.33%) SAP S/4HANA
4 3 (0.25%) Dynamics CRM
5 2 (0.17%) Adobe Campaign
5 2 (0.17%) Aligne
5 2 (0.17%) Dynamics AX
5 2 (0.17%) Dynamics NAV
5 2 (0.17%) SAP ERP
6 1 (0.083%) Actimize
6 1 (0.083%) Cognos Business Intelligence
6 1 (0.083%) Markit EDM
6 1 (0.083%) PolarLake
6 1 (0.083%) SAP CAR
6 1 (0.083%) SAP MDM
6 1 (0.083%) SAP Retail
6 1 (0.083%) Sparx Enterprise Architect
Cloud Services
1 413 (34.08%) AWS
2 286 (23.60%) Azure
3 259 (21.37%) GCP
4 59 (4.87%) Power Platform
5 54 (4.46%) GitHub
6 53 (4.37%) Amazon EMR
7 43 (3.55%) Amazon S3
8 42 (3.47%) Serverless
9 32 (2.64%) Azure Data Factory
10 31 (2.56%) AWS CloudFormation
11 30 (2.48%) Amazon Kinesis
12 24 (1.98%) AWS Lambda
13 23 (1.90%) Amazon CloudWatch
13 23 (1.90%) OpenShift
14 20 (1.65%) Cloud Computing
14 20 (1.65%) Datadog
15 19 (1.57%) Amazon EC2
16 16 (1.32%) Office 365
17 14 (1.16%) PaaS
18 12 (0.99%) Azure Machine Learning
Communications & Networking
1 15 (1.24%) Firewall
2 12 (0.99%) HTTP
3 8 (0.66%) Kerberos
4 7 (0.58%) Internet
5 6 (0.50%) TCP/IP
6 5 (0.41%) NetScaler
7 4 (0.33%) DNS
7 4 (0.33%) Network Security
7 4 (0.33%) Wi-Fi
8 3 (0.25%) Multicast
8 3 (0.25%) PuTTY
8 3 (0.25%) Software-Defined Networking
8 3 (0.25%) SSH
8 3 (0.25%) Wireshark
9 2 (0.17%) 5G
9 2 (0.17%) AMQP
9 2 (0.17%) Cisco ASA
9 2 (0.17%) Cisco Firepower
9 2 (0.17%) Fibre Channel
9 2 (0.17%) iSCSI
Database & Business Intelligence
1 425 (35.07%) Hadoop
2 174 (14.36%) Data Warehouse
3 148 (12.21%) Apache Hive
4 142 (11.72%) NoSQL
5 112 (9.24%) Data Lake
6 89 (7.34%) MongoDB
7 84 (6.93%) SQL Server
8 79 (6.52%) Amazon Redshift
9 77 (6.35%) Relational Database
10 66 (5.45%) PostgreSQL
11 59 (4.87%) Power BI
12 54 (4.46%) HBase
13 52 (4.29%) Impala
14 50 (4.13%) BigQuery
15 47 (3.88%) Spark SQL
16 46 (3.80%) Apache Cassandra
17 44 (3.63%) RDBMS
18 43 (3.55%) MySQL
19 26 (2.15%) Amazon Athena
20 23 (1.90%) SQL Server Analysis Services
Development Applications
1 148 (12.21%) Jenkins
2 132 (10.89%) Git (software)
3 84 (6.93%) JIRA
4 36 (2.97%) Selenium
5 23 (1.90%) Sonatype Nexus
6 21 (1.73%) Maven
6 21 (1.73%) Team Foundation Server
7 18 (1.49%) Cucumber
8 14 (1.16%) Atlassian Bamboo
8 14 (1.16%) Visual Studio Team System
9 13 (1.07%) TeamCity
10 12 (0.99%) GitLab
11 11 (0.91%) JUnit
12 10 (0.83%) Ant
12 10 (0.83%) JMeter
12 10 (0.83%) PowerDesigner
12 10 (0.83%) WebDriver
13 8 (0.66%) Gatling
13 8 (0.66%) NeoLoad
14 7 (0.58%) Travis CI
General
1 379 (31.27%) Finance
2 137 (11.30%) Banking
3 70 (5.78%) Retail
4 55 (4.54%) Investment Banking
5 47 (3.88%) Front Office
6 46 (3.80%) Public Sector
7 37 (3.05%) Telecoms
8 34 (2.81%) Legal
9 33 (2.72%) Marketing
10 26 (2.15%) Manufacturing
11 25 (2.06%) Advertising
12 22 (1.82%) Financial Institution
13 8 (0.66%) Retail Banking
14 7 (0.58%) Publishing
15 6 (0.50%) Pharmaceutical
16 4 (0.33%) Back Office
16 4 (0.33%) Games
16 4 (0.33%) Law
17 3 (0.25%) Billing
18 2 (0.17%) Multimedia
Job Titles
1 270 (22.28%) Data Engineer
2 260 (21.45%) Developer
3 188 (15.51%) Architect
4 119 (9.82%) Big Data Engineer
5 86 (7.10%) Data Architect
6 84 (6.93%) DevOps Engineer
7 82 (6.77%) Python Engineer
8 79 (6.52%) Analyst
9 77 (6.35%) Java Developer
10 76 (6.27%) Python Developer
11 69 (5.69%) Cloud Engineer
12 64 (5.28%) Big Data Developer
13 58 (4.79%) Data Scientist
14 49 (4.04%) Senior Developer
15 44 (3.63%) AWS Engineer
15 44 (3.63%) Java Engineer
16 43 (3.55%) Senior Data Engineer
17 42 (3.47%) Big Data Architect
18 39 (3.22%) Software Engineer
19 37 (3.05%) Azure Engineer
Libraries, Frameworks & Software Standards
1 232 (19.14%) Kafka
2 78 (6.44%) Web Services
3 54 (4.46%) React
4 53 (4.37%) PySpark
5 52 (4.29%) RESTful
6 48 (3.96%) JSON
7 39 (3.22%) REST
8 38 (3.14%) .NET
8 38 (3.14%) Natural Language Processing
8 38 (3.14%) Spring
9 33 (2.72%) HTML
9 33 (2.72%) TensorFlow
10 32 (2.64%) XML
11 31 (2.56%) Pandas
12 29 (2.39%) AngularJS
13 25 (2.06%) Spark Streaming
14 24 (1.98%) CSS
15 23 (1.90%) Middleware
15 23 (1.90%) NumPy
15 23 (1.90%) scikit-learn
Miscellaneous
1 121 (9.98%) Analytical Skills
2 92 (7.59%) Algorithms
3 81 (6.68%) Greenfield Project
4 62 (5.12%) Data Structures
5 35 (2.89%) User Experience
6 32 (2.64%) Data Centre
7 31 (2.56%) Self-Motivation
8 22 (1.82%) Cloud Native
8 22 (1.82%) Management Information System
9 20 (1.65%) Public Cloud
10 17 (1.40%) Hedge funds
11 14 (1.16%) Foreign Exchange (FX)
11 14 (1.16%) Replication
12 13 (1.07%) Derivative
12 13 (1.07%) Virtual Team
13 12 (0.99%) Credit Risk
14 11 (0.91%) Clustering
14 11 (0.91%) Enterprise Software
14 11 (0.91%) Fixed Income
15 10 (0.83%) PKI
Operating Systems
1 148 (12.21%) Linux
2 69 (5.69%) Unix
3 40 (3.30%) Red Hat Enterprise Linux
4 34 (2.81%) Windows
5 10 (0.83%) Apple iOS
6 8 (0.66%) CentOS
6 8 (0.66%) Windows 10
7 7 (0.58%) VMS
8 6 (0.50%) Android
9 4 (0.33%) Ubuntu
10 3 (0.25%) Debian
10 3 (0.25%) Windows Server
11 2 (0.17%) Embedded Linux
11 2 (0.17%) Mac OS X
12 1 (0.083%) AIX
12 1 (0.083%) Fedora
12 1 (0.083%) Mac OS
Processes & Methodologies
1 499 (41.17%) Agile Software Development
2 350 (28.88%) Analytics
3 281 (23.18%) DevOps
4 218 (17.99%) Data Science
5 210 (17.33%) Machine Learning
6 190 (15.68%) ETL
7 163 (13.45%) Scrum
8 154 (12.71%) Data Modelling
9 153 (12.62%) Business Intelligence
10 145 (11.96%) Data Engineering
11 136 (11.22%) Migration
12 133 (10.97%) Artificial Intelligence
13 131 (10.81%) Microservices
14 130 (10.73%) Continuous Integration
14 130 (10.73%) Problem-Solving
15 119 (9.82%) TDD
16 115 (9.49%) Computer Science
17 103 (8.50%) Data Analytics
18 86 (7.10%) Kanban
19 82 (6.77%) Software Engineering
Programming Languages
1 495 (40.84%) Python
2 358 (29.54%) SQL
3 355 (29.29%) Java
4 219 (18.07%) Scala
5 85 (7.01%) JavaScript
6 71 (5.86%) C#
6 71 (5.86%) R
7 47 (3.88%) Bash Shell
8 39 (3.22%) Shell Script
9 31 (2.56%) C++
10 28 (2.31%) Go
11 27 (2.23%) Ruby
12 24 (1.98%) PL/SQL
13 22 (1.82%) Java 8
14 20 (1.65%) T-SQL
15 18 (1.49%) PowerShell
16 16 (1.32%) Perl
17 14 (1.16%) C
17 14 (1.16%) Groovy
18 12 (0.99%) TypeScript
Qualifications
1 107 (8.83%) Degree
2 91 (7.51%) Security Cleared
3 65 (5.36%) SC Cleared
4 41 (3.38%) Computer Science Degree
5 37 (3.05%) PhD
6 25 (2.06%) Master's Degree
7 18 (1.49%) DV Cleared
8 9 (0.74%) AWS Certification
9 8 (0.66%) CISSP
10 7 (0.58%) PMI Certification
10 7 (0.58%) PMP
11 5 (0.41%) CCA
12 4 (0.33%) CEH
12 4 (0.33%) Cisco Certification
12 4 (0.33%) CISM
12 4 (0.33%) Numerate Degree
13 3 (0.25%) CCIE
13 3 (0.25%) CCNP
13 3 (0.25%) ISEB
13 3 (0.25%) TOGAF Certification
Quality Assurance & Compliance
1 36 (2.97%) Data Quality
1 36 (2.97%) QA
2 8 (0.66%) PMO
3 4 (0.33%) GDPR
3 4 (0.33%) ISO/IEC 27001
3 4 (0.33%) PCI DSS
4 3 (0.25%) COBIT
4 3 (0.25%) SLA
5 2 (0.17%) ISO 9000
5 2 (0.17%) MiFID
5 2 (0.17%) NIST
5 2 (0.17%) Sarbanes-Oxley
6 1 (0.083%) Basel III
6 1 (0.083%) EMIR
6 1 (0.083%) GLBA
6 1 (0.083%) HIPAA
6 1 (0.083%) IFRS
6 1 (0.083%) IFRS 9
6 1 (0.083%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
System Software
1 175 (14.44%) Docker
2 39 (3.22%) HDFS
3 10 (0.83%) Active Directory
4 9 (0.74%) XenApp
5 7 (0.58%) Microsoft App-V
5 7 (0.58%) Virtual Desktop
5 7 (0.58%) VMware Infrastructure
5 7 (0.58%) XenDesktop
6 6 (0.50%) Apache Flume
7 5 (0.41%) Oracle RAC
8 4 (0.33%) Apache ZooKeeper
9 3 (0.25%) Hyper-V
9 3 (0.25%) Virtual Machines
10 2 (0.17%) BusyBox
10 2 (0.17%) VirtualBox
10 2 (0.17%) VMware ESXi
11 1 (0.083%) Samba
11 1 (0.083%) vSphere
11 1 (0.083%) Xen
Systems Management
1 169 (13.94%) Kubernetes
2 100 (8.25%) Terraform
3 87 (7.18%) Ansible
4 38 (3.14%) Opscode Chef
5 31 (2.56%) Hadoop YARN
6 14 (1.16%) Puppet
7 12 (0.99%) Kibana
8 11 (0.91%) ITRS Geneos
9 8 (0.66%) Enterprise Manager Cloud Control
9 8 (0.66%) Istio
9 8 (0.66%) Oozie
9 8 (0.66%) Prometheus
10 7 (0.58%) SCCM
11 6 (0.50%) Grafana
12 5 (0.41%) Microsoft Intune
13 3 (0.25%) Microsoft Data Protection Manager
13 3 (0.25%) Packer
13 3 (0.25%) SCOM
13 3 (0.25%) SCOrch
13 3 (0.25%) SELinux
Vendors
1 182 (15.02%) Google
2 111 (9.16%) Oracle
3 109 (8.99%) Microsoft
4 70 (5.78%) Cloudera
5 65 (5.36%) Tableau
6 60 (4.95%) Databricks
7 42 (3.47%) Red Hat
8 33 (2.72%) Hortonworks
8 33 (2.72%) SAP
9 24 (1.98%) Informatica
10 23 (1.90%) Greenplum
11 22 (1.82%) Talend
12 20 (1.65%) Splunk
13 19 (1.57%) Teradata
14 18 (1.49%) Alteryx
14 18 (1.49%) MapR
15 16 (1.32%) StreamSets
16 13 (1.07%) Cisco
17 12 (0.99%) Sybase
18 10 (0.83%) Citrix