Period
to 19 March 2019

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 19 March 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > London
6 months to
19 Mar 2019
Same period 2018 Same period 2017
Rank 63 70 51
Rank change year-on-year +7 -19 +50
Contract jobs citing Big Data 1,683 1,732 1,790
As % of all contract IT jobs advertised in London 3.93% 3.72% 4.44%
As % of the Database & Business Intelligence category 16.12% 15.62% 18.20%
Number of daily rates quoted 1,276 1,271 1,233
London median daily rate £550 £550 £550
10th Percentile £433 £413 £401
90th Percentile £725 £700 £713
England median daily rate £550 £550 £525
% change year-on-year - +4.76% +0.96%
Number of hourly rates quoted 3 0 1
London median hourly rate £45.00 - £100.00
10th Percentile £36.50 - £90.00
90th Percentile £55.50 - £110.00
England median hourly rate £45.00 £31.31 £47.00
% change year-on-year +43.72% -33.38% +77.61%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 10,439 11,087 9,833
As % of all contract IT jobs advertised in London 24.40% 23.84% 24.39%
Number of daily rates quoted 7,690 8,397 7,017
London median daily rate £525 £513 £475
Median daily rate % change year-on-year +2.44% +7.89% +1.33%
10th Percentile £370 £358 £325
90th Percentile £675 £663 £650
England median daily rate £488 £475 £440
% change year-on-year +2.63% +7.95% +3.53%
Number of hourly rates quoted 54 76 40
London median hourly rate £28.50 £27.75 £31.25
Median hourly rate % change year-on-year +2.70% -11.20% +20.19%
10th Percentile £18.37 £17.80 £15.25
90th Percentile £50.65 £44.78 £50.38
England median hourly rate £35.00 £35.00 £25.00
% change year-on-year - +40.00% -1.73%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a percentage of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in London.

Contractor daily rate trend for Big Data in London

Big Data
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Big Data in London over the 6 months to 19 March 2019.

Contractor daily rate histogram for Big Data in London

Big Data
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in London.

Contractor hourly rate trend for Big Data in London

Big Data
Contractor Hourly Rate Histogram in London

The hourly rate distribution of IT jobs citing Big Data in London over the 6 months to 19 March 2019.

Contractor hourly rate histogram for Big Data in London

Big Data
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the London region over the 6 months to 19 March 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +19 365 £550 -2.22% 167
East London +13 88 £525 -6.67% 18
South London -10 85 £600 +9.09% 9
West London +46 64 £550 +4.76% 43
North London +1 11 £700 +27.27% 5
Big Data
England

For the 6 months to 19 March 2019, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Big Data.

1 674 (40.05%) Hadoop
2 639 (37.97%) Python
3 604 (35.89%) Apache Spark
4 553 (32.86%) Amazon AWS
5 526 (31.25%) Agile Software Development
6 517 (30.72%) Java
7 490 (29.11%) Analytics
8 471 (27.99%) SQL
9 458 (27.21%) Finance
10 434 (25.79%) Kafka
11 362 (21.51%) Data Science
12 345 (20.50%) Microsoft Azure
13 338 (20.08%) Apache Hive
14 300 (17.83%) DevOps
15 299 (17.77%) Machine Learning
16 288 (17.11%) Docker
17 247 (14.68%) Data Warehouse
18 243 (14.44%) ETL
19 242 (14.38%) Kubernetes
20 241 (14.32%) Data Modelling
21 235 (13.96%) Scala
22 233 (13.84%) Business Intelligence
23 218 (12.95%) Analytical Skills
24 211 (12.54%) Google Cloud Platform
25 210 (12.48%) Jenkins
26 200 (11.88%) NoSQL
27 192 (11.41%) Linux
28 191 (11.35%) Scrum
29 186 (11.05%) HBase
30 184 (10.93%) Google

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 604 (35.89%) Apache Spark
2 155 (9.21%) Apache
3 110 (6.54%) Elasticsearch
4 51 (3.03%) Apache Airflow
5 50 (2.97%) Confluence
6 43 (2.55%) Apache Pig
7 35 (2.08%) Apache Solr
8 30 (1.78%) SAS
9 26 (1.54%) nginx
10 24 (1.43%) Cloud Foundry
11 15 (0.89%) Tomcat
12 14 (0.83%) WebSphere
13 12 (0.71%) Oracle Coherence
14 11 (0.65%) IIS
15 8 (0.48%) Exchange Server 2013
15 8 (0.48%) Luigi
15 8 (0.48%) Skype for Business
16 6 (0.36%) Jupyter
16 6 (0.36%) Oracle SOA Suite
17 5 (0.30%) CMS
Applications
1 20 (1.19%) Microsoft Office
2 16 (0.95%) Microsoft Excel
3 7 (0.42%) Chatbot
4 5 (0.30%) Microsoft PowerPoint
5 3 (0.18%) MS Visio
6 2 (0.12%) InVision
6 2 (0.12%) LaTeX
6 2 (0.12%) Spreadsheet
7 1 (0.059%) GNU Octave
7 1 (0.059%) iWork
Business Applications
1 20 (1.19%) SAP Oil and Gas
2 11 (0.65%) Actimize
3 3 (0.18%) Distributed Ledger
3 3 (0.18%) Dynamics CRM
3 3 (0.18%) IBM Operational Decision Manager
3 3 (0.18%) SAP ERP
3 3 (0.18%) SAP S/4HANA
4 2 (0.12%) Dynamics NAV
5 1 (0.059%) Dynamics AX
5 1 (0.059%) NetSuite
5 1 (0.059%) Remedy ITSM
5 1 (0.059%) SAP MDG
5 1 (0.059%) SAP MM
5 1 (0.059%) SAP R/3
5 1 (0.059%) Summit
5 1 (0.059%) WebTrends
Cloud Services
1 553 (32.86%) Amazon AWS
2 345 (20.50%) Microsoft Azure
3 211 (12.54%) Google Cloud Platform
4 98 (5.82%) Amazon EMR
5 73 (4.34%) Amazon S3
6 68 (4.04%) GitHub
7 58 (3.45%) Serverless
8 44 (2.61%) PaaS
9 41 (2.44%) Amazon EC2
10 38 (2.26%) IaaS
11 35 (2.08%) Amazon Kinesis
12 34 (2.02%) Cloud Computing
13 33 (1.96%) AWS CloudFormation
14 30 (1.78%) Amazon CloudWatch
15 29 (1.72%) AWS Lambda
16 26 (1.54%) Virtual Private Cloud
17 24 (1.43%) Azure Data Factory
17 24 (1.43%) SaaS
18 22 (1.31%) Office 365
19 21 (1.25%) Heroku
Communications & Networking
1 34 (2.02%) Kerberos
2 31 (1.84%) Firewall
3 26 (1.54%) HTTP
4 19 (1.13%) DNS
5 18 (1.07%) TCP/IP
6 17 (1.01%) SSL
7 14 (0.83%) VPN
8 12 (0.71%) SAN
9 10 (0.59%) Cisco Nexus
9 10 (0.59%) Fibre Channel
9 10 (0.59%) iSCSI
10 9 (0.53%) AMQP
11 8 (0.48%) Cisco ASA
11 8 (0.48%) Cisco Firepower
11 8 (0.48%) DSL
11 8 (0.48%) FTP
11 8 (0.48%) Internet
12 5 (0.30%) WAN
13 4 (0.24%) 3G
13 4 (0.24%) 4G
Database & Business Intelligence
1 674 (40.05%) Hadoop
2 338 (20.08%) Apache Hive
3 247 (14.68%) Data Warehouse
4 200 (11.88%) NoSQL
5 186 (11.05%) HBase
6 125 (7.43%) MongoDB
7 120 (7.13%) Data Lake
8 119 (7.07%) Relational Database
9 118 (7.01%) Apache Cassandra
9 118 (7.01%) SQL Server
10 94 (5.59%) Power BI
11 87 (5.17%) SQL Server Integration Services
12 80 (4.75%) Amazon Redshift
13 73 (4.34%) PostgreSQL
14 71 (4.22%) Impala
15 69 (4.10%) Star Schema
16 64 (3.80%) MySQL
17 57 (3.39%) Redis
18 45 (2.67%) OLAP
19 41 (2.44%) BigQuery
Development Applications
1 210 (12.48%) Jenkins
2 154 (9.15%) Git (software)
3 81 (4.81%) JIRA
4 44 (2.61%) Maven
5 40 (2.38%) Visual Studio Team System
6 35 (2.08%) GitLab
7 29 (1.72%) Sonatype Nexus
8 28 (1.66%) TeamCity
9 27 (1.60%) Gradle
10 24 (1.43%) Selenium
11 23 (1.37%) Cucumber
12 21 (1.25%) gulp
13 18 (1.07%) Atlassian Bamboo
13 18 (1.07%) CircleCI
13 18 (1.07%) Jasmine
14 16 (0.95%) Visual Studio
15 15 (0.89%) Artifactory
16 14 (0.83%) Bitbucket
16 14 (0.83%) JUnit
16 14 (0.83%) SpecFlow
General
1 458 (27.21%) Finance
2 178 (10.58%) Banking
3 97 (5.76%) Retail
4 62 (3.68%) Front Office
5 56 (3.33%) Marketing
6 49 (2.91%) Legal
7 41 (2.44%) Investment Banking
8 39 (2.32%) Telecoms
9 21 (1.25%) Games
10 20 (1.19%) Advertising
11 19 (1.13%) Financial Institution
12 16 (0.95%) Manufacturing
13 13 (0.77%) Publishing
13 13 (0.77%) Retail Banking
14 9 (0.53%) Automotive
15 5 (0.30%) Back Office
15 5 (0.30%) Electronics
16 4 (0.24%) Pharmaceutical
17 3 (0.18%) General Ledger
18 2 (0.12%) Dutch Language
Job Titles
1 443 (26.32%) Developer
2 399 (23.71%) Data Engineer
3 260 (15.45%) Big Data Engineer
4 241 (14.32%) Architect
5 174 (10.34%) Java Developer
6 131 (7.78%) DevOps Engineer
7 128 (7.61%) Python Engineer
8 122 (7.25%) Big Data Developer
9 118 (7.01%) Data Scientist
10 115 (6.83%) Data Architect
11 73 (4.34%) Hadoop Engineer
12 71 (4.22%) Analyst
13 68 (4.04%) Senior Developer
14 64 (3.80%) Big Data Architect
15 57 (3.39%) Java Engineer
16 54 (3.21%) Python Developer
17 47 (2.79%) Apache Spark Developer
18 43 (2.55%) Consultant
18 43 (2.55%) Senior Data Engineer
19 42 (2.50%) Scala Developer
Libraries, Frameworks & Software Standards
1 434 (25.79%) Kafka
2 101 (6.00%) REST
3 95 (5.64%) PySpark
4 76 (4.52%) Web Services
5 72 (4.28%) Spring
6 66 (3.92%) HTML
7 64 (3.80%) Node.js
8 63 (3.74%) JSON
9 59 (3.51%) AngularJS
10 53 (3.15%) Apache NiFi
11 51 (3.03%) .NET
11 51 (3.03%) React
12 50 (2.97%) RESTful
12 50 (2.97%) TensorFlow
13 47 (2.79%) Natural Language Processing
14 43 (2.55%) XML
15 42 (2.50%) Spring Boot
16 40 (2.38%) CSS
17 37 (2.20%) Elastic Stack
17 37 (2.20%) SOAP
Miscellaneous
1 218 (12.95%) Analytical Skills
2 141 (8.38%) Algorithms
3 126 (7.49%) Greenfield Project
4 64 (3.80%) Fintech
5 60 (3.57%) Data Structures
6 38 (2.26%) User Experience
7 28 (1.66%) Public Cloud
8 27 (1.60%) Market Risk
9 26 (1.54%) Self-Motivation
10 24 (1.43%) Management Information System
11 17 (1.01%) Data Centre
12 15 (0.89%) Cloud Native
12 15 (0.89%) Hedge funds
13 14 (0.83%) Credit Risk
13 14 (0.83%) FMCG
14 13 (0.77%) Mobile App
14 13 (0.77%) Robotics
15 12 (0.71%) Enterprise Software
15 12 (0.71%) Virtual Team
16 11 (0.65%) HoloLens
Operating Systems
1 192 (11.41%) Linux
2 63 (3.74%) Unix
3 41 (2.44%) Windows
4 11 (0.65%) Windows Server
5 9 (0.53%) Android
6 8 (0.48%) Red Hat Enterprise Linux
7 6 (0.36%) Ubuntu
8 5 (0.30%) Apple iOS
9 2 (0.12%) CoreOS
9 2 (0.12%) Solaris
10 1 (0.059%) AIX
10 1 (0.059%) DC/OS
10 1 (0.059%) Debian
10 1 (0.059%) Mac OS X
10 1 (0.059%) Windows 10
Processes & Methodologies
1 526 (31.25%) Agile Software Development
2 490 (29.11%) Analytics
3 362 (21.51%) Data Science
4 300 (17.83%) DevOps
5 299 (17.77%) Machine Learning
6 243 (14.44%) ETL
7 241 (14.32%) Data Modelling
8 233 (13.84%) Business Intelligence
9 191 (11.35%) Scrum
10 156 (9.27%) Continuous Integration
10 156 (9.27%) Software Engineering
11 146 (8.67%) Microservices
12 139 (8.26%) Artificial Intelligence
12 139 (8.26%) Open Source
13 135 (8.02%) Visualisation
14 134 (7.96%) TDD
15 132 (7.84%) Data Engineering
16 130 (7.72%) Data Analytics
17 112 (6.65%) Problem-Solving
18 109 (6.48%) Migration
Programming Languages
1 639 (37.97%) Python
2 517 (30.72%) Java
3 471 (27.99%) SQL
4 235 (13.96%) Scala
5 112 (6.65%) JavaScript
6 105 (6.24%) Java 8
7 104 (6.18%) R
8 94 (5.59%) Bash Shell
9 65 (3.86%) C#
10 63 (3.74%) T-SQL
11 48 (2.85%) Groovy
12 37 (2.20%) Ruby
13 35 (2.08%) PowerShell
14 34 (2.02%) C++
15 32 (1.90%) Shell Script
16 30 (1.78%) PL/SQL
17 23 (1.37%) ES6
18 19 (1.13%) MATLAB
18 19 (1.13%) Perl
19 18 (1.07%) C
Qualifications
1 152 (9.03%) Security Cleared
2 133 (7.90%) Degree
3 130 (7.72%) SC Cleared
4 54 (3.21%) Master's Degree
5 33 (1.96%) Computer Science Degree
5 33 (1.96%) PhD
6 16 (0.95%) DV Cleared
7 12 (0.71%) CTC Cleared
8 7 (0.42%) CISSP
9 6 (0.36%) CISM
10 5 (0.30%) CEH
10 5 (0.30%) ITIL Certification
10 5 (0.30%) Numerate Degree
10 5 (0.30%) PRINCE2 Certification
11 4 (0.24%) AWS Certification
11 4 (0.24%) Cisco Certification
11 4 (0.24%) PMI Certification
12 3 (0.18%) BPSS Clearance
13 2 (0.12%) Oracle Certification
13 2 (0.12%) SANS
Quality Assurance & Compliance
1 92 (5.47%) Data Quality
2 29 (1.72%) QA
3 9 (0.53%) GDPR
4 4 (0.24%) ISO/IEC 27001
4 4 (0.24%) SLA
5 3 (0.18%) MiFID
5 3 (0.18%) Sarbanes-Oxley
6 2 (0.12%) Disclosure Scotland
6 2 (0.12%) Dodd-Frank
6 2 (0.12%) EMIR
6 2 (0.12%) PMO
7 1 (0.059%) Actionable Recommendations
7 1 (0.059%) IFRS
7 1 (0.059%) IFRS 9
System Software
1 288 (17.11%) Docker
2 125 (7.43%) HDFS
3 75 (4.46%) Apache Flume
4 39 (2.32%) Apache ZooKeeper
5 29 (1.72%) Virtual Machines
6 15 (0.89%) Active Directory
6 15 (0.89%) VMware Infrastructure
7 12 (0.71%) Hyper-V
8 11 (0.65%) Oracle RAC
8 11 (0.65%) vCloud
8 11 (0.65%) XenApp
9 2 (0.12%) etcd
9 2 (0.12%) flannel
9 2 (0.12%) LXC
10 1 (0.059%) Cronacle
10 1 (0.059%) Virtual Desktop
10 1 (0.059%) vSphere
10 1 (0.059%) XenDesktop
Systems Management
1 242 (14.38%) Kubernetes
2 168 (9.98%) Ansible
3 121 (7.19%) Terraform
4 74 (4.40%) Puppet
5 65 (3.86%) Hadoop YARN
5 65 (3.86%) Oozie
6 41 (2.44%) Opscode Chef
7 15 (0.89%) Kibana
8 13 (0.77%) Docker Swarm
9 12 (0.71%) logstash
10 11 (0.65%) ZABBIX
11 10 (0.59%) Mesos
11 10 (0.59%) Microsoft Clustering
11 10 (0.59%) Microsoft Data Protection Manager
11 10 (0.59%) SCOM
11 10 (0.59%) SCOrch
11 10 (0.59%) Symantec Enterprise Vault
12 9 (0.53%) Ambari
12 9 (0.53%) Grafana
12 9 (0.53%) QRadar
Vendors
1 184 (10.93%) Google
2 167 (9.92%) Cloudera
3 149 (8.85%) Hortonworks
3 149 (8.85%) Microsoft
4 112 (6.65%) Oracle
5 94 (5.59%) Tableau
6 70 (4.16%) Talend
7 50 (2.97%) Splunk
8 44 (2.61%) Databricks
9 38 (2.26%) Informatica
10 34 (2.02%) SAP
11 33 (1.96%) Greenplum
12 32 (1.90%) Alteryx
13 22 (1.31%) Facebook
13 22 (1.31%) IBM
14 21 (1.25%) MapR
15 20 (1.19%) VMware
16 17 (1.01%) Teradata
17 16 (0.95%) Cisco
18 14 (0.83%) Citrix