Period
to 24 May 2019

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 24 May 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK > England
6 months to
24 May 2019
Same period 2018 Same period 2017
Rank 71 78 87
Rank change year-on-year +7 +9 +68
Contract jobs citing Big Data 2,767 2,815 2,250
As % of all contract IT jobs advertised in England 3.30% 3.06% 2.69%
As % of the Database & Business Intelligence category 14.61% 13.56% 11.93%
Number of daily rates quoted 1,999 1,963 1,544
England median daily rate £550 £550 £525
Median daily rate % change year-on-year - +4.76% -
10th Percentile £413 £406 £363
90th Percentile £713 £688 £675
UK median daily rate £550 £550 £525
% change year-on-year - +4.76% -
Number of hourly rates quoted 11 7 6
England median hourly rate £49.13 £45.00 £47.00
Median hourly rate % change year-on-year +9.18% -4.26% +93.81%
10th Percentile £35.00 £21.50 £32.50
90th Percentile £61.25 £73.75 £50.00
UK median hourly rate £49.13 £46.25 £47.00
% change year-on-year +6.23% -1.60% +93.81%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 18,935 20,760 18,866
As % of all contract IT jobs advertised in England 22.59% 22.54% 22.60%
Number of daily rates quoted 13,118 14,586 12,689
England median daily rate £488 £475 £447
Median daily rate % change year-on-year +2.63% +6.26% +5.18%
10th Percentile £325 £313 £300
90th Percentile £650 £638 £615
UK median daily rate £475 £473 £437
% change year-on-year +0.53% +8.12% +2.82%
Number of hourly rates quoted 231 212 220
England median hourly rate £35.00 £32.00 £30.00
Median hourly rate % change year-on-year +9.38% +6.67% +9.09%
10th Percentile £14.00 £14.03 £9.25
90th Percentile £57.50 £53.50 £48.88
UK median hourly rate £35.00 £33.00 £30.00
% change year-on-year +6.06% +10.00% +8.11%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a percentage of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in England.

Contractor daily rate trend for Big Data in England

Big Data
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Big Data in England over the 6 months to 24 May 2019.

Contractor daily rate histogram for Big Data in England

Big Data
Contractor Hourly Rate Trend in England

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in England.

Contractor hourly rate trend for Big Data in England

Big Data
Contractor Hourly Rate Histogram in England

The hourly rate distribution of IT jobs citing Big Data in England over the 6 months to 24 May 2019.

Contractor hourly rate histogram for Big Data in England

Big Data
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the England region over the 6 months to 24 May 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +9 1,866 £550 -1.79% 206
South East -25 364 £500 - 38
North of England +24 274 £550 +10.00% 48
Yorkshire +3 130 £475 - 9
North West +29 119 £600 +9.09% 35
Midlands 0 84 £525 +10.53% 20
South West -31 83 £550 +16.09% 25
East of England +1 74 £525 +16.67% 27
West Midlands +25 53 £603 +26.95% 12
East Midlands -18 31 £450 -5.26% 8
North East +25 25 £563 -10.00% 5
South Coast - 1 - -
Big Data
UK

For the 6 months to 24 May 2019, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Big Data.

1 1,190 (43.01%) Hadoop
2 1,111 (40.15%) Apache Spark
3 1,048 (37.87%) Python
4 957 (34.59%) Amazon AWS
5 926 (33.47%) Agile Software Development
6 860 (31.08%) SQL
7 853 (30.83%) Analytics
8 799 (28.88%) Java
9 707 (25.55%) Kafka
10 649 (23.46%) Finance
11 589 (21.29%) Apache Hive
12 558 (20.17%) Microsoft Azure
13 539 (19.48%) Data Science
14 524 (18.94%) DevOps
15 522 (18.87%) Data Warehouse
16 463 (16.73%) Machine Learning
17 434 (15.68%) Scala
18 403 (14.56%) Docker
19 398 (14.38%) Linux
20 393 (14.20%) Data Modelling
20 393 (14.20%) Jenkins
21 392 (14.17%) ETL
22 391 (14.13%) NoSQL
23 379 (13.70%) Google Cloud Platform
24 378 (13.66%) Business Intelligence
25 353 (12.76%) Kubernetes
26 327 (11.82%) Google
27 323 (11.67%) Analytical Skills
28 301 (10.88%) Scrum
29 289 (10.44%) Apache

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,111 (40.15%) Apache Spark
2 289 (10.44%) Apache
3 154 (5.57%) Elasticsearch
4 134 (4.84%) Apache Airflow
5 74 (2.67%) SAS
6 58 (2.10%) Apache Pig
7 56 (2.02%) Confluence
8 50 (1.81%) Apache Solr
9 30 (1.08%) nginx
10 29 (1.05%) Luigi
11 24 (0.87%) Cloud Foundry
12 20 (0.72%) Jupyter
13 16 (0.58%) IIS
14 14 (0.51%) Tomcat
15 11 (0.40%) Skype for Business
15 11 (0.40%) WebSphere
16 9 (0.33%) Apache Qpid
16 9 (0.33%) Exchange Server 2013
17 8 (0.29%) Oracle Coherence
18 7 (0.25%) Oracle SOA Suite
Applications
1 52 (1.88%) Microsoft Excel
2 24 (0.87%) Microsoft Office
3 17 (0.61%) SPSS
4 16 (0.58%) Stata
5 12 (0.43%) MS Visio
6 9 (0.33%) Microsoft PowerPoint
7 6 (0.22%) Chatbot
8 3 (0.11%) Spreadsheet
9 2 (0.072%) InVision
9 2 (0.072%) LaTeX
9 2 (0.072%) Sketch
10 1 (0.036%) Microsoft Project
Business Applications
1 18 (0.65%) SAP Oil and Gas
2 13 (0.47%) Dynamics CRM
3 11 (0.40%) Actimize
4 7 (0.25%) Distributed Ledger
4 7 (0.25%) SAP S/4HANA
5 5 (0.18%) Dynamics AX
5 5 (0.18%) Dynamics NAV
5 5 (0.18%) Oracle BPM
6 4 (0.14%) SAP ERP
7 1 (0.036%) NetSuite
7 1 (0.036%) Oracle Retail
7 1 (0.036%) PeopleSoft Financials
7 1 (0.036%) Salesforce.com CRM
7 1 (0.036%) SAP HR
7 1 (0.036%) SAP MDG
7 1 (0.036%) WebTrends
Cloud Services
1 957 (34.59%) Amazon AWS
2 558 (20.17%) Microsoft Azure
3 379 (13.70%) Google Cloud Platform
4 171 (6.18%) Amazon EMR
5 164 (5.93%) Power Platform
6 148 (5.35%) GitHub
7 142 (5.13%) Amazon S3
8 135 (4.88%) Serverless
9 90 (3.25%) Amazon Kinesis
10 79 (2.86%) Amazon EC2
11 74 (2.67%) PaaS
12 73 (2.64%) AWS Lambda
12 73 (2.64%) Azure Data Factory
13 56 (2.02%) Cloud Computing
14 54 (1.95%) AWS CloudFormation
15 42 (1.52%) Amazon SQS
16 41 (1.48%) Amazon CloudWatch
16 41 (1.48%) IaaS
17 32 (1.16%) SaaS
18 30 (1.08%) Virtual Private Cloud
Communications & Networking
1 51 (1.84%) Kerberos
2 41 (1.48%) Firewall
3 28 (1.01%) HTTP
4 27 (0.98%) DNS
5 23 (0.83%) SSL
5 23 (0.83%) TCP/IP
6 18 (0.65%) Internet
7 14 (0.51%) MQTT
7 14 (0.51%) SAN
8 13 (0.47%) AMQP
8 13 (0.47%) VPN
9 11 (0.40%) 3G
9 11 (0.40%) 4G
9 11 (0.40%) Cisco Nexus
9 11 (0.40%) Fibre Channel
9 11 (0.40%) iSCSI
10 9 (0.33%) 2G
10 9 (0.33%) Cisco ASA
10 9 (0.33%) Cisco Firepower
11 7 (0.25%) DSL
Database & Business Intelligence
1 1,190 (43.01%) Hadoop
2 589 (21.29%) Apache Hive
3 522 (18.87%) Data Warehouse
4 391 (14.13%) NoSQL
5 275 (9.94%) HBase
6 249 (9.00%) Data Lake
7 190 (6.87%) SQL Server
8 178 (6.43%) Apache Cassandra
8 178 (6.43%) Relational Database
9 164 (5.93%) Power BI
10 157 (5.67%) MongoDB
11 151 (5.46%) Amazon Redshift
12 149 (5.38%) PostgreSQL
13 144 (5.20%) Impala
14 118 (4.26%) MySQL
15 92 (3.32%) Star Schema
16 89 (3.22%) SQL Server Integration Services
17 83 (3.00%) OLAP
18 82 (2.96%) BigQuery
19 76 (2.75%) Sqoop
Development Applications
1 393 (14.20%) Jenkins
2 277 (10.01%) Git (software)
3 149 (5.38%) JIRA
4 83 (3.00%) Maven
5 75 (2.71%) Gradle
6 56 (2.02%) GitLab
7 54 (1.95%) Visual Studio Team System
8 49 (1.77%) Sonatype Nexus
9 44 (1.59%) Atlassian Bamboo
10 42 (1.52%) TeamCity
11 38 (1.37%) Selenium
12 35 (1.26%) Subversion
13 31 (1.12%) Cucumber
14 27 (0.98%) JUnit
15 26 (0.94%) CircleCI
16 23 (0.83%) Visual Studio
17 22 (0.80%) Jasmine
18 21 (0.76%) IntelliJ
19 20 (0.72%) Ant
19 20 (0.72%) Eclipse
General
1 649 (23.46%) Finance
2 232 (8.38%) Banking
3 132 (4.77%) Retail
4 86 (3.11%) Marketing
5 78 (2.82%) Telecoms
6 55 (1.99%) Front Office
7 51 (1.84%) Investment Banking
8 46 (1.66%) Legal
9 35 (1.26%) Financial Institution
10 33 (1.19%) Manufacturing
11 26 (0.94%) Games
12 25 (0.90%) Advertising
13 19 (0.69%) Pharmaceutical
14 14 (0.51%) Electronics
15 11 (0.40%) Retail Banking
16 9 (0.33%) Automotive
16 9 (0.33%) Publishing
17 6 (0.22%) Law
18 4 (0.14%) Aerospace
18 4 (0.14%) Back Office
Job Titles
1 682 (24.65%) Data Engineer
2 648 (23.42%) Developer
3 422 (15.25%) Big Data Engineer
4 407 (14.71%) Architect
5 205 (7.41%) Data Architect
5 205 (7.41%) Java Developer
6 194 (7.01%) DevOps Engineer
7 184 (6.65%) Python Engineer
8 154 (5.57%) Big Data Developer
9 144 (5.20%) Data Scientist
10 132 (4.77%) Hadoop Engineer
11 121 (4.37%) Analyst
12 110 (3.98%) Python Developer
13 104 (3.76%) Cloud Engineer
14 97 (3.51%) AWS Engineer
15 96 (3.47%) Big Data Architect
16 87 (3.14%) Consultant
17 80 (2.89%) Senior Developer
18 73 (2.64%) Solutions Architect
19 70 (2.53%) Business Analyst
Libraries, Frameworks & Software Standards
1 707 (25.55%) Kafka
2 143 (5.17%) PySpark
3 128 (4.63%) REST
4 125 (4.52%) Spring
5 120 (4.34%) Web Services
6 99 (3.58%) JSON
7 95 (3.43%) .NET
8 89 (3.22%) RESTful
9 87 (3.14%) Node.js
10 82 (2.96%) HTML
11 78 (2.82%) Apache NiFi
12 75 (2.71%) React
13 71 (2.57%) AngularJS
14 69 (2.49%) Spark Streaming
15 66 (2.39%) Natural Language Processing
16 64 (2.31%) RabbitMQ
16 64 (2.31%) TensorFlow
17 63 (2.28%) CSS
17 63 (2.28%) XML
18 58 (2.10%) Spring Boot
Miscellaneous
1 323 (11.67%) Analytical Skills
2 166 (6.00%) Greenfield Project
3 162 (5.85%) Algorithms
4 103 (3.72%) Data Structures
5 86 (3.11%) Fintech
6 61 (2.20%) Self-Motivation
7 57 (2.06%) Public Cloud
8 53 (1.92%) User Experience
9 42 (1.52%) Cloud Native
10 40 (1.45%) Management Information System
11 36 (1.30%) Linux Command Line
12 32 (1.16%) Virtual Team
13 28 (1.01%) Clustering
13 28 (1.01%) Enterprise Software
14 26 (0.94%) Hedge funds
15 23 (0.83%) Data Protection Act
16 21 (0.76%) Data Centre
16 21 (0.76%) Market Risk
16 21 (0.76%) Mobile App
17 19 (0.69%) Hybrid Cloud
Operating Systems
1 398 (14.38%) Linux
2 169 (6.11%) Unix
3 79 (2.86%) Windows
4 30 (1.08%) Red Hat Enterprise Linux
5 20 (0.72%) Windows Server
6 15 (0.54%) Solaris
7 13 (0.47%) Android
8 11 (0.40%) Ubuntu
9 10 (0.36%) Apple iOS
10 9 (0.33%) CentOS
11 4 (0.14%) AIX
12 3 (0.11%) Windows Server 2003
12 3 (0.11%) Windows Vista
13 2 (0.072%) SUSE Linux Enterprise Server
14 1 (0.036%) Data ONTAP
14 1 (0.036%) VMS
14 1 (0.036%) Windows 10
14 1 (0.036%) Windows Server 2012
Processes & Methodologies
1 926 (33.47%) Agile Software Development
2 853 (30.83%) Analytics
3 539 (19.48%) Data Science
4 524 (18.94%) DevOps
5 463 (16.73%) Machine Learning
6 393 (14.20%) Data Modelling
7 392 (14.17%) ETL
8 378 (13.66%) Business Intelligence
9 301 (10.88%) Scrum
10 283 (10.23%) Data Engineering
11 273 (9.87%) Continuous Integration
12 250 (9.04%) TDD
13 248 (8.96%) Software Engineering
14 229 (8.28%) Visualisation
15 225 (8.13%) Migration
16 222 (8.02%) Data Analytics
17 221 (7.99%) Microservices
18 204 (7.37%) Problem-Solving
19 199 (7.19%) Data Analysis
20 194 (7.01%) Artificial Intelligence
Programming Languages
1 1,048 (37.87%) Python
2 860 (31.08%) SQL
3 799 (28.88%) Java
4 434 (15.68%) Scala
5 176 (6.36%) R
6 169 (6.11%) JavaScript
7 142 (5.13%) C#
8 134 (4.84%) Bash Shell
9 111 (4.01%) Java 8
10 89 (3.22%) Shell Script
11 85 (3.07%) C++
12 74 (2.67%) Ruby
13 60 (2.17%) PowerShell
14 57 (2.06%) T-SQL
15 43 (1.55%) Go
16 41 (1.48%) C
17 40 (1.45%) PL/SQL
18 37 (1.34%) MATLAB
19 34 (1.23%) Groovy
20 28 (1.01%) Perl
Qualifications
1 248 (8.96%) Security Cleared
2 202 (7.30%) Degree
3 197 (7.12%) SC Cleared
4 54 (1.95%) PhD
5 52 (1.88%) Master's Degree
6 42 (1.52%) DV Cleared
7 38 (1.37%) Computer Science Degree
8 20 (0.72%) TOGAF Certification
9 18 (0.65%) PMI Certification
9 18 (0.65%) PMP
10 17 (0.61%) CCA
11 16 (0.58%) AWS Certification
12 13 (0.47%) CISSP
12 13 (0.47%) Microsoft Certification
13 12 (0.43%) CISM
13 12 (0.43%) ITIL Certification
13 12 (0.43%) MCSE
14 11 (0.40%) BPSS Clearance
14 11 (0.40%) CTC Cleared
15 8 (0.29%) MCSA
Quality Assurance & Compliance
1 136 (4.92%) Data Quality
2 40 (1.45%) QA
3 29 (1.05%) GDPR
4 7 (0.25%) PMO
5 6 (0.22%) IFRS
5 6 (0.22%) ISO/IEC 27001
6 5 (0.18%) SLA
7 4 (0.14%) Sarbanes-Oxley
8 3 (0.11%) PCI DSS
9 2 (0.072%) Disclosure Scotland
9 2 (0.072%) IFRS 9
9 2 (0.072%) PSD2
10 1 (0.036%) Actionable Recommendations
10 1 (0.036%) GxP
10 1 (0.036%) MiFID
System Software
1 403 (14.56%) Docker
2 202 (7.30%) HDFS
3 124 (4.48%) Apache Flume
4 45 (1.63%) Apache ZooKeeper
5 43 (1.55%) Active Directory
6 34 (1.23%) Virtual Machines
7 23 (0.83%) VMware Infrastructure
8 20 (0.72%) Oracle RAC
9 18 (0.65%) Hyper-V
10 14 (0.51%) XenApp
11 11 (0.40%) vCloud
12 4 (0.14%) VMware ESXi
13 3 (0.11%) vSphere
14 2 (0.072%) NFS
14 2 (0.072%) Samba
15 1 (0.036%) KVM
15 1 (0.036%) Virtual Servers
15 1 (0.036%) VirtualBox
Systems Management
1 353 (12.76%) Kubernetes
2 254 (9.18%) Ansible
3 222 (8.02%) Terraform
4 135 (4.88%) Puppet
5 110 (3.98%) Oozie
6 106 (3.83%) Hadoop YARN
7 81 (2.93%) Opscode Chef
8 28 (1.01%) Salt
9 24 (0.87%) Kibana
10 20 (0.72%) logstash
11 18 (0.65%) Docker Swarm
12 17 (0.61%) Microsoft Clustering
13 14 (0.51%) SCOM
14 12 (0.43%) ZABBIX
15 11 (0.40%) Mesos
15 11 (0.40%) Microsoft Data Protection Manager
15 11 (0.40%) Nagios
15 11 (0.40%) SCOrch
15 11 (0.40%) Symantec Enterprise Vault
16 9 (0.33%) QRadar
Vendors
1 327 (11.82%) Google
2 278 (10.05%) Cloudera
3 232 (8.38%) Microsoft
4 186 (6.72%) Oracle
5 184 (6.65%) Hortonworks
6 140 (5.06%) Tableau
7 91 (3.29%) Talend
8 86 (3.11%) Databricks
9 65 (2.35%) Informatica
10 63 (2.28%) SAP
11 44 (1.59%) Greenplum
12 39 (1.41%) Splunk
13 38 (1.37%) MapR
14 31 (1.12%) Teradata
15 29 (1.05%) MicroStrategy
16 27 (0.98%) Alteryx
16 27 (0.98%) Red Hat
16 27 (0.98%) VMware
17 24 (0.87%) Facebook
18 22 (0.80%) IBM