Period
to 18 November 2017

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 18 November 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK > England
6 months to
18 Nov 2017
Same period 2016 Same period 2015
Rank 84 102 165
Rank change year-on-year +18 +63 +93
Contract jobs citing Big Data 2620 2308 1569
As % of all contract IT jobs advertised in England 2.79% 2.35% 1.49%
As % of the Database & Business Intelligence category 12.65% 10.42% 6.39%
Number of daily rates quoted 1855 1504 1072
England median daily rate £550 £525 £520
Median daily rate % change year-on-year +4.76% +0.96% +0.97%
10th Percentile £400 £369 £363
90th Percentile £688 £700 £675
UK median daily rate £550 £525 £520
% change year-on-year +4.76% +0.96% +1.96%
Number of hourly rates quoted 18 15 5
England median hourly rate £30.91 £43.00 £46.50
Median hourly rate % change year-on-year -28.13% -7.53% +55.00%
10th Percentile £16.64 £42.10 £24.50
90th Percentile £59.92 £84.70 £58.25
UK median hourly rate £30.91 £42.92 £46.50
% change year-on-year -27.99% -7.70% +55.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 20718 22156 24548
As % of all contract IT jobs advertised in England 22.07% 22.57% 23.38%
Number of daily rates quoted 14345 14872 16334
England median daily rate £455 £425 £413
Median daily rate % change year-on-year +7.06% +3.03% +3.13%
10th Percentile £313 £288 £275
90th Percentile £638 £600 £588
UK median daily rate £450 £425 £400
% change year-on-year +5.88% +6.25% +1.27%
Number of hourly rates quoted 261 320 377
England median hourly rate £31.50 £28.00 £28.00
Median hourly rate % change year-on-year +12.50% - +16.67%
10th Percentile £14.25 £11.23 £12.00
90th Percentile £56.75 £48.08 £52.29
UK median hourly rate £31.15 £28.18 £29.00
% change year-on-year +10.54% -2.83% +19.59%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a percentage of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in England.

Contractor daily rate trend for Big Data in England

Big Data
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Big Data in England over the 6 months to 18 November 2017.

Contractor daily rate histogram for Big Data in England

Big Data
Contractor Hourly Rate Trend in England

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in England.

Contractor hourly rate trend for Big Data in England

Big Data
Contractor Hourly Rate Histogram in England

The hourly rate distribution of IT jobs citing Big Data in England over the 6 months to 18 November 2017.

Contractor hourly rate histogram for Big Data in England

Big Data
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the England region over the 6 months to 18 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +6 1804 £550 - 185
South East +47 386 £500 +3.90% 33
North of England +82 192 £462 -2.74% 34
Midlands +42 100 £475 -1.55% 12
North West +42 98 £550 +15.79% 23
Yorkshire +46 94 £462 -2.74% 10
South West -15 73 £500 +17.65% 11
East of England -34 65 £488 +30.00% 19
West Midlands +30 55 £450 -6.74% 8
East Midlands +33 43 £525 +10.53% 4
North East +77 21 £425 -5.56% 1
Big Data
UK

For the 6 months to 18 November 2017, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the England region with a requirement for Big Data.

1 1508 (57.56%) Hadoop
2 1125 (42.94%) Apache Spark
3 1073 (40.95%) Java
4 996 (38.02%) Agile Software Development
5 771 (29.43%) Python
6 674 (25.73%) Analytics
7 663 (25.31%) SQL
8 631 (24.08%) Kafka
9 613 (23.40%) Finance
10 569 (21.72%) Apache Hive
11 509 (19.43%) Scala
12 493 (18.82%) TDD
12 493 (18.82%) HBase
13 490 (18.70%) Amazon AWS
14 427 (16.30%) Banking
15 422 (16.11%) Linux
16 408 (15.57%) Scrum
17 382 (14.58%) HDFS
18 380 (14.50%) DevOps
19 370 (14.12%) Business Intelligence
20 365 (13.93%) ETL
21 357 (13.63%) NoSQL
22 320 (12.21%) Analytical Skills
23 318 (12.14%) Machine Learning
24 316 (12.06%) Docker
25 312 (11.91%) Data Modelling
26 309 (11.79%) BDD
27 298 (11.37%) MapReduce
28 291 (11.11%) Security Cleared
29 271 (10.34%) Data Warehouse

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1125 (42.94%) Apache Spark
2 254 (9.69%) Apache
3 142 (5.42%) Apache Pig
4 124 (4.73%) Confluence
5 122 (4.66%) Apache Solr
6 120 (4.58%) Elasticsearch
7 106 (4.05%) SAS
8 48 (1.83%) Tomcat
9 36 (1.37%) JBoss
9 36 (1.37%) OpenStack
10 25 (0.95%) nginx
11 22 (0.84%) Cloud Foundry
12 20 (0.76%) WebSphere
13 17 (0.65%) Oracle SOA Suite
14 16 (0.61%) Apache Airflow
14 16 (0.61%) SharePoint
15 12 (0.46%) GemFire
16 11 (0.42%) ArcGIS
16 11 (0.42%) Luigi
16 11 (0.42%) WildFly
Applications
1 50 (1.91%) Microsoft Excel
2 19 (0.73%) Microsoft PowerPoint
2 19 (0.73%) SPSS
3 15 (0.57%) Microsoft Office
4 14 (0.53%) MS Visio
5 10 (0.38%) Pipeline Pilot
6 8 (0.31%) Microsoft Project
6 8 (0.31%) Stata
7 4 (0.15%) Spreadsheet
8 2 (0.076%) Mingle
8 2 (0.076%) Photoshop
8 2 (0.076%) Weka
9 1 (0.038%) Chatbot
9 1 (0.038%) EViews
9 1 (0.038%) Gephi
9 1 (0.038%) GNU Octave
Business Applications
1 11 (0.42%) Payment Gateway
2 7 (0.27%) WebTrends
3 4 (0.15%) Oracle BPM
4 3 (0.11%) Bloomberg TOMS
4 3 (0.11%) Eagle PACE
4 3 (0.11%) SAP CO
4 3 (0.11%) SAP FI
4 3 (0.11%) SAP FI/CO
5 2 (0.076%) Dynamics CRM
5 2 (0.076%) Hyperion Planning
5 2 (0.076%) Markit EDM
5 2 (0.076%) SAP BPC
5 2 (0.076%) SAP CRM
6 1 (0.038%) Cognos Business Intelligence
6 1 (0.038%) Dynamics NAV
6 1 (0.038%) Oracle EBS R12
6 1 (0.038%) Oracle General Ledger
6 1 (0.038%) Oracle Payables
6 1 (0.038%) Oracle Receivables
6 1 (0.038%) SAP FSCM
Cloud Services
1 490 (18.70%) Amazon AWS
2 153 (5.84%) Microsoft Azure
3 145 (5.53%) GitHub
4 83 (3.17%) Google Cloud Platform
5 60 (2.29%) PaaS
6 54 (2.06%) SaaS
7 51 (1.95%) Amazon S3
8 49 (1.87%) Amazon EC2
9 43 (1.64%) IBM Cloud
10 40 (1.53%) Bluemix
11 36 (1.37%) Amazon EMR
12 34 (1.30%) Cloud Computing
12 34 (1.30%) IaaS
13 33 (1.26%) Serverless
14 32 (1.22%) Virtual Private Cloud
15 22 (0.84%) Google Analytics
16 21 (0.80%) AWS CloudFormation
17 18 (0.69%) Amazon CloudWatch
17 18 (0.69%) AWS Lambda
18 14 (0.53%) Amazon Kinesis
Communications & Networking
1 134 (5.11%) Kerberos
2 34 (1.30%) Network Security
3 33 (1.26%) LAN
3 33 (1.26%) WAN
4 28 (1.07%) Internet
5 27 (1.03%) Firewall
6 26 (0.99%) HTTP
7 22 (0.84%) SSL
7 22 (0.84%) VPN
8 15 (0.57%) 4G
9 14 (0.53%) 3G
9 14 (0.53%) TCP/IP
9 14 (0.53%) Wi-Fi
10 13 (0.50%) 5G
10 13 (0.50%) Bluetooth
10 13 (0.50%) RFID
10 13 (0.50%) ZigBee
10 13 (0.50%) Z-Wave
11 11 (0.42%) DSL
12 10 (0.38%) SAN
Database & Business Intelligence
1 1508 (57.56%) Hadoop
2 569 (21.72%) Apache Hive
3 493 (18.82%) HBase
4 357 (13.63%) NoSQL
5 271 (10.34%) Data Warehouse
6 237 (9.05%) MongoDB
7 204 (7.79%) Apache Cassandra
8 202 (7.71%) PostgreSQL
9 183 (6.98%) Impala
10 171 (6.53%) Relational Database
11 167 (6.37%) Sqoop
12 160 (6.11%) SQL Server
13 102 (3.89%) Data Lake
14 77 (2.94%) MySQL
15 76 (2.90%) RDBMS
16 75 (2.86%) Data Mining
17 65 (2.48%) BusinessObjects
18 58 (2.21%) SQL Server Integration Services
19 55 (2.10%) Amazon Redshift
20 45 (1.72%) Power BI
Development Applications
1 271 (10.34%) Jenkins
2 245 (9.35%) JIRA
3 240 (9.16%) Git (software)
4 136 (5.19%) Cucumber
5 63 (2.40%) Maven
6 49 (1.87%) JUnit
7 43 (1.64%) Gradle
8 40 (1.53%) IntelliJ
9 37 (1.41%) GitLab
10 32 (1.22%) Selenium
11 31 (1.18%) Sonatype Nexus
11 31 (1.18%) Team Foundation Server
12 30 (1.15%) Talend Open Studio
13 29 (1.11%) TeamCity
14 27 (1.03%) Subversion
15 24 (0.92%) Visual Studio
16 22 (0.84%) Ant
16 22 (0.84%) NUnit
17 20 (0.76%) Vagrant
18 19 (0.73%) Mockito
General
1 613 (23.40%) Finance
2 427 (16.30%) Banking
3 148 (5.65%) Telecoms
4 140 (5.34%) Marketing
5 118 (4.50%) Investment Banking
6 117 (4.47%) Retail
7 86 (3.28%) Front Office
8 78 (2.98%) Manufacturing
9 67 (2.56%) Electronics
10 35 (1.34%) Publishing
11 27 (1.03%) Legal
11 27 (1.03%) Retail Banking
12 22 (0.84%) Financial Institution
13 21 (0.80%) Games
14 15 (0.57%) Advertising
15 14 (0.53%) French Language
16 10 (0.38%) Law
16 10 (0.38%) Pharmaceutical
17 7 (0.27%) Back Office
18 6 (0.23%) Wholesale Banking
Job Titles
1 880 (33.59%) Developer
2 406 (15.50%) Data Engineer
3 382 (14.58%) Architect
4 328 (12.52%) Big Data Engineer
5 325 (12.40%) Big Data Developer
6 288 (10.99%) Java Developer
7 227 (8.66%) Data Architect
8 205 (7.82%) Analyst
9 153 (5.84%) Scala Developer
10 149 (5.69%) Hadoop Engineer
11 139 (5.31%) Big Data Architect
12 129 (4.92%) Hadoop Developer
13 124 (4.73%) Consultant
14 116 (4.43%) Data Scientist
15 111 (4.24%) DevOps Engineer
16 98 (3.74%) Senior Developer
17 94 (3.59%) Apache Spark Developer
18 84 (3.21%) Data Analyst
19 83 (3.17%) Business Analyst
20 80 (3.05%) Java Engineer
Libraries, Frameworks & Software Standards
1 631 (24.08%) Kafka
2 268 (10.23%) REST
3 258 (9.85%) Spring
4 213 (8.13%) Web Services
5 212 (8.09%) JSON
6 189 (7.21%) RESTful
7 150 (5.73%) Spring Boot
8 129 (4.92%) HTML
9 116 (4.43%) AngularJS
10 106 (4.05%) XML
11 101 (3.85%) HTML5
12 100 (3.82%) CSS
13 97 (3.70%) Spark Streaming
14 86 (3.28%) PySpark
15 84 (3.21%) React
16 82 (3.13%) Drools
17 81 (3.09%) Apache Camel
18 80 (3.05%) Akka
19 74 (2.82%) .NET
20 73 (2.79%) Node.js
Miscellaneous
1 320 (12.21%) Analytical Skills
2 165 (6.30%) Algorithms
3 115 (4.39%) Computer Science
4 84 (3.21%) Greenfield Project
5 70 (2.67%) User Experience
6 54 (2.06%) Data Structures
7 53 (2.02%) Fintech
8 50 (1.91%) Market Risk
9 44 (1.68%) Enterprise Software
9 44 (1.68%) Management Information System
10 42 (1.60%) Data Centre
11 40 (1.53%) Reference Data
12 38 (1.45%) Foreign Exchange (FX)
12 38 (1.45%) Virtual Team
13 35 (1.34%) Mobile App
14 29 (1.11%) Linux Command Line
14 29 (1.11%) Replication
15 25 (0.95%) Credit Risk
15 25 (0.95%) Semantic Web
16 24 (0.92%) Equities
Operating Systems
1 422 (16.11%) Linux
2 215 (8.21%) Unix
3 57 (2.18%) Windows
4 42 (1.60%) Red Hat Enterprise Linux
5 36 (1.37%) CentOS
6 31 (1.18%) Ubuntu
7 27 (1.03%) Apple iOS
8 26 (0.99%) Android
9 9 (0.34%) AIX
10 8 (0.31%) Solaris
11 5 (0.19%) Windows Vista
12 4 (0.15%) Mac OS X
13 3 (0.11%) Windows Server
14 2 (0.076%) Windows Server 2003
15 1 (0.038%) Debian
15 1 (0.038%) HPUX
15 1 (0.038%) MVS
15 1 (0.038%) Windows Server 2008
Processes & Methodologies
1 996 (38.02%) Agile Software Development
2 674 (25.73%) Analytics
3 493 (18.82%) TDD
4 408 (15.57%) Scrum
5 380 (14.50%) DevOps
6 370 (14.12%) Business Intelligence
7 365 (13.93%) ETL
8 318 (12.14%) Machine Learning
9 312 (11.91%) Data Modelling
10 309 (11.79%) BDD
11 298 (11.37%) MapReduce
12 260 (9.92%) Continuous Integration
13 255 (9.73%) Open Source
14 246 (9.39%) Data Architecture
15 231 (8.82%) Microservices
16 207 (7.90%) Visualisation
17 205 (7.82%) Data Analytics
18 178 (6.79%) Test Automation
19 174 (6.64%) Software Engineering
20 149 (5.69%) Kanban
Programming Languages
1 1073 (40.95%) Java
2 771 (29.43%) Python
3 663 (25.31%) SQL
4 509 (19.43%) Scala
5 234 (8.93%) JavaScript
6 204 (7.79%) R
7 139 (5.31%) Shell Script
8 121 (4.62%) C#
9 77 (2.94%) Bash Shell
10 73 (2.79%) Ruby
11 63 (2.40%) PL/SQL
12 54 (2.06%) C++
13 47 (1.79%) Perl
14 41 (1.56%) C
15 40 (1.53%) Groovy
16 36 (1.37%) T-SQL
17 30 (1.15%) Go
18 24 (0.92%) MATLAB
19 23 (0.88%) PHP
19 23 (0.88%) SPARQL
Qualifications
1 291 (11.11%) Security Cleared
2 207 (7.90%) SC Cleared
3 191 (7.29%) Degree
4 60 (2.29%) DV Cleared
5 38 (1.45%) Computer Science Degree
6 33 (1.26%) PhD
7 21 (0.80%) Numerate Degree
8 17 (0.65%) Master's Degree
9 10 (0.38%) BPSS Clearance
9 10 (0.38%) Postgraduate
10 9 (0.34%) DBS Check
11 7 (0.27%) CCNA
11 7 (0.27%) CESG Certified Professional
11 7 (0.27%) Cisco Certification
11 7 (0.27%) CISSP
11 7 (0.27%) CLAS
11 7 (0.27%) Microsoft Certification
12 6 (0.23%) ISTQB
12 6 (0.23%) PMP
13 5 (0.19%) MCITP
Quality Assurance & Compliance
1 135 (5.15%) Data Quality
2 118 (4.50%) QA
3 38 (1.45%) GDPR
4 20 (0.76%) GCP
4 20 (0.76%) MiFID
5 11 (0.42%) PMO
6 8 (0.31%) Actionable Recommendations
7 7 (0.27%) JSP 440
8 5 (0.19%) Dodd-Frank
8 5 (0.19%) IFRS
8 5 (0.19%) IFRS 9
8 5 (0.19%) SLA
9 3 (0.11%) ISO/IEC 20000
9 3 (0.11%) PCI DSS
10 2 (0.076%) Disclosure Scotland
10 2 (0.076%) EMIR
10 2 (0.076%) PSD2
10 2 (0.076%) RosettaNet
11 1 (0.038%) FATCA
11 1 (0.038%) ISO 9001
System Software
1 382 (14.58%) HDFS
2 316 (12.06%) Docker
3 226 (8.63%) Apache Flume
4 109 (4.16%) Apache ZooKeeper
5 20 (0.76%) Active Directory
5 20 (0.76%) VMware Infrastructure
6 18 (0.69%) Oracle RAC
7 17 (0.65%) Oracle Clusterware
8 14 (0.53%) vCloud
8 14 (0.53%) Virtual Machines
9 7 (0.27%) Hyper-V
10 2 (0.076%) OpenAM
10 2 (0.076%) OpenDJ
10 2 (0.076%) OpenIDM
10 2 (0.076%) VMware ESXi
11 1 (0.038%) Firmware
11 1 (0.038%) PowerHA
11 1 (0.038%) Snort
11 1 (0.038%) Virtual Servers
Systems Management
1 212 (8.09%) Ansible
2 162 (6.18%) Oozie
3 146 (5.57%) Hadoop YARN
4 144 (5.50%) Kubernetes
5 131 (5.00%) Terraform
6 102 (3.89%) Puppet
7 92 (3.51%) Ambari
8 57 (2.18%) Opscode Chef
9 47 (1.79%) Mesos
10 19 (0.73%) Data Guard
11 18 (0.69%) Kibana
11 18 (0.69%) Prometheus
12 17 (0.65%) Graphite
12 17 (0.65%) Oracle Flashback
12 17 (0.65%) Oracle RMAN
13 16 (0.61%) ITRS Geneos
14 15 (0.57%) Control-M
15 12 (0.46%) logstash
16 11 (0.42%) Nagios
17 10 (0.38%) Rsyslog
Vendors
1 270 (10.31%) Cloudera
2 235 (8.97%) Oracle
3 178 (6.79%) Tableau
4 148 (5.65%) Hortonworks
5 126 (4.81%) Microsoft
6 123 (4.69%) Google
7 121 (4.62%) SAP
8 93 (3.55%) IBM
9 89 (3.40%) Splunk
10 64 (2.44%) Informatica
11 62 (2.37%) Teradata
12 61 (2.33%) Red Hat
13 44 (1.68%) Salesforce.com
14 42 (1.60%) MapR
15 33 (1.26%) VMware
16 30 (1.15%) Talend
17 26 (0.99%) TIBCO
18 19 (0.73%) HP
18 19 (0.73%) SaltStack
19 18 (0.69%) AppDynamics