Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 22 January 2019

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 22 January 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK > England
6 months to
22 Jan 2019		 Same period 2018 Same period 2017
Rank 87 87 86
Rank change year-on-year 0 -1 +60
Contract jobs citing Big Data 2,531 2,564 2,417
As % of all contract IT jobs advertised in England 2.77% 2.80% 2.73%
As % of the Database & Business Intelligence category 12.26% 12.73% 12.10%
Number of daily rates quoted 1,770 1,787 1,601
England median daily rate £550 £550 £525
Median daily rate % change year-on-year - +4.76% +0.96%
10th Percentile £413 £400 £375
90th Percentile £723 £675 £700
UK median daily rate £550 £550 £525
% change year-on-year - +4.76% +0.96%
Number of hourly rates quoted 9 15 12
England median hourly rate £45.00 £30.50 £45.25
Median hourly rate % change year-on-year +47.54% -32.60% +40.47%
10th Percentile £32.50 £17.72 £42.08
90th Percentile £58.00 £64.24 £103.68
UK median hourly rate £45.00 £30.50 £45.00
% change year-on-year +47.54% -32.22% +39.70%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 20,644 20,134 19,979
As % of all contract IT jobs advertised in England 22.61% 21.95% 22.57%
Number of daily rates quoted 14,355 14,172 13,462
England median daily rate £483 £475 £430
Median daily rate % change year-on-year +1.68% +10.47% +1.18%
10th Percentile £323 £313 £295
90th Percentile £650 £631 £613
UK median daily rate £475 £455 £425
% change year-on-year +4.40% +7.06% +2.41%
Number of hourly rates quoted 218 225 264
England median hourly rate £35.00 £30.75 £27.50
Median hourly rate % change year-on-year +13.82% +11.82% -8.33%
10th Percentile £14.85 £15.07 £9.63
90th Percentile £56.40 £58.00 £46.93
UK median hourly rate £32.75 £30.50 £28.18
% change year-on-year +7.38% +8.23% -6.07%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a percentage of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in England.

Contractor daily rate trend for Big Data in England

Big Data
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Big Data in England over the 6 months to 22 January 2019.

Contractor daily rate histogram for Big Data in England

Big Data
Contractor Hourly Rate Trend in England

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in England.

Contractor hourly rate trend for Big Data in England

Big Data
Contractor Hourly Rate Histogram in England

The hourly rate distribution of IT jobs citing Big Data in England over the 6 months to 22 January 2019.

Contractor hourly rate histogram for Big Data in England

Big Data
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the England region over the 6 months to 22 January 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
London -1 1,581 £550 - 457
South East -7 432 £525 +5.00% 116
North of England +9 192 £525 +5.00% 66
South West +24 155 £525 +5.00% 67
North West -11 96 £600 +9.09% 35
Midlands -11 86 £486 +0.99% 38
Yorkshire 0 78 £475 - 16
East of England +28 75 £488 - 37
East Midlands -3 45 £450 -10.00% 13
West Midlands -21 41 £515 +8.42% 25
North East -3 21 £500 +17.65% 15
South Coast - 1 - -
Big Data
UK

For the 6 months to 22 January 2019, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Big Data.

1 1,184 (46.78%) Hadoop
2 918 (36.27%) Apache Spark
3 900 (35.56%) Python
4 872 (34.45%) Agile Software Development
5 844 (33.35%) Java
6 775 (30.62%) SQL
7 716 (28.29%) Analytics
8 682 (26.95%) Kafka
9 658 (26.00%) Amazon AWS
10 600 (23.71%) Apache Hive
11 577 (22.80%) Finance
12 482 (19.04%) Data Science
13 416 (16.44%) Linux
14 414 (16.36%) DevOps
15 413 (16.32%) Microsoft Azure
16 408 (16.12%) Data Warehouse
17 402 (15.88%) ETL
18 391 (15.45%) Scala
19 379 (14.97%) Machine Learning
20 373 (14.74%) NoSQL
21 359 (14.18%) Docker
22 347 (13.71%) Jenkins
23 342 (13.51%) Business Intelligence
24 329 (13.00%) Data Modelling
25 322 (12.72%) Analytical Skills
26 307 (12.13%) HBase
27 291 (11.50%) Cloudera
28 281 (11.10%) Scrum
29 261 (10.31%) TDD
30 247 (9.76%) Apache

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 918 (36.27%) Apache Spark
2 247 (9.76%) Apache
3 234 (9.25%) Elasticsearch
4 82 (3.24%) SAS
5 73 (2.88%) Confluence
6 72 (2.84%) Apache Pig
7 54 (2.13%) Apache Solr
8 28 (1.11%) Apache Airflow
9 23 (0.91%) Oracle SOA Suite
10 20 (0.79%) nginx
11 19 (0.75%) Cloud Foundry
12 18 (0.71%) Jupyter
13 16 (0.63%) Oracle Coherence
14 12 (0.47%) Tomcat
15 9 (0.36%) Apache Qpid
16 7 (0.28%) JBoss
16 7 (0.28%) OpenStack
16 7 (0.28%) SharePoint
16 7 (0.28%) WebLogic
16 7 (0.28%) WebSphere
Applications
1 52 (2.05%) Microsoft Excel
2 34 (1.34%) MS Visio
3 17 (0.67%) Microsoft Office
4 6 (0.24%) Spreadsheet
5 5 (0.20%) Chatbot
6 4 (0.16%) Microsoft PowerPoint
7 2 (0.079%) GNU Octave
7 2 (0.079%) SPSS
8 1 (0.040%) LaTeX
8 1 (0.040%) Microsoft Project
8 1 (0.040%) Open Workbench
Business Applications
1 23 (0.91%) SAP Oil and Gas
2 10 (0.40%) Actimize
3 7 (0.28%) Dynamics CRM
4 6 (0.24%) Oracle BPM
5 5 (0.20%) Distributed Ledger
6 4 (0.16%) IBM Operational Decision Manager
6 4 (0.16%) Payment Gateway
6 4 (0.16%) SAP MM
6 4 (0.16%) SAP R/3
7 2 (0.079%) Dynamics AX
7 2 (0.079%) Dynamics NAV
7 2 (0.079%) Markit EDM
7 2 (0.079%) PolarLake
7 2 (0.079%) Unica
8 1 (0.040%) Exstream
8 1 (0.040%) NetSuite
8 1 (0.040%) Remedy ITSM
8 1 (0.040%) SAP HR
8 1 (0.040%) SAP MDG
8 1 (0.040%) WebTrends
Cloud Services
1 658 (26.00%) Amazon AWS
2 413 (16.32%) Microsoft Azure
3 174 (6.87%) Google Cloud Platform
4 116 (4.58%) Amazon S3
5 114 (4.50%) Amazon EMR
6 77 (3.04%) GitHub
7 72 (2.84%) Serverless
8 64 (2.53%) IaaS
9 63 (2.49%) Amazon EC2
10 62 (2.45%) PaaS
11 60 (2.37%) Cloud Computing
12 58 (2.29%) Amazon Kinesis
13 41 (1.62%) AWS Lambda
13 41 (1.62%) Azure Data Factory
14 40 (1.58%) SaaS
15 38 (1.50%) Virtual Private Cloud
16 28 (1.11%) AWS CloudFormation
17 21 (0.83%) Heroku
18 18 (0.71%) OpenShift
19 17 (0.67%) Office 365
Communications & Networking
1 56 (2.21%) HTTP
2 52 (2.05%) Firewall
3 48 (1.90%) Kerberos
3 48 (1.90%) TCP/IP
4 46 (1.82%) Internet
5 38 (1.50%) DNS
6 31 (1.22%) SSL
7 28 (1.11%) VPN
8 23 (0.91%) SSH
9 19 (0.75%) Network Security
10 18 (0.71%) LAN
11 13 (0.51%) SAN
11 13 (0.51%) WAN
12 12 (0.47%) FTP
13 9 (0.36%) DSL
14 8 (0.32%) 3G
14 8 (0.32%) 4G
14 8 (0.32%) HTTPS
15 7 (0.28%) ICMP
16 6 (0.24%) iSCSI
Database & Business Intelligence
1 1,184 (46.78%) Hadoop
2 600 (23.71%) Apache Hive
3 408 (16.12%) Data Warehouse
4 373 (14.74%) NoSQL
5 307 (12.13%) HBase
6 234 (9.25%) Apache Cassandra
7 224 (8.85%) SQL Server
8 223 (8.81%) Data Lake
9 216 (8.53%) Relational Database
10 204 (8.06%) MongoDB
11 157 (6.20%) Impala
12 148 (5.85%) Sqoop
13 144 (5.69%) Power BI
14 113 (4.46%) PostgreSQL
15 106 (4.19%) MySQL
16 102 (4.03%) SQL Server Integration Services
17 90 (3.56%) Amazon Redshift
18 75 (2.96%) OLAP
18 75 (2.96%) RDBMS
19 68 (2.69%) Star Schema
Development Applications
1 347 (13.71%) Jenkins
2 229 (9.05%) Git (software)
3 142 (5.61%) JIRA
4 80 (3.16%) Maven
5 68 (2.69%) Gradle
6 43 (1.70%) Visual Studio Team System
7 34 (1.34%) Cucumber
8 33 (1.30%) Bitbucket
9 32 (1.26%) Artifactory
10 29 (1.15%) Visual Studio
11 28 (1.11%) Sonatype Nexus
12 27 (1.07%) Selenium
13 26 (1.03%) GitLab
14 25 (0.99%) Atlassian Bamboo
15 21 (0.83%) JUnit
16 19 (0.75%) gulp
16 19 (0.75%) IntelliJ
16 19 (0.75%) Subversion
16 19 (0.75%) TeamCity
17 18 (0.71%) Ant
General
1 577 (22.80%) Finance
2 178 (7.03%) Banking
3 134 (5.29%) Retail
4 85 (3.36%) Legal
5 81 (3.20%) Marketing
6 78 (3.08%) Telecoms
7 61 (2.41%) Front Office
8 31 (1.22%) Investment Banking
9 29 (1.15%) Publishing
10 25 (0.99%) Games
11 21 (0.83%) Manufacturing
12 20 (0.79%) Advertising
12 20 (0.79%) Retail Banking
13 19 (0.75%) Financial Institution
14 10 (0.40%) Automotive
14 10 (0.40%) Pharmaceutical
15 7 (0.28%) Back Office
16 6 (0.24%) Aerospace
16 6 (0.24%) Law
17 5 (0.20%) Electronics
Job Titles
1 677 (26.75%) Developer
2 518 (20.47%) Data Engineer
3 363 (14.34%) Architect
4 356 (14.07%) Big Data Engineer
5 246 (9.72%) Java Developer
6 199 (7.86%) Data Architect
7 194 (7.66%) Big Data Developer
8 135 (5.33%) DevOps Engineer
9 130 (5.14%) Data Scientist
10 114 (4.50%) Hadoop Engineer
11 111 (4.39%) Analyst
12 110 (4.35%) Python Engineer
13 92 (3.63%) Apache Spark Developer
14 91 (3.60%) Big Data Architect
14 91 (3.60%) Consultant
14 91 (3.60%) Senior Developer
15 89 (3.52%) Software Engineer
16 83 (3.28%) Java Engineer
16 83 (3.28%) Solutions Architect
17 62 (2.45%) Python Developer
Libraries, Frameworks & Software Standards
1 682 (26.95%) Kafka
2 168 (6.64%) REST
3 166 (6.56%) Spring
4 122 (4.82%) JSON
4 122 (4.82%) Web Services
5 100 (3.95%) Spark Streaming
6 95 (3.75%) RabbitMQ
7 93 (3.67%) RESTful
8 83 (3.28%) .NET
8 83 (3.28%) AngularJS
9 80 (3.16%) HTML
10 78 (3.08%) PySpark
11 76 (3.00%) Node.js
12 75 (2.96%) Spring Boot
13 71 (2.81%) React
14 69 (2.73%) Apache NiFi
15 68 (2.69%) Middleware
16 65 (2.57%) J2EE
17 61 (2.41%) XML
18 59 (2.33%) Elastic Stack
Miscellaneous
1 322 (12.72%) Analytical Skills
2 176 (6.95%) Greenfield Project
3 173 (6.84%) Algorithms
4 76 (3.00%) Data Structures
5 71 (2.81%) Fintech
6 47 (1.86%) Self-Motivation
7 43 (1.70%) Virtual Team
8 41 (1.62%) User Experience
9 36 (1.42%) Data Centre
10 33 (1.30%) Linux Command Line
11 32 (1.26%) Wiki
12 26 (1.03%) Market Risk
13 25 (0.99%) Management Information System
14 23 (0.91%) Replication
15 18 (0.71%) Public Cloud
16 16 (0.63%) Foreign Exchange (FX)
17 15 (0.59%) Enterprise Software
17 15 (0.59%) Mobile App
18 14 (0.55%) Cloud Native
18 14 (0.55%) Clustering
Operating Systems
1 416 (16.44%) Linux
2 232 (9.17%) Unix
3 105 (4.15%) Windows
4 42 (1.66%) Red Hat Enterprise Linux
5 14 (0.55%) Android
6 11 (0.43%) CentOS
7 10 (0.40%) Solaris
8 9 (0.36%) Windows Server
9 8 (0.32%) Apple iOS
10 7 (0.28%) Ubuntu
11 4 (0.16%) Windows 10
12 3 (0.12%) AIX
12 3 (0.12%) Mac OS X
13 2 (0.079%) CoreOS
14 1 (0.040%) Data ONTAP
14 1 (0.040%) DC/OS
14 1 (0.040%) Debian
14 1 (0.040%) Oracle Linux
Processes & Methodologies
1 872 (34.45%) Agile Software Development
2 716 (28.29%) Analytics
3 482 (19.04%) Data Science
4 414 (16.36%) DevOps
5 402 (15.88%) ETL
6 379 (14.97%) Machine Learning
7 342 (13.51%) Business Intelligence
8 329 (13.00%) Data Modelling
9 281 (11.10%) Scrum
10 261 (10.31%) TDD
11 238 (9.40%) Software Engineering
12 223 (8.81%) Open Source
13 219 (8.65%) Data Analytics
13 219 (8.65%) Visualisation
14 210 (8.30%) Continuous Integration
15 207 (8.18%) Microservices
16 193 (7.63%) Data Architecture
17 180 (7.11%) Data Analysis
18 172 (6.80%) Artificial Intelligence
19 171 (6.76%) BDD
Programming Languages
1 900 (35.56%) Python
2 844 (33.35%) Java
3 775 (30.62%) SQL
4 391 (15.45%) Scala
5 186 (7.35%) JavaScript
6 175 (6.91%) R
7 130 (5.14%) Bash Shell
8 123 (4.86%) C#
9 122 (4.82%) Shell Script
10 121 (4.78%) Java 8
11 83 (3.28%) PowerShell
12 65 (2.57%) C++
13 59 (2.33%) T-SQL
14 53 (2.09%) Groovy
15 36 (1.42%) MATLAB
16 33 (1.30%) Ruby
17 32 (1.26%) ES6
17 32 (1.26%) Go
17 32 (1.26%) PL/SQL
18 29 (1.15%) Korn
Qualifications
1 207 (8.18%) Degree
2 196 (7.74%) Security Cleared
3 152 (6.01%) SC Cleared
4 60 (2.37%) Computer Science Degree
5 53 (2.09%) Master's Degree
6 37 (1.46%) PhD
7 28 (1.11%) DV Cleared
8 12 (0.47%) BPSS Clearance
9 11 (0.43%) CISSP
10 10 (0.40%) Microsoft Certification
11 9 (0.36%) CCA
11 9 (0.36%) MCSE
12 8 (0.32%) Numerate Degree
13 7 (0.28%) CISM
13 7 (0.28%) ISTQB
13 7 (0.28%) PMI Certification
14 6 (0.24%) AWS Certification
14 6 (0.24%) TOGAF Certification
15 5 (0.20%) CISA
15 5 (0.20%) PRINCE2 Certification
Quality Assurance & Compliance
1 115 (4.54%) Data Quality
2 55 (2.17%) QA
3 33 (1.30%) GDPR
4 15 (0.59%) SLA
5 9 (0.36%) ISO/IEC 27001
6 5 (0.20%) ISO 9001
6 5 (0.20%) PMO
7 4 (0.16%) EMIR
7 4 (0.16%) MiFID
7 4 (0.16%) PA-DSS
7 4 (0.16%) PCI DSS
8 3 (0.12%) PSD2
9 2 (0.079%) COBIT
9 2 (0.079%) Disclosure Scotland
9 2 (0.079%) Dodd-Frank
9 2 (0.079%) Sarbanes-Oxley
10 1 (0.040%) Actionable Recommendations
10 1 (0.040%) IFRS
10 1 (0.040%) IFRS 9
10 1 (0.040%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
System Software
1 359 (14.18%) Docker
2 239 (9.44%) HDFS
3 108 (4.27%) Apache Flume
4 94 (3.71%) Apache ZooKeeper
5 22 (0.87%) Oracle RAC
6 19 (0.75%) Virtual Machines
7 18 (0.71%) Active Directory
8 10 (0.40%) VMware Infrastructure
9 6 (0.24%) Hyper-V
10 5 (0.20%) XenApp
11 4 (0.16%) vSphere
12 2 (0.079%) etcd
12 2 (0.079%) flannel
12 2 (0.079%) LXC
13 1 (0.040%) Cronacle
13 1 (0.040%) NFS
13 1 (0.040%) Terminal Services
13 1 (0.040%) Virtual Desktop
13 1 (0.040%) VMware ESXi
13 1 (0.040%) XenDesktop
Systems Management
1 232 (9.17%) Kubernetes
2 229 (9.05%) Ansible
3 171 (6.76%) Hadoop YARN
4 141 (5.57%) Oozie
5 123 (4.86%) Terraform
6 107 (4.23%) Puppet
7 81 (3.20%) Opscode Chef
8 40 (1.58%) Kibana
9 28 (1.11%) logstash
10 23 (0.91%) Ambari
11 17 (0.67%) Docker Swarm
12 15 (0.59%) Grafana
13 12 (0.47%) Salt
14 11 (0.43%) Mesos
15 10 (0.40%) Enterprise Manager Cloud Control
15 10 (0.40%) Nagios
16 9 (0.36%) Prometheus
17 8 (0.32%) ZABBIX
18 7 (0.28%) Control-M
19 6 (0.24%) NetBackup
Vendors
1 291 (11.50%) Cloudera
2 218 (8.61%) Oracle
3 200 (7.90%) Hortonworks
4 197 (7.78%) Microsoft
5 171 (6.76%) Tableau
6 169 (6.68%) Google
7 94 (3.71%) Talend
8 86 (3.40%) Splunk
9 77 (3.04%) Informatica
10 58 (2.29%) SAP
11 48 (1.90%) Teradata
12 44 (1.74%) Databricks
13 43 (1.70%) MapR
14 34 (1.34%) IBM
15 29 (1.15%) Alteryx
16 28 (1.11%) Red Hat
17 25 (0.99%) VMware
18 23 (0.91%) Cisco
19 21 (0.83%) Ab Initio
20 20 (0.79%) Sybase