Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 22 September 2019

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 22 September 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK > England
6 months to
22 Sep 2019		 Same period 2018 Same period 2017
Rank 80 89 90
Rank change year-on-year +9 +1 +43
Contract jobs citing Big Data 2,329 2,651 2,491
As % of all contract IT jobs advertised in England 2.91% 2.85% 2.74%
As % of the Database & Business Intelligence category 13.37% 12.41% 12.27%
Number of daily rates quoted 1,693 1,888 1,744
England median daily rate £550 £550 £550
10th Percentile £413 £406 £381
90th Percentile £725 £700 £688
UK median daily rate £550 £550 £546
% change year-on-year - +0.69% +4.05%
Number of hourly rates quoted 12 13 13
England median hourly rate £46.85 £40.00 £40.00
Median hourly rate % change year-on-year +17.12% - -6.63%
10th Percentile £35.00 £15.60 £16.64
90th Percentile £53.75 £71.00 £54.88
UK median hourly rate £46.85 £42.25 £40.00
% change year-on-year +10.88% +5.63% -6.63%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 17,420 21,359 20,306
As % of all contract IT jobs advertised in England 21.80% 22.93% 22.38%
Number of daily rates quoted 11,996 15,107 13,723
England median daily rate £475 £475 £450
Median daily rate % change year-on-year - +5.56% +5.88%
10th Percentile £325 £313 £306
90th Percentile £663 £638 £625
UK median daily rate £475 £475 £450
% change year-on-year - +5.56% +5.88%
Number of hourly rates quoted 232 227 257
England median hourly rate £35.00 £29.50 £30.00
Median hourly rate % change year-on-year +18.64% -1.67% -
10th Percentile £13.99 £13.87 £12.00
90th Percentile £60.68 £56.00 £52.50
UK median hourly rate £35.00 £28.75 £29.56
% change year-on-year +21.74% -2.74% -1.47%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a percentage of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Contractor Daily Rate Trend in England

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in England.

Contractor daily rate trend for Big Data in England

Big Data
Contractor Daily Rate Histogram in England

The daily rate distribution of IT jobs citing Big Data in England over the 6 months to 22 September 2019.

Contractor daily rate histogram for Big Data in England

Big Data
Contractor Hourly Rate Trend in England

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in England.

Contractor hourly rate trend for Big Data in England

Big Data
Contractor Hourly Rate Histogram in England

The hourly rate distribution of IT jobs citing Big Data in England over the 6 months to 22 September 2019.

Contractor hourly rate histogram for Big Data in England

Big Data
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the England region over the 6 months to 22 September 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
London +13 1,529 £575 +4.55% 317
South East -44 286 £500 - 75
North of England -4 206 £538 +7.50% 48
South West +15 130 £550 +4.76% 53
North West +22 117 £538 +2.38% 36
Midlands +70 88 £525 +13.51% 29
Yorkshire -16 77 £525 +10.53% 7
East of England -9 69 £525 +10.53% 46
West Midlands +61 53 £513 +10.92% 20
East Midlands +20 35 £525 +12.60% 9
North East +21 12 £575 -11.54% 5
Big Data
UK

For the 6 months to 22 September 2019, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Big Data.

1 884 (37.96%) Python
2 865 (37.14%) Apache Spark
3 852 (36.58%) Hadoop
4 798 (34.26%) Agile Software Development
5 781 (33.53%) AWS
6 759 (32.59%) SQL
7 675 (28.98%) Analytics
8 572 (24.56%) Java
9 559 (24.00%) Finance
10 531 (22.80%) Azure
11 511 (21.94%) DevOps
12 469 (20.14%) Kafka
13 428 (18.38%) Data Warehouse
14 417 (17.90%) GCP
15 402 (17.26%) Data Science
16 381 (16.36%) Apache Hive
17 366 (15.71%) Linux
18 353 (15.16%) Scala
19 344 (14.77%) Jenkins
20 337 (14.47%) Data Modelling
21 330 (14.17%) Docker
22 328 (14.08%) ETL
23 325 (13.95%) Machine Learning
24 323 (13.87%) Business Intelligence
25 316 (13.57%) Google
26 294 (12.62%) Migration
27 285 (12.24%) Kubernetes
28 276 (11.85%) Data Lake
29 273 (11.72%) Scrum
30 269 (11.55%) Data Engineering

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 865 (37.14%) Apache Spark
2 214 (9.19%) Apache
3 99 (4.25%) Apache Airflow
4 97 (4.16%) Elasticsearch
5 56 (2.40%) SAS
6 36 (1.55%) Confluence
7 29 (1.25%) Jupyter
8 28 (1.20%) Apache Pig
9 19 (0.82%) Apache Solr
9 19 (0.82%) Luigi
10 14 (0.60%) JBoss
11 12 (0.52%) OpenStack
12 9 (0.39%) Oracle Coherence
12 9 (0.39%) SharePoint
12 9 (0.39%) Tomcat
12 9 (0.39%) WebLogic
13 8 (0.34%) Oracle SOA Suite
14 7 (0.30%) IIS
14 7 (0.30%) Moodle
14 7 (0.30%) Skype for Business
Applications
1 58 (2.49%) Microsoft Excel
2 26 (1.12%) Microsoft PowerPoint
3 18 (0.77%) MS Visio
4 14 (0.60%) Microsoft Office
5 5 (0.21%) Microsoft Project
6 4 (0.17%) SPSS
7 3 (0.13%) Stata
8 2 (0.086%) AutoCAD
9 1 (0.043%) Chatbot
9 1 (0.043%) InVision
9 1 (0.043%) Sketch
9 1 (0.043%) Spreadsheet
9 1 (0.043%) Zeplin
Business Applications
1 9 (0.39%) Oracle BPM
1 9 (0.39%) SAP S/4HANA
2 8 (0.34%) Dynamics CRM
3 6 (0.26%) SAP Oil and Gas
4 5 (0.21%) Dynamics AX
4 5 (0.21%) Dynamics NAV
5 4 (0.17%) Distributed Ledger
6 3 (0.13%) SAP ERP
7 2 (0.086%) Adobe Campaign
7 2 (0.086%) BPCS
7 2 (0.086%) FINCAD Analytics
7 2 (0.086%) SAP R/3
8 1 (0.043%) Markit EDM
8 1 (0.043%) Oracle Retail
8 1 (0.043%) PeopleSoft Financials
8 1 (0.043%) PolarLake
8 1 (0.043%) Salesforce.com CRM
8 1 (0.043%) SAP APO
8 1 (0.043%) SAP CAR
8 1 (0.043%) SAP Retail
Cloud Services
1 781 (33.53%) AWS
2 531 (22.80%) Azure
3 417 (17.90%) GCP
4 126 (5.41%) GitHub
5 118 (5.07%) Power Platform
6 111 (4.77%) Amazon EMR
7 105 (4.51%) Serverless
8 92 (3.95%) Amazon S3
9 88 (3.78%) Azure Data Factory
10 62 (2.66%) AWS Lambda
11 59 (2.53%) Amazon Kinesis
12 44 (1.89%) Amazon EC2
13 39 (1.67%) Amazon CloudWatch
13 39 (1.67%) AWS CloudFormation
13 39 (1.67%) PaaS
14 33 (1.42%) Cloud Computing
15 26 (1.12%) OpenShift
15 26 (1.12%) SaaS
16 25 (1.07%) IaaS
17 24 (1.03%) Data Lake Analytics
Communications & Networking
1 36 (1.55%) Kerberos
2 25 (1.07%) DNS
2 25 (1.07%) Firewall
3 21 (0.90%) SSL
4 15 (0.64%) Internet
5 14 (0.60%) HTTP
5 14 (0.60%) SAN
6 12 (0.52%) TCP/IP
7 9 (0.39%) Software-Defined Networking
8 7 (0.30%) Multicast
9 6 (0.26%) AMQP
10 5 (0.21%) MQTT
10 5 (0.21%) NetScaler
10 5 (0.21%) Network Security
11 4 (0.17%) F5 BIG-IP GTM
11 4 (0.17%) F5 BIG-IP LTM
12 3 (0.13%) 4G
12 3 (0.13%) 5G
12 3 (0.13%) Cisco Nexus
12 3 (0.13%) Fibre Channel
Database & Business Intelligence
1 852 (36.58%) Hadoop
2 428 (18.38%) Data Warehouse
3 381 (16.36%) Apache Hive
4 276 (11.85%) Data Lake
5 242 (10.39%) NoSQL
6 188 (8.07%) SQL Server
7 156 (6.70%) Amazon Redshift
8 143 (6.14%) Relational Database
9 138 (5.93%) HBase
10 135 (5.80%) Impala
11 120 (5.15%) PostgreSQL
12 118 (5.07%) BigQuery
12 118 (5.07%) MongoDB
12 118 (5.07%) Power BI
13 107 (4.59%) MySQL
14 89 (3.82%) Apache Cassandra
15 66 (2.83%) RDBMS
16 65 (2.79%) SQL Server Integration Services
17 47 (2.02%) Sqoop
18 45 (1.93%) OLAP
Development Applications
1 344 (14.77%) Jenkins
2 253 (10.86%) Git (software)
3 153 (6.57%) JIRA
4 54 (2.32%) Visual Studio Team System
5 47 (2.02%) Atlassian Bamboo
5 47 (2.02%) Selenium
6 46 (1.98%) GitLab
7 45 (1.93%) Sonatype Nexus
8 44 (1.89%) Gradle
8 44 (1.89%) Maven
9 37 (1.59%) TeamCity
10 31 (1.33%) Cucumber
11 26 (1.12%) Artifactory
12 24 (1.03%) Visual Studio
13 21 (0.90%) Ant
13 21 (0.90%) CircleCI
14 18 (0.77%) Subversion
15 17 (0.73%) Team Foundation Server
16 13 (0.56%) Travis CI
17 12 (0.52%) SonarQube
General
1 559 (24.00%) Finance
2 184 (7.90%) Banking
3 120 (5.15%) Public Sector
4 110 (4.72%) Retail
5 81 (3.48%) Telecoms
6 70 (3.01%) Investment Banking
7 60 (2.58%) Marketing
8 49 (2.10%) Manufacturing
9 47 (2.02%) Financial Institution
10 46 (1.98%) Front Office
11 43 (1.85%) Legal
12 34 (1.46%) Advertising
13 17 (0.73%) Games
13 17 (0.73%) Pharmaceutical
14 9 (0.39%) Electronics
14 9 (0.39%) Publishing
15 8 (0.34%) Retail Banking
16 7 (0.30%) Law
17 5 (0.21%) Automotive
17 5 (0.21%) Back Office
Job Titles
1 581 (24.95%) Data Engineer
2 472 (20.27%) Developer
3 358 (15.37%) Architect
4 273 (11.72%) Big Data Engineer
5 175 (7.51%) DevOps Engineer
6 165 (7.08%) Data Architect
7 132 (5.67%) Python Engineer
8 128 (5.50%) Java Developer
9 126 (5.41%) Analyst
10 116 (4.98%) Cloud Engineer
11 111 (4.77%) Big Data Developer
12 109 (4.68%) Python Developer
13 98 (4.21%) AWS Engineer
14 79 (3.39%) Data Scientist
15 77 (3.31%) Consultant
16 74 (3.18%) Administrator
17 72 (3.09%) Big Data Architect
17 72 (3.09%) Hadoop Engineer
18 71 (3.05%) Business Analyst
19 68 (2.92%) Senior Developer
Libraries, Frameworks & Software Standards
1 469 (20.14%) Kafka
2 120 (5.15%) Web Services
3 104 (4.47%) PySpark
4 92 (3.95%) .NET
5 82 (3.52%) Spring
6 81 (3.48%) JSON
7 70 (3.01%) RESTful
8 63 (2.71%) REST
9 59 (2.53%) XML
10 58 (2.49%) React
11 52 (2.23%) AngularJS
12 51 (2.19%) Natural Language Processing
13 50 (2.15%) CSS
13 50 (2.15%) HTML
14 47 (2.02%) TensorFlow
15 41 (1.76%) Spark Streaming
16 40 (1.72%) Apache NiFi
16 40 (1.72%) Middleware
16 40 (1.72%) Node.js
17 38 (1.63%) Spring Boot
Miscellaneous
1 221 (9.49%) Analytical Skills
2 142 (6.10%) Greenfield Project
3 110 (4.72%) Algorithms
4 74 (3.18%) Data Structures
5 49 (2.10%) Cloud Native
5 49 (2.10%) Self-Motivation
6 48 (2.06%) Public Cloud
7 42 (1.80%) Management Information System
8 40 (1.72%) User Experience
9 38 (1.63%) Data Centre
10 36 (1.55%) Virtual Team
11 34 (1.46%) Clustering
12 26 (1.12%) Enterprise Software
12 26 (1.12%) Replication
13 23 (0.99%) PKI
14 21 (0.90%) Linux Command Line
15 20 (0.86%) Hedge funds
16 17 (0.73%) Foreign Exchange (FX)
17 16 (0.69%) Market Risk
18 15 (0.64%) Hybrid Cloud
Operating Systems
1 366 (15.71%) Linux
2 127 (5.45%) Unix
3 80 (3.43%) Red Hat Enterprise Linux
4 76 (3.26%) Windows
5 29 (1.25%) CentOS
6 20 (0.86%) Windows Server
7 14 (0.60%) Apple iOS
7 14 (0.60%) Solaris
8 13 (0.56%) Ubuntu
9 10 (0.43%) VMS
10 9 (0.39%) Android
11 6 (0.26%) Windows 10
12 5 (0.21%) Debian
13 3 (0.13%) Windows Server 2012
14 2 (0.086%) AIX
14 2 (0.086%) Mac OS X
14 2 (0.086%) SUSE Linux Enterprise Server
15 1 (0.043%) Fedora
15 1 (0.043%) Mac OS
15 1 (0.043%) Oracle Linux
Processes & Methodologies
1 798 (34.26%) Agile Software Development
2 675 (28.98%) Analytics
3 511 (21.94%) DevOps
4 402 (17.26%) Data Science
5 337 (14.47%) Data Modelling
6 328 (14.08%) ETL
7 325 (13.95%) Machine Learning
8 323 (13.87%) Business Intelligence
9 294 (12.62%) Migration
10 273 (11.72%) Scrum
11 269 (11.55%) Data Engineering
12 221 (9.49%) Data Analytics
13 220 (9.45%) Continuous Integration
13 220 (9.45%) Problem-Solving
14 184 (7.90%) Microservices
15 178 (7.64%) Data Architecture
15 178 (7.64%) Software Engineering
16 174 (7.47%) TDD
17 173 (7.43%) Artificial Intelligence
18 171 (7.34%) Stakeholder Management
Programming Languages
1 884 (37.96%) Python
2 759 (32.59%) SQL
3 572 (24.56%) Java
4 353 (15.16%) Scala
5 136 (5.84%) C#
6 134 (5.75%) JavaScript
7 125 (5.37%) R
8 104 (4.47%) Bash Shell
9 84 (3.61%) Shell Script
10 70 (3.01%) PowerShell
11 57 (2.45%) Java 8
12 55 (2.36%) Ruby
13 53 (2.28%) C++
14 45 (1.93%) Go
15 41 (1.76%) PL/SQL
16 35 (1.50%) T-SQL
17 33 (1.42%) C
18 32 (1.37%) Perl
19 26 (1.12%) TypeScript
20 21 (0.90%) Groovy
Qualifications
1 245 (10.52%) Security Cleared
2 177 (7.60%) Degree
3 147 (6.31%) SC Cleared
4 73 (3.13%) DV Cleared
5 47 (2.02%) Computer Science Degree
6 43 (1.85%) PhD
7 31 (1.33%) CISSP
8 21 (0.90%) CISM
8 21 (0.90%) Master's Degree
8 21 (0.90%) PMI Certification
8 21 (0.90%) PMP
8 21 (0.90%) TOGAF Certification
9 14 (0.60%) AWS Certification
10 13 (0.56%) Cisco Certification
11 12 (0.52%) CCA
12 11 (0.47%) Microsoft Certification
13 8 (0.34%) (ISC)2 CCSP
13 8 (0.34%) MCSA
13 8 (0.34%) MCSE
14 6 (0.26%) SANS
Quality Assurance & Compliance
1 87 (3.74%) Data Quality
2 52 (2.23%) QA
3 31 (1.33%) GDPR
4 15 (0.64%) PCI DSS
4 15 (0.64%) Sarbanes-Oxley
5 11 (0.47%) PMO
6 7 (0.30%) SLA
7 6 (0.26%) ISO/IEC 27001
8 5 (0.21%) IFRS
9 4 (0.17%) Disclosure Scotland
10 3 (0.13%) GxP
10 3 (0.13%) MiFID
11 2 (0.086%) EMIR
11 2 (0.086%) NIST
12 1 (0.043%) COBIT
12 1 (0.043%) GLBA
12 1 (0.043%) HIPAA
12 1 (0.043%) IFRS 9
12 1 (0.043%) ISO 9000
12 1 (0.043%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
System Software
1 330 (14.17%) Docker
2 102 (4.38%) HDFS
3 55 (2.36%) Apache Flume
4 40 (1.72%) Active Directory
5 19 (0.82%) Apache ZooKeeper
6 18 (0.77%) Oracle RAC
7 13 (0.56%) Virtual Desktop
8 12 (0.52%) XenApp
9 9 (0.39%) VMware ESXi
9 9 (0.39%) VMware Infrastructure
10 8 (0.34%) Virtual Machines
10 8 (0.34%) Virtual Servers
11 7 (0.30%) Hyper-V
11 7 (0.30%) vSphere
12 6 (0.26%) Microsoft App-V
12 6 (0.26%) XenDesktop
13 3 (0.13%) VirtualBox
14 2 (0.086%) NFS
14 2 (0.086%) Samba
15 1 (0.043%) Xen
Systems Management
1 285 (12.24%) Kubernetes
2 245 (10.52%) Terraform
3 233 (10.00%) Ansible
4 93 (3.99%) Puppet
5 75 (3.22%) Opscode Chef
6 71 (3.05%) Oozie
7 63 (2.71%) Hadoop YARN
8 22 (0.94%) Kibana
9 18 (0.77%) Salt
10 16 (0.69%) Enterprise Manager Cloud Control
11 15 (0.64%) logstash
12 12 (0.52%) vCenter Server
13 11 (0.47%) Packer
14 9 (0.39%) Nagios
14 9 (0.39%) Prometheus
15 8 (0.34%) Istio
16 7 (0.30%) Ambari
16 7 (0.30%) Microsoft Clustering
16 7 (0.30%) vRealize
17 6 (0.26%) SCCM
Vendors
1 316 (13.57%) Google
2 217 (9.32%) Cloudera
3 213 (9.15%) Microsoft
4 206 (8.84%) Oracle
5 116 (4.98%) Tableau
6 94 (4.04%) Hortonworks
7 92 (3.95%) Databricks
8 69 (2.96%) Informatica
9 66 (2.83%) Talend
10 63 (2.71%) Red Hat
11 48 (2.06%) SAP
12 35 (1.50%) Teradata
13 31 (1.33%) Greenplum
14 28 (1.20%) Splunk
15 23 (0.99%) Sybase
16 22 (0.94%) MapR
17 20 (0.86%) Alteryx
17 20 (0.86%) StreamSets
18 19 (0.82%) Cisco
18 19 (0.82%) VMware