Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 23 October 2019

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 23 October 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK
6 months to
23 Oct 2019		 Same period 2018 Same period 2017
Rank 84 92 93
Rank change year-on-year +8 +1 +36
Contract jobs citing Big Data 2,316 2,715 2,687
As % of all contract IT jobs advertised in the UK 2.73% 2.62% 2.68%
As % of the Database & Business Intelligence category 12.67% 11.59% 12.07%
Number of daily rates quoted 1,652 1,898 1,881
UK median daily rate £550 £550 £550
10th Percentile £413 £400 £375
90th Percentile £725 £700 £688
UK excluding London median daily rate £525 £500 £475
% change year-on-year +5.00% +5.26% +5.56%
Number of hourly rates quoted 14 15 17
UK median hourly rate £46.85 £44.50 £35.00
Median hourly rate % change year-on-year +5.28% +27.14% -18.45%
10th Percentile £35.00 £15.95 £16.64
90th Percentile £53.75 £70.25 £61.36
UK excluding London median hourly rate £36.00 £40.00 £35.00
% change year-on-year -10.00% +14.29% -18.45%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 18,286 23,420 22,256
As % of all contract IT jobs advertised in the UK 21.59% 22.64% 22.21%
Number of daily rates quoted 12,470 16,339 15,064
UK median daily rate £475 £475 £450
Median daily rate % change year-on-year - +5.56% +5.88%
10th Percentile £325 £313 £308
90th Percentile £656 £638 £625
UK excluding London median daily rate £438 £425 £400
% change year-on-year +2.94% +6.25% +6.67%
Number of hourly rates quoted 258 227 277
UK median hourly rate £35.00 £30.00 £30.00
Median hourly rate % change year-on-year +16.67% - +1.69%
10th Percentile £12.59 £12.46 £13.71
90th Percentile £60.00 £56.55 £54.25
UK excluding London median hourly rate £31.50 £33.00 £33.00
% change year-on-year -4.55% - +15.79%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a percentage of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data.

Contractor daily rate trend for Big Data in the UK

Big Data
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Big Data over the 6 months to 23 October 2019.

Contractor daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data.

Contractor hourly rate trend for Big Data in the UK

Big Data
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Big Data over the 6 months to 23 October 2019.

Contractor hourly rate histogram for Big Data in the UK

Big Data
Top 17 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 23 October 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England +8 2,142 £550 - 583
London +11 1,378 £575 +4.55% 317
UK excluding London +9 898 £525 +5.00% 299
South East -26 271 £500 - 82
North of England +20 209 £525 +5.00% 56
South West +4 132 £550 +4.76% 49
North West +31 125 £531 -2.52% 41
Scotland +67 123 £475 +15.15% 24
Yorkshire +3 71 £500 +5.26% 9
East of England -5 68 £525 +9.09% 42
Midlands +47 67 £525 +16.67% 40
West Midlands +38 36 £488 +8.33% 20
East Midlands +19 31 £525 +16.67% 20
Northern Ireland +17 23 £530 +23.04% 2
North East +10 13 £575 -11.54% 6
Wales -9 4 £513 +1.99% 8
Channel Islands - 1 - -

For the 6 months to 23 October 2019, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Big Data.

1 869 (37.52%) Python
2 834 (36.01%) Hadoop
3 830 (35.84%) Apache Spark
4 788 (34.02%) Agile Software Development
5 731 (31.56%) SQL
6 705 (30.44%) AWS
7 660 (28.50%) Analytics
8 581 (25.09%) Java
9 577 (24.91%) Finance
10 513 (22.15%) Azure
11 505 (21.80%) DevOps
12 470 (20.29%) Kafka
13 394 (17.01%) Scala
14 383 (16.54%) Data Warehouse
15 382 (16.49%) GCP
16 372 (16.06%) Apache Hive
17 367 (15.85%) Data Science
18 357 (15.41%) Linux
19 342 (14.77%) Business Intelligence
20 341 (14.72%) ETL
21 327 (14.12%) Docker
22 310 (13.39%) Jenkins
23 299 (12.91%) Data Modelling
23 299 (12.91%) Machine Learning
24 281 (12.13%) Migration
25 277 (11.96%) Google
26 271 (11.70%) Kubernetes
27 262 (11.31%) Data Lake
28 261 (11.27%) Data Engineering
28 261 (11.27%) Scrum

Big Data
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 830 (35.84%) Apache Spark
2 202 (8.72%) Apache
3 83 (3.58%) Elasticsearch
4 74 (3.20%) Apache Airflow
5 62 (2.68%) SAS
6 37 (1.60%) Jupyter
7 30 (1.30%) Confluence
8 22 (0.95%) Apache Pig
9 16 (0.69%) Apache Solr
10 13 (0.56%) JBoss
11 12 (0.52%) OpenStack
11 12 (0.52%) SharePoint
12 10 (0.43%) Tomcat
13 9 (0.39%) Luigi
14 8 (0.35%) IIS
14 8 (0.35%) Oracle SOA Suite
15 7 (0.30%) WebLogic
16 6 (0.26%) Moodle
16 6 (0.26%) Oracle Coherence
16 6 (0.26%) Oracle HTTP Server
Applications
1 61 (2.63%) Microsoft Excel
2 24 (1.04%) Microsoft PowerPoint
3 15 (0.65%) MS Visio
4 9 (0.39%) Microsoft Office
4 9 (0.39%) Microsoft Project
5 4 (0.17%) SPSS
6 3 (0.13%) InVision
7 2 (0.086%) AutoCAD
7 2 (0.086%) Sketch
8 1 (0.043%) Adobe Creative Suite
8 1 (0.043%) Spreadsheet
8 1 (0.043%) Zeplin
Business Applications
1 12 (0.52%) Dynamics CRM
2 7 (0.30%) Oracle BPM
2 7 (0.30%) SAP S/4HANA
3 5 (0.22%) Dynamics AX
3 5 (0.22%) Dynamics NAV
3 5 (0.22%) SAP Oil and Gas
4 4 (0.17%) FINCAD Analytics
5 3 (0.13%) Distributed Ledger
5 3 (0.13%) SAP ERP
6 2 (0.086%) Adobe Campaign
6 2 (0.086%) BPCS
6 2 (0.086%) SAP R/3
7 1 (0.043%) Actimize
7 1 (0.043%) Markit EDM
7 1 (0.043%) NetSuite
7 1 (0.043%) PolarLake
7 1 (0.043%) SAP APO
7 1 (0.043%) SAP CAR
7 1 (0.043%) SAP Retail
7 1 (0.043%) Sparx Enterprise Architect
Cloud Services
1 705 (30.44%) AWS
2 513 (22.15%) Azure
3 382 (16.49%) GCP
4 137 (5.92%) Power Platform
5 100 (4.32%) Amazon EMR
6 95 (4.10%) GitHub
7 88 (3.80%) Serverless
8 84 (3.63%) Amazon S3
9 78 (3.37%) Azure Data Factory
10 55 (2.37%) AWS Lambda
11 50 (2.16%) Amazon Kinesis
12 45 (1.94%) OpenShift
13 37 (1.60%) Amazon CloudWatch
13 37 (1.60%) AWS CloudFormation
13 37 (1.60%) Cloud Computing
14 36 (1.55%) Amazon EC2
15 25 (1.08%) PaaS
16 23 (0.99%) Data Lake Analytics
16 23 (0.99%) Office 365
17 20 (0.86%) Datadog
Communications & Networking
1 34 (1.47%) Kerberos
2 25 (1.08%) Firewall
3 18 (0.78%) DNS
4 16 (0.69%) HTTP
5 15 (0.65%) Internet
6 14 (0.60%) SSL
7 13 (0.56%) SAN
8 12 (0.52%) TCP/IP
9 10 (0.43%) Software-Defined Networking
10 7 (0.30%) Multicast
10 7 (0.30%) Network Security
11 5 (0.22%) NetScaler
11 5 (0.22%) Wi-Fi
12 4 (0.17%) AMQP
12 4 (0.17%) F5 BIG-IP GTM
12 4 (0.17%) F5 BIG-IP LTM
13 3 (0.13%) DMZ
13 3 (0.13%) LAN
13 3 (0.13%) PuTTY
13 3 (0.13%) WAN
Database & Business Intelligence
1 834 (36.01%) Hadoop
2 383 (16.54%) Data Warehouse
3 372 (16.06%) Apache Hive
4 262 (11.31%) Data Lake
5 227 (9.80%) NoSQL
6 198 (8.55%) SQL Server
7 162 (6.99%) Impala
8 144 (6.22%) HBase
9 137 (5.92%) Power BI
10 136 (5.87%) Relational Database
11 127 (5.48%) Amazon Redshift
12 126 (5.44%) MongoDB
13 111 (4.79%) BigQuery
14 107 (4.62%) PostgreSQL
15 91 (3.93%) MySQL
16 77 (3.32%) Spark SQL
17 75 (3.24%) Apache Cassandra
18 65 (2.81%) SQL Server Integration Services
19 60 (2.59%) RDBMS
20 48 (2.07%) SQL Server Analysis Services
Development Applications
1 310 (13.39%) Jenkins
2 245 (10.58%) Git (software)
3 143 (6.17%) JIRA
4 50 (2.16%) Maven
5 48 (2.07%) Visual Studio Team System
6 46 (1.99%) Selenium
7 43 (1.86%) Atlassian Bamboo
8 42 (1.81%) GitLab
8 42 (1.81%) Sonatype Nexus
9 32 (1.38%) Cucumber
9 32 (1.38%) Gradle
10 31 (1.34%) Visual Studio
11 30 (1.30%) TeamCity
12 21 (0.91%) Team Foundation Server
13 20 (0.86%) Artifactory
13 20 (0.86%) JUnit
14 19 (0.82%) IntelliJ
14 19 (0.82%) Subversion
15 17 (0.73%) Eclipse
16 16 (0.69%) CircleCI
General
1 577 (24.91%) Finance
2 247 (10.66%) Banking
3 108 (4.66%) Public Sector
4 107 (4.62%) Retail
5 89 (3.84%) Investment Banking
6 77 (3.32%) Telecoms
7 51 (2.20%) Front Office
8 48 (2.07%) Manufacturing
9 45 (1.94%) Financial Institution
9 45 (1.94%) Legal
9 45 (1.94%) Marketing
10 30 (1.30%) Advertising
11 19 (0.82%) Pharmaceutical
12 16 (0.69%) Games
12 16 (0.69%) Retail Banking
13 7 (0.30%) Publishing
14 5 (0.22%) Law
15 4 (0.17%) Automotive
15 4 (0.17%) Military
16 3 (0.13%) Back Office
Job Titles
1 536 (23.14%) Data Engineer
2 497 (21.46%) Developer
3 336 (14.51%) Architect
4 244 (10.54%) Big Data Engineer
5 166 (7.17%) DevOps Engineer
6 151 (6.52%) Data Architect
7 149 (6.43%) Analyst
8 131 (5.66%) Python Engineer
9 126 (5.44%) Java Developer
10 118 (5.09%) Python Developer
11 116 (5.01%) Big Data Developer
12 114 (4.92%) Cloud Engineer
13 82 (3.54%) Data Scientist
14 78 (3.37%) AWS Engineer
14 78 (3.37%) Consultant
15 72 (3.11%) Scala Developer
16 70 (3.02%) Administrator
17 68 (2.94%) Business Analyst
17 68 (2.94%) Senior Developer
18 65 (2.81%) Big Data Architect
Libraries, Frameworks & Software Standards
1 470 (20.29%) Kafka
2 133 (5.74%) Web Services
3 104 (4.49%) PySpark
4 86 (3.71%) .NET
5 82 (3.54%) Spring
6 80 (3.45%) JSON
7 74 (3.20%) RESTful
8 72 (3.11%) React
9 63 (2.72%) XML
10 60 (2.59%) REST
11 53 (2.29%) HTML
12 51 (2.20%) CSS
13 45 (1.94%) Pandas
13 45 (1.94%) scikit-learn
13 45 (1.94%) TensorFlow
14 44 (1.90%) AngularJS
14 44 (1.90%) Natural Language Processing
15 41 (1.77%) Spring Boot
16 38 (1.64%) Apache NiFi
16 38 (1.64%) Middleware
Miscellaneous
1 229 (9.89%) Analytical Skills
2 126 (5.44%) Greenfield Project
3 123 (5.31%) Algorithms
4 79 (3.41%) Data Structures
5 49 (2.12%) Self-Motivation
6 45 (1.94%) User Experience
7 42 (1.81%) Data Centre
8 41 (1.77%) Cloud Native
9 40 (1.73%) Management Information System
10 39 (1.68%) Clustering
11 32 (1.38%) Public Cloud
12 29 (1.25%) Virtual Team
13 27 (1.17%) PKI
14 25 (1.08%) Replication
15 21 (0.91%) Hedge funds
16 17 (0.73%) Enterprise Software
17 16 (0.69%) Credit Risk
17 16 (0.69%) Derivative
17 16 (0.69%) Foreign Exchange (FX)
17 16 (0.69%) Linux Command Line
Operating Systems
1 357 (15.41%) Linux
2 145 (6.26%) Unix
3 89 (3.84%) Red Hat Enterprise Linux
4 77 (3.32%) Windows
5 31 (1.34%) CentOS
6 22 (0.95%) Windows Server
7 15 (0.65%) Ubuntu
8 13 (0.56%) Apple iOS
8 13 (0.56%) Solaris
9 11 (0.47%) Android
9 11 (0.47%) VMS
10 7 (0.30%) Windows 10
11 6 (0.26%) Debian
12 4 (0.17%) Mac OS X
13 3 (0.13%) AIX
13 3 (0.13%) Windows Server 2012
14 2 (0.086%) Embedded Linux
15 1 (0.043%) Fedora
15 1 (0.043%) Mac OS
15 1 (0.043%) Oracle Linux
Processes & Methodologies
1 788 (34.02%) Agile Software Development
2 660 (28.50%) Analytics
3 505 (21.80%) DevOps
4 367 (15.85%) Data Science
5 342 (14.77%) Business Intelligence
6 341 (14.72%) ETL
7 299 (12.91%) Data Modelling
7 299 (12.91%) Machine Learning
8 281 (12.13%) Migration
9 261 (11.27%) Data Engineering
9 261 (11.27%) Scrum
10 228 (9.84%) Problem-Solving
11 221 (9.54%) Continuous Integration
12 217 (9.37%) Data Analytics
13 185 (7.99%) Microservices
14 179 (7.73%) Artificial Intelligence
15 178 (7.69%) Computer Science
15 178 (7.69%) Software Engineering
16 167 (7.21%) Data Architecture
17 162 (6.99%) Stakeholder Management
Programming Languages
1 869 (37.52%) Python
2 731 (31.56%) SQL
3 581 (25.09%) Java
4 394 (17.01%) Scala
5 131 (5.66%) JavaScript
6 125 (5.40%) C#
7 122 (5.27%) R
8 96 (4.15%) Bash Shell
9 81 (3.50%) Shell Script
10 74 (3.20%) PowerShell
11 51 (2.20%) C++
12 41 (1.77%) Java 8
13 39 (1.68%) Go
13 39 (1.68%) PL/SQL
14 36 (1.55%) Ruby
15 34 (1.47%) C
16 29 (1.25%) T-SQL
17 24 (1.04%) Perl
18 20 (0.86%) Groovy
19 19 (0.82%) TypeScript
Qualifications
1 231 (9.97%) Security Cleared
2 184 (7.94%) Degree
3 125 (5.40%) SC Cleared
4 76 (3.28%) DV Cleared
5 54 (2.33%) Computer Science Degree
6 41 (1.77%) PhD
7 29 (1.25%) CISSP
7 29 (1.25%) Master's Degree
8 18 (0.78%) CISM
8 18 (0.78%) PMI Certification
8 18 (0.78%) PMP
9 15 (0.65%) TOGAF Certification
10 13 (0.56%) Cisco Certification
11 10 (0.43%) AWS Certification
11 10 (0.43%) CCA
12 9 (0.39%) Microsoft Certification
13 8 (0.35%) (ISC)2 CCSP
14 7 (0.30%) MCSA
14 7 (0.30%) MCSE
15 5 (0.22%) CSSLP
Quality Assurance & Compliance
1 81 (3.50%) Data Quality
2 57 (2.46%) QA
3 28 (1.21%) GDPR
4 20 (0.86%) PCI DSS
5 17 (0.73%) Sarbanes-Oxley
6 11 (0.47%) PMO
7 8 (0.35%) ISO/IEC 27001
8 6 (0.26%) SLA
9 4 (0.17%) Disclosure Scotland
10 3 (0.13%) COBIT
10 3 (0.13%) GxP
10 3 (0.13%) MiFID
11 2 (0.086%) EMIR
11 2 (0.086%) IFRS
11 2 (0.086%) IFRS 9
11 2 (0.086%) ISO 9000
11 2 (0.086%) NIST
12 1 (0.043%) GLBA
12 1 (0.043%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
12 1 (0.043%) PSD2
System Software
1 327 (14.12%) Docker
2 125 (5.40%) HDFS
3 41 (1.77%) Apache Flume
4 34 (1.47%) Active Directory
5 15 (0.65%) Oracle RAC
6 14 (0.60%) Apache ZooKeeper
6 14 (0.60%) Virtual Desktop
7 12 (0.52%) XenApp
8 10 (0.43%) VMware ESXi
8 10 (0.43%) VMware Infrastructure
9 8 (0.35%) Virtual Servers
9 8 (0.35%) vSphere
10 7 (0.30%) Microsoft App-V
10 7 (0.30%) XenDesktop
11 6 (0.26%) Hyper-V
12 5 (0.22%) Virtual Machines
13 2 (0.086%) Samba
13 2 (0.086%) VirtualBox
14 1 (0.043%) NFS
14 1 (0.043%) Xen
Systems Management
1 271 (11.70%) Kubernetes
2 218 (9.41%) Terraform
3 215 (9.28%) Ansible
4 79 (3.41%) Puppet
5 59 (2.55%) Hadoop YARN
5 59 (2.55%) Oozie
6 55 (2.37%) Opscode Chef
7 18 (0.78%) Kibana
8 16 (0.69%) Enterprise Manager Cloud Control
9 14 (0.60%) Packer
10 13 (0.56%) vCenter Server
11 11 (0.47%) logstash
12 10 (0.43%) Prometheus
13 9 (0.39%) Nagios
14 8 (0.35%) Istio
14 8 (0.35%) ITRS Geneos
14 8 (0.35%) SCCM
14 8 (0.35%) vRealize
15 7 (0.30%) Salt
16 6 (0.26%) Ambari
Vendors
1 277 (11.96%) Google
2 227 (9.80%) Oracle
3 223 (9.63%) Cloudera
4 204 (8.81%) Microsoft
5 111 (4.79%) Tableau
6 102 (4.40%) Databricks
7 87 (3.76%) Hortonworks
8 68 (2.94%) Red Hat
9 67 (2.89%) Informatica
10 60 (2.59%) Talend
11 44 (1.90%) Teradata
12 42 (1.81%) SAP
13 37 (1.60%) Splunk
14 26 (1.12%) Greenplum
14 26 (1.12%) StreamSets
15 23 (0.99%) Sybase
16 22 (0.95%) VMware
17 20 (0.86%) Alteryx
18 19 (0.82%) Cisco
18 19 (0.82%) MapR
622 Big Data job vacancies Nationwide