Period
to 21 August 2018

The following table provides summary statistics for contract job vacancies advertised in the South East with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 21 August 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > South East
6 months to
21 Aug 2018
Same period 2017 Same period 2016
Rank 88 115 170
Rank change year-on-year +27 +55 +52
Contract jobs citing Big Data 468 332 252
As % of all contract IT jobs advertised in the South East 2.82% 2.08% 1.39%
As % of the Database & Business Intelligence category 13.22% 9.58% 6.62%
Number of daily rates quoted 278 182 127
South East median daily rate £500 £475 £463
Median daily rate % change year-on-year +5.26% +2.70% -
10th Percentile £375 £313 £320
90th Percentile £588 £623 £630
England median daily rate £550 £540 £525
% change year-on-year +1.85% +2.86% -
Number of hourly rates quoted 3 4 1
South East median hourly rate £44.50 £34.65 £20.50
Median hourly rate % change year-on-year +28.44% +69.01% -59.00%
10th Percentile £22.05 £16.64 £19.25
90th Percentile £55.35 £50.00 £21.75
England median hourly rate £42.25 £28.25 £43.92
% change year-on-year +49.56% -35.68% +60.79%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the South East with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
South East
Contract vacancies with a requirement for database or business intelligence skills 3,539 3,464 3,806
As % of all contract IT jobs advertised in the South East 21.36% 21.72% 20.97%
Number of daily rates quoted 2,224 2,109 2,394
South East median daily rate £438 £408 £400
Median daily rate % change year-on-year +7.36% +1.88% +6.67%
10th Percentile £313 £284 £275
90th Percentile £575 £538 £538
England median daily rate £475 £450 £425
% change year-on-year +5.56% +5.88% +6.25%
Number of hourly rates quoted 53 73 97
South East median hourly rate £40.00 £19.66 £35.50
Median hourly rate % change year-on-year +103.46% -44.62% +42.00%
10th Percentile £12.25 £9.25 £9.25
90th Percentile £55.00 £49.60 £52.25
England median hourly rate £30.00 £30.00 £28.50
% change year-on-year - +5.26% +4.34%

Big Data
Job Vacancy Trend in the South East

Job postings citing Big Data as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for Big Data in the South East

Big Data
Contractor Daily Rate Trend in the South East

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the South East.

Contractor daily rate trend for Big Data in the South East

Big Data
Contractor Daily Rate Histogram in the South East

The daily rate distribution of IT jobs citing Big Data in the South East over the 6 months to 21 August 2018.

Contractor daily rate histogram for Big Data in the South East

Big Data
Contractor Hourly Rate Trend in the South East

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in the South East.

Contractor hourly rate trend for Big Data in the South East

Big Data
Contractor Hourly Rate Histogram in the South East

The hourly rate distribution of IT jobs citing Big Data in the South East over the 6 months to 21 August 2018.

Contractor hourly rate histogram for Big Data in the South East

Big Data
Contract Job Locations in the South East

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the South East region over the 6 months to 21 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Thames Valley +1 185 £500 +5.26% 61
Surrey +17 132 £500 +2.04% 17
Berkshire +1 102 £525 +13.51% 36
Hampshire +23 95 £494 +23.44% 14
Buckinghamshire +10 69 £513 +29.75% 3
West Sussex +6 27 £475 +5.56% 2
East Sussex +12 17 £513 +7.89% 1
Oxfordshire -14 14 £475 -5.00% 22
Middlesex +3 9 - -
Sussex - 2 £525 -
Big Data
England

For the 6 months to 21 August 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the South East region with a requirement for Big Data.

1 229 (48.93%) Hadoop
2 202 (43.16%) Agile Software Development
3 181 (38.68%) Kafka
4 175 (37.39%) Analytics
5 171 (36.54%) Java
6 165 (35.26%) Apache Spark
7 114 (24.36%) Linux
8 110 (23.50%) Finance
9 106 (22.65%) Python
10 95 (20.30%) SQL
11 92 (19.66%) Data Warehouse
11 92 (19.66%) Jenkins
12 89 (19.02%) Business Intelligence
12 89 (19.02%) Microsoft Azure
13 88 (18.80%) ETL
14 86 (18.38%) TDD
15 85 (18.16%) Apache
16 78 (16.67%) RabbitMQ
16 78 (16.67%) Spring
16 78 (16.67%) Data Analytics
17 76 (16.24%) Scrum
18 73 (15.60%) Amazon AWS
18 73 (15.60%) Data Lake
19 71 (15.17%) NoSQL
20 69 (14.74%) SQL Server
21 68 (14.53%) Data Modelling
22 66 (14.10%) JSON
23 65 (13.89%) JavaScript
24 62 (13.25%) Unix
25 59 (12.61%) RESTful

Big Data
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 165 (35.26%) Apache Spark
2 85 (18.16%) Apache
3 35 (7.48%) Elasticsearch
4 22 (4.70%) SAS
5 16 (3.42%) Cloud Foundry
5 16 (3.42%) GemFire
6 13 (2.78%) OpenStack
7 10 (2.14%) Apache Solr
8 6 (1.28%) Apache Pig
9 5 (1.07%) JBoss
9 5 (1.07%) Mule
9 5 (1.07%) Tomcat
10 3 (0.64%) BizTalk Server
10 3 (0.64%) CMS
11 2 (0.43%) ArcGIS
11 2 (0.43%) Confluence
12 1 (0.21%) Drupal
12 1 (0.21%) IBM Domino
12 1 (0.21%) Jupyter
Applications
1 19 (4.06%) Microsoft Excel
2 12 (2.56%) Microsoft PowerPoint
3 2 (0.43%) SPSS
4 1 (0.21%) GIMP
4 1 (0.21%) Photoshop
4 1 (0.21%) Spreadsheet
4 1 (0.21%) Stata
Business Applications
1 7 (1.50%) SAP APO
1 7 (1.50%) SAP MM
2 5 (1.07%) SAP MDM
3 4 (0.85%) SAP ERP
4 3 (0.64%) Oracle Financials
5 1 (0.21%) Dynamics CRM
5 1 (0.21%) HFM
5 1 (0.21%) Markit EDM
5 1 (0.21%) Oracle EBS
5 1 (0.21%) Remedy ITSM
Cloud Services
1 89 (19.02%) Microsoft Azure
2 73 (15.60%) Amazon AWS
3 30 (6.41%) Azure Data Factory
4 15 (3.21%) Google Cloud Platform
4 15 (3.21%) PaaS
5 14 (2.99%) SaaS
5 14 (2.99%) Serverless
6 13 (2.78%) Azure Machine Learning
6 13 (2.78%) GitHub
7 9 (1.92%) Cortana Intelligence Suite
8 8 (1.71%) Amazon S3
8 8 (1.71%) Azure Functions
9 6 (1.28%) Data Lake Analytics
9 6 (1.28%) Google Analytics
10 5 (1.07%) Amazon Kinesis
10 5 (1.07%) Azure Active Directory
11 4 (0.85%) AWS CloudFormation
11 4 (0.85%) AWS Lambda
11 4 (0.85%) Office 365
11 4 (0.85%) OpenShift
Communications & Networking
1 8 (1.71%) HTTP
1 8 (1.71%) Kerberos
2 7 (1.50%) Network Security
3 6 (1.28%) Firewall
4 5 (1.07%) Internet
4 5 (1.07%) SSH
4 5 (1.07%) TCP/IP
5 2 (0.43%) MQTT
6 1 (0.21%) Broadband
6 1 (0.21%) DNS
6 1 (0.21%) DVB
6 1 (0.21%) NAS
6 1 (0.21%) Reverse Proxy
6 1 (0.21%) SAN
Database & Business Intelligence
1 229 (48.93%) Hadoop
2 92 (19.66%) Data Warehouse
3 73 (15.60%) Data Lake
4 71 (15.17%) NoSQL
5 69 (14.74%) SQL Server
6 50 (10.68%) HBase
7 48 (10.26%) Apache Hive
8 45 (9.62%) Power BI
8 45 (9.62%) Relational Database
9 40 (8.55%) MongoDB
10 34 (7.26%) Apache Cassandra
11 33 (7.05%) SQL Server Integration Services
12 21 (4.49%) Impala
13 20 (4.27%) SQL Server Reporting Services
14 19 (4.06%) Azure SQL Data Warehouse
14 19 (4.06%) OLAP
15 15 (3.21%) Cosmos DB
16 14 (2.99%) PostgreSQL
17 13 (2.78%) HDInsight
17 13 (2.78%) MySQL
Development Applications
1 92 (19.66%) Jenkins
2 49 (10.47%) Git (software)
3 28 (5.98%) JIRA
4 16 (3.42%) Visual Studio Team System
5 13 (2.78%) Visual Studio
6 10 (2.14%) Cucumber
6 10 (2.14%) Gradle
7 9 (1.92%) JUnit
8 8 (1.71%) Selenium
9 6 (1.28%) Team Foundation Server
10 5 (1.07%) Cobertura
10 5 (1.07%) Protractor
11 4 (0.85%) Eclipse
11 4 (0.85%) gulp
11 4 (0.85%) IntelliJ
11 4 (0.85%) MSBuild
11 4 (0.85%) NUnit
11 4 (0.85%) Sonatype Nexus
12 3 (0.64%) Atlassian Bamboo
12 3 (0.64%) Maven
General
1 110 (23.50%) Finance
2 24 (5.13%) Retail
3 20 (4.27%) Telecoms
4 11 (2.35%) Marketing
5 8 (1.71%) Legal
6 6 (1.28%) Banking
6 6 (1.28%) Manufacturing
7 4 (0.85%) Law
8 3 (0.64%) Advertising
8 3 (0.64%) Pharmaceutical
9 1 (0.21%) Billing
9 1 (0.21%) Dutch Language
9 1 (0.21%) French Language
9 1 (0.21%) German Language
9 1 (0.21%) Italian Language
9 1 (0.21%) Publishing
9 1 (0.21%) Retail Banking
9 1 (0.21%) Spanish Language
Job Titles
1 207 (44.23%) Developer
2 87 (18.59%) Java Developer
3 70 (14.96%) Big Data Developer
4 62 (13.25%) Architect
5 43 (9.19%) Analyst
6 42 (8.97%) Data Architect
7 33 (7.05%) Data Engineer
8 31 (6.62%) Hadoop Developer
9 30 (6.41%) Apache Spark Developer
10 26 (5.56%) Big Data Engineer
11 24 (5.13%) Consultant
12 20 (4.27%) Business Intelligence Developer
13 19 (4.06%) Data Analyst
14 17 (3.63%) DevOps Engineer
15 15 (3.21%) Big Data Architect
16 14 (2.99%) Big Data Manager
16 14 (2.99%) Business Analyst
17 13 (2.78%) Azure Developer
17 13 (2.78%) Scala Developer
17 13 (2.78%) SQL Developer
Libraries, Frameworks & Software Standards
1 181 (38.68%) Kafka
2 78 (16.67%) RabbitMQ
2 78 (16.67%) Spring
3 66 (14.10%) JSON
4 59 (12.61%) RESTful
5 56 (11.97%) Middleware
6 48 (10.26%) Spark Streaming
7 47 (10.04%) Spring Boot
8 40 (8.55%) J2EE
9 35 (7.48%) AngularJS
10 32 (6.84%) REST
11 22 (4.70%) .NET
12 19 (4.06%) React
13 18 (3.85%) HTML
13 18 (3.85%) Node.js
14 17 (3.63%) Web Services
15 15 (3.21%) Apache Camel
15 15 (3.21%) jQuery
16 13 (2.78%) Hibernate
16 13 (2.78%) LAPP Stack
Miscellaneous
1 53 (11.32%) Analytical Skills
2 45 (9.62%) Greenfield Project
3 14 (2.99%) Computer Science
4 12 (2.56%) Linux Command Line
5 11 (2.35%) Self-Motivation
5 11 (2.35%) Virtual Team
6 10 (2.14%) Algorithms
7 8 (1.71%) Public Cloud
8 7 (1.50%) Data Structures
8 7 (1.50%) Management Information System
9 5 (1.07%) Clustering
10 4 (0.85%) AS400
11 3 (0.64%) Cyberthreat
11 3 (0.64%) Fintech
11 3 (0.64%) Mobile App
11 3 (0.64%) Security Operations Centre
12 2 (0.43%) Cyber Defence
12 2 (0.43%) Data Centre
12 2 (0.43%) Fat Client
12 2 (0.43%) Replication
Operating Systems
1 114 (24.36%) Linux
2 62 (13.25%) Unix
3 33 (7.05%) Windows
4 10 (2.14%) VMS
5 7 (1.50%) Android
5 7 (1.50%) Red Hat Enterprise Linux
6 6 (1.28%) CentOS
7 5 (1.07%) Apple iOS
8 2 (0.43%) Debian
8 2 (0.43%) Ubuntu
9 1 (0.21%) Windows Server
Processes & Methodologies
1 202 (43.16%) Agile Software Development
2 175 (37.39%) Analytics
3 89 (19.02%) Business Intelligence
4 88 (18.80%) ETL
5 86 (18.38%) TDD
6 78 (16.67%) Data Analytics
7 76 (16.24%) Scrum
8 68 (14.53%) Data Modelling
9 56 (11.97%) DevOps
9 56 (11.97%) Visualisation
10 55 (11.75%) BDD
11 54 (11.54%) Continuous Integration
12 51 (10.90%) Data Architecture
13 50 (10.68%) Open Source
14 47 (10.04%) Machine Learning
15 46 (9.83%) Microservices
16 41 (8.76%) Migration
16 41 (8.76%) SDLC
17 40 (8.55%) Data Management
18 37 (7.91%) Data Governance
Programming Languages
1 171 (36.54%) Java
2 106 (22.65%) Python
3 95 (20.30%) SQL
4 65 (13.89%) JavaScript
5 50 (10.68%) Scala
6 34 (7.26%) C#
7 33 (7.05%) R
8 20 (4.27%) PowerShell
9 17 (3.63%) Shell Script
10 14 (2.99%) C
10 14 (2.99%) Go
11 12 (2.56%) Bash Shell
12 11 (2.35%) T-SQL
13 10 (2.14%) Perl
14 9 (1.92%) C++
15 8 (1.71%) Java 8
16 7 (1.50%) Ruby
17 6 (1.28%) U-SQL
18 5 (1.07%) PHP
18 5 (1.07%) VBA
Qualifications
1 52 (11.11%) Degree
2 41 (8.76%) Security Cleared
3 22 (4.70%) SC Cleared
4 11 (2.35%) BPSS Clearance
5 10 (2.14%) BC Cleared
6 9 (1.92%) Microsoft Certification
7 7 (1.50%) Numerate Degree
8 5 (1.07%) Computer Science Degree
8 5 (1.07%) ISTQB
9 4 (0.85%) CISM
9 4 (0.85%) CISSP
9 4 (0.85%) ISEB
10 3 (0.64%) DV Cleared
10 3 (0.64%) MCSE
11 2 (0.43%) OCA
11 2 (0.43%) Oracle Certification
11 2 (0.43%) PhD
12 1 (0.21%) AWS Certification
12 1 (0.21%) CEH
12 1 (0.21%) MCSA
Quality Assurance & Compliance
1 43 (9.19%) Data Quality
2 23 (4.91%) GDPR
3 17 (3.63%) QA
4 12 (2.56%) GCP
5 9 (1.92%) PCI DSS
6 3 (0.64%) Sarbanes-Oxley
7 2 (0.43%) SLA
System Software
1 56 (11.97%) Apache ZooKeeper
2 49 (10.47%) HDFS
3 29 (6.20%) Docker
4 24 (5.13%) Apache Flume
5 10 (2.14%) Hyper-V
6 7 (1.50%) Virtual Machines
7 6 (1.28%) Active Directory
8 4 (0.85%) Virtual Servers
9 1 (0.21%) KVM
9 1 (0.21%) VMware Infrastructure
9 1 (0.21%) Xen
Systems Management
1 51 (10.90%) Hadoop YARN
2 24 (5.13%) Puppet
3 21 (4.49%) Opscode Chef
4 17 (3.63%) Ansible
5 14 (2.99%) Kubernetes
5 14 (2.99%) Mesos
6 12 (2.56%) Kibana
6 12 (2.56%) Terraform
7 9 (1.92%) Nagios
8 6 (1.28%) HP ALM
9 3 (0.64%) ArcSight ESM
9 3 (0.64%) MIIS
9 3 (0.64%) Salt
10 2 (0.43%) Ambari
10 2 (0.43%) Ganglia
10 2 (0.43%) logstash
10 2 (0.43%) Oozie
10 2 (0.43%) SELinux
10 2 (0.43%) StatsD
10 2 (0.43%) ZABBIX
Vendors
1 57 (12.18%) Cloudera
2 52 (11.11%) Microsoft
3 44 (9.40%) Oracle
4 29 (6.20%) Tableau
5 24 (5.13%) SAP
6 21 (4.49%) Hortonworks
7 19 (4.06%) Informatica
8 18 (3.85%) Google
8 18 (3.85%) Talend
9 15 (3.21%) Ab Initio
10 13 (2.78%) Splunk
11 11 (2.35%) HP
11 11 (2.35%) IBM
11 11 (2.35%) Vertica
12 10 (2.14%) MapR
13 9 (1.92%) ArcSight
14 8 (1.71%) Databricks
15 6 (1.28%) Intel
16 4 (0.85%) JD Edwards
16 4 (0.85%) Teradata