Period
to 17 October 2018

The following table provides summary statistics for contract job vacancies advertised in the South East with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 17 October 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > South East
6 months to
17 Oct 2018
Same period 2017 Same period 2016
Rank 94 105 144
Rank change year-on-year +11 +39 +61
Contract jobs citing Big Data 423 364 277
As % of all contract IT jobs advertised in the South East 2.57% 2.24% 1.63%
As % of the Database & Business Intelligence category 12.03% 10.44% 7.84%
Number of daily rates quoted 267 215 132
South East median daily rate £500 £500 £475
Median daily rate % change year-on-year - +5.26% -5.00%
10th Percentile £380 £325 £332
90th Percentile £593 £600 £686
England median daily rate £550 £550 £525
% change year-on-year - +4.76% -
Number of hourly rates quoted 5 8 2
South East median hourly rate £44.50 £32.17 £80.25
Median hourly rate % change year-on-year +38.33% -59.91% +60.50%
10th Percentile £19.20 £16.64 £30.83
90th Percentile £59.00 £50.00 £132.68
England median hourly rate £42.25 £40.00 £43.00
% change year-on-year +5.63% -6.98% -1.71%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the South East with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
South East
Contract vacancies with a requirement for database or business intelligence skills 3,516 3,488 3,531
As % of all contract IT jobs advertised in the South East 21.35% 21.45% 20.74%
Number of daily rates quoted 2,285 2,197 2,161
South East median daily rate £448 £400 £400
Median daily rate % change year-on-year +11.88% - +6.67%
10th Percentile £313 £288 £275
90th Percentile £575 £546 £550
England median daily rate £475 £450 £425
% change year-on-year +5.56% +5.88% +6.25%
Number of hourly rates quoted 50 67 94
South East median hourly rate £37.50 £27.50 £30.00
Median hourly rate % change year-on-year +36.36% -8.33% +22.45%
10th Percentile £17.56 £9.25 £9.25
90th Percentile £57.75 £49.25 £52.25
England median hourly rate £32.48 £30.63 £28.50
% change year-on-year +6.04% +7.46% +3.64%

Big Data
Job Vacancy Trend in the South East

Job postings citing Big Data as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for Big Data in the South East

Big Data
Contractor Daily Rate Trend in the South East

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the South East.

Contractor daily rate trend for Big Data in the South East

Big Data
Contractor Daily Rate Histogram in the South East

The daily rate distribution of IT jobs citing Big Data in the South East over the 6 months to 17 October 2018.

Contractor daily rate histogram for Big Data in the South East

Big Data
Contractor Hourly Rate Trend in the South East

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in the South East.

Contractor hourly rate trend for Big Data in the South East

Big Data
Contractor Hourly Rate Histogram in the South East

The hourly rate distribution of IT jobs citing Big Data in the South East over the 6 months to 17 October 2018.

Contractor hourly rate histogram for Big Data in the South East

Big Data
Contract Job Locations in the South East

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the South East region over the 6 months to 17 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Thames Valley -3 180 £500 - 47
Surrey +20 121 £500 - 13
Berkshire +26 120 £500 +5.26% 25
Hampshire -13 73 £500 +17.65% 14
Buckinghamshire -11 47 £500 +26.58% 3
East Sussex +13 17 £538 +13.16% 4
Oxfordshire -14 13 £415 -17.00% 19
West Sussex -12 12 £475 +9.20% 7
Middlesex +14 11 - - 4
Kent +11 7 £550 - 6
Sussex - 3 £550 -
Big Data
England

For the 6 months to 17 October 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the South East region with a requirement for Big Data.

1 224 (52.96%) Hadoop
2 168 (39.72%) Apache Spark
3 166 (39.24%) Analytics
4 165 (39.01%) Agile Software Development
5 162 (38.30%) Kafka
6 139 (32.86%) Java
7 120 (28.37%) Python
8 106 (25.06%) Linux
9 99 (23.40%) SQL
10 91 (21.51%) Finance
11 90 (21.28%) ETL
12 79 (18.68%) Data Analytics
13 77 (18.20%) Data Warehouse
14 73 (17.26%) TDD
15 70 (16.55%) Apache
15 70 (16.55%) Microsoft Azure
16 68 (16.08%) Jenkins
16 68 (16.08%) Business Intelligence
17 67 (15.84%) NoSQL
18 66 (15.60%) Open Source
19 64 (15.13%) Amazon AWS
20 62 (14.66%) RabbitMQ
20 62 (14.66%) Apache Hive
21 60 (14.18%) Spring
21 60 (14.18%) Data Lake
22 59 (13.95%) Machine Learning
23 57 (13.48%) JavaScript
24 53 (12.53%) SQL Server
24 53 (12.53%) Data Modelling
25 52 (12.29%) Cloudera

Big Data
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 168 (39.72%) Apache Spark
2 70 (16.55%) Apache
3 39 (9.22%) Elasticsearch
4 23 (5.44%) SAS
5 12 (2.84%) OpenStack
6 11 (2.60%) Apache Solr
6 11 (2.60%) GemFire
7 5 (1.18%) Apache Pig
7 5 (1.18%) Tomcat
8 4 (0.95%) Cloud Foundry
9 2 (0.47%) ArcGIS
9 2 (0.47%) Confluence
10 1 (0.24%) Drupal
10 1 (0.24%) Jupyter
Applications
1 6 (1.42%) Microsoft Excel
2 4 (0.95%) Microsoft PowerPoint
3 1 (0.24%) Spreadsheet
3 1 (0.24%) SPSS
3 1 (0.24%) Stata
Business Applications
1 7 (1.65%) SAP APO
1 7 (1.65%) SAP MM
2 5 (1.18%) SAP MDM
3 4 (0.95%) SAP ERP
4 3 (0.71%) Dynamics CRM
4 3 (0.71%) Oracle Financials
5 2 (0.47%) Unica
6 1 (0.24%) HFM
6 1 (0.24%) Oracle EBS
6 1 (0.24%) Remedy ITSM
Cloud Services
1 70 (16.55%) Microsoft Azure
2 64 (15.13%) Amazon AWS
3 22 (5.20%) Azure Data Factory
4 16 (3.78%) Google Cloud Platform
5 15 (3.55%) PaaS
5 15 (3.55%) SaaS
6 12 (2.84%) Serverless
7 11 (2.60%) Azure Machine Learning
8 9 (2.13%) Azure Functions
9 8 (1.89%) Amazon Kinesis
9 8 (1.89%) Cortana Intelligence Suite
10 7 (1.65%) Amazon S3
11 6 (1.42%) Office 365
12 5 (1.18%) Azure Active Directory
13 4 (0.95%) Data Lake Analytics
14 3 (0.71%) Amazon CloudWatch
14 3 (0.71%) AWS Lambda
14 3 (0.71%) GitHub
14 3 (0.71%) Google Analytics
14 3 (0.71%) IaaS
Communications & Networking
1 21 (4.96%) Internet
2 16 (3.78%) Firewall
2 16 (3.78%) SSH
2 16 (3.78%) TCP/IP
3 10 (2.36%) HTTP
4 4 (0.95%) Network Security
5 3 (0.71%) DNS
5 3 (0.71%) Kerberos
6 2 (0.47%) VPN
7 1 (0.24%) Broadband
7 1 (0.24%) DVB
7 1 (0.24%) MQTT
7 1 (0.24%) NAS
7 1 (0.24%) Reverse Proxy
7 1 (0.24%) SAN
Database & Business Intelligence
1 224 (52.96%) Hadoop
2 77 (18.20%) Data Warehouse
3 67 (15.84%) NoSQL
4 62 (14.66%) Apache Hive
5 60 (14.18%) Data Lake
6 53 (12.53%) SQL Server
7 45 (10.64%) Apache Cassandra
8 43 (10.17%) Relational Database
9 30 (7.09%) Power BI
10 26 (6.15%) HBase
10 26 (6.15%) MongoDB
11 20 (4.73%) Impala
11 20 (4.73%) SQL Server Integration Services
12 18 (4.26%) Cosmos DB
12 18 (4.26%) OLAP
13 15 (3.55%) Azure SQL Data Warehouse
13 15 (3.55%) Flink
13 15 (3.55%) SQL Server Reporting Services
14 12 (2.84%) Geospatial Data
14 12 (2.84%) HDInsight
Development Applications
1 68 (16.08%) Jenkins
2 38 (8.98%) Git (software)
3 21 (4.96%) JIRA
4 11 (2.60%) Visual Studio Team System
5 10 (2.36%) Visual Studio
6 5 (1.18%) Atlassian Bamboo
6 5 (1.18%) Gradle
7 4 (0.95%) Cucumber
7 4 (0.95%) Maven
7 4 (0.95%) Selenium
8 3 (0.71%) Jasmine
8 3 (0.71%) TeamCity
9 2 (0.47%) Eclipse
9 2 (0.47%) IntelliJ
9 2 (0.47%) JUnit
9 2 (0.47%) LoadRunner
9 2 (0.47%) Mocha
9 2 (0.47%) Octopus Deploy
9 2 (0.47%) SoapUI
10 1 (0.24%) GitLab
General
1 91 (21.51%) Finance
2 26 (6.15%) Telecoms
3 21 (4.96%) Legal
4 16 (3.78%) Retail
5 13 (3.07%) Marketing
6 7 (1.65%) Pharmaceutical
7 5 (1.18%) Manufacturing
8 4 (0.95%) Aerospace
8 4 (0.95%) Law
9 3 (0.71%) Advertising
9 3 (0.71%) Banking
10 1 (0.24%) Games
10 1 (0.24%) Publishing
Job Titles
1 172 (40.66%) Developer
2 72 (17.02%) Java Developer
3 63 (14.89%) Big Data Developer
4 45 (10.64%) Architect
5 42 (9.93%) Data Engineer
6 39 (9.22%) Analyst
7 31 (7.33%) Big Data Engineer
8 27 (6.38%) Apache Spark Developer
9 24 (5.67%) Consultant
10 23 (5.44%) Data Architect
11 19 (4.49%) Data Analyst
12 17 (4.02%) Hadoop Developer
13 15 (3.55%) Administrator
13 15 (3.55%) Business Intelligence Developer
13 15 (3.55%) Data Scientist
13 15 (3.55%) DevOps Engineer
14 14 (3.31%) Big Data Architect
15 12 (2.84%) Analytics Developer
15 12 (2.84%) Azure Developer
15 12 (2.84%) Software Engineer
Libraries, Frameworks & Software Standards
1 162 (38.30%) Kafka
2 62 (14.66%) RabbitMQ
3 60 (14.18%) Spring
4 50 (11.82%) Spark Streaming
5 49 (11.58%) JSON
6 43 (10.17%) RESTful
7 39 (9.22%) Spring Boot
8 36 (8.51%) Middleware
9 35 (8.27%) J2EE
10 27 (6.38%) .NET
11 24 (5.67%) REST
12 23 (5.44%) AngularJS
13 19 (4.49%) React
14 17 (4.02%) HTML
15 16 (3.78%) Apache Camel
16 13 (3.07%) Elastic Stack
17 11 (2.60%) jQuery
17 11 (2.60%) Natural Language Processing
17 11 (2.60%) Node.js
18 9 (2.13%) .NET Core
Miscellaneous
1 48 (11.35%) Analytical Skills
2 40 (9.46%) Greenfield Project
3 16 (3.78%) Computer Science
4 12 (2.84%) Algorithms
5 9 (2.13%) Data Structures
6 8 (1.89%) Self-Motivation
7 6 (1.42%) Public Cloud
8 5 (1.18%) Linux Command Line
9 4 (0.95%) AS400
9 4 (0.95%) Data Centre
9 4 (0.95%) Fintech
9 4 (0.95%) Internet of Things
9 4 (0.95%) Virtual Team
10 3 (0.71%) Cyberthreat
10 3 (0.71%) Management Information System
10 3 (0.71%) Mobile App
10 3 (0.71%) Social Media
11 2 (0.47%) Cyber Defence
11 2 (0.47%) Distributed Denial-of-Service
11 2 (0.47%) Smart Energy
Operating Systems
1 106 (25.06%) Linux
2 51 (12.06%) Unix
3 30 (7.09%) Windows
4 14 (3.31%) Red Hat Enterprise Linux
5 11 (2.60%) CentOS
6 7 (1.65%) VMS
7 1 (0.24%) Windows Server
Processes & Methodologies
1 166 (39.24%) Analytics
2 165 (39.01%) Agile Software Development
3 90 (21.28%) ETL
4 79 (18.68%) Data Analytics
5 73 (17.26%) TDD
6 68 (16.08%) Business Intelligence
7 66 (15.60%) Open Source
8 59 (13.95%) Machine Learning
9 53 (12.53%) Data Modelling
10 51 (12.06%) Scrum
11 50 (11.82%) Data Science
12 44 (10.40%) DevOps
12 44 (10.40%) Visualisation
13 41 (9.69%) BDD
13 41 (9.69%) Data Ingestion
14 40 (9.46%) Data Architecture
15 39 (9.22%) Continuous Integration
16 37 (8.75%) Microservices
17 36 (8.51%) Big Data Analytics
18 34 (8.04%) SDLC
Programming Languages
1 139 (32.86%) Java
2 120 (28.37%) Python
3 99 (23.40%) SQL
4 57 (13.48%) JavaScript
5 51 (12.06%) Scala
6 37 (8.75%) R
7 32 (7.57%) C#
8 23 (5.44%) PowerShell
9 22 (5.20%) Shell Script
10 15 (3.55%) T-SQL
11 13 (3.07%) Bash Shell
12 11 (2.60%) Go
13 10 (2.36%) C++
13 10 (2.36%) Perl
14 8 (1.89%) Java 8
14 8 (1.89%) MATLAB
14 8 (1.89%) Ruby
15 7 (1.65%) C
16 4 (0.95%) Lua
16 4 (0.95%) U-SQL
Qualifications
1 43 (10.17%) Security Cleared
2 38 (8.98%) Degree
3 22 (5.20%) SC Cleared
4 11 (2.60%) BPSS Clearance
5 9 (2.13%) BC Cleared
6 5 (1.18%) ISTQB
6 5 (1.18%) Microsoft Certification
7 4 (0.95%) DV Cleared
8 3 (0.71%) Computer Science Degree
8 3 (0.71%) ISEB
9 2 (0.47%) CISM
9 2 (0.47%) CISSP
9 2 (0.47%) Master's Degree
9 2 (0.47%) Numerate Degree
9 2 (0.47%) PhD
10 1 (0.24%) CEH
10 1 (0.24%) MCSA
10 1 (0.24%) MCSE
10 1 (0.24%) SANS
Quality Assurance & Compliance
1 33 (7.80%) Data Quality
2 14 (3.31%) QA
3 12 (2.84%) GDPR
4 4 (0.95%) PCI DSS
5 3 (0.71%) Sarbanes-Oxley
6 2 (0.47%) COBIT
6 2 (0.47%) ISO/IEC 27001
7 1 (0.24%) SLA
System Software
1 42 (9.93%) HDFS
2 40 (9.46%) Apache ZooKeeper
3 39 (9.22%) Docker
4 19 (4.49%) Apache Flume
5 7 (1.65%) Hyper-V
6 6 (1.42%) Virtual Machines
7 5 (1.18%) Active Directory
8 1 (0.24%) VMware Infrastructure
Systems Management
1 36 (8.51%) Hadoop YARN
2 22 (5.20%) Kubernetes
3 21 (4.96%) Puppet
4 17 (4.02%) Ansible
5 16 (3.78%) Opscode Chef
6 15 (3.55%) Mesos
7 11 (2.60%) Nagios
8 10 (2.36%) Terraform
9 8 (1.89%) Kibana
10 6 (1.42%) HP ALM
11 4 (0.95%) Grafana
12 3 (0.71%) Graphite
12 3 (0.71%) Oozie
12 3 (0.71%) Salt
12 3 (0.71%) StatsD
12 3 (0.71%) ZABBIX
13 2 (0.47%) Ambari
13 2 (0.47%) Ganglia
14 1 (0.24%) ArcSight ESM
14 1 (0.24%) logstash
Vendors
1 52 (12.29%) Cloudera
2 48 (11.35%) Microsoft
3 29 (6.86%) Oracle
4 23 (5.44%) Tableau
5 19 (4.49%) Informatica
6 18 (4.26%) SAP
7 17 (4.02%) Hortonworks
7 17 (4.02%) Talend
8 14 (3.31%) Ab Initio
9 12 (2.84%) Google
10 10 (2.36%) Red Hat
10 10 (2.36%) Splunk
11 9 (2.13%) HP
12 8 (1.89%) Databricks
13 7 (1.65%) ArcSight
13 7 (1.65%) MapR
13 7 (1.65%) Vertica
14 6 (1.42%) Pega
14 6 (1.42%) Sybase
15 4 (0.95%) Chordiant