Period
to 11 December 2018

The following table provides summary statistics for contract job vacancies advertised in the South East with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 11 December 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > South East
6 months to
11 Dec 2018
Same period 2017 Same period 2016
Rank 90 96 137
Rank change year-on-year +6 +41 +56
Contract jobs citing Big Data 455 392 283
As % of all contract IT jobs advertised in the South East 2.67% 2.34% 1.74%
As % of the Database & Business Intelligence category 12.26% 11.24% 8.81%
Number of daily rates quoted 263 230 122
South East median daily rate £500 £500 £475
Median daily rate % change year-on-year - +5.26% -5.00%
10th Percentile £380 £363 £288
90th Percentile £625 £600 £673
England median daily rate £550 £550 £525
% change year-on-year - +4.76% +0.96%
Number of hourly rates quoted 4 7 2
South East median hourly rate £49.75 £19.34 £80.25
Median hourly rate % change year-on-year +157.24% -75.90% +60.50%
10th Percentile £28.43 £16.64 £30.83
90th Percentile £59.25 £47.50 £132.68
England median hourly rate £44.75 £30.91 £43.00
% change year-on-year +44.80% -28.13% -7.53%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the South East with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
South East
Contract vacancies with a requirement for database or business intelligence skills 3,712 3,488 3,214
As % of all contract IT jobs advertised in the South East 21.82% 20.81% 19.78%
Number of daily rates quoted 2,400 2,222 1,920
South East median daily rate £450 £425 £400
Median daily rate % change year-on-year +5.94% +6.19% +5.26%
10th Percentile £313 £300 £275
90th Percentile £588 £570 £538
England median daily rate £475 £463 £425
% change year-on-year +2.70% +8.82% +1.19%
Number of hourly rates quoted 46 47 79
South East median hourly rate £37.50 £42.50 £20.50
Median hourly rate % change year-on-year -11.76% +107.32% -22.64%
10th Percentile £18.69 £12.08 £9.25
90th Percentile £57.41 £49.25 £52.25
England median hourly rate £35.00 £32.25 £27.50
% change year-on-year +8.53% +17.27% -

Big Data
Job Vacancy Trend in the South East

Job postings citing Big Data as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for Big Data in the South East

Big Data
Contractor Daily Rate Trend in the South East

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the South East.

Contractor daily rate trend for Big Data in the South East

Big Data
Contractor Daily Rate Histogram in the South East

The daily rate distribution of IT jobs citing Big Data in the South East over the 6 months to 11 December 2018.

Contractor daily rate histogram for Big Data in the South East

Big Data
Contractor Hourly Rate Trend in the South East

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in the South East.

Contractor hourly rate trend for Big Data in the South East

Big Data
Contractor Hourly Rate Histogram in the South East

The hourly rate distribution of IT jobs citing Big Data in the South East over the 6 months to 11 December 2018.

Contractor hourly rate histogram for Big Data in the South East

Big Data
Contract Job Locations in the South East

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the South East region over the 6 months to 11 December 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Thames Valley -7 187 £500 - 53
Berkshire +16 139 £513 - 30
Surrey +26 121 £500 -1.23% 24
Hampshire 0 93 £500 +17.65% 26
Buckinghamshire -35 35 £600 +35.21% 7
East Sussex +2 18 £550 +46.67% 3
Middlesex +22 16 - -
Oxfordshire +5 13 £415 -17.00% 16
Kent +12 11 £550 - 9
West Sussex -11 6 £475 +18.60%
Sussex - 3 £550 -
Big Data
England

For the 6 months to 11 December 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the South East region with a requirement for Big Data.

1 256 (56.26%) Hadoop
2 178 (39.12%) Apache Spark
3 177 (38.90%) Kafka
4 174 (38.24%) Agile Software Development
5 162 (35.60%) Analytics
6 160 (35.16%) Java
7 141 (30.99%) Python
8 120 (26.37%) SQL
9 114 (25.05%) Linux
10 96 (21.10%) ETL
11 89 (19.56%) Apache
11 89 (19.56%) TDD
12 81 (17.80%) Data Warehouse
12 81 (17.80%) Apache Hive
13 79 (17.36%) Jenkins
14 78 (17.14%) NoSQL
14 78 (17.14%) Finance
15 75 (16.48%) Amazon AWS
16 72 (15.82%) Spring
16 72 (15.82%) Unix
17 70 (15.38%) Microsoft Azure
17 70 (15.38%) RabbitMQ
18 65 (14.29%) Data Lake
19 63 (13.85%) HDFS
19 63 (13.85%) Business Intelligence
20 62 (13.63%) Open Source
20 62 (13.63%) Machine Learning
20 62 (13.63%) Data Science
21 61 (13.41%) Hadoop YARN
21 61 (13.41%) JSON

Big Data
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 178 (39.12%) Apache Spark
2 89 (19.56%) Apache
3 41 (9.01%) Elasticsearch
4 25 (5.49%) SAS
5 16 (3.52%) Apache Solr
6 12 (2.64%) Apache Pig
7 8 (1.76%) GemFire
7 8 (1.76%) OpenStack
8 6 (1.32%) Apache Qpid
8 6 (1.32%) Jupyter
9 4 (0.88%) Cloud Foundry
10 3 (0.66%) Confluence
11 1 (0.22%) CMS
11 1 (0.22%) Sitecore CMS
Applications
1 5 (1.10%) Microsoft Excel
2 1 (0.22%) Microsoft PowerPoint
2 1 (0.22%) Spreadsheet
Business Applications
1 7 (1.54%) SAP APO
1 7 (1.54%) SAP MM
2 5 (1.10%) SAP MDM
3 4 (0.88%) Dynamics CRM
3 4 (0.88%) SAP ERP
4 2 (0.44%) SAP Oil and Gas
4 2 (0.44%) Unica
5 1 (0.22%) Dynamics AX
5 1 (0.22%) Dynamics NAV
5 1 (0.22%) HFM
5 1 (0.22%) Oracle EBS
Cloud Services
1 75 (16.48%) Amazon AWS
2 70 (15.38%) Microsoft Azure
3 26 (5.71%) GitHub
4 23 (5.05%) Azure Data Factory
5 20 (4.40%) PaaS
6 18 (3.96%) Google Cloud Platform
7 16 (3.52%) IaaS
8 14 (3.08%) SaaS
9 12 (2.64%) Serverless
10 9 (1.98%) Amazon Kinesis
11 8 (1.76%) Amazon EMR
11 8 (1.76%) AWS CloudFormation
11 8 (1.76%) Cortana Intelligence Suite
12 7 (1.54%) Amazon S3
12 7 (1.54%) AWS Lambda
13 6 (1.32%) Azure Machine Learning
13 6 (1.32%) Office 365
14 4 (0.88%) Amazon SageMaker
14 4 (0.88%) Amazon SQS
15 3 (0.66%) Azure Functions
Communications & Networking
1 31 (6.81%) Internet
2 19 (4.18%) SSH
2 19 (4.18%) TCP/IP
3 18 (3.96%) Firewall
4 7 (1.54%) HTTP
5 5 (1.10%) Kerberos
5 5 (1.10%) Network Security
6 4 (0.88%) LAN
6 4 (0.88%) WAN
7 3 (0.66%) DNS
7 3 (0.66%) MQTT
8 2 (0.44%) VPN
9 1 (0.22%) DVB
Database & Business Intelligence
1 256 (56.26%) Hadoop
2 81 (17.80%) Apache Hive
2 81 (17.80%) Data Warehouse
3 78 (17.14%) NoSQL
4 65 (14.29%) Data Lake
5 57 (12.53%) Apache Cassandra
6 53 (11.65%) HBase
7 50 (10.99%) SQL Server
8 45 (9.89%) Relational Database
9 36 (7.91%) Power BI
10 30 (6.59%) Impala
11 24 (5.27%) MongoDB
12 22 (4.84%) Parquet
13 21 (4.62%) Flink
14 18 (3.96%) Cosmos DB
14 18 (3.96%) Sqoop
15 17 (3.74%) OLAP
16 16 (3.52%) SQL Server Integration Services
17 14 (3.08%) Azure SQL Database
17 14 (3.08%) RDBMS
Development Applications
1 79 (17.36%) Jenkins
2 43 (9.45%) Git (software)
3 27 (5.93%) Gradle
4 22 (4.84%) JIRA
5 10 (2.20%) Visual Studio
5 10 (2.20%) Visual Studio Team System
6 9 (1.98%) Atlassian Bamboo
7 5 (1.10%) Cucumber
7 5 (1.10%) Maven
8 4 (0.88%) Jasmine
8 4 (0.88%) Mocha
9 3 (0.66%) Grunt
9 3 (0.66%) IntelliJ
9 3 (0.66%) Subversion
9 3 (0.66%) TeamCity
10 2 (0.44%) Eclipse
10 2 (0.44%) GitLab
10 2 (0.44%) JBehave
10 2 (0.44%) JUnit
10 2 (0.44%) Octopus Deploy
General
1 78 (17.14%) Finance
2 34 (7.47%) Telecoms
3 23 (5.05%) Legal
4 19 (4.18%) Retail
5 14 (3.08%) Marketing
6 7 (1.54%) Pharmaceutical
7 5 (1.10%) Aerospace
8 4 (0.88%) Banking
9 3 (0.66%) Advertising
10 2 (0.44%) Games
11 1 (0.22%) Publishing
Job Titles
1 177 (38.90%) Developer
2 73 (16.04%) Java Developer
3 69 (15.16%) Data Engineer
4 61 (13.41%) Big Data Developer
5 57 (12.53%) Big Data Engineer
6 51 (11.21%) Architect
7 29 (6.37%) Data Architect
8 28 (6.15%) Analyst
9 25 (5.49%) Apache Spark Developer
10 24 (5.27%) Hadoop Developer
11 21 (4.62%) Consultant
12 20 (4.40%) Data Scientist
13 19 (4.18%) Software Developer
14 16 (3.52%) Data Analyst
14 16 (3.52%) DevOps Engineer
15 15 (3.30%) Analytics Developer
15 15 (3.30%) Big Data Architect
16 13 (2.86%) Administrator
16 13 (2.86%) Python Engineer
16 13 (2.86%) Software Engineer
Libraries, Frameworks & Software Standards
1 177 (38.90%) Kafka
2 72 (15.82%) Spring
3 70 (15.38%) RabbitMQ
4 61 (13.41%) JSON
5 54 (11.87%) J2EE
6 53 (11.65%) Middleware
7 46 (10.11%) Spark Streaming
8 44 (9.67%) REST
9 38 (8.35%) RESTful
10 34 (7.47%) Spring Boot
11 27 (5.93%) Apache Avro
12 22 (4.84%) .NET
13 18 (3.96%) AngularJS
13 18 (3.96%) Node.js
14 16 (3.52%) React
15 14 (3.08%) Apache Camel
16 13 (2.86%) Elastic Stack
17 11 (2.42%) HTML
17 11 (2.42%) Natural Language Processing
18 10 (2.20%) XML
Miscellaneous
1 54 (11.87%) Analytical Skills
2 28 (6.15%) Greenfield Project
3 25 (5.49%) Linux Command Line
4 24 (5.27%) Virtual Team
5 16 (3.52%) Algorithms
6 10 (2.20%) Data Structures
7 8 (1.76%) Self-Motivation
8 7 (1.54%) Internet of Things
9 5 (1.10%) Data Centre
9 5 (1.10%) Fintech
9 5 (1.10%) Mobile App
9 5 (1.10%) Smart Energy
10 4 (0.88%) AS400
10 4 (0.88%) RIA
11 3 (0.66%) Cyberthreat
11 3 (0.66%) Public Cloud
11 3 (0.66%) Smart Home
11 3 (0.66%) Social Media
12 2 (0.44%) Cyber Defence
12 2 (0.44%) Distributed Denial-of-Service
Operating Systems
1 114 (25.05%) Linux
2 72 (15.82%) Unix
3 14 (3.08%) Red Hat Enterprise Linux
4 12 (2.64%) Windows
5 11 (2.42%) CentOS
6 3 (0.66%) VMS
7 2 (0.44%) Android
8 1 (0.22%) Windows Server
Processes & Methodologies
1 174 (38.24%) Agile Software Development
2 162 (35.60%) Analytics
3 96 (21.10%) ETL
4 89 (19.56%) TDD
5 63 (13.85%) Business Intelligence
6 62 (13.63%) Data Science
6 62 (13.63%) Machine Learning
6 62 (13.63%) Open Source
7 59 (12.97%) Data Analytics
8 57 (12.53%) BDD
9 55 (12.09%) DevOps
9 55 (12.09%) Scrum
10 50 (10.99%) Continuous Integration
11 48 (10.55%) Data Modelling
11 48 (10.55%) Unit Testing
12 46 (10.11%) System Testing
13 45 (9.89%) Visualisation
14 42 (9.23%) Data Ingestion
15 40 (8.79%) Data Architecture
15 40 (8.79%) Microservices
Programming Languages
1 160 (35.16%) Java
2 141 (30.99%) Python
3 120 (26.37%) SQL
4 51 (11.21%) Scala
5 45 (9.89%) JavaScript
6 42 (9.23%) Shell Script
7 38 (8.35%) R
8 30 (6.59%) C#
9 20 (4.40%) C++
10 14 (3.08%) T-SQL
11 11 (2.42%) MATLAB
12 10 (2.20%) Bash Shell
12 10 (2.20%) Go
13 9 (1.98%) Java 8
13 9 (1.98%) PowerShell
14 8 (1.76%) C
15 4 (0.88%) TypeScript
16 3 (0.66%) Perl
16 3 (0.66%) VB
17 2 (0.44%) AWK
Qualifications
1 49 (10.77%) Degree
2 40 (8.79%) Security Cleared
3 25 (5.49%) SC Cleared
4 6 (1.32%) Computer Science Degree
5 5 (1.10%) BPSS Clearance
5 5 (1.10%) DV Cleared
5 5 (1.10%) ISTQB
6 3 (0.66%) BC Cleared
6 3 (0.66%) ISEB
6 3 (0.66%) PhD
6 3 (0.66%) TOGAF Certification
7 2 (0.44%) Master's Degree
7 2 (0.44%) Microsoft Certification
7 2 (0.44%) Numerate Degree
8 1 (0.22%) CEH
8 1 (0.22%) CISM
8 1 (0.22%) CISSP
8 1 (0.22%) MCSA
8 1 (0.22%) MCSE
8 1 (0.22%) SANS
Quality Assurance & Compliance
1 28 (6.15%) Data Quality
2 12 (2.64%) QA
3 9 (1.98%) GDPR
4 5 (1.10%) SLA
5 3 (0.66%) PCI DSS
6 2 (0.44%) COBIT
6 2 (0.44%) ISO/IEC 27001
6 2 (0.44%) Sarbanes-Oxley
System Software
1 63 (13.85%) HDFS
2 57 (12.53%) Apache ZooKeeper
3 41 (9.01%) Docker
4 21 (4.62%) Apache Flume
5 4 (0.88%) Oracle RAC
6 3 (0.66%) Hyper-V
7 1 (0.22%) VMware Infrastructure
Systems Management
1 61 (13.41%) Hadoop YARN
2 32 (7.03%) Kubernetes
3 29 (6.37%) Ansible
4 24 (5.27%) Puppet
5 14 (3.08%) Oozie
6 11 (2.42%) Opscode Chef
7 8 (1.76%) Mesos
8 6 (1.32%) Ambari
8 6 (1.32%) HP ALM
8 6 (1.32%) Nagios
9 5 (1.10%) Terraform
10 4 (0.88%) Grafana
11 3 (0.66%) Graphite
11 3 (0.66%) Kibana
11 3 (0.66%) Salt
11 3 (0.66%) StatsD
11 3 (0.66%) ZABBIX
12 2 (0.44%) Ganglia
13 1 (0.22%) ArcSight ESM
13 1 (0.22%) Systems Management Server (SMS)
Vendors
1 49 (10.77%) Cloudera
2 42 (9.23%) Microsoft
3 30 (6.59%) Tableau
4 29 (6.37%) Oracle
5 21 (4.62%) SAP
6 18 (3.96%) Informatica
7 16 (3.52%) Google
7 16 (3.52%) Hortonworks
7 16 (3.52%) Talend
8 13 (2.86%) Ab Initio
9 10 (2.20%) Red Hat
10 8 (1.76%) HP
10 8 (1.76%) Splunk
11 7 (1.54%) ArcSight
11 7 (1.54%) Databricks
12 6 (1.32%) MapR
12 6 (1.32%) Pega
12 6 (1.32%) Sybase
13 5 (1.10%) Intel
13 5 (1.10%) MicroStrategy