Period
to 20 November 2017

The following table provides summary statistics for contract job vacancies advertised in the South East with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 20 November 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > South East
6 months to
20 Nov 2017
Same period 2016 Same period 2015
Rank 97 143 200
Rank change year-on-year +46 +57 +91
Contract jobs citing Big Data 387 274 219
As % of all contract IT jobs advertised in the South East 2.31% 1.66% 1.13%
As % of the Database & Business Intelligence category 11.02% 8.17% 5.03%
Number of daily rates quoted 232 113 128
South East median daily rate £500 £488 £500
Median daily rate % change year-on-year +2.56% -2.50% -
10th Percentile £346 £313 £359
90th Percentile £600 £650 £550
England median daily rate £550 £525 £520
% change year-on-year +4.76% +0.96% -
Number of hourly rates quoted 8 2 1
South East median hourly rate £19.34 £80.25 £50.00
Median hourly rate % change year-on-year -75.90% +60.50% -
England median hourly rate £30.91 £43.00 £46.50
% change year-on-year -28.13% -7.53% +41.98%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the South East with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
South East
Contract vacancies with a requirement for database or business intelligence skills 3511 3354 4353
As % of all contract IT jobs advertised in the South East 21.00% 20.33% 22.44%
Number of daily rates quoted 2230 2004 2573
South East median daily rate £413 £400 £375
Median daily rate % change year-on-year +3.13% +6.67% +7.14%
10th Percentile £294 £275 £263
90th Percentile £556 £538 £525
England median daily rate £460 £425 £413
% change year-on-year +8.24% +3.03% +3.13%
Number of hourly rates quoted 55 88 95
South East median hourly rate £42.50 £28.69 £28.00
Median hourly rate % change year-on-year +48.15% +2.46% +12.00%
10th Percentile £9.25 £9.25 £9.25
90th Percentile £50.00 £52.25 £48.75
England median hourly rate £31.50 £28.00 £27.89
% change year-on-year +12.50% +0.39% +15.01%

Big Data
Job Vacancy Trend in the South East

Job postings citing Big Data as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for Big Data in the South East

Big Data
Contractor Daily Rate Trend in the South East

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the South East.

Contractor daily rate trend for Big Data in the South East

Big Data
Contractor Daily Rate Histogram in the South East

The daily rate distribution of IT jobs citing Big Data in the South East over the 6 months to 20 November 2017.

Contractor daily rate histogram for Big Data in the South East

Big Data
Contractor Hourly Rate Trend in the South East

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in the South East.

Contractor hourly rate trend for Big Data in the South East

Big Data
Contractor Hourly Rate Histogram in the South East

The hourly rate distribution of IT jobs citing Big Data in the South East over the 6 months to 20 November 2017.

Contractor hourly rate histogram for Big Data in the South East

Big Data
Contract Job Locations in the South East

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the South East region over the 6 months to 20 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Thames Valley +41 227 £500 +5.26% 27
Berkshire +54 102 £500 +2.56% 14
Buckinghamshire -15 98 £438 +2.94% 3
Surrey 0 67 £500 -4.76% 12
Hampshire +24 66 £425 -19.05% 9
Oxfordshire +23 27 £500 -2.44% 10
West Sussex -16 9 £418 -20.43% 1
Middlesex +3 7 £413 +3.13%
East Sussex -5 3 £425 +30.77% 1
Kent -14 1 - - 2
Big Data
England

For the 6 months to 20 November 2017, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the South East region with a requirement for Big Data.

1 255 (65.89%) Hadoop
2 184 (47.55%) Apache Spark
3 156 (40.31%) Agile Software Development
4 116 (29.97%) Kafka
5 114 (29.46%) Java
6 112 (28.94%) Analytics
7 95 (24.55%) SQL
8 93 (24.03%) Apache Hive
9 91 (23.51%) Python
9 91 (23.51%) TDD
10 84 (21.71%) Cloudera
11 72 (18.60%) Finance
12 70 (18.09%) Linux
13 69 (17.83%) HDFS
14 68 (17.57%) Git (software)
15 65 (16.80%) Scala
15 65 (16.80%) ETL
15 65 (16.80%) Scrum
16 63 (16.28%) Jenkins
16 63 (16.28%) HBase
17 59 (15.25%) MapReduce
18 57 (14.73%) Unix
19 52 (13.44%) RESTful
20 51 (13.18%) Apache
21 49 (12.66%) Business Intelligence
22 48 (12.40%) Telecoms
23 47 (12.14%) JSON
23 47 (12.14%) NoSQL
23 47 (12.14%) Sqoop
23 47 (12.14%) Analytical Skills

Big Data
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 184 (47.55%) Apache Spark
2 51 (13.18%) Apache
3 16 (4.13%) SAS
4 15 (3.88%) Apache Pig
5 13 (3.36%) Cloud Foundry
5 13 (3.36%) Tomcat
6 12 (3.10%) GemFire
7 11 (2.84%) Apache Airflow
8 10 (2.58%) Elasticsearch
8 10 (2.58%) Luigi
9 8 (2.07%) Confluence
10 4 (1.03%) ArcGIS
11 3 (0.78%) nginx
12 2 (0.52%) Apache Solr
12 2 (0.52%) IIS
12 2 (0.52%) JBoss
12 2 (0.52%) MS Exchange
13 1 (0.26%) CMS
13 1 (0.26%) Oracle SOA Suite
13 1 (0.26%) SharePoint
Applications
1 10 (2.58%) Pipeline Pilot
2 5 (1.29%) Stata
3 4 (1.03%) Microsoft Excel
4 3 (0.78%) Microsoft PowerPoint
5 1 (0.26%) GNU Octave
5 1 (0.26%) Microsoft Office
Business Applications
1 2 (0.52%) SAP CRM
1 2 (0.52%) WebTrends
2 1 (0.26%) SAP CO
2 1 (0.26%) SAP FI
2 1 (0.26%) SAP FI/CO
2 1 (0.26%) SAP FSCM
Cloud Services
1 37 (9.56%) Amazon AWS
2 25 (6.46%) GitHub
3 23 (5.94%) Microsoft Azure
4 22 (5.68%) PaaS
5 11 (2.84%) Google Analytics
5 11 (2.84%) Google Cloud Platform
5 11 (2.84%) SaaS
6 10 (2.58%) IaaS
7 7 (1.81%) Bluemix
7 7 (1.81%) IBM Cloud
8 5 (1.29%) BlazeMeter
8 5 (1.29%) Cloud Computing
9 4 (1.03%) AWS CloudFormation
9 4 (1.03%) Slack
10 3 (0.78%) Amazon EMR
10 3 (0.78%) Serverless
11 2 (0.52%) Office 365
12 1 (0.26%) Amazon EC2
12 1 (0.26%) Amazon S3
12 1 (0.26%) Amazon SQS
Communications & Networking
1 12 (3.10%) Internet
2 10 (2.58%) Network Security
3 4 (1.03%) Firewall
3 4 (1.03%) SAN
4 3 (0.78%) SSL
5 2 (0.52%) Intranet
5 2 (0.52%) Kerberos
5 2 (0.52%) NAS
6 1 (0.26%) 4G
6 1 (0.26%) Intelligent Network
6 1 (0.26%) LDAP
6 1 (0.26%) LTE
6 1 (0.26%) MPLS
6 1 (0.26%) PSTN
6 1 (0.26%) Radio Access Network
6 1 (0.26%) Skype
6 1 (0.26%) TCP/IP
6 1 (0.26%) VoIP
6 1 (0.26%) VPN
6 1 (0.26%) Wi-Fi
Database & Business Intelligence
1 255 (65.89%) Hadoop
2 93 (24.03%) Apache Hive
3 63 (16.28%) HBase
4 47 (12.14%) NoSQL
4 47 (12.14%) Sqoop
5 45 (11.63%) Data Warehouse
6 36 (9.30%) SQL Server
7 34 (8.79%) Impala
8 29 (7.49%) Data Lake
9 19 (4.91%) Relational Database
9 19 (4.91%) SQL Server 2008
10 17 (4.39%) PostgreSQL
11 16 (4.13%) Data Mining
12 15 (3.88%) SQL Server 2012
13 14 (3.62%) Cloudera CDH
14 13 (3.36%) OLTP
15 12 (3.10%) IBM BigInsights
15 12 (3.10%) SQL Server Integration Services
16 10 (2.58%) KNIME
17 9 (2.33%) RDBMS
Development Applications
1 68 (17.57%) Git (software)
2 63 (16.28%) Jenkins
3 36 (9.30%) JIRA
4 19 (4.91%) Gradle
5 17 (4.39%) Team Foundation Server
6 14 (3.62%) IntelliJ
7 11 (2.84%) JUnit
8 10 (2.58%) Cucumber
8 10 (2.58%) Subversion
9 6 (1.55%) Selenium
9 6 (1.55%) Talend Open Studio
10 5 (1.29%) Eclipse
10 5 (1.29%) Gatling
10 5 (1.29%) JMeter
10 5 (1.29%) Sonatype Nexus
10 5 (1.29%) Visual Studio
11 4 (1.03%) Atlassian Bamboo
12 3 (0.78%) NUnit
12 3 (0.78%) SpecFlow
12 3 (0.78%) WebDriver
General
1 72 (18.60%) Finance
2 48 (12.40%) Telecoms
3 46 (11.89%) Banking
4 19 (4.91%) Retail
5 12 (3.10%) Marketing
6 10 (2.58%) Publishing
7 8 (2.07%) Retail Banking
8 5 (1.29%) Pharmaceutical
9 4 (1.03%) Corporate Banking
9 4 (1.03%) Legal
10 2 (0.52%) Billing
10 2 (0.52%) Electronics
10 2 (0.52%) Spanish Language
11 1 (0.26%) General Ledger
11 1 (0.26%) Manufacturing
11 1 (0.26%) Wholesale Banking
Job Titles
1 109 (28.17%) Developer
2 71 (18.35%) Architect
3 57 (14.73%) Data Engineer
4 55 (14.21%) Big Data Engineer
5 53 (13.70%) Big Data Developer
6 41 (10.59%) Data Architect
7 40 (10.34%) Java Developer
8 31 (8.01%) Big Data Architect
9 30 (7.75%) Hadoop Engineer
10 29 (7.49%) Analyst
11 25 (6.46%) Hadoop Developer
12 22 (5.68%) Apache Spark Developer
13 19 (4.91%) Python Developer
14 16 (4.13%) Administrator
14 16 (4.13%) Project Manager
14 16 (4.13%) Test Architect
15 15 (3.88%) Cloud Architect
16 14 (3.62%) Hadoop Administrator
16 14 (3.62%) Scala Developer
17 13 (3.36%) Business Analyst
Libraries, Frameworks & Software Standards
1 116 (29.97%) Kafka
2 52 (13.44%) RESTful
3 47 (12.14%) JSON
4 37 (9.56%) J2EE
5 33 (8.53%) Spring
6 28 (7.24%) Middleware
7 24 (6.20%) Spring Boot
8 23 (5.94%) Web Services
8 23 (5.94%) XML
9 22 (5.68%) REST
10 21 (5.43%) Spark Streaming
11 17 (4.39%) CSS
12 16 (4.13%) RabbitMQ
12 16 (4.13%) SOAP
13 14 (3.62%) Apache Camel
14 13 (3.36%) HTML
15 12 (3.10%) Spring Integration
16 9 (2.33%) AngularJS
16 9 (2.33%) Django
16 9 (2.33%) jQuery
Miscellaneous
1 47 (12.14%) Analytical Skills
2 21 (5.43%) Virtual Team
3 19 (4.91%) Computer Science
4 17 (4.39%) Linux Command Line
5 15 (3.88%) Greenfield Project
6 11 (2.84%) Life Science
6 11 (2.84%) Replication
7 9 (2.33%) Data Centre
8 8 (2.07%) Fintech
8 8 (2.07%) Semantic Web
9 7 (1.81%) Internet of Things
10 6 (1.55%) Enterprise Software
11 3 (0.78%) Algorithms
11 3 (0.78%) Management Information System
11 3 (0.78%) Mobile App
12 2 (0.52%) Clustering
12 2 (0.52%) Device Driver
12 2 (0.52%) Marketing Technology
12 2 (0.52%) Reference Data
13 1 (0.26%) User Experience
Operating Systems
1 70 (18.09%) Linux
2 57 (14.73%) Unix
3 14 (3.62%) Red Hat Enterprise Linux
4 13 (3.36%) Ubuntu
5 10 (2.58%) Windows
6 3 (0.78%) Android
6 3 (0.78%) Apple iOS
6 3 (0.78%) Mac OS X
7 2 (0.52%) Solaris
7 2 (0.52%) Windows Server
7 2 (0.52%) Windows Server 2003
7 2 (0.52%) Windows Vista
8 1 (0.26%) CentOS
8 1 (0.26%) Debian
Processes & Methodologies
1 156 (40.31%) Agile Software Development
2 112 (28.94%) Analytics
3 91 (23.51%) TDD
4 65 (16.80%) ETL
4 65 (16.80%) Scrum
5 59 (15.25%) MapReduce
6 49 (12.66%) Business Intelligence
7 36 (9.30%) BDD
8 35 (9.04%) Data Analytics
8 35 (9.04%) Data Modelling
9 34 (8.79%) Continuous Integration
9 34 (8.79%) Test Automation
10 31 (8.01%) Unit Testing
11 30 (7.75%) Data Analysis
12 27 (6.98%) Machine Learning
13 25 (6.46%) Stakeholder Management
14 24 (6.20%) Big Data Analytics
14 24 (6.20%) Mentoring
14 24 (6.20%) System Testing
15 23 (5.94%) Continuous Delivery
Programming Languages
1 114 (29.46%) Java
2 95 (24.55%) SQL
3 91 (23.51%) Python
4 65 (16.80%) Scala
5 26 (6.72%) JavaScript
6 20 (5.17%) Ruby
7 18 (4.65%) Shell Script
8 16 (4.13%) R
9 13 (3.36%) Perl
10 10 (2.58%) C
11 8 (2.07%) C++
12 5 (1.29%) C#
12 5 (1.29%) PL/SQL
13 4 (1.03%) Bash Shell
13 4 (1.03%) HiveQL
13 4 (1.03%) PHP
14 3 (0.78%) Apple Swift
14 3 (0.78%) PowerShell
14 3 (0.78%) T-SQL
15 2 (0.52%) VB
Qualifications
1 35 (9.04%) Degree
2 11 (2.84%) PhD
3 10 (2.58%) Security Cleared
4 8 (2.07%) SC Cleared
5 5 (1.29%) Postgraduate
6 2 (0.52%) Computer Science Degree
6 2 (0.52%) ISEB
6 2 (0.52%) MCITP
6 2 (0.52%) MCSE
6 2 (0.52%) Microsoft Certification
6 2 (0.52%) Numerate Degree
7 1 (0.26%) BC Cleared
7 1 (0.26%) BPSS Clearance
7 1 (0.26%) CCNA
7 1 (0.26%) Cisco Certification
7 1 (0.26%) DV Cleared
7 1 (0.26%) ISTQB
7 1 (0.26%) PMI Certification
7 1 (0.26%) PMP
7 1 (0.26%) VMware Certified Professional (VCP)
Quality Assurance & Compliance
1 29 (7.49%) QA
2 16 (4.13%) GDPR
3 15 (3.88%) Data Quality
4 3 (0.78%) ISO/IEC 20000
4 3 (0.78%) SLA
5 2 (0.52%) RosettaNet
6 1 (0.26%) CDISC
6 1 (0.26%) Disclosure Scotland
6 1 (0.26%) FATCA
6 1 (0.26%) ISO 9001
System Software
1 69 (17.83%) HDFS
2 45 (11.63%) Apache Flume
3 35 (9.04%) Docker
4 28 (7.24%) Apache ZooKeeper
5 2 (0.52%) Active Directory
5 2 (0.52%) Hyper-V
5 2 (0.52%) VMware Infrastructure
6 1 (0.26%) Virtual Servers
Systems Management
1 42 (10.85%) Hadoop YARN
2 35 (9.04%) Oozie
3 20 (5.17%) Ambari
4 18 (4.65%) Mesos
5 13 (3.36%) Ansible
6 12 (3.10%) Control-M
7 8 (2.07%) Kibana
7 8 (2.07%) Kubernetes
8 6 (1.55%) Opscode Chef
9 5 (1.29%) Puppet
10 4 (1.03%) Terraform
11 3 (0.78%) Ganglia
11 3 (0.78%) Graphite
11 3 (0.78%) HP Quality Center
11 3 (0.78%) logstash
11 3 (0.78%) Nagios
11 3 (0.78%) StatsD
12 2 (0.52%) Data Guard
12 2 (0.52%) OpenView Configuration Management
12 2 (0.52%) SCCM
Vendors
1 84 (21.71%) Cloudera
2 30 (7.75%) Hortonworks
3 28 (7.24%) Oracle
4 26 (6.72%) Google
4 26 (6.72%) Red Hat
5 24 (6.20%) IBM
5 24 (6.20%) Tableau
6 18 (4.65%) SAP
7 14 (3.62%) Salesforce.com
8 11 (2.84%) Microsoft
9 10 (2.58%) Netezza
9 10 (2.58%) RapidMiner
10 8 (2.07%) MapR
11 6 (1.55%) Talend
12 5 (1.29%) HP
12 5 (1.29%) Teradata
13 4 (1.03%) Ab Initio
13 4 (1.03%) MicroStrategy
13 4 (1.03%) Pega
14 2 (0.52%) Facebook