Period
to 17 January 2018

The following table provides summary statistics for contract job vacancies advertised in the South East with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 17 January 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > South East
6 months to
17 Jan 2018
Same period 2017 Same period 2016
Rank 83 126 171
Rank change year-on-year +43 +45 +124
Contract jobs citing Big Data 436 279 225
As % of all contract IT jobs advertised in the South East 2.63% 1.80% 1.25%
As % of the Database & Business Intelligence category 12.82% 9.34% 5.65%
Number of daily rates quoted 239 127 156
South East median daily rate £500 £500 £500
10th Percentile £370 £302 £363
90th Percentile £600 £750 £575
England median daily rate £550 £525 £520
% change year-on-year +4.76% +0.96% +1.96%
Number of hourly rates quoted 7 2 1
South East median hourly rate £19.34 £80.25 £50.00
Median hourly rate % change year-on-year -75.90% +60.50% -
England median hourly rate £30.50 £45.25 £37.50
% change year-on-year -32.60% +20.67% +25.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the South East with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
South East
Contract vacancies with a requirement for database or business intelligence skills 3,401 2,986 3,981
As % of all contract IT jobs advertised in the South East 20.55% 19.27% 22.09%
Number of daily rates quoted 2,171 1,784 2,391
South East median daily rate £418 £400 £388
Median daily rate % change year-on-year +4.38% +3.23% +6.31%
10th Percentile £300 £275 £263
90th Percentile £575 £551 £531
England median daily rate £470 £428 £425
% change year-on-year +9.94% +0.59% +6.25%
Number of hourly rates quoted 42 67 113
South East median hourly rate £45.00 £17.40 £26.50
Median hourly rate % change year-on-year +158.62% -34.34% -11.67%
10th Percentile £15.14 £9.25 £9.25
90th Percentile £49.88 £45.00 £50.00
England median hourly rate £31.31 £27.75 £30.50
% change year-on-year +12.83% -9.02% +6.31%

Big Data
Job Vacancy Trend in the South East

Job postings citing Big Data as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for Big Data in the South East

Big Data
Contractor Daily Rate Trend in the South East

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the South East.

Contractor daily rate trend for Big Data in the South East

Big Data
Contractor Daily Rate Histogram in the South East

The daily rate distribution of IT jobs citing Big Data in the South East over the 6 months to 17 January 2018.

Contractor daily rate histogram for Big Data in the South East

Big Data
Contractor Hourly Rate Trend in the South East

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in the South East.

Contractor hourly rate trend for Big Data in the South East

Big Data
Contractor Hourly Rate Histogram in the South East

The hourly rate distribution of IT jobs citing Big Data in the South East over the 6 months to 17 January 2018.

Contractor hourly rate histogram for Big Data in the South East

Big Data
Contract Job Locations in the South East

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the South East region over the 6 months to 17 January 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Thames Valley +33 255 £500 +2.56% 52
Berkshire +47 122 £525 -2.33% 25
Buckinghamshire +1 118 £463 +8.82% 10
Hampshire +31 83 £425 -15.00% 18
Surrey +8 77 £500 -4.76% 19
Oxfordshire +4 15 £500 -6.98% 17
West Sussex -7 12 £400 -23.81%
Middlesex -6 3 £413 +10.00% 1
East Sussex -10 2 £375 +158.62% 4
Kent -13 2 - - 2
Big Data
England

For the 6 months to 17 January 2018, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the South East region with a requirement for Big Data.

1 280 (64.22%) Hadoop
2 213 (48.85%) Apache Spark
3 171 (39.22%) Agile Software Development
4 168 (38.53%) Java
5 160 (36.70%) Kafka
6 130 (29.82%) Analytics
7 115 (26.38%) Apache Hive
8 103 (23.62%) Cloudera
8 103 (23.62%) Linux
9 100 (22.94%) TDD
10 99 (22.71%) HDFS
11 94 (21.56%) SQL
11 94 (21.56%) Jenkins
12 93 (21.33%) HBase
13 89 (20.41%) Scala
14 88 (20.18%) Git (software)
15 85 (19.50%) Finance
16 82 (18.81%) RESTful
17 77 (17.66%) Python
18 72 (16.51%) Apache Flume
19 71 (16.28%) Sqoop
20 69 (15.83%) ETL
20 69 (15.83%) Hadoop YARN
21 68 (15.60%) Unix
22 64 (14.68%) Hortonworks
23 62 (14.22%) Continuous Integration
23 62 (14.22%) Spring
24 61 (13.99%) JSON
25 58 (13.30%) Apache ZooKeeper
25 58 (13.30%) MapReduce

Big Data
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 213 (48.85%) Apache Spark
2 56 (12.84%) Apache
3 22 (5.05%) Apache Pig
4 15 (3.44%) Tomcat
5 14 (3.21%) SAS
6 13 (2.98%) GemFire
7 12 (2.75%) Cloud Foundry
7 12 (2.75%) Elasticsearch
8 11 (2.52%) Apache Airflow
9 10 (2.29%) Luigi
10 8 (1.83%) Confluence
11 4 (0.92%) SharePoint
12 3 (0.69%) ArcGIS
12 3 (0.69%) IIS
12 3 (0.69%) MS Exchange
12 3 (0.69%) WebSphere
13 2 (0.46%) Apache Solr
13 2 (0.46%) JBoss
13 2 (0.46%) Oracle SOA Suite
14 1 (0.23%) CMS
Applications
1 12 (2.75%) Microsoft Excel
2 10 (2.29%) Pipeline Pilot
3 7 (1.61%) Microsoft PowerPoint
4 4 (0.92%) MS Visio
4 4 (0.92%) Stata
5 1 (0.23%) GNU Octave
5 1 (0.23%) Microsoft Office
5 1 (0.23%) Microsoft Project
Business Applications
1 3 (0.69%) SAP APO
1 3 (0.69%) SAP ERP
2 2 (0.46%) SAP CRM
3 1 (0.23%) SAP CO
3 1 (0.23%) SAP FI
3 1 (0.23%) SAP FI/CO
3 1 (0.23%) SAP FSCM
3 1 (0.23%) SAP Oil and Gas
Cloud Services
1 38 (8.72%) GitHub
2 28 (6.42%) Amazon AWS
3 20 (4.59%) PaaS
4 19 (4.36%) Microsoft Azure
5 16 (3.67%) Google Tag Manager
6 11 (2.52%) Google Analytics
6 11 (2.52%) Google Cloud Platform
7 9 (2.06%) SaaS
8 8 (1.83%) IaaS
9 7 (1.61%) Bluemix
9 7 (1.61%) IBM Cloud
9 7 (1.61%) Slack
10 5 (1.15%) BlazeMeter
10 5 (1.15%) Cloud Computing
11 3 (0.69%) Office 365
11 3 (0.69%) Trello
12 2 (0.46%) OpenShift
12 2 (0.46%) Serverless
13 1 (0.23%) AWS OpsWorks
13 1 (0.23%) Azure Data Factory
Communications & Networking
1 11 (2.52%) Internet
1 11 (2.52%) Kerberos
2 4 (0.92%) Firewall
2 4 (0.92%) Network Security
3 3 (0.69%) SAN
4 1 (0.23%) 4G
4 1 (0.23%) AMQP
4 1 (0.23%) HTTP
4 1 (0.23%) Intrusion Detection
4 1 (0.23%) LTE
4 1 (0.23%) MPLS
4 1 (0.23%) NAS
4 1 (0.23%) PSTN
4 1 (0.23%) SMS
4 1 (0.23%) SMTP
4 1 (0.23%) SSL
4 1 (0.23%) TCP/IP
4 1 (0.23%) VoIP
4 1 (0.23%) VPN
4 1 (0.23%) Wi-Fi
Database & Business Intelligence
1 280 (64.22%) Hadoop
2 115 (26.38%) Apache Hive
3 93 (21.33%) HBase
4 71 (16.28%) Sqoop
5 51 (11.70%) Impala
6 49 (11.24%) Data Lake
7 48 (11.01%) Data Warehouse
8 44 (10.09%) SQL Server
9 40 (9.17%) NoSQL
10 30 (6.88%) PostgreSQL
11 25 (5.73%) Data Mining
12 18 (4.13%) Parquet
13 17 (3.90%) SAP BW
14 16 (3.67%) Relational Database
14 16 (3.67%) SQL Server 2008
15 15 (3.44%) SQL Server 2012
16 14 (3.21%) Cloudera CDH
17 13 (2.98%) BusinessObjects
18 12 (2.75%) OLTP
18 12 (2.75%) SAP Data Services
Development Applications
1 94 (21.56%) Jenkins
2 88 (20.18%) Git (software)
3 39 (8.94%) JIRA
4 31 (7.11%) Gradle
5 15 (3.44%) Team Foundation Server
6 14 (3.21%) IntelliJ
7 13 (2.98%) JUnit
8 11 (2.52%) Cucumber
8 11 (2.52%) Subversion
9 9 (2.06%) Eclipse
10 8 (1.83%) Selenium
11 6 (1.38%) Visual Studio
12 5 (1.15%) Gatling
12 5 (1.15%) JMeter
13 4 (0.92%) Appium
13 4 (0.92%) Atlassian Bamboo
13 4 (0.92%) GitLab
13 4 (0.92%) Maven
13 4 (0.92%) Sonatype Nexus
14 3 (0.69%) SpecFlow
General
1 85 (19.50%) Finance
2 55 (12.61%) Banking
3 43 (9.86%) Telecoms
4 19 (4.36%) Retail
5 11 (2.52%) Retail Banking
6 10 (2.29%) Publishing
7 7 (1.61%) Marketing
8 4 (0.92%) Corporate Banking
8 4 (0.92%) Pharmaceutical
9 3 (0.69%) Legal
10 2 (0.46%) Billing
10 2 (0.46%) Electronics
10 2 (0.46%) Spanish Language
11 1 (0.23%) General Ledger
11 1 (0.23%) Manufacturing
11 1 (0.23%) Wholesale Banking
Job Titles
1 143 (32.80%) Developer
2 70 (16.06%) Java Developer
3 69 (15.83%) Big Data Developer
4 67 (15.37%) Architect
5 56 (12.84%) Data Engineer
6 55 (12.61%) Big Data Engineer
7 36 (8.26%) Data Architect
8 33 (7.57%) Analyst
8 33 (7.57%) Hadoop Developer
9 32 (7.34%) Apache Spark Developer
10 31 (7.11%) Hadoop Engineer
11 28 (6.42%) Big Data Architect
12 19 (4.36%) Business Analyst
13 18 (4.13%) Scala Developer
14 17 (3.90%) Python Developer
14 17 (3.90%) Test Architect
15 16 (3.67%) Administrator
16 13 (2.98%) Hadoop Administrator
16 13 (2.98%) Project Manager
16 13 (2.98%) Technical Architect
Libraries, Frameworks & Software Standards
1 160 (36.70%) Kafka
2 82 (18.81%) RESTful
3 62 (14.22%) Spring
4 61 (13.99%) JSON
5 57 (13.07%) J2EE
6 50 (11.47%) Web Services
7 44 (10.09%) Middleware
8 42 (9.63%) RabbitMQ
9 38 (8.72%) Spring Boot
10 37 (8.49%) REST
11 34 (7.80%) Spark Streaming
12 33 (7.57%) SOAP
13 27 (6.19%) XML
14 21 (4.82%) Spring Integration
15 18 (4.13%) Apache Avro
15 18 (4.13%) CSS
16 14 (3.21%) HTML
17 13 (2.98%) AngularJS
17 13 (2.98%) Apache Camel
18 11 (2.52%) Elastic Stack
Miscellaneous
1 44 (10.09%) Analytical Skills
2 38 (8.72%) Greenfield Project
3 30 (6.88%) Linux Command Line
3 30 (6.88%) Virtual Team
4 22 (5.05%) Computer Science
5 11 (2.52%) Life Science
5 11 (2.52%) Replication
6 8 (1.83%) Fintech
7 7 (1.61%) Internet of Things
7 7 (1.61%) Semantic Web
8 6 (1.38%) Mobile App
9 5 (1.15%) Management Information System
10 4 (0.92%) Data Centre
10 4 (0.92%) Enterprise Software
11 3 (0.69%) Clustering
12 2 (0.46%) Algorithms
12 2 (0.46%) Device Driver
12 2 (0.46%) IVR
12 2 (0.46%) Security Operations Centre
13 1 (0.23%) User Experience
Operating Systems
1 103 (23.62%) Linux
2 68 (15.60%) Unix
3 16 (3.67%) CentOS
4 15 (3.44%) Red Hat Enterprise Linux
5 13 (2.98%) Windows
6 12 (2.75%) Ubuntu
7 4 (0.92%) Windows Server
8 3 (0.69%) Android
8 3 (0.69%) Apple iOS
8 3 (0.69%) Mac OS X
8 3 (0.69%) Windows Server 2003
8 3 (0.69%) Windows Vista
9 2 (0.46%) Debian
10 1 (0.23%) Mesosphere
10 1 (0.23%) Solaris
10 1 (0.23%) Windows 10
10 1 (0.23%) Windows 8
Processes & Methodologies
1 171 (39.22%) Agile Software Development
2 130 (29.82%) Analytics
3 100 (22.94%) TDD
4 69 (15.83%) ETL
5 62 (14.22%) Continuous Integration
6 58 (13.30%) MapReduce
7 54 (12.39%) Business Intelligence
7 54 (12.39%) Scrum
8 51 (11.70%) BDD
9 46 (10.55%) Unit Testing
10 41 (9.40%) Data Modelling
11 40 (9.17%) System Testing
12 36 (8.26%) Test Automation
13 33 (7.57%) Data Analysis
13 33 (7.57%) Data Strategy
13 33 (7.57%) Visualisation
14 31 (7.11%) Benchmarking
15 30 (6.88%) Technical Architecture
16 29 (6.65%) Data Analytics
17 25 (5.73%) Stakeholder Management
Programming Languages
1 168 (38.53%) Java
2 94 (21.56%) SQL
3 89 (20.41%) Scala
4 77 (17.66%) Python
5 33 (7.57%) JavaScript
6 29 (6.65%) Shell Script
7 20 (4.59%) Ruby
8 16 (3.67%) Bash Shell
9 15 (3.44%) R
10 13 (2.98%) Perl
11 11 (2.52%) C
11 11 (2.52%) C++
12 10 (2.29%) C#
13 7 (1.61%) VBA
14 5 (1.15%) PHP
14 5 (1.15%) PL/SQL
15 4 (0.92%) HiveQL
16 3 (0.69%) Apple Swift
16 3 (0.69%) Go
16 3 (0.69%) Gremlin
Qualifications
1 52 (11.93%) Degree
2 12 (2.75%) Security Cleared
3 11 (2.52%) PhD
4 10 (2.29%) SC Cleared
5 4 (0.92%) Postgraduate
6 3 (0.69%) CCNA
6 3 (0.69%) CCSP
6 3 (0.69%) Cisco Certification
6 3 (0.69%) Computer Science Degree
6 3 (0.69%) MCITP
6 3 (0.69%) MCSE
6 3 (0.69%) Microsoft Certification
6 3 (0.69%) VMware Certified Professional (VCP)
7 2 (0.46%) DV Cleared
7 2 (0.46%) Numerate Degree
8 1 (0.23%) APMG
8 1 (0.23%) BC Cleared
8 1 (0.23%) BPSS Clearance
Quality Assurance & Compliance
1 30 (6.88%) QA
2 20 (4.59%) Data Quality
3 17 (3.90%) GDPR
4 5 (1.15%) ISO/IEC 20000
5 3 (0.69%) SLA
6 2 (0.46%) RosettaNet
6 2 (0.46%) Sarbanes-Oxley
7 1 (0.23%) Disclosure Scotland
7 1 (0.23%) FATCA
7 1 (0.23%) ISO 9001
System Software
1 99 (22.71%) HDFS
2 72 (16.51%) Apache Flume
3 58 (13.30%) Apache ZooKeeper
4 26 (5.96%) Docker
5 4 (0.92%) Active Directory
6 3 (0.69%) Hyper-V
6 3 (0.69%) VMware Infrastructure
7 1 (0.23%) BitLocker
7 1 (0.23%) Virtual Machines
7 1 (0.23%) Virtual Servers
Systems Management
1 69 (15.83%) Hadoop YARN
2 57 (13.07%) Oozie
3 18 (4.13%) Ambari
4 10 (2.29%) Ansible
4 10 (2.29%) Kibana
4 10 (2.29%) Mesos
5 9 (2.06%) Control-M
6 7 (1.61%) Kubernetes
7 6 (1.38%) Puppet
8 4 (0.92%) Opscode Chef
9 3 (0.69%) HP Quality Center
9 3 (0.69%) logstash
9 3 (0.69%) Microsoft Clustering
9 3 (0.69%) SCCM
9 3 (0.69%) SCOM
9 3 (0.69%) Terraform
10 2 (0.46%) Data Guard
10 2 (0.46%) Oracle EDQ
11 1 (0.23%) Amdocs OSS
11 1 (0.23%) Docker Swarm
Vendors
1 103 (23.62%) Cloudera
2 64 (14.68%) Hortonworks
3 42 (9.63%) Google
4 34 (7.80%) SAP
5 32 (7.34%) Tableau
6 28 (6.42%) Salesforce.com
7 27 (6.19%) Oracle
8 24 (5.50%) Red Hat
9 23 (5.28%) MapR
10 20 (4.59%) IBM
10 20 (4.59%) Talend
11 16 (3.67%) Tealium
12 11 (2.52%) Microsoft
13 10 (2.29%) Netezza
13 10 (2.29%) RapidMiner
14 5 (1.15%) Ab Initio
15 4 (0.92%) HP
15 4 (0.92%) MicroStrategy
16 3 (0.69%) VMware
17 2 (0.46%) Teradata