Period
to 6 December 2019

The following table provides summary statistics for contract job vacancies advertised in the South East with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 6 December 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > South East
6 months to
6 Dec 2019
Same period 2018 Same period 2017
Rank 119 92 98
Rank change year-on-year -27 +6 +40
Contract jobs citing Big Data 260 449 389
As % of all contract IT jobs advertised in the South East 1.98% 2.66% 2.30%
As % of the Database & Business Intelligence category 9.95% 12.24% 11.07%
Number of daily rates quoted 152 262 228
South East median daily rate £500 £500 £500
10th Percentile £331 £380 £363
90th Percentile £638 £625 £600
England median daily rate £550 £550 £550
Number of hourly rates quoted 0 4 7
South East median hourly rate - £49.75 £19.34
Median hourly rate % change year-on-year - +157.24% -75.90%
England median hourly rate £43.75 £44.75 £30.50
% change year-on-year -2.23% +46.72% -29.07%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the South East with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
South East
Contract vacancies with a requirement for database or business intelligence skills 2,614 3,669 3,515
As % of all contract IT jobs advertised in the South East 19.93% 21.70% 20.81%
Number of daily rates quoted 1,587 2,370 2,233
South East median daily rate £450 £450 £425
Median daily rate % change year-on-year - +6.01% +6.13%
10th Percentile £306 £313 £300
90th Percentile £600 £588 £570
England median daily rate £475 £475 £463
% change year-on-year - +2.70% +8.82%
Number of hourly rates quoted 77 46 53
South East median hourly rate £35.00 £37.50 £41.50
Median hourly rate % change year-on-year -6.67% -9.64% +102.44%
10th Percentile £15.23 £18.69 £11.17
90th Percentile £80.25 £57.41 £48.75
England median hourly rate £32.50 £35.00 £31.23
% change year-on-year -7.14% +12.07% +13.56%

Big Data
Job Vacancy Trend in the South East

Job postings citing Big Data as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for Big Data in the South East

Big Data
Contractor Daily Rate Trend in the South East

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the South East.

Contractor daily rate trend for Big Data in the South East

Big Data
Contractor Daily Rate Histogram in the South East

The daily rate distribution of IT jobs citing Big Data in the South East over the 6 months to 6 December 2019.

Contractor daily rate histogram for Big Data in the South East

Big Data
Contractor Hourly Rate Trend in the South East

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in the South East.

Contractor hourly rate trend for Big Data in the South East

Big Data
Contract Job Locations in the South East

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the South East region over the 6 months to 6 December 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Thames Valley -16 115 £450 -10.00% 38
Berkshire -44 73 £438 -14.04% 24
Hampshire -2 66 £525 +5.00% 25
Surrey -22 38 £525 +5.00% 21
Buckinghamshire +25 36 £531 -15.00% 4
East Sussex +23 22 £525 -4.55% 4
West Sussex +28 12 £494 +3.95% 2
Oxfordshire +23 6 £575 +38.55% 10
Sussex -5 3 - -
Kent +5 2 £575 +4.55% 1
Big Data
England

For the 6 months to 6 December 2019, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the South East region with a requirement for Big Data.

1 111 (42.69%) Hadoop
2 93 (35.77%) SQL
3 85 (32.69%) Analytics
4 82 (31.54%) Python
5 77 (29.62%) Agile Software Development
6 73 (28.08%) Apache Spark
7 66 (25.38%) Azure
7 66 (25.38%) AWS
8 65 (25.00%) Business Intelligence
9 64 (24.62%) Data Lake
10 52 (20.00%) DevOps
11 51 (19.62%) Apache Hive
12 48 (18.46%) Data Modelling
12 48 (18.46%) Linux
13 46 (17.69%) ETL
14 43 (16.54%) Data Science
15 40 (15.38%) Kafka
16 39 (15.00%) Data Warehouse
16 39 (15.00%) Microsoft
17 38 (14.62%) Security Cleared
18 34 (13.08%) Data Architecture
18 34 (13.08%) Oracle
19 32 (12.31%) Cloudera
19 32 (12.31%) Data Engineering
19 32 (12.31%) Power BI
19 32 (12.31%) Power Platform
20 31 (11.92%) Scrum
21 30 (11.54%) Data Analytics
21 30 (11.54%) HBase
22 29 (11.15%) Ansible

Big Data
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 73 (28.08%) Apache Spark
2 21 (8.08%) Apache
3 20 (7.69%) SAS
4 10 (3.85%) Apache Pig
5 9 (3.46%) Apache Airflow
5 9 (3.46%) Jupyter
6 8 (3.08%) Elasticsearch
7 3 (1.15%) Tomcat
8 1 (0.38%) ArcGIS
8 1 (0.38%) Confluence
8 1 (0.38%) Luigi
8 1 (0.38%) OpenStack
8 1 (0.38%) SharePoint
Applications
1 6 (2.31%) Microsoft Excel
2 4 (1.54%) Microsoft PowerPoint
3 3 (1.15%) SPSS
4 1 (0.38%) Spreadsheet
Business Applications
1 2 (0.77%) BPCS
1 2 (0.77%) SAP R/3
2 1 (0.38%) NetSuite
2 1 (0.38%) SAP APO
2 1 (0.38%) SAP CRM
2 1 (0.38%) SAP ERP
2 1 (0.38%) SAP IS-U
Cloud Services
1 66 (25.38%) AWS
1 66 (25.38%) Azure
2 32 (12.31%) Power Platform
3 18 (6.92%) Data Lake Analytics
4 16 (6.15%) GCP
5 10 (3.85%) Amazon S3
5 10 (3.85%) Serverless
6 9 (3.46%) Amazon EMR
7 7 (2.69%) Amazon Kinesis
7 7 (2.69%) GitHub
8 6 (2.31%) AWS Lambda
9 5 (1.92%) Amazon EC2
9 5 (1.92%) Amazon ECS
9 5 (1.92%) Azure Data Factory
9 5 (1.92%) Cloud Computing
10 4 (1.54%) Amazon Glacier
10 4 (1.54%) PaaS
11 3 (1.15%) AWS CloudFormation
11 3 (1.15%) IaaS
11 3 (1.15%) iPaaS
Communications & Networking
1 7 (2.69%) Kerberos
1 7 (2.69%) SAN
2 4 (1.54%) Internet
2 4 (1.54%) Multicast
2 4 (1.54%) SSL
3 2 (0.77%) DNS
3 2 (0.77%) MQTT
3 2 (0.77%) PuTTY
3 2 (0.77%) WinSCP
4 1 (0.38%) 5G
4 1 (0.38%) DHCP
4 1 (0.38%) DMZ
4 1 (0.38%) DWDM
4 1 (0.38%) Ethernet
4 1 (0.38%) LAN
4 1 (0.38%) MPLS
4 1 (0.38%) Network Security
4 1 (0.38%) WAN
4 1 (0.38%) Wi-Fi
Database & Business Intelligence
1 111 (42.69%) Hadoop
2 64 (24.62%) Data Lake
3 51 (19.62%) Apache Hive
4 39 (15.00%) Data Warehouse
5 32 (12.31%) Power BI
6 30 (11.54%) HBase
7 27 (10.38%) NoSQL
7 27 (10.38%) SQL Server
7 27 (10.38%) SQL Server Integration Services
8 25 (9.62%) Impala
8 25 (9.62%) Relational Database
9 16 (6.15%) MySQL
10 14 (5.38%) Amazon Redshift
10 14 (5.38%) MongoDB
11 12 (4.62%) Apache Cassandra
12 10 (3.85%) SQL Server 2016
12 10 (3.85%) Sqoop
13 8 (3.08%) Amazon Athena
13 8 (3.08%) Apache Zeppelin
14 7 (2.69%) RDBMS
Development Applications
1 23 (8.85%) Jenkins
2 22 (8.46%) Visual Studio
3 18 (6.92%) Visual Studio Team System
4 17 (6.54%) Git (software)
5 9 (3.46%) JIRA
6 7 (2.69%) Maven
6 7 (2.69%) Subversion
7 5 (1.92%) Cucumber
7 5 (1.92%) TeamCity
8 4 (1.54%) Atlassian Bamboo
8 4 (1.54%) Concordion
8 4 (1.54%) EasyMock
8 4 (1.54%) Gradle
8 4 (1.54%) Mockito
8 4 (1.54%) MSTest
8 4 (1.54%) NUnit
9 3 (1.15%) Log4j
9 3 (1.15%) Mercurial
9 3 (1.15%) Selenium
9 3 (1.15%) Team Foundation Server
General
1 24 (9.23%) Finance
2 19 (7.31%) Telecoms
3 14 (5.38%) Banking
4 10 (3.85%) Games
4 10 (3.85%) Public Sector
5 9 (3.46%) Retail
6 5 (1.92%) Investment Banking
7 4 (1.54%) Military
8 3 (1.15%) Manufacturing
8 3 (1.15%) Pharmaceutical
9 2 (0.77%) Legal
9 2 (0.77%) Marketing
10 1 (0.38%) Automotive
10 1 (0.38%) Electronics
10 1 (0.38%) Front Office
10 1 (0.38%) International Banking
10 1 (0.38%) Police
Job Titles
1 57 (21.92%) Data Engineer
2 48 (18.46%) Architect
3 34 (13.08%) Analyst
4 30 (11.54%) Data Architect
5 28 (10.77%) Developer
6 24 (9.23%) Big Data Engineer
7 19 (7.31%) Data Scientist
8 16 (6.15%) DevOps Engineer
9 13 (5.00%) Solutions Architect
10 12 (4.62%) Service Analyst
10 12 (4.62%) Service Transition Analyst
10 12 (4.62%) Transition Analyst
11 11 (4.23%) Big Data Architect
11 11 (4.23%) Data Analyst
11 11 (4.23%) Hadoop Engineer
12 10 (3.85%) Administrator
12 10 (3.85%) ITIL Service Analyst
12 10 (3.85%) Python Engineer
12 10 (3.85%) SQL Analyst
12 10 (3.85%) Technical Leader
Libraries, Frameworks & Software Standards
1 40 (15.38%) Kafka
2 14 (5.38%) Apache NiFi
3 9 (3.46%) RabbitMQ
4 8 (3.08%) PySpark
5 7 (2.69%) .NET
6 6 (2.31%) CSS
6 6 (2.31%) HTML
6 6 (2.31%) Spring
6 6 (2.31%) Ultra Messaging
6 6 (2.31%) Web Services
6 6 (2.31%) XML
7 5 (1.92%) Elastic Stack
7 5 (1.92%) Node.js
8 4 (1.54%) .NET Framework
8 4 (1.54%) Gherkin
8 4 (1.54%) GraphQL
8 4 (1.54%) HTML5
8 4 (1.54%) JSON
8 4 (1.54%) XSLT
8 4 (1.54%) ZeroMQ
Miscellaneous
1 23 (8.85%) Analytical Skills
2 10 (3.85%) Algorithms
3 9 (3.46%) Cloud Native
4 8 (3.08%) Greenfield Project
4 8 (3.08%) Management Information System
5 7 (2.69%) Credit Risk
6 5 (1.92%) Self-Motivation
7 4 (1.54%) Linux Command Line
8 3 (1.15%) Freedom of Information
8 3 (1.15%) Public Cloud
9 2 (0.77%) AS400
9 2 (0.77%) Client/Server
9 2 (0.77%) Data Centre
9 2 (0.77%) Data Protection Act
9 2 (0.77%) Data Structures
9 2 (0.77%) Internet of Things
9 2 (0.77%) Market Risk
9 2 (0.77%) PKI
9 2 (0.77%) User Experience
10 1 (0.38%) Private Cloud
Operating Systems
1 48 (18.46%) Linux
2 21 (8.08%) Red Hat Enterprise Linux
3 18 (6.92%) Windows
4 15 (5.77%) Unix
5 10 (3.85%) CentOS
6 9 (3.46%) Windows Server
7 4 (1.54%) Ubuntu
7 4 (1.54%) VMS
8 3 (1.15%) Debian
9 2 (0.77%) Android
9 2 (0.77%) Apple iOS
9 2 (0.77%) Mac OS X
9 2 (0.77%) Windows Server 2012
Processes & Methodologies
1 85 (32.69%) Analytics
2 77 (29.62%) Agile Software Development
3 65 (25.00%) Business Intelligence
4 52 (20.00%) DevOps
5 48 (18.46%) Data Modelling
6 46 (17.69%) ETL
7 43 (16.54%) Data Science
8 34 (13.08%) Data Architecture
9 32 (12.31%) Data Engineering
10 31 (11.92%) Scrum
11 30 (11.54%) Data Analytics
12 29 (11.15%) Configuration Management
13 28 (10.77%) Data Analysis
14 26 (10.00%) Data Management
14 26 (10.00%) Infrastructure as Code
15 25 (9.62%) Migration
16 23 (8.85%) Machine Learning
17 21 (8.08%) Project Delivery
18 19 (7.31%) Continuous Integration
18 19 (7.31%) Data Transformation
Programming Languages
1 93 (35.77%) SQL
2 82 (31.54%) Python
3 25 (9.62%) Scala
4 21 (8.08%) Java
4 21 (8.08%) PowerShell
5 14 (5.38%) R
6 8 (3.08%) Bash Shell
6 8 (3.08%) C
6 8 (3.08%) C#
6 8 (3.08%) C++
7 6 (2.31%) JavaScript
7 6 (2.31%) Perl
8 2 (0.77%) Data Analysis Expressions (DAX)
8 2 (0.77%) F#
8 2 (0.77%) PL/SQL
8 2 (0.77%) T-SQL
9 1 (0.38%) Java 8
9 1 (0.38%) MATLAB
9 1 (0.38%) Shell Script
9 1 (0.38%) TypeScript
Qualifications
1 38 (14.62%) Security Cleared
2 25 (9.62%) SC Cleared
3 24 (9.23%) Degree
4 8 (3.08%) AWS Certification
4 8 (3.08%) TOGAF Certification
5 6 (2.31%) DV Cleared
6 4 (1.54%) Computer Science Degree
6 4 (1.54%) Master's Degree
6 4 (1.54%) PhD
7 2 (0.77%) CISM
7 2 (0.77%) CISSP
7 2 (0.77%) HNC
7 2 (0.77%) HND
7 2 (0.77%) ISEB
7 2 (0.77%) ISEB Practitioner
7 2 (0.77%) ISTQB Foundation Certification
7 2 (0.77%) ITIL Certification
8 1 (0.38%) RHCE
Quality Assurance & Compliance
1 9 (3.46%) QA
2 5 (1.92%) Data Quality
3 4 (1.54%) PCI DSS
3 4 (1.54%) Sarbanes-Oxley
4 2 (0.77%) GDPR
5 1 (0.38%) EMIR
5 1 (0.38%) ISO/IEC 27001
5 1 (0.38%) MiFID
System Software
1 26 (10.00%) Docker
2 24 (9.23%) HDFS
3 11 (4.23%) Apache Flume
4 9 (3.46%) Apache ZooKeeper
5 7 (2.69%) Virtual Desktop
5 7 (2.69%) Virtual Servers
6 4 (1.54%) Active Directory
7 3 (1.15%) vSphere
8 1 (0.38%) NFS
8 1 (0.38%) vCloud
8 1 (0.38%) VMware Infrastructure
Systems Management
1 29 (11.15%) Ansible
2 23 (8.85%) Terraform
3 19 (7.31%) Oozie
4 16 (6.15%) Kubernetes
5 11 (4.23%) Puppet
6 7 (2.69%) Opscode Chef
7 4 (1.54%) Consul
7 4 (1.54%) Mesos
7 4 (1.54%) Prometheus
8 3 (1.15%) logstash
9 2 (0.77%) Hadoop YARN
9 2 (0.77%) HP ALM
10 1 (0.38%) Ambari
10 1 (0.38%) Data Guard
10 1 (0.38%) Kibana
10 1 (0.38%) vCenter Server
Vendors
1 39 (15.00%) Microsoft
2 34 (13.08%) Oracle
3 32 (12.31%) Cloudera
4 18 (6.92%) Google
4 18 (6.92%) Talend
5 14 (5.38%) Hortonworks
6 13 (5.00%) Tableau
7 9 (3.46%) Splunk
8 8 (3.08%) SAP
9 7 (2.69%) StreamSets
10 6 (2.31%) Imperva
10 6 (2.31%) Red Hat
11 5 (1.92%) Informatica
11 5 (1.92%) JD Edwards
11 5 (1.92%) Varonis
12 4 (1.54%) TIBCO
13 3 (1.15%) Databricks
13 3 (1.15%) Palantir
13 3 (1.15%) SnapLogic
13 3 (1.15%) VMware