Period
to 22 September 2019

The following table provides summary statistics for contract job vacancies advertised in the South East with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 22 September 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > South East
6 months to
22 Sep 2019
Same period 2018 Same period 2017
Rank 126 82 109
Rank change year-on-year -44 +27 +56
Contract jobs citing Big Data 286 462 357
As % of all contract IT jobs advertised in the South East 2.01% 2.82% 2.18%
As % of the Database & Business Intelligence category 10.34% 13.02% 10.02%
Number of daily rates quoted 158 286 207
South East median daily rate £500 £500 £475
Median daily rate % change year-on-year - +5.26% +1.01%
10th Percentile £363 £400 £313
90th Percentile £641 £609 £600
England median daily rate £550 £550 £550
Number of hourly rates quoted 2 5 6
South East median hourly rate £52.50 £44.50 £32.17
Median hourly rate % change year-on-year +17.98% +38.33% +56.93%
10th Percentile £51.25 £19.20 £16.64
90th Percentile £53.75 £59.00 £50.00
England median hourly rate £46.85 £40.00 £40.00
% change year-on-year +17.12% - -6.63%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the South East with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
South East
Contract vacancies with a requirement for database or business intelligence skills 2,766 3,549 3,562
As % of all contract IT jobs advertised in the South East 19.44% 21.63% 21.71%
Number of daily rates quoted 1,711 2,275 2,209
South East median daily rate £450 £448 £401
Median daily rate % change year-on-year +0.56% +11.74% +0.13%
10th Percentile £300 £313 £277
90th Percentile £600 £575 £538
England median daily rate £475 £475 £450
% change year-on-year - +5.56% +5.88%
Number of hourly rates quoted 80 59 71
South East median hourly rate £45.32 £35.00 £25.00
Median hourly rate % change year-on-year +29.48% +40.00% -33.77%
10th Percentile £15.23 £13.00 £9.25
90th Percentile £73.75 £58.00 £50.00
England median hourly rate £35.00 £29.50 £30.00
% change year-on-year +18.64% -1.67% -

Big Data
Job Vacancy Trend in the South East

Job postings citing Big Data as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for Big Data in the South East

Big Data
Contractor Daily Rate Trend in the South East

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the South East.

Contractor daily rate trend for Big Data in the South East

Big Data
Contractor Daily Rate Histogram in the South East

The daily rate distribution of IT jobs citing Big Data in the South East over the 6 months to 22 September 2019.

Contractor daily rate histogram for Big Data in the South East

Big Data
Contractor Hourly Rate Trend in the South East

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in the South East.

Contractor hourly rate trend for Big Data in the South East

Big Data
Contract Job Locations in the South East

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the South East region over the 6 months to 22 September 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Thames Valley -45 110 £475 -5.00% 41
Hampshire -7 77 £538 +7.50% 11
Berkshire -43 73 £475 -7.32% 26
Surrey -29 42 £520 +4.00% 13
Buckinghamshire -10 32 £500 -4.76% 6
East Sussex +9 25 £500 -9.09%
West Sussex +16 19 £488 +2.63% 4
Kent +6 7 £525 -4.55% 4
Oxfordshire +19 5 £415 -7.78% 9
Sussex -2 3 - -
Big Data
England

For the 6 months to 22 September 2019, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the South East region with a requirement for Big Data.

1 126 (44.06%) Hadoop
2 90 (31.47%) Analytics
3 87 (30.42%) SQL
4 84 (29.37%) Agile Software Development
5 83 (29.02%) Apache Spark
6 80 (27.97%) Python
7 70 (24.48%) Business Intelligence
8 69 (24.13%) Linux
9 67 (23.43%) Kafka
10 65 (22.73%) DevOps
10 65 (22.73%) AWS
11 59 (20.63%) Data Lake
12 58 (20.28%) Azure
13 51 (17.83%) Data Modelling
14 49 (17.13%) Data Warehouse
15 48 (16.78%) Apache Hive
16 47 (16.43%) Jenkins
17 43 (15.03%) Java
17 43 (15.03%) Security Cleared
18 42 (14.69%) Data Analytics
19 41 (14.34%) Ansible
20 40 (13.99%) HBase
20 40 (13.99%) Data Architecture
21 39 (13.64%) Oracle
21 39 (13.64%) Microsoft
22 38 (13.29%) Scrum
22 38 (13.29%) Docker
23 35 (12.24%) HDFS
23 35 (12.24%) Continuous Integration
23 35 (12.24%) Git (software)

Big Data
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 83 (29.02%) Apache Spark
2 28 (9.79%) Apache
3 15 (5.24%) Elasticsearch
3 15 (5.24%) SAS
4 14 (4.90%) Apache Airflow
5 11 (3.85%) Apache Pig
6 10 (3.50%) Jupyter
7 6 (2.10%) Luigi
8 4 (1.40%) Tomcat
9 3 (1.05%) Confluence
10 1 (0.35%) Apache Solr
10 1 (0.35%) Cloud Foundry
10 1 (0.35%) OpenStack
Applications
1 12 (4.20%) Microsoft Excel
2 7 (2.45%) Microsoft PowerPoint
3 1 (0.35%) Spreadsheet
3 1 (0.35%) SPSS
Business Applications
1 2 (0.70%) BPCS
1 2 (0.70%) SAP R/3
2 1 (0.35%) SAP APO
Cloud Services
1 65 (22.73%) AWS
2 58 (20.28%) Azure
3 26 (9.09%) Power Platform
4 19 (6.64%) Amazon EMR
4 19 (6.64%) GitHub
5 16 (5.59%) GCP
6 13 (4.55%) Amazon EC2
6 13 (4.55%) Data Lake Analytics
7 12 (4.20%) Amazon S3
7 12 (4.20%) PaaS
8 9 (3.15%) Amazon Kinesis
9 6 (2.10%) AWS CloudFormation
9 6 (2.10%) Azure Data Factory
9 6 (2.10%) Cloud Computing
9 6 (2.10%) Serverless
10 5 (1.75%) Amazon ECS
10 5 (1.75%) Amazon SQS
10 5 (1.75%) IaaS
11 4 (1.40%) Amazon Glacier
11 4 (1.40%) AWS Lambda
Communications & Networking
1 7 (2.45%) SAN
2 6 (2.10%) Kerberos
3 5 (1.75%) MQTT
4 4 (1.40%) Multicast
4 4 (1.40%) SSL
5 3 (1.05%) 2G
5 3 (1.05%) 3G
5 3 (1.05%) 4G
5 3 (1.05%) 5G
6 2 (0.70%) 2.5G
6 2 (0.70%) DNS
6 2 (0.70%) DSL
6 2 (0.70%) PuTTY
6 2 (0.70%) WinSCP
7 1 (0.35%) DHCP
7 1 (0.35%) DMZ
7 1 (0.35%) Internet
7 1 (0.35%) Network Security
7 1 (0.35%) TCP/IP
7 1 (0.35%) VoLTE
Database & Business Intelligence
1 126 (44.06%) Hadoop
2 59 (20.63%) Data Lake
3 49 (17.13%) Data Warehouse
4 48 (16.78%) Apache Hive
5 40 (13.99%) HBase
6 34 (11.89%) Relational Database
6 34 (11.89%) SQL Server
7 31 (10.84%) NoSQL
8 26 (9.09%) Power BI
9 25 (8.74%) MySQL
10 23 (8.04%) SQL Server Integration Services
11 13 (4.55%) Amazon Redshift
11 13 (4.55%) Impala
11 13 (4.55%) RDBMS
11 13 (4.55%) SQL Server 2016
11 13 (4.55%) Sqoop
12 12 (4.20%) MongoDB
13 11 (3.85%) Amazon Athena
13 11 (3.85%) Apache Cassandra
14 10 (3.50%) PostgreSQL
Development Applications
1 47 (16.43%) Jenkins
2 35 (12.24%) Git (software)
3 17 (5.94%) JIRA
3 17 (5.94%) Visual Studio
4 15 (5.24%) Visual Studio Team System
5 12 (4.20%) Gradle
6 9 (3.15%) Maven
7 8 (2.80%) Cucumber
7 8 (2.80%) Subversion
8 6 (2.10%) Atlassian Bamboo
9 5 (1.75%) TeamCity
10 4 (1.40%) Concordion
10 4 (1.40%) EasyMock
10 4 (1.40%) FindBugs
10 4 (1.40%) Log4j
10 4 (1.40%) Mercurial
10 4 (1.40%) Mockito
10 4 (1.40%) MSTest
10 4 (1.40%) NUnit
10 4 (1.40%) Selenium
General
1 34 (11.89%) Telecoms
2 21 (7.34%) Finance
3 17 (5.94%) Banking
4 9 (3.15%) Games
4 9 (3.15%) Public Sector
4 9 (3.15%) Retail
5 6 (2.10%) Manufacturing
6 5 (1.75%) Investment Banking
7 4 (1.40%) Military
8 3 (1.05%) Marketing
9 2 (0.70%) Legal
9 2 (0.70%) Pharmaceutical
10 1 (0.35%) Automotive
10 1 (0.35%) Electronics
10 1 (0.35%) Front Office
10 1 (0.35%) International Banking
10 1 (0.35%) Police
Job Titles
1 56 (19.58%) Architect
1 56 (19.58%) Data Engineer
2 46 (16.08%) Developer
3 34 (11.89%) Data Architect
4 28 (9.79%) Analyst
5 21 (7.34%) Big Data Developer
5 21 (7.34%) Big Data Engineer
5 21 (7.34%) DevOps Engineer
6 20 (6.99%) Java Developer
7 17 (5.94%) Administrator
8 11 (3.85%) Business Analyst
8 11 (3.85%) Consultant
8 11 (3.85%) Python Engineer
8 11 (3.85%) Solutions Architect
9 10 (3.50%) Azure Architect
9 10 (3.50%) Big Data Architect
9 10 (3.50%) Cloud Engineer
9 10 (3.50%) DBA
9 10 (3.50%) Enterprise Architect
9 10 (3.50%) Lead DevOps
Libraries, Frameworks & Software Standards
1 67 (23.43%) Kafka
2 18 (6.29%) RabbitMQ
3 15 (5.24%) Apache NiFi
3 15 (5.24%) Spring
4 11 (3.85%) .NET
5 8 (2.80%) JSON
5 8 (2.80%) Middleware
6 7 (2.45%) Apache Avro
6 7 (2.45%) Elastic Stack
7 6 (2.10%) CSS
7 6 (2.10%) HTML
7 6 (2.10%) J2EE
7 6 (2.10%) REST
7 6 (2.10%) Ultra Messaging
8 5 (1.75%) .NET Framework
8 5 (1.75%) Web Services
9 4 (1.40%) Gherkin
9 4 (1.40%) HTML5
9 4 (1.40%) XML
9 4 (1.40%) XSLT
Miscellaneous
1 25 (8.74%) Analytical Skills
2 15 (5.24%) Greenfield Project
3 11 (3.85%) Management Information System
4 10 (3.50%) Linux Command Line
5 9 (3.15%) Cloud Native
6 6 (2.10%) PKI
6 6 (2.10%) Virtual Team
7 5 (1.75%) Clustering
7 5 (1.75%) Self-Motivation
8 4 (1.40%) Mobile App
9 3 (1.05%) Credit Risk
9 3 (1.05%) Data Structures
9 3 (1.05%) Freedom of Information
9 3 (1.05%) Public Cloud
10 2 (0.70%) Algorithms
10 2 (0.70%) AS400
10 2 (0.70%) Client/Server
10 2 (0.70%) Data Protection Act
10 2 (0.70%) Enterprise Software
11 1 (0.35%) Data Centre
Operating Systems
1 69 (24.13%) Linux
2 29 (10.14%) Unix
3 23 (8.04%) Red Hat Enterprise Linux
4 22 (7.69%) Windows
5 11 (3.85%) CentOS
6 10 (3.50%) Ubuntu
7 9 (3.15%) Windows Server
8 4 (1.40%) Debian
8 4 (1.40%) VMS
9 3 (1.05%) Android
9 3 (1.05%) Apple iOS
10 2 (0.70%) Mac OS X
10 2 (0.70%) Windows Server 2012
Processes & Methodologies
1 90 (31.47%) Analytics
2 84 (29.37%) Agile Software Development
3 70 (24.48%) Business Intelligence
4 65 (22.73%) DevOps
5 51 (17.83%) Data Modelling
6 42 (14.69%) Data Analytics
7 40 (13.99%) Data Architecture
8 38 (13.29%) Scrum
9 35 (12.24%) Continuous Integration
9 35 (12.24%) ETL
10 34 (11.89%) Data Science
11 31 (10.84%) Migration
12 30 (10.49%) Project Delivery
13 28 (9.79%) Configuration Management
13 28 (9.79%) TDD
14 27 (9.44%) Data Analysis
15 25 (8.74%) Big Data Analytics
15 25 (8.74%) Infrastructure as Code
15 25 (8.74%) Use Case
16 22 (7.69%) Data Engineering
Programming Languages
1 87 (30.42%) SQL
2 80 (27.97%) Python
3 43 (15.03%) Java
4 22 (7.69%) Scala
5 18 (6.29%) PowerShell
6 15 (5.24%) Shell Script
7 12 (4.20%) C#
7 12 (4.20%) R
8 10 (3.50%) Bash Shell
9 9 (3.15%) C++
10 8 (2.80%) C
10 8 (2.80%) JavaScript
11 6 (2.10%) Java 8
11 6 (2.10%) Perl
12 3 (1.05%) PL/SQL
13 2 (0.70%) F#
13 2 (0.70%) Groovy
13 2 (0.70%) PHP
13 2 (0.70%) Ruby
14 1 (0.35%) Korn
Qualifications
1 43 (15.03%) Security Cleared
2 29 (10.14%) Degree
3 28 (9.79%) SC Cleared
4 13 (4.55%) TOGAF Certification
5 6 (2.10%) DV Cleared
6 5 (1.75%) MCSE
6 5 (1.75%) Microsoft Certification
7 4 (1.40%) AWS Certification
7 4 (1.40%) Master's Degree
7 4 (1.40%) MCSA
8 3 (1.05%) CISSP
8 3 (1.05%) Computer Science Degree
9 2 (0.70%) CISM
9 2 (0.70%) HNC
9 2 (0.70%) HND
9 2 (0.70%) ISEB
9 2 (0.70%) ISEB Practitioner
9 2 (0.70%) ISTQB Foundation Certification
9 2 (0.70%) ITIL Certification
10 1 (0.35%) OCP
Quality Assurance & Compliance
1 13 (4.55%) Data Quality
2 9 (3.15%) QA
3 4 (1.40%) PCI DSS
3 4 (1.40%) Sarbanes-Oxley
4 1 (0.35%) EMIR
4 1 (0.35%) GDPR
4 1 (0.35%) ISO/IEC 27001
4 1 (0.35%) MiFID
4 1 (0.35%) PMO
4 1 (0.35%) SLA
System Software
1 38 (13.29%) Docker
2 35 (12.24%) HDFS
3 16 (5.59%) Apache Flume
4 15 (5.24%) Apache ZooKeeper
5 8 (2.80%) Active Directory
6 7 (2.45%) Virtual Desktop
6 7 (2.45%) Virtual Servers
6 7 (2.45%) vSphere
7 5 (1.75%) Oracle RAC
8 2 (0.70%) Virtual Machines
9 1 (0.35%) NFS
9 1 (0.35%) vCloud
9 1 (0.35%) VirtualBox
9 1 (0.35%) VMware Infrastructure
Systems Management
1 41 (14.34%) Ansible
2 28 (9.79%) Terraform
3 21 (7.34%) Kubernetes
4 17 (5.94%) Oozie
5 14 (4.90%) Puppet
6 10 (3.50%) Opscode Chef
7 8 (2.80%) Hadoop YARN
8 6 (2.10%) Data Guard
9 5 (1.75%) logstash
9 5 (1.75%) Oracle RMAN
9 5 (1.75%) vCenter Server
10 4 (1.40%) Consul
10 4 (1.40%) Mesos
10 4 (1.40%) Prometheus
11 3 (1.05%) Control-M
12 2 (0.70%) HP ALM
12 2 (0.70%) Kibana
13 1 (0.35%) EMC NetWorker
13 1 (0.35%) NetBackup
Vendors
1 39 (13.64%) Microsoft
1 39 (13.64%) Oracle
2 22 (7.69%) Tableau
3 20 (6.99%) Cloudera
4 17 (5.94%) Google
5 15 (5.24%) Hortonworks
6 14 (4.90%) SAP
7 11 (3.85%) Talend
8 10 (3.50%) Informatica
9 9 (3.15%) Splunk
10 8 (2.80%) Red Hat
11 7 (2.45%) StreamSets
12 6 (2.10%) Databricks
12 6 (2.10%) Imperva
13 5 (1.75%) Varonis
14 4 (1.40%) JD Edwards
15 3 (1.05%) Ab Initio
15 3 (1.05%) CA Agile Central
15 3 (1.05%) SnapLogic
15 3 (1.05%) TIBCO