Period
to 26 May 2019

The following table provides summary statistics for contract job vacancies advertised in the South East with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 26 May 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > South East
6 months to
26 May 2019
Same period 2018 Same period 2017
Rank 97 76 119
Rank change year-on-year -21 +43 +60
Contract jobs citing Big Data 359 515 305
As % of all contract IT jobs advertised in the South East 2.44% 3.06% 1.97%
As % of the Database & Business Intelligence category 12.24% 15.23% 9.44%
Number of daily rates quoted 182 280 163
South East median daily rate £500 £500 £475
Median daily rate % change year-on-year - +5.26% -
10th Percentile £338 £381 £311
90th Percentile £663 £600 £625
England median daily rate £550 £550 £525
% change year-on-year - +4.76% -
Number of hourly rates quoted 1 1 3
South East median hourly rate £57.50 £17.50 £50.00
Median hourly rate % change year-on-year +228.57% -65.00% -
England median hourly rate £49.13 £45.00 £47.00
% change year-on-year +9.18% -4.26% +93.81%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the South East with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
South East
Contract vacancies with a requirement for database or business intelligence skills 2,932 3,382 3,231
As % of all contract IT jobs advertised in the South East 19.96% 20.09% 20.91%
Number of daily rates quoted 1,839 2,076 1,995
South East median daily rate £450 £438 £401
Median daily rate % change year-on-year +2.86% +9.24% +0.13%
10th Percentile £306 £306 £280
90th Percentile £600 £575 £538
England median daily rate £488 £475 £450
% change year-on-year +2.63% +5.56% +5.88%
Number of hourly rates quoted 57 48 75
South East median hourly rate £47.50 £40.00 £17.00
Median hourly rate % change year-on-year +18.75% +135.29% -26.09%
10th Percentile £20.80 £11.85 £9.25
90th Percentile £60.00 £50.75 £47.80
England median hourly rate £35.00 £32.25 £30.00
% change year-on-year +8.53% +7.50% +5.26%

Big Data
Job Vacancy Trend in the South East

Job postings citing Big Data as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for Big Data in the South East

Big Data
Contractor Daily Rate Trend in the South East

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Big Data in the South East.

Contractor daily rate trend for Big Data in the South East

Big Data
Contractor Daily Rate Histogram in the South East

The daily rate distribution of IT jobs citing Big Data in the South East over the 6 months to 26 May 2019.

Contractor daily rate histogram for Big Data in the South East

Big Data
Contractor Hourly Rate Trend in the South East

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Big Data in the South East.

Contractor hourly rate trend for Big Data in the South East

Big Data
Contract Job Locations in the South East

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the South East region over the 6 months to 26 May 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Hampshire -2 118 £525 +9.09% 10
Thames Valley -55 102 £487 -7.19% 18
Berkshire -44 70 £475 -13.64% 9
Surrey -14 63 £500 - 4
East Sussex +15 39 £475 - 1
Buckinghamshire -43 30 £500 - 4
West Sussex -6 16 £520 +18.86% 2
Kent +12 14 £525 - 2
Oxfordshire +20 2 £415 -12.63% 5
Middlesex +11 2 £550 -
Big Data
England

For the 6 months to 26 May 2019, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the South East region with a requirement for Big Data.

1 191 (53.20%) Hadoop
2 148 (41.23%) Apache Spark
3 135 (37.60%) Agile Software Development
4 127 (35.38%) Java
5 118 (32.87%) Kafka
6 115 (32.03%) Analytics
7 109 (30.36%) Python
8 104 (28.97%) SQL
9 91 (25.35%) Amazon AWS
10 77 (21.45%) Data Warehouse
11 76 (21.17%) Linux
12 69 (19.22%) Apache Hive
13 65 (18.11%) Continuous Integration
13 65 (18.11%) Apache
14 64 (17.83%) DevOps
15 59 (16.43%) HDFS
15 59 (16.43%) TDD
16 58 (16.16%) Business Intelligence
17 57 (15.88%) Unix
17 57 (15.88%) Jenkins
18 56 (15.60%) HBase
19 55 (15.32%) NoSQL
19 55 (15.32%) Microsoft Azure
20 53 (14.76%) ETL
21 52 (14.48%) Scala
22 48 (13.37%) Data Lake
23 45 (12.53%) Security Cleared
23 45 (12.53%) Elasticsearch
24 43 (11.98%) Data Analysis
25 41 (11.42%) Spring

Big Data
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 148 (41.23%) Apache Spark
2 65 (18.11%) Apache
3 45 (12.53%) Elasticsearch
4 17 (4.74%) Apache Airflow
4 17 (4.74%) Apache Pig
5 14 (3.90%) Luigi
5 14 (3.90%) SAS
6 12 (3.34%) Jupyter
7 10 (2.79%) Apache Solr
8 9 (2.51%) Apache Qpid
9 3 (0.84%) Confluence
10 2 (0.56%) Cloud Foundry
10 2 (0.56%) MS Exchange
11 1 (0.28%) IIS
Applications
1 10 (2.79%) Microsoft Excel
2 3 (0.84%) Microsoft PowerPoint
3 1 (0.28%) MS Visio
Business Applications
1 2 (0.56%) SAP Oil and Gas
2 1 (0.28%) Dynamics CRM
Cloud Services
1 91 (25.35%) Amazon AWS
2 55 (15.32%) Microsoft Azure
3 41 (11.42%) Power Platform
4 33 (9.19%) Amazon EMR
5 26 (7.24%) GitHub
6 24 (6.69%) Amazon EC2
6 24 (6.69%) Amazon S3
7 23 (6.41%) PaaS
8 21 (5.85%) Serverless
9 19 (5.29%) Google Cloud Platform
10 17 (4.74%) Amazon Kinesis
11 15 (4.18%) AWS CloudFormation
11 15 (4.18%) Azure Data Factory
12 13 (3.62%) Amazon SQS
13 11 (3.06%) AWS Lambda
14 9 (2.51%) Data Lake Analytics
15 8 (2.23%) Amazon CloudWatch
15 8 (2.23%) Azure Functions
15 8 (2.23%) Cortana Intelligence Suite
16 7 (1.95%) Azure Machine Learning
Communications & Networking
1 12 (3.34%) MQTT
2 8 (2.23%) 3G
2 8 (2.23%) 4G
3 6 (1.67%) 2G
3 6 (1.67%) Firewall
4 5 (1.39%) 5G
4 5 (1.39%) Internet
4 5 (1.39%) TCP/IP
5 3 (0.84%) HTTP
5 3 (0.84%) SSH
6 2 (0.56%) 2.5G
6 2 (0.56%) Diameter Protocol
6 2 (0.56%) DSL
6 2 (0.56%) Ethernet
6 2 (0.56%) LTE
6 2 (0.56%) Radio Access Network
6 2 (0.56%) RTP
6 2 (0.56%) RTSP
6 2 (0.56%) VoLTE
7 1 (0.28%) OpenLDAP
Database & Business Intelligence
1 191 (53.20%) Hadoop
2 77 (21.45%) Data Warehouse
3 69 (19.22%) Apache Hive
4 56 (15.60%) HBase
5 55 (15.32%) NoSQL
6 48 (13.37%) Data Lake
7 41 (11.42%) Power BI
8 32 (8.91%) Apache Cassandra
9 27 (7.52%) SQL Server
10 25 (6.96%) Parquet
11 23 (6.41%) Amazon DynamoDB
11 23 (6.41%) MySQL
12 22 (6.13%) Cosmos DB
12 22 (6.13%) Impala
13 21 (5.85%) Amazon Redshift
13 21 (5.85%) PostgreSQL
14 19 (5.29%) Amazon Athena
15 17 (4.74%) Azure SQL Data Warehouse
15 17 (4.74%) Relational Database
15 17 (4.74%) Sqoop
Development Applications
1 57 (15.88%) Jenkins
2 35 (9.75%) Git (software)
3 27 (7.52%) JIRA
4 22 (6.13%) Gradle
5 8 (2.23%) Visual Studio
6 7 (1.95%) Visual Studio Team System
7 5 (1.39%) Atlassian Bamboo
8 4 (1.11%) ERwin
8 4 (1.11%) VersionOne
9 3 (0.84%) Cucumber
9 3 (0.84%) Maven
9 3 (0.84%) PowerDesigner
10 2 (0.56%) IntelliJ
10 2 (0.56%) JIRA Agile
10 2 (0.56%) PyCharm
10 2 (0.56%) RStudio
10 2 (0.56%) Selenium
10 2 (0.56%) Sonatype Nexus
10 2 (0.56%) SQL Server Management Studio (SSMS)
10 2 (0.56%) Vagrant
General
1 38 (10.58%) Finance
2 36 (10.03%) Telecoms
3 15 (4.18%) Retail
4 11 (3.06%) Banking
5 6 (1.67%) Marketing
6 4 (1.11%) Automotive
6 4 (1.11%) Manufacturing
7 3 (0.84%) Legal
8 2 (0.56%) Aerospace
8 2 (0.56%) Games
9 1 (0.28%) Pharmaceutical
9 1 (0.28%) Spanish Language
Job Titles
1 99 (27.58%) Developer
2 67 (18.66%) Data Engineer
3 54 (15.04%) Architect
4 43 (11.98%) Java Developer
5 40 (11.14%) Big Data Engineer
6 35 (9.75%) Data Architect
7 32 (8.91%) Big Data Developer
8 24 (6.69%) Consultant
9 18 (5.01%) Hadoop Developer
10 16 (4.46%) Software Engineer
11 15 (4.18%) Analyst
12 14 (3.90%) Cloud Engineer
12 14 (3.90%) Data Consultant
12 14 (3.90%) Java Hadoop Developer
12 14 (3.90%) Python Developer
13 13 (3.62%) AWS Engineer
13 13 (3.62%) Big Data Consultant
13 13 (3.62%) DevOps Engineer
14 11 (3.06%) Administrator
14 11 (3.06%) Java Engineer
Libraries, Frameworks & Software Standards
1 118 (32.87%) Kafka
2 41 (11.42%) Spring
3 31 (8.64%) Apache Avro
4 25 (6.96%) RabbitMQ
5 23 (6.41%) J2EE
6 22 (6.13%) Middleware
6 22 (6.13%) REST
7 21 (5.85%) JSON
7 21 (5.85%) Spark Streaming
8 16 (4.46%) Apache NiFi
9 12 (3.34%) RESTful
10 11 (3.06%) Apache Camel
11 10 (2.79%) XML
12 9 (2.51%) Oracle GoldenGate
12 9 (2.51%) XSLT
13 8 (2.23%) MLlib
14 6 (1.67%) .NET
14 6 (1.67%) Node.js
15 5 (1.39%) AngularJS
15 5 (1.39%) OAuth
Miscellaneous
1 31 (8.64%) Analytical Skills
2 20 (5.57%) Linux Command Line
2 20 (5.57%) Virtual Team
3 18 (5.01%) Greenfield Project
4 17 (4.74%) Self-Motivation
5 8 (2.23%) Data Structures
5 8 (2.23%) Management Information System
6 7 (1.95%) Cloud Native
7 6 (1.67%) Clustering
8 4 (1.11%) Algorithms
9 3 (0.84%) Data Centre
9 3 (0.84%) Mobile App
9 3 (0.84%) PKI
10 2 (0.56%) Enterprise Software
10 2 (0.56%) Fintech
10 2 (0.56%) Linked Data
10 2 (0.56%) Semantic Web
10 2 (0.56%) User Experience
11 1 (0.28%) Cyberattack
11 1 (0.28%) Smart Energy
Operating Systems
1 76 (21.17%) Linux
2 57 (15.88%) Unix
3 12 (3.34%) Windows
4 5 (1.39%) Ubuntu
5 4 (1.11%) Red Hat Enterprise Linux
6 2 (0.56%) Windows Server
6 2 (0.56%) Windows Server 2003
6 2 (0.56%) Windows Vista
7 1 (0.28%) Data ONTAP
7 1 (0.28%) Solaris
Processes & Methodologies
1 135 (37.60%) Agile Software Development
2 115 (32.03%) Analytics
3 65 (18.11%) Continuous Integration
4 64 (17.83%) DevOps
5 59 (16.43%) TDD
6 58 (16.16%) Business Intelligence
7 53 (14.76%) ETL
8 43 (11.98%) Data Analysis
9 41 (11.42%) Scrum
10 40 (11.14%) Data Modelling
11 35 (9.75%) Data Architecture
12 34 (9.47%) Open Source
13 33 (9.19%) Data Science
14 32 (8.91%) BDD
14 32 (8.91%) Data Analytics
14 32 (8.91%) Machine Learning
15 31 (8.64%) Test Automation
16 30 (8.36%) Software Engineering
16 30 (8.36%) Stakeholder Management
17 27 (7.52%) Use Case
Programming Languages
1 127 (35.38%) Java
2 109 (30.36%) Python
3 104 (28.97%) SQL
4 52 (14.48%) Scala
5 28 (7.80%) Shell Script
6 16 (4.46%) Java 8
7 15 (4.18%) C#
8 14 (3.90%) JavaScript
9 13 (3.62%) C++
10 10 (2.79%) R
11 8 (2.23%) C
11 8 (2.23%) Kotlin
11 8 (2.23%) PowerShell
12 7 (1.95%) Bash Shell
12 7 (1.95%) Go
13 6 (1.67%) U-SQL
14 3 (0.84%) MATLAB
14 3 (0.84%) PHP
14 3 (0.84%) PL/SQL
14 3 (0.84%) SAS Macro
Qualifications
1 45 (12.53%) Security Cleared
2 41 (11.42%) SC Cleared
3 27 (7.52%) Degree
4 11 (3.06%) TOGAF Certification
5 8 (2.23%) MCSE
5 8 (2.23%) Microsoft Certification
6 6 (1.67%) ITIL Certification
7 5 (1.39%) MCSA
8 4 (1.11%) AWS Certification
9 3 (0.84%) BPSS Clearance
9 3 (0.84%) Computer Science Degree
10 2 (0.56%) ISEB
10 2 (0.56%) MCITP
10 2 (0.56%) PhD
11 1 (0.28%) Cisco Certification
11 1 (0.28%) CISSP
11 1 (0.28%) ISTQB
11 1 (0.28%) OCP
11 1 (0.28%) Oracle Certification
11 1 (0.28%) VMware Certified Professional (VCP)
Quality Assurance & Compliance
1 15 (4.18%) Data Quality
2 6 (1.67%) QA
3 5 (1.39%) GDPR
4 2 (0.56%) SLA
System Software
1 59 (16.43%) HDFS
2 40 (11.14%) Docker
3 25 (6.96%) Apache ZooKeeper
4 23 (6.41%) Apache Flume
5 8 (2.23%) Active Directory
6 5 (1.39%) Oracle RAC
6 5 (1.39%) VMware Infrastructure
7 3 (0.84%) Virtual Machines
7 3 (0.84%) vSphere
8 2 (0.56%) Hyper-V
9 1 (0.28%) KVM
9 1 (0.28%) VirtualBox
9 1 (0.28%) VMware ESXi
Systems Management
1 36 (10.03%) Hadoop YARN
2 33 (9.19%) Kubernetes
3 29 (8.08%) Ansible
4 19 (5.29%) Terraform
5 16 (4.46%) Oozie
5 16 (4.46%) Puppet
6 11 (3.06%) Opscode Chef
7 6 (1.67%) Data Guard
8 5 (1.39%) Oracle RMAN
9 3 (0.84%) vCenter Server
10 2 (0.56%) logstash
10 2 (0.56%) Microsoft Clustering
10 2 (0.56%) SCCM
10 2 (0.56%) SCOM
10 2 (0.56%) Single Sign-On
11 1 (0.28%) Control-M
11 1 (0.28%) EMC NetWorker
11 1 (0.28%) HAProxy
11 1 (0.28%) NetBackup
11 1 (0.28%) OpenView Configuration Management
Vendors
1 35 (9.75%) Cloudera
2 31 (8.64%) Tableau
3 26 (7.24%) Microsoft
4 24 (6.69%) Oracle
5 20 (5.57%) Google
6 18 (5.01%) Databricks
7 12 (3.34%) Talend
8 10 (2.79%) SAP
9 9 (2.51%) CA Agile Central
10 8 (2.23%) Informatica
11 7 (1.95%) MicroStrategy
12 6 (1.67%) Ab Initio
12 6 (1.67%) VMware
13 3 (0.84%) DataFlux
13 3 (0.84%) Datameer
13 3 (0.84%) Netezza
13 3 (0.84%) Red Hat
13 3 (0.84%) Workday
14 2 (0.56%) Hortonworks
14 2 (0.56%) MapR