Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 16 October 2021

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 16 October 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK > England
6 months to
16 Oct 2021		 Same period 2020 Same period 2019
Rank 110 101 83
Rank change year-on-year -9 -18 +11
Contract jobs citing Big Data 1,538 651 2,191
As % of all contract jobs advertised in England 2.31% 2.45% 2.82%
As % of the Database & Business Intelligence category 10.79% 10.69% 12.68%
Number of daily rates quoted 1,062 458 1,603
10th Percentile £425 £377 £413
25th Percentile £500 £450 £488
Median daily rate (50th Percentile) £600 £550 £550
Median % change year-on-year +9.09% - -
75th Percentile £693 £625 £638
90th Percentile £774 £688 £725
UK median daily rate £600 £539 £550
% change year-on-year +11.37% -2.05% +1.85%
Number of hourly rates quoted 8 6 10
10th Percentile £33.69 £9.75 £39.58
25th Percentile £36.25 £11.25 £47.86
Median hourly rate £46.13 £19.75 £49.93
Median % change year-on-year +133.54% -60.44% +18.18%
75th Percentile £59.38 £25.28 £53.39
90th Percentile £65.00 £43.39 £55.38
UK median hourly rate £44.25 £20.00 £49.93
% change year-on-year +121.25% -59.94% +12.20%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 14,256 6,091 17,281
As % of all contract IT jobs advertised in England 21.41% 22.92% 22.20%
Number of daily rates quoted 10,150 4,258 12,094
10th Percentile £350 £313 £325
25th Percentile £425 £400 £400
Median daily rate (50th Percentile) £525 £500 £480
Median % change year-on-year +5.00% +4.17% +1.05%
75th Percentile £627 £600 £575
90th Percentile £719 £688 £663
UK median daily rate £525 £498 £475
% change year-on-year +5.47% +4.80% -
Number of hourly rates quoted 189 95 227
10th Percentile £16.15 £12.63 £12.30
25th Percentile £21.25 £17.48 £17.17
Median hourly rate £34.50 £26.00 £30.00
Median % change year-on-year +32.69% -13.33% -
75th Percentile £61.00 £42.00 £50.00
90th Percentile £65.51 £55.00 £63.75
UK median hourly rate £35.00 £25.00 £30.00
% change year-on-year +40.00% -16.67% +1.69%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a proportion of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Big Data in England.

Daily rate trend for Big Data in England

Big Data
Daily Rate Histogram in England

Daily rate distribution for jobs citing Big Data in England over the 6 months to 16 October 2021.

Daily rate histogram for Big Data in England

Big Data
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Big Data in England.

Hourly rate trend for Big Data in England

Big Data
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Big Data in England over the 6 months to 16 October 2021.

Hourly rate histogram for Big Data in England

Big Data
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the England region over the 6 months to 16 October 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
London +6 1,065 £600 +9.09% 274
South East -25 141 £550 +8.91% 44
North of England -77 84 £600 +9.09% 46
Midlands -43 62 £565 +47.52% 25
South West -6 51 £550 +18.92% 13
West Midlands -26 50 £550 +23.94% 14
Yorkshire -13 40 £650 - 10
North West -90 32 £600 +9.09% 30
East of England -48 26 £551 +10.25% 12
North East - 13 £565 - 6
East Midlands -41 12 £775 +104.22% 11
Big Data
UK

For the 6 months to 16 October 2021, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Big Data.

1 538 (34.98%) Agile Software Development
2 533 (34.66%) Apache Spark
3 525 (34.14%) SQL
3 525 (34.14%) Python
4 482 (31.34%) AWS
5 469 (30.49%) Azure
6 466 (30.30%) Analytics
7 444 (28.87%) Hadoop
8 420 (27.31%) DevOps
9 400 (26.01%) Finance
10 381 (24.77%) Social Skills
11 348 (22.63%) Java
12 314 (20.42%) Data Warehouse
13 297 (19.31%) Kafka
14 289 (18.79%) Data Modelling
15 282 (18.34%) ETL
16 261 (16.97%) Scala
17 256 (16.64%) Apache Hive
18 251 (16.32%) GCP
19 248 (16.12%) Business Intelligence
20 220 (14.30%) Kubernetes
21 215 (13.98%) NoSQL
22 207 (13.46%) Banking
23 201 (13.07%) Data Lake
24 200 (13.00%) Docker
25 198 (12.87%) Data Engineering
26 196 (12.74%) Data Pipeline
27 194 (12.61%) Analytical Skills
28 189 (12.29%) Data Science
29 188 (12.22%) Terraform

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 533 (34.66%) Apache Spark
2 128 (8.32%) Apache
3 76 (4.94%) Apache Airflow
4 68 (4.42%) Confluence
5 45 (2.93%) Elasticsearch
6 33 (2.15%) Luigi
7 29 (1.89%) SAS
8 13 (0.85%) Tomcat
9 12 (0.78%) Apache Pig
10 9 (0.59%) Oracle Coherence
10 9 (0.59%) SharePoint
11 7 (0.46%) nginx
12 5 (0.33%) Jupyter
12 5 (0.33%) OpenStack
12 5 (0.33%) Oracle SOA Suite
13 4 (0.26%) Oracle Workflow
14 3 (0.20%) CMS
14 3 (0.20%) Moodle
15 2 (0.13%) Apache Solr
15 2 (0.13%) WordPress
Applications
1 19 (1.24%) Microsoft Excel
2 10 (0.65%) Spreadsheet
3 5 (0.33%) Microsoft Office
3 5 (0.33%) Microsoft PowerPoint
4 2 (0.13%) Microsoft Project
4 2 (0.13%) MS Visio
5 1 (0.065%) Chatbot
5 1 (0.065%) Figma
5 1 (0.065%) Sketch
5 1 (0.065%) SPSS
Business Applications
1 4 (0.26%) SAP S/4HANA
2 3 (0.20%) SAP Oil and Gas
3 2 (0.13%) Dynamics CRM
3 2 (0.13%) Oracle EBS
3 2 (0.13%) SAP R/3
3 2 (0.13%) Workday HCM
4 1 (0.065%) Dynamics AX
4 1 (0.065%) Oracle BPM
4 1 (0.065%) Oracle Procure-to-Pay
4 1 (0.065%) Salesforce.com CRM
4 1 (0.065%) SAP ERP
4 1 (0.065%) SAP PLM
4 1 (0.065%) Sentinel
Cloud Services
1 482 (31.34%) AWS
2 469 (30.49%) Azure
3 251 (16.32%) GCP
4 140 (9.10%) Serverless
5 121 (7.87%) Power Platform
6 88 (5.72%) PaaS
7 78 (5.07%) IaaS
8 73 (4.75%) Azure Data Factory
9 63 (4.10%) Amazon EMR
10 61 (3.97%) Amazon S3
11 54 (3.51%) AWS Lambda
12 51 (3.32%) Azure Cosmos DB
13 50 (3.25%) Azure Functions
14 47 (3.06%) Azure Synapse Analytics
15 45 (2.93%) Snowflake
16 44 (2.86%) GitHub
17 30 (1.95%) Cloud Computing
18 28 (1.82%) Amazon Kinesis
19 23 (1.50%) AWS CloudFormation
20 22 (1.43%) Amazon EC2
Communications & Networking
1 21 (1.37%) Firewall
2 14 (0.91%) HTTP
3 9 (0.59%) FTP
3 9 (0.59%) SAN
4 7 (0.46%) Intrusion Detection
4 7 (0.46%) SSH
5 6 (0.39%) Kerberos
5 6 (0.39%) TCP/IP
6 5 (0.33%) Internet
7 4 (0.26%) Network Security
7 4 (0.26%) Remote Desktop
8 3 (0.20%) Intranet
9 2 (0.13%) Broadband
9 2 (0.13%) LAN
9 2 (0.13%) Multicast
9 2 (0.13%) Unified Communications
9 2 (0.13%) WAN
9 2 (0.13%) Wireless
10 1 (0.065%) Cisco ASA
10 1 (0.065%) NAS
Database & Business Intelligence
1 444 (28.87%) Hadoop
2 314 (20.42%) Data Warehouse
3 256 (16.64%) Apache Hive
4 215 (13.98%) NoSQL
5 201 (13.07%) Data Lake
6 158 (10.27%) Relational Database
7 131 (8.52%) PostgreSQL
8 116 (7.54%) Power BI
9 106 (6.89%) Metadata
10 103 (6.70%) BigQuery
11 102 (6.63%) Tableau
12 100 (6.50%) HBase
13 98 (6.37%) SQL Server
14 90 (5.85%) MongoDB
15 80 (5.20%) Apache Cassandra
16 69 (4.49%) Amazon Redshift
17 60 (3.90%) RDBMS
18 46 (2.99%) Amazon Athena
19 42 (2.73%) Impala
20 37 (2.41%) Spark SQL
Development Applications
1 151 (9.82%) Git (software)
2 147 (9.56%) Jenkins
3 117 (7.61%) JIRA
4 58 (3.77%) GitLab
5 48 (3.12%) Maven
6 41 (2.67%) PowerDesigner
7 29 (1.89%) TeamCity
8 21 (1.37%) Bitbucket
8 21 (1.37%) IntelliJ
9 20 (1.30%) Subversion
10 19 (1.24%) Hudson
10 19 (1.24%) Sonatype Nexus
11 15 (0.98%) Visual Studio Team System
12 12 (0.78%) Gradle
12 12 (0.78%) kappa
13 10 (0.65%) Artifactory
13 10 (0.65%) Cucumber
14 9 (0.59%) IBM UrbanCode
14 9 (0.59%) JUnit
15 7 (0.46%) GoCD
General
1 400 (26.01%) Finance
2 381 (24.77%) Social Skills
3 207 (13.46%) Banking
4 194 (12.61%) Analytical Skills
5 79 (5.14%) Investment Banking
6 68 (4.42%) Presentation Skills
7 56 (3.64%) Public Sector
8 41 (2.67%) Retail
9 34 (2.21%) Influencing Skills
10 28 (1.82%) Marketing
11 23 (1.50%) Telecoms
12 21 (1.37%) Front Office
12 21 (1.37%) Games
13 20 (1.30%) Financial Institution
13 20 (1.30%) Legal
14 18 (1.17%) Documentation Skills
15 10 (0.65%) Manufacturing
16 8 (0.52%) Aerospace
17 7 (0.46%) Law
18 5 (0.33%) Publishing
Job Titles
1 373 (24.25%) Data Engineer
2 316 (20.55%) Architect
3 285 (18.53%) Developer
4 180 (11.70%) Data Architect
5 129 (8.39%) Big Data Engineer
6 118 (7.67%) Solutions Architect
7 103 (6.70%) DevOps Engineer
8 67 (4.36%) Java Developer
9 66 (4.29%) Azure Architect
10 63 (4.10%) AWS Engineer
11 58 (3.77%) Analyst
12 48 (3.12%) Big Data Developer
13 46 (2.99%) Azure Engineer
14 41 (2.67%) Consultant
15 40 (2.60%) Software Engineer
16 39 (2.54%) Cloud Architect
16 39 (2.54%) Cloud Engineer
17 38 (2.47%) Senior Developer
18 35 (2.28%) Scala Developer
19 34 (2.21%) Data Scientist
Libraries, Frameworks & Software Standards
1 297 (19.31%) Kafka
2 105 (6.83%) PySpark
3 79 (5.14%) Web Services
4 55 (3.58%) Spring
5 52 (3.38%) Apache NiFi
6 47 (3.06%) JSON
7 45 (2.93%) RESTful
8 44 (2.86%) REST
9 43 (2.80%) Spark Streaming
10 40 (2.60%) .NET
11 37 (2.41%) Node.js
12 35 (2.28%) HTML
12 35 (2.28%) React
13 33 (2.15%) Apache Avro
14 31 (2.02%) XML
15 28 (1.82%) ARM Templates
15 28 (1.82%) CSS
16 27 (1.76%) Spring Boot
17 24 (1.56%) AngularJS
18 23 (1.50%) Elastic Stack
Miscellaneous
1 84 (5.46%) Data Structures
2 58 (3.77%) Data Protection Act
3 53 (3.45%) Algorithms
4 42 (2.73%) Cloud Native
5 37 (2.41%) Virtual Team
6 36 (2.34%) Data Centre
7 31 (2.02%) Hybrid Cloud
8 30 (1.95%) Public Cloud
9 28 (1.82%) Management Information System
10 21 (1.37%) Market Risk
11 19 (1.24%) iPad
11 19 (1.24%) Reference Data
12 17 (1.11%) Enterprise Software
12 17 (1.11%) Legacy Applications
12 17 (1.11%) Linux Command Line
13 14 (0.91%) Legacy Systems
14 12 (0.78%) Fixed Income
14 12 (0.78%) Greenfield Project
14 12 (0.78%) Hedge funds
14 12 (0.78%) User Experience
Operating Systems
1 183 (11.90%) Linux
2 99 (6.44%) Unix
3 24 (1.56%) Windows
4 17 (1.11%) Red Hat Enterprise Linux
5 7 (0.46%) VMS
6 5 (0.33%) AIX
7 4 (0.26%) Apple iOS
8 3 (0.20%) Android
9 2 (0.13%) Ubuntu
10 1 (0.065%) CoreOS
Processes & Methodologies
1 538 (34.98%) Agile Software Development
2 466 (30.30%) Analytics
3 420 (27.31%) DevOps
4 289 (18.79%) Data Modelling
5 282 (18.34%) ETL
6 248 (16.12%) Business Intelligence
7 198 (12.87%) Data Engineering
8 196 (12.74%) Data Pipeline
9 189 (12.29%) Data Science
10 183 (11.90%) Scrum
11 173 (11.25%) Data Architecture
12 167 (10.86%) Data Management
13 147 (9.56%) Machine Learning
14 143 (9.30%) Microservices
14 143 (9.30%) Visualisation
15 140 (9.10%) Artificial Intelligence
16 136 (8.84%) Migration
17 133 (8.65%) Data Integration
17 133 (8.65%) Software Engineering
18 130 (8.45%) Data Analytics
Programming Languages
1 525 (34.14%) Python
1 525 (34.14%) SQL
2 348 (22.63%) Java
3 261 (16.97%) Scala
4 76 (4.94%) JavaScript
5 71 (4.62%) R
6 56 (3.64%) C#
7 43 (2.80%) PL/SQL
8 42 (2.73%) Bash Shell
9 41 (2.67%) Go
10 37 (2.41%) Shell Script
11 33 (2.15%) Groovy
12 29 (1.89%) PowerShell
13 24 (1.56%) C++
14 20 (1.30%) C
14 20 (1.30%) Ruby
15 18 (1.17%) Java 8
16 16 (1.04%) Kotlin
17 15 (0.98%) TypeScript
18 14 (0.91%) T-SQL
Qualifications
1 150 (9.75%) Security Cleared
2 110 (7.15%) Degree
3 107 (6.96%) SC Cleared
4 48 (3.12%) DV Cleared
5 46 (2.99%) Computer Science Degree
6 16 (1.04%) BPSS Clearance
7 14 (0.91%) AWS Certification
8 9 (0.59%) Master's Degree
8 9 (0.59%) PMP
9 8 (0.52%) PMI Certification
9 8 (0.52%) TOGAF Certification
10 7 (0.46%) PhD
11 6 (0.39%) BC Cleared
11 6 (0.39%) OCP
11 6 (0.39%) Oracle Certification
12 5 (0.33%) Microsoft Certification
12 5 (0.33%) SAS Certification
13 4 (0.26%) CISSP
13 4 (0.26%) ISEB
13 4 (0.26%) ISTQB
Quality Assurance & Compliance
1 124 (8.06%) Data Quality
2 53 (3.45%) GDPR
3 40 (2.60%) QA
4 15 (0.98%) PMO
5 14 (0.91%) Sarbanes-Oxley
6 10 (0.65%) IFRS
7 6 (0.39%) NCSC
8 5 (0.33%) PCI DSS
8 5 (0.33%) SLA
9 4 (0.26%) MiFID
10 3 (0.20%) Accessibility
10 3 (0.20%) ISO 20022
10 3 (0.20%) ISO/IEC 27001
11 2 (0.13%) COBIT
11 2 (0.13%) IFRS 9
11 2 (0.13%) NIST
11 2 (0.13%) SOC 1
11 2 (0.13%) SOC 2
12 1 (0.065%) Dodd-Frank
12 1 (0.065%) EMIR
System Software
1 200 (13.00%) Docker
2 69 (4.49%) HDFS
3 35 (2.28%) Active Directory
4 19 (1.24%) Apache ZooKeeper
5 12 (0.78%) VMware Infrastructure
6 8 (0.52%) Apache Flume
7 7 (0.46%) Oracle RAC
8 5 (0.33%) Virtual Machines
9 2 (0.13%) VMware NSX
10 1 (0.065%) Platform Symphony
Systems Management
1 220 (14.30%) Kubernetes
2 188 (12.22%) Terraform
3 133 (8.65%) Ansible
4 25 (1.63%) Oozie
5 24 (1.56%) Hadoop YARN
6 22 (1.43%) Puppet
7 20 (1.30%) Kibana
8 19 (1.24%) Grafana
9 15 (0.98%) Prometheus
10 14 (0.91%) Single Sign-On
11 12 (0.78%) Control-M
11 12 (0.78%) Opscode Chef
12 10 (0.65%) logstash
13 9 (0.59%) Docker Swarm
13 9 (0.59%) Rancher
14 7 (0.46%) Ambari
15 6 (0.39%) Data Guard
15 6 (0.39%) Istio
15 6 (0.39%) Oracle RMAN
16 5 (0.33%) Active Directory Federation Services
Vendors
1 168 (10.92%) Databricks
1 168 (10.92%) Google
2 150 (9.75%) Oracle
3 137 (8.91%) Microsoft
4 132 (8.58%) Cloudera
5 67 (4.36%) Hortonworks
6 64 (4.16%) Informatica
7 46 (2.99%) Salesforce.com
8 41 (2.67%) SAP
9 40 (2.60%) Teradata
10 38 (2.47%) Ab Initio
11 35 (2.28%) BiZZdesign
12 28 (1.82%) IBM
13 26 (1.69%) Red Hat
14 24 (1.56%) VMware
15 18 (1.17%) MapR
16 17 (1.11%) Confluent
16 17 (1.11%) Talend
17 16 (1.04%) Splunk
18 15 (0.98%) ServiceNow