Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 23 January 2022

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 23 January 2022 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK > England
6 months to
23 Jan 2022		 Same period 2021 Same period 2020
Rank 125 107 99
Rank change year-on-year -18 -8 -8
Contract jobs citing Big Data 1,415 787 1,626
As % of all contract jobs advertised in England 2.06% 2.30% 2.47%
As % of the Database & Business Intelligence category 9.82% 10.65% 11.41%
Number of daily rates quoted 940 554 1,132
10th Percentile £431 £374 £400
25th Percentile £513 £450 £468
Median daily rate (50th Percentile) £600 £550 £550
Median % change year-on-year +9.09% - -
75th Percentile £700 £615 £650
90th Percentile £788 £688 £725
UK median daily rate £600 £538 £550
% change year-on-year +11.63% -2.27% -
Number of hourly rates quoted 6 5 0
10th Percentile £40.12 £18.05 -
25th Percentile £54.19 £21.50 -
Median hourly rate £62.75 £23.75 -
Median % change year-on-year +164.27% - -
75th Percentile £65.00 £55.00 -
90th Percentile £67.50 £61.90 -
UK median hourly rate £65.00 £23.37 -
% change year-on-year +178.10% - -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 14,411 7,393 14,253
As % of all contract IT jobs advertised in England 21.01% 21.62% 21.63%
Number of daily rates quoted 10,444 5,163 9,832
10th Percentile £363 £310 £320
25th Percentile £431 £391 £400
Median daily rate (50th Percentile) £540 £488 £475
Median % change year-on-year +10.77% +2.63% -
75th Percentile £650 £588 £575
90th Percentile £738 £675 £670
UK median daily rate £525 £485 £475
% change year-on-year +8.25% +2.11% -
Number of hourly rates quoted 178 138 197
10th Percentile £17.52 £13.46 £12.75
25th Percentile £24.50 £19.06 £17.83
Median hourly rate £43.85 £26.00 £26.50
Median % change year-on-year +68.65% -1.89% -8.32%
75th Percentile £62.11 £50.35 £43.75
90th Percentile £73.25 £62.01 £56.30
UK median hourly rate £43.95 £26.96 £26.00
% change year-on-year +63.02% +3.69% -2.44%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a proportion of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Big Data in England.

Daily rate trend for Big Data in England

Big Data
Daily Rate Histogram in England

Daily rate distribution for jobs citing Big Data in England over the 6 months to 23 January 2022.

Daily rate histogram for Big Data in England

Big Data
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Big Data in England.

Hourly rate trend for Big Data in England

Big Data
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Big Data in England over the 6 months to 23 January 2022.

Hourly rate histogram for Big Data in England

Big Data
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the England region over the 6 months to 23 January 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Jobs
London -1 1,014 £615 +11.82% 240
South East +1 134 £573 +14.50% 46
North of England -65 72 £580 +5.45% 71
Yorkshire -6 50 £600 +8.60% 19
Midlands -49 37 £575 +48.39% 28
South West -66 35 £600 +26.32% 23
West Midlands -38 29 £575 +15.00% 20
East of England -56 25 £550 +7.32% 30
North West -97 17 £575 +6.98% 40
East Midlands -44 7 £550 +44.93% 8
North East -1 5 £585 -16.43% 12
Big Data
UK

For the 6 months to 23 January 2022, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Big Data.

1 529 (37.39%) Apache Spark
2 515 (36.40%) Agile Software Development
3 510 (36.04%) Analytics
4 461 (32.58%) Python
5 457 (32.30%) Azure
6 445 (31.45%) SQL
7 443 (31.31%) AWS
8 386 (27.28%) Hadoop
9 359 (25.37%) Finance
10 357 (25.23%) Social Skills
11 346 (24.45%) DevOps
12 334 (23.60%) Data Warehouse
13 322 (22.76%) Data Modelling
14 313 (22.12%) ETL
15 311 (21.98%) Kafka
16 305 (21.55%) Java
17 263 (18.59%) Business Intelligence
18 249 (17.60%) CI/CD
19 230 (16.25%) Data Lake
20 210 (14.84%) Scala
20 210 (14.84%) Data Engineering
21 205 (14.49%) Apache Hive
22 203 (14.35%) Data Science
23 201 (14.20%) Banking
24 196 (13.85%) GCP
25 192 (13.57%) NoSQL
26 189 (13.36%) Data Management
27 187 (13.22%) Databricks
28 183 (12.93%) Scrum
29 179 (12.65%) Kubernetes

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 529 (37.39%) Apache Spark
2 112 (7.92%) Apache
3 66 (4.66%) Confluence
4 57 (4.03%) Apache Airflow
5 47 (3.32%) Elasticsearch
6 18 (1.27%) Luigi
7 17 (1.20%) SAS
8 11 (0.78%) Camunda
9 10 (0.71%) nginx
10 9 (0.64%) Jupyter
10 9 (0.64%) Tomcat
11 7 (0.49%) Apache Pulsar
11 7 (0.49%) OpenStack
12 5 (0.35%) Apache Pig
12 5 (0.35%) SharePoint
13 3 (0.21%) Moodle
13 3 (0.21%) Oracle SOA Suite
14 2 (0.14%) Adobe Experience Manager
14 2 (0.14%) IIS
14 2 (0.14%) Oracle Coherence
Applications
1 33 (2.33%) Microsoft Excel
2 8 (0.57%) Microsoft PowerPoint
3 7 (0.49%) Spreadsheet
4 5 (0.35%) MS Visio
5 2 (0.14%) Chatbot
5 2 (0.14%) Microsoft Office
6 1 (0.071%) Microsoft Project
6 1 (0.071%) Sketch
Business Applications
1 6 (0.42%) Oracle EBS
2 5 (0.35%) SAP Oil and Gas
2 5 (0.35%) SAP S/4HANA
3 2 (0.14%) Salesforce.com CRM
3 2 (0.14%) Workday HCM
4 1 (0.071%) Adobe Campaign
4 1 (0.071%) Dynamics CRM
4 1 (0.071%) IBM Planning Analytics
4 1 (0.071%) Oracle BPM
4 1 (0.071%) SAP PLM
4 1 (0.071%) SAP R/3
Cloud Services
1 457 (32.30%) Azure
2 443 (31.31%) AWS
3 196 (13.85%) GCP
4 137 (9.68%) Serverless
5 133 (9.40%) Power Platform
6 91 (6.43%) Azure Data Factory
7 84 (5.94%) Amazon EMR
8 83 (5.87%) Amazon S3
9 74 (5.23%) AWS Lambda
10 70 (4.95%) Azure Synapse Analytics
11 68 (4.81%) Snowflake
12 61 (4.31%) GitHub
13 45 (3.18%) AWS CloudFormation
14 44 (3.11%) Azure Cosmos DB
15 42 (2.97%) PaaS
16 38 (2.69%) Amazon Kinesis
17 34 (2.40%) Azure Functions
18 31 (2.19%) Cloud Computing
19 24 (1.70%) AWS Fargate
20 23 (1.63%) Amazon ECS
Communications & Networking
1 14 (0.99%) Firewall
2 10 (0.71%) Kerberos
3 7 (0.49%) HTTP
4 6 (0.42%) Cisco IPT
5 5 (0.35%) Broadband
5 5 (0.35%) Ethernet
5 5 (0.35%) Radio Access Network
6 4 (0.28%) Multicast
6 4 (0.28%) Network Security
6 4 (0.28%) SAN
6 4 (0.28%) SSH
7 3 (0.21%) 5G
7 3 (0.21%) DOCSIS
7 3 (0.21%) FTP
7 3 (0.21%) Intrusion Detection
7 3 (0.21%) Remote Desktop
7 3 (0.21%) VPN
7 3 (0.21%) Wi-Fi
8 2 (0.14%) EIGRP
8 2 (0.14%) SNMP
Database & Business Intelligence
1 386 (27.28%) Hadoop
2 334 (23.60%) Data Warehouse
3 230 (16.25%) Data Lake
4 205 (14.49%) Apache Hive
5 192 (13.57%) NoSQL
6 134 (9.47%) Tableau
7 133 (9.40%) Power BI
8 109 (7.70%) Relational Database
9 107 (7.56%) Amazon Redshift
10 100 (7.07%) HBase
11 96 (6.78%) Metadata
12 92 (6.50%) SQL Server
13 88 (6.22%) MongoDB
14 72 (5.09%) Apache Cassandra
15 71 (5.02%) BigQuery
16 68 (4.81%) PostgreSQL
17 67 (4.73%) RDBMS
18 57 (4.03%) Amazon Athena
19 55 (3.89%) Amazon RDS
20 41 (2.90%) Pentaho
Development Applications
1 157 (11.10%) Git (software)
2 142 (10.04%) Jenkins
3 110 (7.77%) JIRA
4 57 (4.03%) GitLab
5 52 (3.67%) PowerDesigner
6 44 (3.11%) Maven
7 37 (2.61%) TeamCity
8 25 (1.77%) kappa
9 20 (1.41%) Gradle
10 19 (1.34%) ERwin
11 17 (1.20%) Subversion
12 15 (1.06%) Atlassian Bamboo
12 15 (1.06%) Hudson
13 14 (0.99%) ER Studio
14 12 (0.85%) RStudio
15 11 (0.78%) JUnit
15 11 (0.78%) SonarQube
15 11 (0.78%) Sonatype Nexus
16 9 (0.64%) IntelliJ
17 8 (0.57%) Visual Studio Team System
General
1 359 (25.37%) Finance
2 357 (25.23%) Social Skills
3 201 (14.20%) Banking
4 171 (12.08%) Analytical Skills
5 87 (6.15%) Investment Banking
6 69 (4.88%) Presentation Skills
7 61 (4.31%) Public Sector
8 59 (4.17%) Retail
9 53 (3.75%) Legal
10 48 (3.39%) Financial Institution
11 45 (3.18%) Marketing
12 34 (2.40%) Influencing Skills
13 23 (1.63%) Front Office
13 23 (1.63%) Telecoms
14 18 (1.27%) Games
15 17 (1.20%) Documentation Skills
16 16 (1.13%) Pharmaceutical
17 12 (0.85%) Manufacturing
18 11 (0.78%) Law
19 8 (0.57%) Publishing
Job Titles
1 339 (23.96%) Data Engineer
2 309 (21.84%) Architect
3 265 (18.73%) Developer
4 176 (12.44%) Data Architect
5 122 (8.62%) Solutions Architect
6 105 (7.42%) Big Data Engineer
7 78 (5.51%) DevOps Engineer
8 77 (5.44%) Analyst
9 68 (4.81%) Java Developer
10 54 (3.82%) Azure Architect
11 53 (3.75%) Big Data Developer
12 52 (3.67%) Cloud Engineer
13 48 (3.39%) Azure Engineer
14 44 (3.11%) Data Manager
15 42 (2.97%) Senior Developer
16 40 (2.83%) AWS Engineer
17 39 (2.76%) Senior Data Engineer
18 37 (2.61%) Data Analyst
19 34 (2.40%) Data Modeller
20 33 (2.33%) Lead Architect
Libraries, Frameworks & Software Standards
1 311 (21.98%) Kafka
2 86 (6.08%) PySpark
3 53 (3.75%) Spark Streaming
4 42 (2.97%) .NET
5 41 (2.90%) REST
6 39 (2.76%) JSON
7 37 (2.61%) Apache NiFi
8 36 (2.54%) RESTful
9 35 (2.47%) XML
10 33 (2.33%) Spring
11 30 (2.12%) Elastic Stack
12 29 (2.05%) React
12 29 (2.05%) Web Services
13 28 (1.98%) TensorFlow
14 27 (1.91%) Apache Avro
15 23 (1.63%) Pandas
16 21 (1.48%) HTML
16 21 (1.48%) Keras
17 20 (1.41%) Node.js
18 17 (1.20%) NumPy
Miscellaneous
1 59 (4.17%) Data Structures
2 49 (3.46%) Cloud Native
3 47 (3.32%) Algorithms
4 42 (2.97%) Data Protection Act
5 35 (2.47%) Hedge funds
6 33 (2.33%) Public Cloud
7 32 (2.26%) Enterprise Software
8 30 (2.12%) User Experience
9 29 (2.05%) Self-Motivation
9 29 (2.05%) Virtual Team
10 22 (1.55%) Greenfield Project
11 20 (1.41%) Management Information System
12 18 (1.27%) Reference Data
13 17 (1.20%) Hybrid Cloud
14 16 (1.13%) Data Centre
15 13 (0.92%) iPad
16 10 (0.71%) Foreign Exchange (FX)
17 9 (0.64%) Legacy Applications
17 9 (0.64%) NHS
18 7 (0.49%) Legacy Systems
Operating Systems
1 140 (9.89%) Linux
2 51 (3.60%) Unix
3 25 (1.77%) Windows
4 15 (1.06%) Red Hat Enterprise Linux
5 4 (0.28%) VMS
6 2 (0.14%) Apple iOS
6 2 (0.14%) Windows Server
7 1 (0.071%) Android
7 1 (0.071%) CentOS
7 1 (0.071%) Windows 10
Processes & Methodologies
1 515 (36.40%) Agile Software Development
2 510 (36.04%) Analytics
3 346 (24.45%) DevOps
4 322 (22.76%) Data Modelling
5 313 (22.12%) ETL
6 263 (18.59%) Business Intelligence
7 249 (17.60%) CI/CD
8 210 (14.84%) Data Engineering
9 203 (14.35%) Data Science
10 189 (13.36%) Data Management
11 183 (12.93%) Scrum
12 172 (12.16%) Machine Learning
13 169 (11.94%) Data Pipeline
14 164 (11.59%) Data Analytics
15 154 (10.88%) Data Architecture
16 151 (10.67%) Visualisation
17 146 (10.32%) Data Integration
18 135 (9.54%) Stakeholder Management
19 134 (9.47%) Microservices
20 130 (9.19%) Data Analysis
Programming Languages
1 461 (32.58%) Python
2 445 (31.45%) SQL
3 305 (21.55%) Java
4 210 (14.84%) Scala
5 76 (5.37%) R
6 59 (4.17%) C#
7 58 (4.10%) JavaScript
8 51 (3.60%) Bash
9 46 (3.25%) PowerShell
10 36 (2.54%) Shell Script
11 28 (1.98%) PL/SQL
12 25 (1.77%) Go
13 18 (1.27%) C++
14 16 (1.13%) T-SQL
15 15 (1.06%) C
16 10 (0.71%) Groovy
17 9 (0.64%) Java 8
17 9 (0.64%) TypeScript
18 8 (0.57%) MATLAB
19 7 (0.49%) Perl
Qualifications
1 148 (10.46%) Security Cleared
2 113 (7.99%) SC Cleared
3 79 (5.58%) Degree
4 42 (2.97%) DV Cleared
5 36 (2.54%) Computer Science Degree
6 26 (1.84%) AWS Certification
7 18 (1.27%) BPSS Clearance
8 12 (0.85%) PMP
9 11 (0.78%) PMI Certification
10 10 (0.71%) Master's Degree
11 9 (0.64%) CISSP
11 9 (0.64%) ISTQB
12 7 (0.49%) Microsoft Certification
13 6 (0.42%) (ISC)2 CCSP
13 6 (0.42%) Cisco Certification
13 6 (0.42%) ISEB
13 6 (0.42%) PhD
14 5 (0.35%) ISTQB Foundation Certification
14 5 (0.35%) TOGAF Certification
15 3 (0.21%) Numerate Degree
Quality Assurance & Compliance
1 138 (9.75%) Data Quality
2 56 (3.96%) GDPR
3 34 (2.40%) QA
4 14 (0.99%) Accessibility
4 14 (0.99%) PMO
5 11 (0.78%) SLA
6 8 (0.57%) Sarbanes-Oxley
7 7 (0.49%) IFRS
7 7 (0.49%) NCSC
8 3 (0.21%) ISO 20022
8 3 (0.21%) PCI DSS
9 2 (0.14%) Actionable Recommendations
9 2 (0.14%) IFRS 9
10 1 (0.071%) COREP
10 1 (0.071%) FINREP
10 1 (0.071%) MiFID
System Software
1 166 (11.73%) Docker
2 60 (4.24%) HDFS
3 20 (1.41%) Active Directory
4 13 (0.92%) Apache Flume
5 7 (0.49%) Virtual Machines
6 6 (0.42%) Apache ZooKeeper
7 4 (0.28%) Oracle RAC
7 4 (0.28%) VMware Infrastructure
8 3 (0.21%) Active Directory Lightweight Directory Services
8 3 (0.21%) VMware NSX
9 2 (0.14%) NFS
10 1 (0.071%) VMware ESXi
10 1 (0.071%) vSphere
Systems Management
1 179 (12.65%) Kubernetes
2 148 (10.46%) Terraform
3 103 (7.28%) Ansible
4 29 (2.05%) Kibana
5 18 (1.27%) Grafana
5 18 (1.27%) Prometheus
6 17 (1.20%) Hadoop YARN
7 14 (0.99%) logstash
8 12 (0.85%) Oozie
9 11 (0.78%) Opscode Chef
9 11 (0.78%) Puppet
10 6 (0.42%) Istio
11 5 (0.35%) HP ALM
11 5 (0.35%) Single Sign-On
12 4 (0.28%) Control-M
12 4 (0.28%) Rancher
13 3 (0.21%) Consul
13 3 (0.21%) Data Guard
13 3 (0.21%) Docker Swarm
13 3 (0.21%) Oracle RMAN
Vendors
1 187 (13.22%) Databricks
2 149 (10.53%) Microsoft
3 112 (7.92%) Cloudera
4 103 (7.28%) Google
5 97 (6.86%) Oracle
6 72 (5.09%) Hortonworks
7 61 (4.31%) Talend
8 52 (3.67%) Informatica
9 47 (3.32%) BiZZdesign
10 41 (2.90%) Salesforce.com
11 40 (2.83%) SAP
11 40 (2.83%) Teradata
12 35 (2.47%) Ab Initio
13 34 (2.40%) Red Hat
14 27 (1.91%) IBM
15 24 (1.70%) StreamSets
16 21 (1.48%) Alteryx
16 21 (1.48%) MapR
17 17 (1.20%) MuleSoft
18 12 (0.85%) Pega