Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 1 July 2022 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
UK > England
6 months to
1 Jul 2022		 Same period 2021 Same period 2020
Rank 168 102 85
Rank change year-on-year -66 -17 -11
Contract jobs citing Big Data 1,181 1,249 1,003
As % of all contract jobs advertised in England 1.64% 2.39% 2.73%
As % of the Database & Business Intelligence category 8.49% 11.19% 12.04%
Number of daily rates quoted 733 855 743
10th Percentile £453 £425 £400
25th Percentile £513 £500 £463
Median daily rate (50th Percentile) £600 £575 £550
Median % change year-on-year +4.35% +4.55% -
75th Percentile £713 £675 £663
90th Percentile £800 £750 £725
UK median daily rate £600 £575 £550
% change year-on-year +4.35% +4.55% -
Number of hourly rates quoted 2 5 4
10th Percentile £63.09 £18.05 £40.00
25th Percentile £67.73 £23.75 £43.38
Median hourly rate £75.45 £37.50 £46.75
Median % change year-on-year +101.20% -19.79% -6.37%
75th Percentile £83.18 £50.00 £51.31
90th Percentile £87.81 £51.35 £57.28
UK median hourly rate £75.45 £39.25 £46.50
% change year-on-year +92.23% -15.59% -6.87%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Contract vacancies with a requirement for database or business intelligence skills 13,915 11,157 8,329
As % of all contract IT jobs advertised in England 19.32% 21.35% 22.67%
Number of daily rates quoted 10,086 7,760 5,902
10th Percentile £375 £325 £330
25th Percentile £450 £413 £413
Median daily rate (50th Percentile) £550 £508 £500
Median % change year-on-year +8.37% +1.50% +4.17%
75th Percentile £675 £613 £600
90th Percentile £763 £700 £688
UK median daily rate £550 £500 £500
% change year-on-year +10.00% - +5.26%
Number of hourly rates quoted 168 170 110
10th Percentile £14.25 £11.49 £13.63
25th Percentile £21.25 £19.00 £18.40
Median hourly rate £39.27 £24.72 £25.00
Median % change year-on-year +58.84% -1.12% -21.88%
75th Percentile £63.15 £45.25 £45.31
90th Percentile £75.00 £64.50 £64.99
UK median hourly rate £39.27 £26.00 £25.00
% change year-on-year +51.02% +4.00% -16.67%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a proportion of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Big Data in England.

Daily rate trend for Big Data in England

Big Data
Daily Rate Histogram in England

Daily rate distribution for jobs citing Big Data in England over the 6 months to 1 July 2022.

Daily rate histogram for Big Data in England

Big Data
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Big Data in England.

Hourly rate trend for Big Data in England

Big Data
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Big Data in England over the 6 months to 1 July 2022.

Hourly rate histogram for Big Data in England

Big Data
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the England region over the 6 months to 1 July 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Jobs
London -45 848 £625 +6.84% 163
South East -14 103 £525 -4.55% 38
South West -27 63 £600 +9.09% 13
North of England -87 41 £600 +6.19% 50
Midlands -37 38 £500 -11.11% 21
West Midlands -29 33 £513 +3.54% 13
East of England -23 25 £475 -13.64% 12
North West -63 20 £613 +5.60% 22
Yorkshire -49 12 £613 +8.12% 25
North East -2 9 £600 -1.23% 3
East Midlands -13 5 £350 -51.72% 8
Big Data
UK

For the 6 months to 1 July 2022, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Big Data.

1 504 (42.68%) Python
1 504 (42.68%) Agile
2 443 (37.51%) Azure
3 437 (37.00%) Analytics
4 413 (34.97%) Apache Spark
5 385 (32.60%) SQL
6 374 (31.67%) AWS
7 336 (28.45%) Java
8 322 (27.27%) DevOps
9 299 (25.32%) Finance
10 272 (23.03%) Kafka
11 270 (22.86%) Data Warehouse
12 268 (22.69%) Data Modelling
13 237 (20.07%) Scala
13 237 (20.07%) Social Skills
14 235 (19.90%) CI/CD
15 234 (19.81%) Data Science
15 234 (19.81%) Hadoop
16 228 (19.31%) ETL
17 219 (18.54%) Databricks
18 205 (17.36%) Machine Learning
18 205 (17.36%) Data Lake
19 201 (17.02%) Business Intelligence
20 182 (15.41%) Kubernetes
21 179 (15.16%) Data Pipeline
22 178 (15.07%) Data Engineering
22 178 (15.07%) Docker
23 170 (14.39%) Microservices
24 169 (14.31%) GCP
25 163 (13.80%) Analytical Skills

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 413 (34.97%) Apache Spark
2 151 (12.79%) Apache
3 81 (6.86%) Apache Airflow
4 45 (3.81%) Confluence
5 15 (1.27%) Oracle Coherence
6 14 (1.19%) Jupyter
7 13 (1.10%) Apache Pig
8 9 (0.76%) SAS
9 8 (0.68%) Luigi
10 7 (0.59%) Apache Pulsar
10 7 (0.59%) Tomcat
11 6 (0.51%) Camunda
12 4 (0.34%) CMS
13 3 (0.25%) WebLogic
14 2 (0.17%) BizTalk Server
14 2 (0.17%) JBoss
14 2 (0.17%) nginx
14 2 (0.17%) OpenStack
14 2 (0.17%) WebSphere
15 1 (0.085%) Adobe Experience Manager
Applications
1 30 (2.54%) Microsoft Excel
2 5 (0.42%) Microsoft Office
2 5 (0.42%) Microsoft PowerPoint
3 2 (0.17%) Microsoft Project
3 2 (0.17%) Spreadsheet
4 1 (0.085%) MS Visio
Business Applications
1 10 (0.85%) Sparx Enterprise Architect
2 8 (0.68%) Oracle Financials
3 7 (0.59%) SAP Oil and Gas
4 5 (0.42%) Maximo
4 5 (0.42%) SAP BPC
4 5 (0.42%) SAP CO
4 5 (0.42%) SAP FI
4 5 (0.42%) SAP FI/CO
5 4 (0.34%) Oracle AML
6 3 (0.25%) Avolution ABACUS
7 2 (0.17%) Dynamics CRM
7 2 (0.17%) Primavera
7 2 (0.17%) SAP CRM
8 1 (0.085%) assyst
8 1 (0.085%) SAP S/4HANA
Cloud Services
1 443 (37.51%) Azure
2 374 (31.67%) AWS
3 169 (14.31%) GCP
4 110 (9.31%) Serverless
5 99 (8.38%) Power Platform
6 82 (6.94%) Azure Data Factory
7 62 (5.25%) Azure Synapse Analytics
8 54 (4.57%) GitHub
9 52 (4.40%) AWS Lambda
10 46 (3.90%) Snowflake
11 44 (3.73%) Amazon S3
12 42 (3.56%) Azure DevOps
13 40 (3.39%) Azure AKS
14 38 (3.22%) PaaS
15 32 (2.71%) Amazon EMR
16 28 (2.37%) Azure Monitor
17 24 (2.03%) Azure Functions
18 23 (1.95%) Azure Cosmos DB
18 23 (1.95%) Azure Key Vault
19 21 (1.78%) Azure Service Bus
Communications & Networking
1 15 (1.27%) Internet
2 11 (0.93%) Firewall
3 7 (0.59%) SSL
4 6 (0.51%) SSH
5 4 (0.34%) Radio Access Network
5 4 (0.34%) Software-Defined Networking
5 4 (0.34%) Wireless
6 3 (0.25%) 4G
6 3 (0.25%) FTP
6 3 (0.25%) Intrusion Detection
6 3 (0.25%) Kerberos
7 2 (0.17%) AMQP
7 2 (0.17%) Cisco IPT
7 2 (0.17%) HTTP
7 2 (0.17%) LAN
7 2 (0.17%) SAN
7 2 (0.17%) TCP/IP
7 2 (0.17%) WAN
8 1 (0.085%) Bluetooth
8 1 (0.085%) Broadband
Database & Business Intelligence
1 270 (22.86%) Data Warehouse
2 234 (19.81%) Hadoop
3 205 (17.36%) Data Lake
4 139 (11.77%) NoSQL
5 120 (10.16%) Apache Hive
6 99 (8.38%) Power BI
7 82 (6.94%) Relational Database
8 70 (5.93%) Tableau
9 68 (5.76%) SQL Server
10 66 (5.59%) HBase
11 62 (5.25%) Metadata
12 52 (4.40%) Amazon Redshift
12 52 (4.40%) BigQuery
13 49 (4.15%) Flink
14 45 (3.81%) MongoDB
15 43 (3.64%) Apache Cassandra
15 43 (3.64%) RDBMS
16 41 (3.47%) Pentaho
17 40 (3.39%) Elasticsearch
18 36 (3.05%) Delta Lake
Development Applications
1 145 (12.28%) Git (software)
2 123 (10.41%) JIRA
3 86 (7.28%) Jenkins
4 68 (5.76%) GitLab
5 54 (4.57%) Maven
6 50 (4.23%) kappa
7 43 (3.64%) PowerDesigner
8 33 (2.79%) Gradle
9 30 (2.54%) MLflow
10 29 (2.46%) TeamCity
11 27 (2.29%) Sonatype Nexus
12 23 (1.95%) ERwin
13 14 (1.19%) JUnit
14 12 (1.02%) Artifactory
14 12 (1.02%) Bitbucket
15 11 (0.93%) Cucumber
16 10 (0.85%) Mockito
17 9 (0.76%) ER Studio
17 9 (0.76%) JBehave
18 8 (0.68%) Selenium
General
1 299 (25.32%) Finance
2 237 (20.07%) Social Skills
3 163 (13.80%) Analytical Skills
4 156 (13.21%) Banking
5 63 (5.33%) Public Sector
6 53 (4.49%) Investment Banking
7 43 (3.64%) Retail
8 40 (3.39%) Front Office
9 36 (3.05%) Legal
9 36 (3.05%) Presentation Skills
10 32 (2.71%) Marketing
11 28 (2.37%) Financial Institution
12 26 (2.20%) Telecoms
13 22 (1.86%) Influencing Skills
14 17 (1.44%) Law
15 13 (1.10%) Games
16 11 (0.93%) Manufacturing
17 9 (0.76%) Publishing
18 8 (0.68%) Electronics
18 8 (0.68%) German Language
Job Titles
1 304 (25.74%) Data Engineer
2 252 (21.34%) Architect
3 219 (18.54%) Developer
4 166 (14.06%) Data Architect
5 100 (8.47%) Big Data Engineer
6 88 (7.45%) Solutions Architect
7 60 (5.08%) Java Developer
8 58 (4.91%) Python Developer
9 57 (4.83%) Software Engineer
10 56 (4.74%) Analyst
11 54 (4.57%) Big Data Developer
12 51 (4.32%) Java Engineer
13 50 (4.23%) DevOps Engineer
14 48 (4.06%) Senior Data Engineer
15 47 (3.98%) Data Scientist
15 47 (3.98%) Senior Developer
16 46 (3.90%) Azure Engineer
17 45 (3.81%) AWS Engineer
18 37 (3.13%) Cloud Engineer
19 34 (2.88%) Azure Data Engineer
Libraries, Frameworks & Software Standards
1 272 (23.03%) Kafka
2 84 (7.11%) PySpark
3 72 (6.10%) Pandas
4 71 (6.01%) NumPy
5 50 (4.23%) React
6 49 (4.15%) HTML
7 43 (3.64%) CSS
8 42 (3.56%) Apache Beam
8 42 (3.56%) Apache NiFi
9 40 (3.39%) RabbitMQ
10 37 (3.13%) Spring
11 35 (2.96%) Flask
12 33 (2.79%) Django
13 32 (2.71%) jQuery
13 32 (2.71%) TensorFlow
14 31 (2.62%) Celery
15 30 (2.54%) REST
16 28 (2.37%) Spark Streaming
17 25 (2.12%) .NET
18 24 (2.03%) scikit-learn
Miscellaneous
1 69 (5.84%) Data Structures
2 68 (5.76%) Algorithms
3 48 (4.06%) Management Information System
4 39 (3.30%) Virtual Team
5 33 (2.79%) Cloud Native
6 32 (2.71%) Enterprise Software
7 31 (2.62%) Self-Motivation
8 30 (2.54%) Public Cloud
9 27 (2.29%) User Experience
10 24 (2.03%) Hedge funds
11 22 (1.86%) Reference Data
12 21 (1.78%) Legacy Systems
13 20 (1.69%) Equities
14 19 (1.61%) Market Risk
15 18 (1.52%) Linux Command Line
16 15 (1.27%) Data Protection Act
16 15 (1.27%) IoT
17 14 (1.19%) Replication
18 13 (1.10%) Derivative
19 12 (1.02%) Data Centre
Operating Systems
1 151 (12.79%) Linux
2 37 (3.13%) Unix
3 19 (1.61%) Windows
4 8 (0.68%) Red Hat Enterprise Linux
5 6 (0.51%) VMS
6 3 (0.25%) Ubuntu
7 2 (0.17%) CentOS
8 1 (0.085%) Android
8 1 (0.085%) Apple iOS
8 1 (0.085%) VxWorks
Processes & Methodologies
1 504 (42.68%) Agile
2 437 (37.00%) Analytics
3 322 (27.27%) DevOps
4 268 (22.69%) Data Modelling
5 235 (19.90%) CI/CD
6 234 (19.81%) Data Science
7 228 (19.31%) ETL
8 205 (17.36%) Machine Learning
9 201 (17.02%) Business Intelligence
10 179 (15.16%) Data Pipeline
11 178 (15.07%) Data Engineering
12 170 (14.39%) Microservices
13 151 (12.79%) Data Architecture
13 151 (12.79%) Software Engineering
14 150 (12.70%) Data Management
15 141 (11.94%) Migration
16 132 (11.18%) Scrum
17 122 (10.33%) Test Automation
18 120 (10.16%) Data Analysis
19 118 (9.99%) Visualisation
Programming Languages
1 504 (42.68%) Python
2 385 (32.60%) SQL
3 336 (28.45%) Java
4 237 (20.07%) Scala
5 62 (5.25%) JavaScript
5 62 (5.25%) R
6 44 (3.73%) C
7 39 (3.30%) C#
8 31 (2.62%) Bash
9 28 (2.37%) PowerShell
10 19 (1.61%) C++
11 18 (1.52%) Shell Script
12 13 (1.10%) T-SQL
13 10 (0.85%) Perl
13 10 (0.85%) PL/SQL
14 8 (0.68%) Ruby
15 7 (0.59%) Go
15 7 (0.59%) TypeScript
16 6 (0.51%) SPARQL
17 5 (0.42%) Data Analysis Expressions (DAX)
Qualifications
1 157 (13.29%) Security Cleared
2 119 (10.08%) SC Cleared
3 91 (7.71%) Degree
4 82 (6.94%) DV Cleared
5 29 (2.46%) PhD
6 22 (1.86%) Computer Science Degree
7 15 (1.27%) AWS Certification
7 15 (1.27%) Master's Degree
7 15 (1.27%) TOGAF Certification
8 11 (0.93%) Microsoft Certification
9 9 (0.76%) CISSP
9 9 (0.76%) PMI Certification
9 9 (0.76%) PMP
10 8 (0.68%) ISTQB
11 5 (0.42%) Cisco Certification
12 4 (0.34%) BPSS Clearance
13 3 (0.25%) CASP
13 3 (0.25%) CREST Certified
13 3 (0.25%) GIAC
13 3 (0.25%) SANS
Quality Assurance & Compliance
1 77 (6.52%) Data Quality
2 57 (4.83%) QA
3 33 (2.79%) GDPR
4 10 (0.85%) Accessibility
5 8 (0.68%) SLA
6 4 (0.34%) IFRS
7 3 (0.25%) IFRS 17
7 3 (0.25%) ISO/IEC 27001
7 3 (0.25%) NIST
8 2 (0.17%) COBIT
8 2 (0.17%) PMO
8 2 (0.17%) Sarbanes-Oxley
9 1 (0.085%) GRC
System Software
1 178 (15.07%) Docker
2 58 (4.91%) HDFS
3 7 (0.59%) Apache Flume
4 6 (0.51%) Virtual Machines
5 5 (0.42%) VMware Infrastructure
6 4 (0.34%) VMware ESXi
6 4 (0.34%) vSphere
7 3 (0.25%) Apache ZooKeeper
7 3 (0.25%) Platform Symphony
8 2 (0.17%) Active Directory
8 2 (0.17%) EMC RecoverPoint
9 1 (0.085%) Firmware
9 1 (0.085%) KVM
9 1 (0.085%) Oracle RAC
Systems Management
1 182 (15.41%) Kubernetes
2 117 (9.91%) Terraform
3 63 (5.33%) Ansible
4 18 (1.52%) Kubeflow
4 18 (1.52%) Puppet
5 16 (1.35%) Grafana
6 15 (1.27%) Istio
6 15 (1.27%) Kibana
7 14 (1.19%) Hadoop YARN
8 11 (0.93%) logstash
8 11 (0.93%) Packer
8 11 (0.93%) Prometheus
9 9 (0.76%) Opscode Chef
10 7 (0.59%) Docker Swarm
10 7 (0.59%) Oozie
10 7 (0.59%) Rancher
11 6 (0.51%) Failover Clustering
12 5 (0.42%) ITRS Geneos
12 5 (0.42%) Mesos
13 4 (0.34%) vRealize
Vendors
1 219 (18.54%) Databricks
2 125 (10.58%) Microsoft
3 92 (7.79%) Oracle
4 73 (6.18%) Google
5 56 (4.74%) Talend
6 50 (4.23%) Cloudera
7 45 (3.81%) BiZZdesign
8 43 (3.64%) SAP
9 33 (2.79%) IBM
10 28 (2.37%) Informatica
11 26 (2.20%) AppDynamics
12 23 (1.95%) Teradata
13 21 (1.78%) Alteryx
14 20 (1.69%) VMware
15 16 (1.35%) Adobe
15 16 (1.35%) Hortonworks
15 16 (1.35%) Netezza
16 15 (1.27%) Splunk
17 11 (0.93%) Dynatrace
17 11 (0.93%) MuleSoft