Period
to

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 18 May 2022 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > London
6 months to
18 May 2022
Same period 2021 Same period 2020
Rank 120 82 69
Rank change year-on-year -38 -13 -11
Contract jobs citing Big Data 860 731 682
As % of all contract jobs advertised in London 2.23% 3.06% 3.35%
As % of the Database & Business Intelligence category 10.65% 13.01% 13.74%
Number of daily rates quoted 512 480 510
10th Percentile £460 £425 £413
25th Percentile £525 £500 £488
Median daily rate (50th Percentile) £600 £575 £563
Median % change year-on-year +4.35% +2.22% +2.27%
75th Percentile £725 £675 £650
90th Percentile £808 £738 £713
England median daily rate £600 £563 £550
% change year-on-year +6.67% +2.27% -
Number of hourly rates quoted 2 3 3
10th Percentile £62.42 £36.35 £39.25
25th Percentile £67.16 £36.50 £41.50
Median hourly rate £75.70 £44.50 £46.50
Median % change year-on-year +70.11% -4.30% -6.18%
75th Percentile £83.61 £59.38 £47.88
90th Percentile £87.99 £63.65 £47.95
England median hourly rate £60.50 £41.00 £46.75
% change year-on-year +47.56% -12.30% -6.24%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 8,078 5,617 4,964
As % of all contract IT jobs advertised in London 20.94% 23.52% 24.41%
Number of daily rates quoted 5,954 3,974 3,632
10th Percentile £406 £375 £363
25th Percentile £488 £450 £425
Median daily rate (50th Percentile) £577 £525 £525
Median % change year-on-year +9.86% - -
75th Percentile £700 £638 £625
90th Percentile £775 £713 £700
England median daily rate £550 £500 £500
% change year-on-year +10.00% - +2.56%
Number of hourly rates quoted 35 36 29
10th Percentile £26.25 £11.00 £15.85
25th Percentile £32.00 £20.00 £19.99
Median hourly rate £52.50 £32.25 £25.00
Median % change year-on-year +62.78% +29.01% +2.04%
75th Percentile £72.50 £58.75 £37.50
90th Percentile £76.84 £66.50 £48.13
England median hourly rate £45.00 £24.50 £24.70
% change year-on-year +83.67% -0.81% -17.67%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a proportion of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Big Data in London.

Daily rate trend for Big Data in London

Big Data
Daily Rate Histogram in London

Daily rate distribution for jobs citing Big Data in London over the 6 months to 18 May 2022.

Daily rate histogram for Big Data in London

Big Data
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Big Data in London.

Hourly rate trend for Big Data in London

Big Data
Hourly Rate Histogram in London

Hourly rate distribution of jobs citing Big Data in London over the 6 months to 18 May 2022.

Hourly rate histogram for Big Data in London

Big Data
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the London region over the 6 months to 18 May 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London -26 105 £625 +6.84% 46
South London -13 7 £500 -0.99% 1
West London -10 6 £450 -21.53% 11
East London - 1 £750 - 3
Big Data
England

For the 6 months to 18 May 2022, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Big Data.

1 381 (44.30%) Agile
2 333 (38.72%) Apache Spark
3 332 (38.60%) AWS
4 331 (38.49%) Azure
5 325 (37.79%) Python
6 320 (37.21%) Analytics
7 266 (30.93%) SQL
8 249 (28.95%) Java
9 238 (27.67%) Finance
10 235 (27.33%) Data Modelling
11 229 (26.63%) Kafka
12 220 (25.58%) DevOps
13 214 (24.88%) Social Skills
14 212 (24.65%) Data Warehouse
15 186 (21.63%) CI/CD
16 179 (20.81%) Scala
17 178 (20.70%) Data Lake
18 168 (19.53%) ETL
19 166 (19.30%) Databricks
20 160 (18.60%) Data Engineering
21 158 (18.37%) Hadoop
22 155 (18.02%) Data Science
23 153 (17.79%) Business Intelligence
24 145 (16.86%) Machine Learning
25 137 (15.93%) Docker
26 133 (15.47%) Kubernetes
27 130 (15.12%) Data Management
28 129 (15.00%) Git (software)
29 121 (14.07%) Data Analysis
29 121 (14.07%) Banking

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 333 (38.72%) Apache Spark
2 96 (11.16%) Apache
3 49 (5.70%) Apache Airflow
4 28 (3.26%) Elasticsearch
5 16 (1.86%) Confluence
6 13 (1.51%) Apache Pig
7 10 (1.16%) Oracle Coherence
8 9 (1.05%) Apache Pulsar
8 9 (1.05%) Camunda
8 9 (1.05%) Luigi
9 5 (0.58%) Jupyter
9 5 (0.58%) Tomcat
10 3 (0.35%) SAS
10 3 (0.35%) WebLogic
11 2 (0.23%) CMS
11 2 (0.23%) JBoss
11 2 (0.23%) nginx
11 2 (0.23%) OpenStack
11 2 (0.23%) WebSphere
12 1 (0.12%) Adobe Experience Manager
Applications
1 23 (2.67%) Microsoft Excel
2 5 (0.58%) Microsoft PowerPoint
3 3 (0.35%) Microsoft Office
4 1 (0.12%) MS Visio
4 1 (0.12%) Spreadsheet
Business Applications
1 10 (1.16%) Sparx Enterprise Architect
2 7 (0.81%) Oracle Financials
3 6 (0.70%) SAP Oil and Gas
4 5 (0.58%) SAP BPC
4 5 (0.58%) SAP CO
4 5 (0.58%) SAP FI
4 5 (0.58%) SAP FI/CO
5 4 (0.47%) Oracle AML
6 3 (0.35%) Maximo
7 2 (0.23%) Avolution ABACUS
7 2 (0.23%) Salesforce.com CRM
8 1 (0.12%) Dynamics CRM
8 1 (0.12%) IBM Planning Analytics
8 1 (0.12%) SAP S/4HANA
Cloud Services
1 332 (38.60%) AWS
2 331 (38.49%) Azure
3 110 (12.79%) GCP
4 105 (12.21%) Serverless
5 65 (7.56%) Azure Data Factory
6 62 (7.21%) AWS Lambda
6 62 (7.21%) Power Platform
7 57 (6.63%) Amazon S3
8 49 (5.70%) Azure Synapse Analytics
8 49 (5.70%) GitHub
9 44 (5.12%) Snowflake
10 42 (4.88%) Amazon EMR
11 32 (3.72%) AWS CloudFormation
12 30 (3.49%) PaaS
13 23 (2.67%) Amazon EC2
13 23 (2.67%) Azure Functions
14 22 (2.56%) Amazon Kinesis
14 22 (2.56%) AWS Fargate
15 21 (2.44%) Azure Key Vault
15 21 (2.44%) Azure Monitor
Communications & Networking
1 4 (0.47%) Firewall
2 3 (0.35%) 4G
2 3 (0.35%) Cisco IPT
2 3 (0.35%) Radio Access Network
2 3 (0.35%) SSL
2 3 (0.35%) Wireless
3 2 (0.23%) 5G
3 2 (0.23%) Broadband
3 2 (0.23%) DOCSIS
3 2 (0.23%) Ethernet
3 2 (0.23%) FTP
3 2 (0.23%) Internet
3 2 (0.23%) SSH
3 2 (0.23%) Wi-Fi
4 1 (0.12%) AMQP
4 1 (0.12%) DNS
4 1 (0.12%) Kerberos
4 1 (0.12%) WebEx
Database & Business Intelligence
1 212 (24.65%) Data Warehouse
2 178 (20.70%) Data Lake
3 158 (18.37%) Hadoop
4 114 (13.26%) NoSQL
5 79 (9.19%) Relational Database
6 73 (8.49%) Apache Hive
7 63 (7.33%) Amazon Redshift
8 62 (7.21%) Metadata
8 62 (7.21%) Power BI
9 60 (6.98%) SQL Server
10 50 (5.81%) RDBMS
11 49 (5.70%) HBase
12 47 (5.47%) Tableau
13 43 (5.00%) Pentaho
14 42 (4.88%) Amazon RDS
15 40 (4.65%) Amazon Athena
15 40 (4.65%) MongoDB
16 39 (4.53%) Apache Cassandra
17 37 (4.30%) BigQuery
17 37 (4.30%) Flink
Development Applications
1 129 (15.00%) Git (software)
2 87 (10.12%) JIRA
3 75 (8.72%) Jenkins
4 51 (5.93%) GitLab
5 49 (5.70%) kappa
6 42 (4.88%) Maven
7 41 (4.77%) PowerDesigner
8 34 (3.95%) TeamCity
9 29 (3.37%) Gradle
10 25 (2.91%) ERwin
11 18 (2.09%) Sonatype Nexus
12 14 (1.63%) ER Studio
13 12 (1.40%) MLflow
14 9 (1.05%) JUnit
15 8 (0.93%) Visual Studio Team System
16 7 (0.81%) Cucumber
16 7 (0.81%) Eclipse
16 7 (0.81%) IntelliJ
17 6 (0.70%) JBehave
17 6 (0.70%) Selenium
General
1 238 (27.67%) Finance
2 214 (24.88%) Social Skills
3 121 (14.07%) Banking
4 114 (13.26%) Analytical Skills
5 40 (4.65%) Investment Banking
5 40 (4.65%) Retail
6 39 (4.53%) Presentation Skills
7 34 (3.95%) Front Office
7 34 (3.95%) Legal
8 31 (3.60%) Financial Institution
9 30 (3.49%) Public Sector
10 22 (2.56%) Marketing
11 14 (1.63%) Telecoms
12 12 (1.40%) Pharmaceutical
13 11 (1.28%) Law
14 10 (1.16%) Games
15 8 (0.93%) German Language
15 8 (0.93%) Influencing Skills
16 7 (0.81%) Publishing
17 4 (0.47%) Manufacturing
Job Titles
1 222 (25.81%) Data Engineer
2 193 (22.44%) Architect
3 152 (17.67%) Developer
4 139 (16.16%) Data Architect
5 81 (9.42%) Big Data Engineer
6 73 (8.49%) Solutions Architect
7 45 (5.23%) DevOps Engineer
8 44 (5.12%) Python Developer
9 41 (4.77%) AWS Engineer
10 40 (4.65%) Senior Developer
11 38 (4.42%) Analyst
12 35 (4.07%) Big Data Developer
12 35 (4.07%) Cloud Engineer
13 34 (3.95%) Data Modeller
14 32 (3.72%) Java Developer
15 31 (3.60%) Senior Data Engineer
16 28 (3.26%) Azure Engineer
17 23 (2.67%) Data Analyst
17 23 (2.67%) Java Engineer
18 22 (2.56%) Scala Developer
Libraries, Frameworks & Software Standards
1 229 (26.63%) Kafka
2 53 (6.16%) Pandas
3 48 (5.58%) NumPy
4 42 (4.88%) HTML
5 41 (4.77%) React
6 39 (4.53%) CSS
7 37 (4.30%) RabbitMQ
8 36 (4.19%) PySpark
9 31 (3.60%) Django
10 30 (3.49%) Celery
10 30 (3.49%) Flask
10 30 (3.49%) jQuery
11 26 (3.02%) Apache Beam
12 25 (2.91%) TensorFlow
13 24 (2.79%) .NET
14 23 (2.67%) Spring
15 21 (2.44%) JSON
15 21 (2.44%) Spark Streaming
16 20 (2.33%) Apache NiFi
17 19 (2.21%) XML
Miscellaneous
1 40 (4.65%) Management Information System
2 35 (4.07%) Virtual Team
3 32 (3.72%) Algorithms
4 29 (3.37%) Enterprise Software
5 28 (3.26%) Public Cloud
5 28 (3.26%) User Experience
6 27 (3.14%) Data Structures
7 24 (2.79%) Cloud Native
8 22 (2.56%) Hedge funds
9 20 (2.33%) Self-Motivation
10 18 (2.09%) Reference Data
11 15 (1.74%) Greenfield Project
11 15 (1.74%) Market Risk
12 12 (1.40%) Equities
13 11 (1.28%) Legacy Systems
14 10 (1.16%) Derivative
15 9 (1.05%) Credit Risk
15 9 (1.05%) Data Centre
15 9 (1.05%) Renewable Energy
16 8 (0.93%) Linux Command Line
Operating Systems
1 90 (10.47%) Linux
2 19 (2.21%) Unix
3 12 (1.40%) Windows
4 7 (0.81%) Red Hat Enterprise Linux
5 5 (0.58%) VMS
6 1 (0.12%) CentOS
6 1 (0.12%) Ubuntu
6 1 (0.12%) Windows 10
Processes & Methodologies
1 381 (44.30%) Agile
2 320 (37.21%) Analytics
3 235 (27.33%) Data Modelling
4 220 (25.58%) DevOps
5 186 (21.63%) CI/CD
6 168 (19.53%) ETL
7 160 (18.60%) Data Engineering
8 155 (18.02%) Data Science
9 153 (17.79%) Business Intelligence
10 145 (16.86%) Machine Learning
11 130 (15.12%) Data Management
12 121 (14.07%) Data Analysis
13 120 (13.95%) Migration
14 119 (13.84%) Data Pipeline
15 117 (13.60%) Data Integration
16 116 (13.49%) Data Architecture
17 112 (13.02%) Microservices
18 108 (12.56%) Scrum
19 102 (11.86%) SDLC
20 96 (11.16%) TDD
Programming Languages
1 325 (37.79%) Python
2 266 (30.93%) SQL
3 249 (28.95%) Java
4 179 (20.81%) Scala
5 49 (5.70%) JavaScript
6 48 (5.58%) R
7 44 (5.12%) C#
8 37 (4.30%) C
9 27 (3.14%) Bash
10 24 (2.79%) PowerShell
11 13 (1.51%) Shell Script
12 11 (1.28%) Go
13 10 (1.16%) C++
14 6 (0.70%) TypeScript
15 5 (0.58%) Perl
16 4 (0.47%) Data Analysis Expressions (DAX)
16 4 (0.47%) PL/SQL
16 4 (0.47%) Ruby
16 4 (0.47%) VBScript
17 3 (0.35%) T-SQL
Qualifications
1 74 (8.60%) Security Cleared
2 60 (6.98%) SC Cleared
3 42 (4.88%) Degree
4 17 (1.98%) AWS Certification
4 17 (1.98%) Computer Science Degree
5 15 (1.74%) DV Cleared
6 11 (1.28%) PhD
7 10 (1.16%) Master's Degree
8 8 (0.93%) TOGAF Certification
9 6 (0.70%) BPSS Clearance
10 4 (0.47%) CISSP
10 4 (0.47%) PMP
11 3 (0.35%) (ISC)2 CCSP
11 3 (0.35%) CASP
11 3 (0.35%) Cisco Certification
11 3 (0.35%) PMI Certification
12 1 (0.12%) CISM
12 1 (0.12%) Microsoft Certification
12 1 (0.12%) PRINCE2 Certification
12 1 (0.12%) Sun Certification
Quality Assurance & Compliance
1 69 (8.02%) Data Quality
2 39 (4.53%) QA
3 25 (2.91%) GDPR
4 11 (1.28%) Accessibility
5 10 (1.16%) SLA
6 4 (0.47%) IFRS
7 3 (0.35%) IFRS 17
7 3 (0.35%) ISO/IEC 27001
7 3 (0.35%) NIST
8 2 (0.23%) PMO
8 2 (0.23%) Sarbanes-Oxley
9 1 (0.12%) Actionable Recommendations
9 1 (0.12%) GRC
System Software
1 137 (15.93%) Docker
2 34 (3.95%) HDFS
3 5 (0.58%) Virtual Machines
4 4 (0.47%) Active Directory
5 3 (0.35%) VMware Infrastructure
6 2 (0.23%) Apache Flume
6 2 (0.23%) Platform Symphony
7 1 (0.12%) Oracle RAC
Systems Management
1 133 (15.47%) Kubernetes
2 103 (11.98%) Terraform
3 38 (4.42%) Ansible
4 12 (1.40%) Kibana
5 10 (1.16%) Kubeflow
5 10 (1.16%) logstash
6 9 (1.05%) Istio
7 6 (0.70%) Failover Clustering
8 5 (0.58%) Prometheus
9 4 (0.47%) Grafana
9 4 (0.47%) Hadoop YARN
9 4 (0.47%) Oozie
9 4 (0.47%) Opscode Chef
9 4 (0.47%) Puppet
10 2 (0.23%) Ambari
10 2 (0.23%) Docker Swarm
10 2 (0.23%) ITRS Geneos
10 2 (0.23%) Mesos
10 2 (0.23%) QRadar
10 2 (0.23%) Rancher
Vendors
1 166 (19.30%) Databricks
2 102 (11.86%) Microsoft
3 69 (8.02%) Talend
4 62 (7.21%) Oracle
5 50 (5.81%) Google
6 45 (5.23%) Cloudera
7 42 (4.88%) BiZZdesign
8 29 (3.37%) SAP
9 26 (3.02%) IBM
10 25 (2.91%) Teradata
11 24 (2.79%) Informatica
12 21 (2.44%) Alteryx
13 18 (2.09%) Hortonworks
14 14 (1.63%) AppDynamics
15 13 (1.51%) Netezza
16 12 (1.40%) MuleSoft
17 11 (1.28%) Red Hat
17 11 (1.28%) StreamSets
18 10 (1.16%) Salesforce.com
18 10 (1.16%) Sparx