Period
to 17 October 2021

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 17 October 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
Central London > City of London
6 months to
17 Oct 2021
Same period 2020 Same period 2019
Rank 88 81 63
Rank change year-on-year -7 -18 +8
Contract jobs citing Big Data 97 39 222
As % of all contract jobs advertised in the City of London 2.54% 2.20% 3.72%
As % of the Database & Business Intelligence category 11.11% 8.35% 14.61%
Number of daily rates quoted 72 31 190
10th Percentile £450 £406 £456
25th Percentile £536 £419 £513
Median daily rate (50th Percentile) £625 £525 £550
Median % change year-on-year +19.05% -4.55% -4.35%
75th Percentile £688 £594 £625
90th Percentile £799 £675 £710
Central London median daily rate £625 £544 £550
% change year-on-year +14.94% -1.14% -4.35%
Number of hourly rates quoted 0 0 2
Median hourly rate - - £46.85
Central London median hourly rate - - £46.85

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 873 467 1,519
As % of all contract IT jobs advertised in the City of London 22.83% 26.35% 25.47%
Number of daily rates quoted 656 352 1,220
10th Percentile £381 £363 £388
25th Percentile £488 £425 £456
Median daily rate (50th Percentile) £570 £525 £525
Median % change year-on-year +8.57% - -
75th Percentile £663 £601 £612
90th Percentile £738 £675 £688
Central London median daily rate £570 £525 £525
% change year-on-year +8.57% - -
Number of hourly rates quoted 8 5 5
10th Percentile " £18.20 £21.20
25th Percentile £8.00 £20.00 £21.25
Median hourly rate £15.25 £22.00 £44.57
Median % change year-on-year -30.68% -50.63% +39.27%
75th Percentile £33.69 £38.25 £49.13
90th Percentile £43.33 £38.85 £52.95
Central London median hourly rate £15.25 £22.00 £44.57
% change year-on-year -30.68% -50.63% +39.27%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing Big Data in the City of London.

Daily rate trend for Big Data in the City of London

Big Data
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing Big Data in the City of London over the 6 months to 17 October 2021.

Daily rate histogram for Big Data in the City of London

Big Data
Contractor Hourly Rate Trend in the City of London

3-month moving average hourly rates quoted in jobs citing Big Data in the City of London.

Hourly rate trend for Big Data in the City of London

Big Data
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the City of London region over the 6 months to 17 October 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge - 2 £625 -
Big Data
Central London

For the 6 months to 17 October 2021, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Big Data.

1 46 (47.42%) Apache Spark
2 36 (37.11%) SQL
2 36 (37.11%) Python
3 35 (36.08%) Finance
4 28 (28.87%) Agile Software Development
5 27 (27.84%) DevOps
6 26 (26.80%) Java
6 26 (26.80%) Hadoop
7 25 (25.77%) AWS
8 24 (24.74%) Analytics
9 23 (23.71%) Social Skills
10 22 (22.68%) GCP
11 21 (21.65%) Scala
12 20 (20.62%) Banking
13 19 (19.59%) Apache Hive
14 18 (18.56%) Kafka
14 18 (18.56%) ETL
15 17 (17.53%) Artificial Intelligence
15 17 (17.53%) Algorithms
16 15 (15.46%) Data Science
17 14 (14.43%) SQL Server
17 14 (14.43%) NoSQL
18 13 (13.40%) Machine Learning
18 13 (13.40%) MongoDB
18 13 (13.40%) Data Engineering
19 12 (12.37%) Analytical Skills
19 12 (12.37%) Data Pipeline
19 12 (12.37%) Visualisation
19 12 (12.37%) Data Modelling
20 11 (11.34%) Business Intelligence

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 46 (47.42%) Apache Spark
2 8 (8.25%) Apache
3 3 (3.09%) Elasticsearch
3 3 (3.09%) Moodle
4 1 (1.03%) Apache Airflow
4 1 (1.03%) Apache Solr
4 1 (1.03%) Confluence
Applications
1 1 (1.03%) Microsoft Project
Cloud Services
1 25 (25.77%) AWS
2 22 (22.68%) GCP
3 10 (10.31%) Azure
4 5 (5.15%) Amazon EC2
5 4 (4.12%) Amazon EMR
5 4 (4.12%) Cloud Computing
5 4 (4.12%) IaaS
5 4 (4.12%) PaaS
6 3 (3.09%) Amazon S3
6 3 (3.09%) Datadog
6 3 (3.09%) Serverless
7 2 (2.06%) AWS CloudFormation
7 2 (2.06%) AWS Lambda
7 2 (2.06%) AWS Step Functions
7 2 (2.06%) Azure Data Factory
7 2 (2.06%) Power Platform
8 1 (1.03%) AWS CodePipeline
8 1 (1.03%) Azure Logic Apps
8 1 (1.03%) Google Data Studio
8 1 (1.03%) Snowflake
Communications & Networking
1 1 (1.03%) LAN
1 1 (1.03%) Multicast
1 1 (1.03%) SAN
1 1 (1.03%) WAN
Database & Business Intelligence
1 26 (26.80%) Hadoop
2 19 (19.59%) Apache Hive
3 14 (14.43%) NoSQL
3 14 (14.43%) SQL Server
4 13 (13.40%) MongoDB
5 10 (10.31%) BigQuery
5 10 (10.31%) Data Warehouse
6 8 (8.25%) Tableau
7 7 (7.22%) Data Lake
7 7 (7.22%) Relational Database
8 6 (6.19%) Apache Cassandra
9 4 (4.12%) Couchbase
9 4 (4.12%) Looker
9 4 (4.12%) MySQL
9 4 (4.12%) Oracle Database
9 4 (4.12%) PostgreSQL
9 4 (4.12%) RDBMS
10 3 (3.09%) Amazon Redshift
10 3 (3.09%) Flink
10 3 (3.09%) Oracle Database 12c
Development Applications
1 8 (8.25%) Jenkins
2 4 (4.12%) Git (software)
2 4 (4.12%) IBM UrbanCode
2 4 (4.12%) JIRA
2 4 (4.12%) TeamCity
3 2 (2.06%) Grunt
3 2 (2.06%) gulp
3 2 (2.06%) Jasmine
3 2 (2.06%) PhantomJS
3 2 (2.06%) webpack
4 1 (1.03%) AppScan
4 1 (1.03%) Bitbucket
4 1 (1.03%) Gatling
4 1 (1.03%) GitLab
4 1 (1.03%) Hudson
4 1 (1.03%) MLflow
4 1 (1.03%) Postman
4 1 (1.03%) Selenium
4 1 (1.03%) Subversion
4 1 (1.03%) Visual Studio Team System
General
1 35 (36.08%) Finance
2 23 (23.71%) Social Skills
3 20 (20.62%) Banking
4 12 (12.37%) Analytical Skills
5 4 (4.12%) Presentation Skills
5 4 (4.12%) Public Sector
6 3 (3.09%) Documentation Skills
7 2 (2.06%) Investment Banking
8 1 (1.03%) Advertising
8 1 (1.03%) Financial Institution
8 1 (1.03%) Legal
8 1 (1.03%) Marketing
8 1 (1.03%) Organisational Skills
Job Titles
1 30 (30.93%) Data Engineer
2 23 (23.71%) Developer
3 14 (14.43%) Architect
4 9 (9.28%) Java Developer
5 7 (7.22%) Big Data Engineer
6 6 (6.19%) Data Scientist
7 5 (5.15%) Data Architect
7 5 (5.15%) Senior Data Engineer
8 4 (4.12%) Senior Data Scientist
9 3 (3.09%) AWS Engineer
9 3 (3.09%) Big Data Developer
9 3 (3.09%) DBA
9 3 (3.09%) Moodle Developer
9 3 (3.09%) Oracle DBA
9 3 (3.09%) PHP Developer
9 3 (3.09%) Python Developer
9 3 (3.09%) Senior Developer
9 3 (3.09%) Senior Java Developer
9 3 (3.09%) UI Developer
10 2 (2.06%) Front End Developer (Client-Side Developer)
Libraries, Frameworks & Software Standards
1 18 (18.56%) Kafka
2 10 (10.31%) PySpark
3 8 (8.25%) CSS
3 8 (8.25%) HTML
4 7 (7.22%) .NET
4 7 (7.22%) Web Services
5 6 (6.19%) AngularJS
5 6 (6.19%) Spring
6 5 (5.15%) React
7 3 (3.09%) Apache Avro
7 3 (3.09%) Apache NiFi
7 3 (3.09%) JSON
7 3 (3.09%) Oracle GoldenGate
7 3 (3.09%) REST
8 2 (2.06%) .NET Framework
8 2 (2.06%) JDBC
8 2 (2.06%) JMS
8 2 (2.06%) RESTful
8 2 (2.06%) Samza
8 2 (2.06%) Sass
Miscellaneous
1 17 (17.53%) Algorithms
2 7 (7.22%) Legacy Applications
3 5 (5.15%) Market Risk
4 4 (4.12%) Data Structures
5 3 (3.09%) e-Learning
5 3 (3.09%) Greenfield Project
5 3 (3.09%) SCORM
6 2 (2.06%) Cloud Native
6 2 (2.06%) Hybrid Cloud
6 2 (2.06%) Legacy Systems
7 1 (1.03%) Credit Risk
7 1 (1.03%) Data Centre
7 1 (1.03%) Fixed Income
7 1 (1.03%) Management Information System
7 1 (1.03%) Mobile App
7 1 (1.03%) Replication
7 1 (1.03%) Robotics
7 1 (1.03%) Social Media
7 1 (1.03%) Taxonomies
7 1 (1.03%) Virtual Team
Operating Systems
1 7 (7.22%) Linux
2 4 (4.12%) Red Hat Enterprise Linux
2 4 (4.12%) Unix
3 3 (3.09%) VMS
4 1 (1.03%) Apple iOS
Processes & Methodologies
1 28 (28.87%) Agile Software Development
2 27 (27.84%) DevOps
3 24 (24.74%) Analytics
4 18 (18.56%) ETL
5 17 (17.53%) Artificial Intelligence
6 15 (15.46%) Data Science
7 13 (13.40%) Data Engineering
7 13 (13.40%) Machine Learning
8 12 (12.37%) Data Modelling
8 12 (12.37%) Data Pipeline
8 12 (12.37%) Visualisation
9 11 (11.34%) Business Intelligence
10 8 (8.25%) Computer Science
11 7 (7.22%) Data Management
11 7 (7.22%) Microservices
12 6 (6.19%) Continuous Integration
12 6 (6.19%) Log Aggregation
12 6 (6.19%) Performance Tuning
12 6 (6.19%) Problem-Solving
13 5 (5.15%) Data Architecture
Programming Languages
1 36 (37.11%) Python
1 36 (37.11%) SQL
2 26 (26.80%) Java
3 21 (21.65%) Scala
4 11 (11.34%) JavaScript
5 6 (6.19%) C
6 5 (5.15%) C++
7 4 (4.12%) PHP
8 3 (3.09%) Bash Shell
8 3 (3.09%) PL/SQL
8 3 (3.09%) R
8 3 (3.09%) Shell Script
9 2 (2.06%) C#
9 2 (2.06%) ES6
9 2 (2.06%) TypeScript
10 1 (1.03%) Perl
10 1 (1.03%) PowerShell
10 1 (1.03%) Ruby
Qualifications
1 8 (8.25%) Degree
2 4 (4.12%) Security Cleared
3 3 (3.09%) Computer Science Degree
3 3 (3.09%) OCP
3 3 (3.09%) Oracle Certification
3 3 (3.09%) SC Cleared
4 1 (1.03%) AWS Certification
4 1 (1.03%) DV Cleared
4 1 (1.03%) ISEB
4 1 (1.03%) TOGAF Certification
Quality Assurance & Compliance
1 3 (3.09%) Data Quality
1 3 (3.09%) GDPR
2 2 (2.06%) QA
3 1 (1.03%) Accessibility
3 1 (1.03%) NCSC
3 1 (1.03%) PMO
System Software
1 11 (11.34%) Docker
2 3 (3.09%) Oracle RAC
3 2 (2.06%) VMware Infrastructure
4 1 (1.03%) HDFS
Systems Management
1 6 (6.19%) Kubernetes
2 5 (5.15%) Terraform
3 3 (3.09%) Ansible
3 3 (3.09%) Data Guard
3 3 (3.09%) Oracle RMAN
4 2 (2.06%) Opscode Chef
5 1 (1.03%) Ambari
5 1 (1.03%) Grafana
5 1 (1.03%) HP Fortify
5 1 (1.03%) Kibana
5 1 (1.03%) Kubeflow
5 1 (1.03%) WebInspect
Vendors
1 11 (11.34%) Google
1 11 (11.34%) Oracle
2 9 (9.28%) Cloudera
3 8 (8.25%) Hortonworks
4 5 (5.15%) Databricks
4 5 (5.15%) Microsoft
5 4 (4.12%) IBM
5 4 (4.12%) Red Hat
6 3 (3.09%) EMC
6 3 (3.09%) Splunk
7 2 (2.06%) Ab Initio
7 2 (2.06%) AppDynamics
7 2 (2.06%) Confluent
7 2 (2.06%) SAP
7 2 (2.06%) VMware
8 1 (1.03%) Capita
8 1 (1.03%) Dell
8 1 (1.03%) HP
8 1 (1.03%) PagerDuty
8 1 (1.03%) Veracode