Period
to

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 15 August 2022 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
Central London > City of London
6 months to
15 Aug 2022
Same period 2021 Same period 2020
Rank 98 91 68
Rank change year-on-year -7 -23 -21
Contract jobs citing Big Data 101 88 66
As % of all contract jobs advertised in the City of London 2.25% 2.53% 3.10%
As % of the Database & Business Intelligence category 10.67% 11.72% 11.98%
Number of daily rates quoted 59 60 50
10th Percentile £461 £419 £424
25th Percentile £513 £521 £475
Median daily rate (50th Percentile) £575 £609 £544
Median % change year-on-year -5.54% +11.95% -1.14%
75th Percentile £713 £675 £600
90th Percentile £778 £725 £714
Central London median daily rate £575 £613 £550
% change year-on-year -6.12% +11.36% -
Number of hourly rates quoted 0 0 1
10th Percentile - - -
25th Percentile - - £45.25
Median hourly rate - - £46.50
75th Percentile - - £47.75
90th Percentile - - -
Central London median hourly rate - - £46.50
% change year-on-year - - -0.74%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Contract vacancies with a requirement for database or business intelligence skills 947 751 551
As % of all contract IT jobs advertised in the City of London 21.14% 21.62% 25.89%
Number of daily rates quoted 665 528 408
10th Percentile £444 £406 £390
25th Percentile £513 £463 £450
Median daily rate (50th Percentile) £588 £550 £525
Median % change year-on-year +6.82% +4.76% -
75th Percentile £713 £650 £603
90th Percentile £790 £719 £688
Central London median daily rate £583 £550 £525
% change year-on-year +5.95% +4.76% -
Number of hourly rates quoted 8 7 6
10th Percentile £47.03 - £18.50
25th Percentile £52.50 - £20.50
Median hourly rate £56.50 £8.00 £29.75
Median % change year-on-year +606.25% -73.11% -15.00%
75th Percentile £62.75 £24.46 £39.00
90th Percentile £74.04 £28.31 £43.50
Central London median hourly rate £56.50 £14.00 £29.75
% change year-on-year +303.57% -52.94% -15.00%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing Big Data in the City of London.

Daily rate trend for Big Data in the City of London

Big Data
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing Big Data in the City of London over the 6 months to 15 August 2022.

Daily rate histogram for Big Data in the City of London

Big Data
Contractor Hourly Rate Trend in the City of London

3-month moving average hourly rates quoted in jobs citing Big Data in the City of London.

Hourly rate trend for Big Data in the City of London

For the 6 months to 15 August 2022, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Big Data.

1 53 (52.48%) Python
2 48 (47.52%) DevOps
3 47 (46.53%) SQL
4 46 (45.54%) Finance
5 40 (39.60%) Azure
6 38 (37.62%) Analytics
6 38 (37.62%) Agile
7 34 (33.66%) AWS
8 32 (31.68%) Java
9 28 (27.72%) Apache Spark
10 27 (26.73%) CI/CD
10 27 (26.73%) Data Modelling
11 26 (25.74%) Financial Institution
11 26 (25.74%) Legal
11 26 (25.74%) Hedge funds
11 26 (25.74%) Data Protection
11 26 (25.74%) GDPR
12 22 (21.78%) Business Intelligence
13 21 (20.79%) JIRA
13 21 (20.79%) Scala
14 20 (19.80%) Hadoop
14 20 (19.80%) Microservices
15 19 (18.81%) Kafka
15 19 (18.81%) AOP
16 18 (17.82%) TOGAF
16 18 (17.82%) PowerDesigner
16 18 (17.82%) Power Platform
16 18 (17.82%) Power BI
16 18 (17.82%) BiZZdesign
17 17 (16.83%) Data Science

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 28 (27.72%) Apache Spark
2 5 (4.95%) Apache Airflow
3 4 (3.96%) Apache Pig
3 4 (3.96%) Oracle Coherence
3 4 (3.96%) Tomcat
4 3 (2.97%) WebLogic
5 2 (1.98%) Apache
5 2 (1.98%) Luigi
6 1 (0.99%) CMS
6 1 (0.99%) Confluence
6 1 (0.99%) JBoss
6 1 (0.99%) OpenStack
6 1 (0.99%) SAS
6 1 (0.99%) Sitecore CMS
6 1 (0.99%) WebSphere
Applications
1 5 (4.95%) Microsoft Excel
2 1 (0.99%) Microsoft Office
Business Applications
1 5 (4.95%) SAP BPC
1 5 (4.95%) SAP CO
1 5 (4.95%) SAP FI
1 5 (4.95%) SAP FI/CO
2 1 (0.99%) Dynamics CRM
2 1 (0.99%) SAP Oil and Gas
2 1 (0.99%) SAP S/4HANA
2 1 (0.99%) Sparx Enterprise Architect
Cloud Services
1 40 (39.60%) Azure
2 34 (33.66%) AWS
3 18 (17.82%) Power Platform
4 14 (13.86%) Serverless
5 13 (12.87%) PaaS
6 11 (10.89%) GCP
7 8 (7.92%) Azure Synapse Analytics
8 7 (6.93%) Snowflake
9 6 (5.94%) Amazon EC2
9 6 (5.94%) AWS Lambda
9 6 (5.94%) Azure Cosmos DB
10 5 (4.95%) Amazon EMR
10 5 (4.95%) AWS CloudFormation
10 5 (4.95%) SaaS
11 4 (3.96%) Azure Data Factory
11 4 (3.96%) Azure DevOps
11 4 (3.96%) Azure Functions
11 4 (3.96%) Azure Logic Apps
11 4 (3.96%) Azure Service Bus
11 4 (3.96%) IBM Cloud
Communications & Networking
1 2 (1.98%) Internet
1 2 (1.98%) SSL
2 1 (0.99%) Firewall
2 1 (0.99%) WebEx
Database & Business Intelligence
1 20 (19.80%) Hadoop
2 18 (17.82%) Power BI
3 17 (16.83%) Data Warehouse
3 17 (16.83%) NoSQL
4 16 (15.84%) Data Lake
5 12 (11.88%) Apache Hive
6 11 (10.89%) Relational Database
6 11 (10.89%) SQL Server
7 8 (7.92%) Apache Cassandra
8 7 (6.93%) HBase
8 7 (6.93%) MongoDB
8 7 (6.93%) Spotfire
9 6 (5.94%) RDBMS
10 5 (4.95%) Amazon Athena
10 5 (4.95%) Amazon Redshift
10 5 (4.95%) Data Mart
10 5 (4.95%) Impala
10 5 (4.95%) MySQL
11 4 (3.96%) Oracle Database
11 4 (3.96%) Spark SQL
Development Applications
1 21 (20.79%) JIRA
2 18 (17.82%) PowerDesigner
3 12 (11.88%) Git (software)
4 8 (7.92%) TeamCity
5 7 (6.93%) Jenkins
6 6 (5.94%) kappa
7 4 (3.96%) Artifactory
7 4 (3.96%) Bitbucket
7 4 (3.96%) Eclipse
7 4 (3.96%) IntelliJ
7 4 (3.96%) JBehave
7 4 (3.96%) Maven
8 3 (2.97%) git-flow
8 3 (2.97%) HP UFT
8 3 (2.97%) Rational Robot
8 3 (2.97%) RIATest
8 3 (2.97%) SilkTest
8 3 (2.97%) WinRunner
9 2 (1.98%) GitLab
10 1 (0.99%) ER Studio
General
1 46 (45.54%) Finance
2 26 (25.74%) Financial Institution
2 26 (25.74%) Legal
3 16 (15.84%) Social Skills
4 12 (11.88%) Banking
5 9 (8.91%) Analytical Skills
6 6 (5.94%) Games
6 6 (5.94%) Retail
7 3 (2.97%) Front Office
8 1 (0.99%) Investment Banking
8 1 (0.99%) Law
8 1 (0.99%) Public Sector
Job Titles
1 27 (26.73%) Architect
2 21 (20.79%) Developer
3 19 (18.81%) Data Engineer
4 15 (14.85%) Solutions Architect
5 13 (12.87%) Big Data Developer
5 13 (12.87%) Data Architect
6 10 (9.90%) DevOps Engineer
7 9 (8.91%) AWS Engineer
8 7 (6.93%) Azure Data Engineer
8 7 (6.93%) Azure Engineer
8 7 (6.93%) Cloud Engineer
9 6 (5.94%) AWS DevOps
9 6 (5.94%) AWS DevOps Engineer
10 5 (4.95%) Big Data Engineer
10 5 (4.95%) Machine Learning Engineer
11 4 (3.96%) Java Developer
12 3 (2.97%) Data Scientist
12 3 (2.97%) Senior Data Engineer
12 3 (2.97%) Software Engineer
13 2 (1.98%) SAP Financial Architect
Libraries, Frameworks & Software Standards
1 19 (18.81%) Kafka
2 12 (11.88%) PySpark
2 12 (11.88%) RESTful
3 6 (5.94%) .NET
3 6 (5.94%) Spark Streaming
4 5 (4.95%) REST
4 5 (4.95%) Spring
5 4 (3.96%) COM
5 4 (3.96%) J2EE
5 4 (3.96%) RabbitMQ
6 2 (1.98%) JSON
6 2 (1.98%) Node.js
6 2 (1.98%) SOAP
6 2 (1.98%) XML
7 1 (0.99%) HTML
7 1 (0.99%) MDX
7 1 (0.99%) OAuth
7 1 (0.99%) OAuth2
7 1 (0.99%) Web Services
7 1 (0.99%) XSD
Miscellaneous
1 26 (25.74%) Hedge funds
2 14 (13.86%) Data Structures
3 9 (8.91%) Algorithms
4 8 (7.92%) Virtual Team
5 4 (3.96%) Credit Risk
5 4 (3.96%) Derivative
5 4 (3.96%) Legacy Systems
5 4 (3.96%) Linux Command Line
6 3 (2.97%) Data Fabric
6 3 (2.97%) Equities
6 3 (2.97%) Greenfield Project
6 3 (2.97%) Market Risk
6 3 (2.97%) Self-Motivation
7 2 (1.98%) Enterprise Software
7 2 (1.98%) Foreign Exchange (FX)
7 2 (1.98%) Management Information System
8 1 (0.99%) Cloud Native
8 1 (0.99%) Equity Derivative
8 1 (0.99%) Equity Risk
8 1 (0.99%) Replication
Operating Systems
1 7 (6.93%) Unix
2 6 (5.94%) Linux
2 6 (5.94%) VMS
3 3 (2.97%) Windows
Processes & Methodologies
1 48 (47.52%) DevOps
2 38 (37.62%) Agile
2 38 (37.62%) Analytics
3 27 (26.73%) CI/CD
3 27 (26.73%) Data Modelling
4 26 (25.74%) Data Protection
5 22 (21.78%) Business Intelligence
6 20 (19.80%) Microservices
7 19 (18.81%) AOP
8 18 (17.82%) TOGAF
9 17 (16.83%) Data Science
10 16 (15.84%) Data Management
10 16 (15.84%) Data Pipeline
10 16 (15.84%) ETL
11 15 (14.85%) Data Architecture
12 13 (12.87%) Migration
13 11 (10.89%) Data Analysis
13 11 (10.89%) Test Automation
14 10 (9.90%) Containerisation
14 10 (9.90%) Visualisation
Programming Languages
1 53 (52.48%) Python
2 47 (46.53%) SQL
3 32 (31.68%) Java
4 21 (20.79%) Scala
5 7 (6.93%) C#
5 7 (6.93%) R
6 6 (5.94%) Bash
7 5 (4.95%) Perl
8 4 (3.96%) C++
9 3 (2.97%) T-SQL
10 2 (1.98%) Go
10 2 (1.98%) JavaScript
10 2 (1.98%) Ruby
10 2 (1.98%) Shell Script
11 1 (0.99%) PHP
Qualifications
1 8 (7.92%) Degree
2 5 (4.95%) Numerate Degree
3 3 (2.97%) SC Cleared
3 3 (2.97%) Security Cleared
3 3 (2.97%) TOGAF Certification
4 2 (1.98%) Computer Science Degree
5 1 (0.99%) ISEB
5 1 (0.99%) Master's Degree
5 1 (0.99%) Sun Certification
Quality Assurance & Compliance
1 26 (25.74%) GDPR
2 11 (10.89%) QA
3 8 (7.92%) Data Quality
4 2 (1.98%) Accessibility
System Software
1 11 (10.89%) Docker
2 4 (3.96%) Platform Symphony
3 2 (1.98%) Virtual Machines
4 1 (0.99%) HDFS
4 1 (0.99%) VMware Infrastructure
Systems Management
1 16 (15.84%) Kubernetes
2 15 (14.85%) Terraform
3 12 (11.88%) Ansible
4 4 (3.96%) Docker Swarm
4 4 (3.96%) ITRS Geneos
4 4 (3.96%) Mesos
4 4 (3.96%) Puppet
4 4 (3.96%) Rancher
5 1 (0.99%) Ambari
Vendors
1 18 (17.82%) BiZZdesign
2 16 (15.84%) Microsoft
3 14 (13.86%) Databricks
4 11 (10.89%) Oracle
5 7 (6.93%) Alteryx
5 7 (6.93%) SAP
6 6 (5.94%) Dynatrace
6 6 (5.94%) IBM
7 4 (3.96%) Anaplan
7 4 (3.96%) Blue Prism
7 4 (3.96%) Concur
7 4 (3.96%) Google
7 4 (3.96%) Splunk
8 3 (2.97%) Green Hat
8 3 (2.97%) HP
8 3 (2.97%) MuleSoft
9 2 (1.98%) AppDynamics
9 2 (1.98%) Cloudera
9 2 (1.98%) Denodo
9 2 (1.98%) Informatica