Period
to 3 March 2021

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 3 March 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > London
6 months to
3 Mar 2021
Same period 2020 Same period 2019
Rank 84 69 69
Rank change year-on-year -15 0 +2
Contract jobs citing Big Data 575 903 1,626
As % of all contract jobs advertised in London 2.88% 3.25% 3.77%
As % of the Database & Business Intelligence category 12.23% 13.34% 15.32%
Number of daily rates quoted 439 689 1,257
Median daily rate £555 £575 £550
Median daily rate % change year-on-year -3.48% +4.55% -
10th Percentile £413 £413 £437
90th Percentile £688 £725 £725
England median daily rate £550 £550 £550
Number of hourly rates quoted 1 1 4
Median hourly rate £66.50 £38.50 £45.00
Median hourly rate % change year-on-year +72.73% -14.44% -
England median hourly rate £55.00 £38.50 £45.00
% change year-on-year +42.86% -14.44% +1.12%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 4,702 6,769 10,615
As % of all contract IT jobs advertised in London 23.52% 24.36% 24.60%
Number of daily rates quoted 3,335 4,924 7,895
Median daily rate £525 £525 £525
10th Percentile £350 £363 £363
90th Percentile £694 £700 £675
England median daily rate £495 £488 £485
% change year-on-year +1.54% +0.52% +2.11%
Number of hourly rates quoted 27 31 41
Median hourly rate £42.00 £35.00 £24.50
Median hourly rate % change year-on-year +20.00% +42.86% -9.79%
10th Percentile £20.60 £18.25 £16.69
90th Percentile £68.00 £64.88 £47.50
Median hourly rate £25.00 £26.00 £30.00
% change year-on-year -3.85% -13.33% -7.69%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a proportion of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Big Data in London.

Daily rate trend for Big Data in London

Big Data
Daily Rate Histogram in London

Daily rate distribution for jobs citing Big Data in London over the 6 months to 3 March 2021.

Daily rate histogram for Big Data in London

Big Data
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Big Data in London.

Hourly rate trend for Big Data in London

Big Data
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the London region over the 6 months to 3 March 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +21 85 £565 +2.73% 71
West London +24 19 £475 -13.64% 40
South London +31 11 £505 -3.81% 5
Big Data
England

For the 6 months to 3 March 2021, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Big Data.

1 239 (41.57%) Python
2 207 (36.00%) Apache Spark
3 183 (31.83%) Agile Software Development
4 178 (30.96%) SQL
5 171 (29.74%) Analytics
6 166 (28.87%) Java
7 162 (28.17%) AWS
8 160 (27.83%) Azure
9 159 (27.65%) Hadoop
10 148 (25.74%) Finance
11 143 (24.87%) DevOps
12 121 (21.04%) Kafka
13 115 (20.00%) Data Warehouse
14 108 (18.78%) ETL
15 106 (18.43%) Data Modelling
16 91 (15.83%) Banking
16 91 (15.83%) Data Science
17 89 (15.48%) Scala
18 88 (15.30%) Security Cleared
19 87 (15.13%) Data Engineering
20 84 (14.61%) Apache Hive
21 83 (14.43%) GCP
21 83 (14.43%) Docker
22 80 (13.91%) SC Cleared
23 79 (13.74%) Analytical Skills
23 79 (13.74%) Data Lake
24 72 (12.52%) Machine Learning
25 71 (12.35%) NoSQL
26 67 (11.65%) Kubernetes
27 66 (11.48%) Terraform

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 207 (36.00%) Apache Spark
2 49 (8.52%) Apache
3 31 (5.39%) Apache Airflow
4 17 (2.96%) Confluence
5 11 (1.91%) Jupyter
6 10 (1.74%) SAS
7 6 (1.04%) Elasticsearch
8 5 (0.87%) Oracle Coherence
9 4 (0.70%) Apache Pig
9 4 (0.70%) Cloud Foundry
9 4 (0.70%) nginx
10 3 (0.52%) SharePoint
11 2 (0.35%) Tomcat
12 1 (0.17%) Apache Solr
12 1 (0.17%) Luigi
12 1 (0.17%) Oracle SOA Suite
12 1 (0.17%) Skype for Business
12 1 (0.17%) Tornado
Applications
1 5 (0.87%) Microsoft Office
2 4 (0.70%) Chatbot
3 3 (0.52%) Microsoft Excel
4 2 (0.35%) Microsoft PowerPoint
4 2 (0.35%) MS Visio
5 1 (0.17%) Spreadsheet
Business Applications
1 2 (0.35%) Oracle EBS
1 2 (0.35%) Sparx Enterprise Architect
2 1 (0.17%) Cognos Business Intelligence
2 1 (0.17%) NetSuite
2 1 (0.17%) SAP CRM
2 1 (0.17%) SAP ERP
2 1 (0.17%) SAP IS-U
Cloud Services
1 162 (28.17%) AWS
2 160 (27.83%) Azure
3 83 (14.43%) GCP
4 61 (10.61%) Serverless
5 43 (7.48%) Amazon S3
6 39 (6.78%) AWS Lambda
7 36 (6.26%) GitHub
8 32 (5.57%) Amazon EMR
9 29 (5.04%) Power Platform
10 20 (3.48%) PaaS
11 18 (3.13%) Amazon EC2
12 16 (2.78%) Amazon Kinesis
13 14 (2.43%) Amazon EKS
13 14 (2.43%) Azure Data Factory
14 12 (2.09%) Cloud Computing
15 11 (1.91%) Amazon CloudWatch
15 11 (1.91%) Amazon ECS
16 10 (1.74%) iPaaS
17 8 (1.39%) IaaS
18 7 (1.22%) OpenShift
Communications & Networking
1 17 (2.96%) HTTP
2 5 (0.87%) Network Security
3 4 (0.70%) DNS
3 4 (0.70%) Firewall
3 4 (0.70%) VPN
4 3 (0.52%) Internet
4 3 (0.52%) Remote Desktop
4 3 (0.52%) SMTP
5 1 (0.17%) DHCP
5 1 (0.17%) Kerberos
5 1 (0.17%) LAN
5 1 (0.17%) Skype
5 1 (0.17%) Software-Defined Networking
5 1 (0.17%) WAN
Database & Business Intelligence
1 159 (27.65%) Hadoop
2 115 (20.00%) Data Warehouse
3 84 (14.61%) Apache Hive
4 79 (13.74%) Data Lake
5 71 (12.35%) NoSQL
6 46 (8.00%) Relational Database
7 31 (5.39%) BigQuery
8 30 (5.22%) HBase
8 30 (5.22%) Impala
9 28 (4.87%) Power BI
10 23 (4.00%) Amazon Redshift
10 23 (4.00%) MongoDB
11 21 (3.65%) Apache Cassandra
12 20 (3.48%) SQL Server
13 19 (3.30%) RDBMS
14 18 (3.13%) Tableau
15 17 (2.96%) MySQL
15 17 (2.96%) Parquet
16 15 (2.61%) Amazon RDS
17 14 (2.43%) Amazon Athena
Development Applications
1 44 (7.65%) Jenkins
2 38 (6.61%) JIRA
3 29 (5.04%) Git (software)
4 26 (4.52%) PowerDesigner
5 21 (3.65%) kappa
6 20 (3.48%) GitLab
7 16 (2.78%) Maven
8 7 (1.22%) Bitbucket
9 6 (1.04%) Atlassian Bamboo
9 6 (1.04%) Selenium
9 6 (1.04%) Sonatype Nexus
10 5 (0.87%) Gradle
10 5 (0.87%) SonarQube
11 4 (0.70%) Artifactory
11 4 (0.70%) CircleCI
11 4 (0.70%) gulp
11 4 (0.70%) SQL Server Management Studio (SSMS)
11 4 (0.70%) Travis CI
11 4 (0.70%) Vagrant
12 3 (0.52%) SoapUI
General
1 148 (25.74%) Finance
2 91 (15.83%) Banking
3 33 (5.74%) Investment Banking
4 24 (4.17%) Marketing
4 24 (4.17%) Public Sector
5 23 (4.00%) Retail
6 19 (3.30%) Telecoms
7 18 (3.13%) Front Office
8 16 (2.78%) Manufacturing
9 7 (1.22%) Legal
9 7 (1.22%) Pharmaceutical
10 5 (0.87%) Financial Institution
11 3 (0.52%) Electronics
11 3 (0.52%) French Language
11 3 (0.52%) Military
12 2 (0.35%) Automotive
12 2 (0.35%) Games
12 2 (0.35%) Law
12 2 (0.35%) Publishing
12 2 (0.35%) Retail Banking
Job Titles
1 153 (26.61%) Data Engineer
2 114 (19.83%) Developer
3 100 (17.39%) Architect
4 62 (10.78%) Big Data Engineer
5 57 (9.91%) Data Architect
6 41 (7.13%) AWS Engineer
7 38 (6.61%) DevOps Engineer
8 36 (6.26%) Solutions Architect
9 31 (5.39%) Analyst
9 31 (5.39%) Python Engineer
10 25 (4.35%) Senior Developer
11 24 (4.17%) Cloud Engineer
12 23 (4.00%) Software Engineer
13 22 (3.83%) Big Data Developer
14 20 (3.48%) Java Developer
14 20 (3.48%) Python Developer
15 18 (3.13%) Consultant
15 18 (3.13%) Data Analyst
16 16 (2.78%) Cloud Architect
16 16 (2.78%) Java Engineer
Libraries, Frameworks & Software Standards
1 121 (21.04%) Kafka
2 37 (6.43%) Web Services
3 34 (5.91%) PySpark
4 32 (5.57%) HTML
5 20 (3.48%) NumPy
6 18 (3.13%) .NET
6 18 (3.13%) CSS
6 18 (3.13%) RESTful
7 16 (2.78%) HTML5
7 16 (2.78%) JSON
7 16 (2.78%) Node.js
7 16 (2.78%) XML
8 14 (2.43%) Pandas
9 13 (2.26%) Apache NiFi
10 12 (2.09%) React
11 11 (1.91%) D3.js
11 11 (1.91%) Highcharts JS
11 11 (1.91%) REST
11 11 (1.91%) Spark Streaming
11 11 (1.91%) Velocity
Miscellaneous
1 79 (13.74%) Analytical Skills
2 34 (5.91%) Algorithms
2 34 (5.91%) Data Structures
3 22 (3.83%) Cloud Native
4 21 (3.65%) User Experience
5 14 (2.43%) Greenfield Project
6 13 (2.26%) iPad
6 13 (2.26%) Virtual Team
7 12 (2.09%) Hedge funds
8 11 (1.91%) Foreign Exchange (FX)
8 11 (1.91%) Self-Motivation
9 10 (1.74%) Analytical Mindset
9 10 (1.74%) FMCG
10 8 (1.39%) Grid Computing
11 7 (1.22%) Public Cloud
12 6 (1.04%) Market Risk
13 5 (0.87%) CMDB
13 5 (0.87%) Replication
14 4 (0.70%) Reference Data
14 4 (0.70%) Robotics
Operating Systems
1 57 (9.91%) Linux
2 16 (2.78%) Unix
3 12 (2.09%) Windows
4 5 (0.87%) Red Hat Enterprise Linux
5 3 (0.52%) Apple iOS
5 3 (0.52%) Windows Server
6 2 (0.35%) AIX
6 2 (0.35%) HPUX
6 2 (0.35%) Solaris
6 2 (0.35%) SUSE Linux Enterprise Server
6 2 (0.35%) Windows 10
7 1 (0.17%) Android
7 1 (0.17%) CentOS
7 1 (0.17%) VMS
Processes & Methodologies
1 183 (31.83%) Agile Software Development
2 171 (29.74%) Analytics
3 143 (24.87%) DevOps
4 108 (18.78%) ETL
5 106 (18.43%) Data Modelling
6 91 (15.83%) Data Science
7 87 (15.13%) Data Engineering
8 72 (12.52%) Machine Learning
9 64 (11.13%) Data Analysis
9 64 (11.13%) Migration
10 62 (10.78%) Business Intelligence
10 62 (10.78%) Data Management
11 60 (10.43%) Software Engineering
12 55 (9.57%) Microservices
13 54 (9.39%) Data Architecture
14 53 (9.22%) Data Analytics
15 44 (7.65%) Stakeholder Management
16 43 (7.48%) Problem-Solving
17 42 (7.30%) SDLC
18 40 (6.96%) Test Automation
Programming Languages
1 239 (41.57%) Python
2 178 (30.96%) SQL
3 166 (28.87%) Java
4 89 (15.48%) Scala
5 35 (6.09%) JavaScript
6 24 (4.17%) R
7 23 (4.00%) Shell Script
8 18 (3.13%) Bash Shell
9 17 (2.96%) C#
10 11 (1.91%) C++
10 11 (1.91%) Haskell
11 8 (1.39%) Perl
11 8 (1.39%) PL/SQL
11 8 (1.39%) T-SQL
11 8 (1.39%) TypeScript
12 7 (1.22%) Groovy
12 7 (1.22%) PowerShell
13 6 (1.04%) Go
14 5 (0.87%) C
15 4 (0.70%) Java 8
Qualifications
1 88 (15.30%) Security Cleared
2 80 (13.91%) SC Cleared
3 30 (5.22%) Degree
4 24 (4.17%) DV Cleared
5 12 (2.09%) AWS Certification
6 9 (1.57%) Master's Degree
6 9 (1.57%) PhD
7 6 (1.04%) Computer Science Degree
8 3 (0.52%) Numerate Degree
9 2 (0.35%) CISM
9 2 (0.35%) CISSP
9 2 (0.35%) Microsoft Certification
10 1 (0.17%) CESG Certified Professional
10 1 (0.17%) CGEIT
10 1 (0.17%) CISA
10 1 (0.17%) DBS Check
10 1 (0.17%) MCP
Quality Assurance & Compliance
1 34 (5.91%) Data Quality
2 30 (5.22%) QA
3 4 (0.70%) MiFID
3 4 (0.70%) Section 508
3 4 (0.70%) WAI
4 2 (0.35%) GDPR
4 2 (0.35%) IFRS
4 2 (0.35%) PCI DSS
4 2 (0.35%) SLA
5 1 (0.17%) Basel II
5 1 (0.17%) Government Security Classifications
5 1 (0.17%) IFRS 9
5 1 (0.17%) ISO/IEC 20000
5 1 (0.17%) NCSC
5 1 (0.17%) Sarbanes-Oxley
5 1 (0.17%) Solvency II
System Software
1 83 (14.43%) Docker
2 48 (8.35%) HDFS
3 6 (1.04%) Apache Flume
4 5 (0.87%) Apache ZooKeeper
4 5 (0.87%) Virtual Machines
5 3 (0.52%) Active Directory
5 3 (0.52%) Active Directory Lightweight Directory Services
Systems Management
1 67 (11.65%) Kubernetes
2 66 (11.48%) Terraform
3 40 (6.96%) Ansible
4 13 (2.26%) Hadoop YARN
5 11 (1.91%) Packer
6 7 (1.22%) Oozie
7 6 (1.04%) Opscode Chef
8 5 (0.87%) Argo
8 5 (0.87%) Puppet
9 4 (0.70%) Docker Swarm
10 3 (0.52%) Control-M
10 3 (0.52%) MIIS
10 3 (0.52%) Prometheus
11 2 (0.35%) Nagios
12 1 (0.17%) Ambari
12 1 (0.17%) Grafana
12 1 (0.17%) ITRS Geneos
12 1 (0.17%) Kibana
12 1 (0.17%) Kubeflow
Vendors
1 58 (10.09%) Google
2 52 (9.04%) Cloudera
3 46 (8.00%) Databricks
4 42 (7.30%) Microsoft
5 35 (6.09%) Oracle
6 27 (4.70%) Hortonworks
7 24 (4.17%) BiZZdesign
8 16 (2.78%) Informatica
9 14 (2.43%) SAP
10 12 (2.09%) MuleSoft
10 12 (2.09%) Teradata
11 11 (1.91%) IBM
12 9 (1.57%) Alteryx
12 9 (1.57%) StreamSets
13 8 (1.39%) Dataiku
13 8 (1.39%) MapR
13 8 (1.39%) Talend
14 7 (1.22%) Salesforce.com
14 7 (1.22%) VMware
15 5 (0.87%) Sage