Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Job Locations Skill Sets
Period
to 26 October 2020

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 26 October 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Big Data
England > London
6 months to
26 Oct 2020		 Same period 2019 Same period 2018
Rank 87 67 71
Rank change year-on-year -20 +4 -7
Contract jobs citing Big Data 415 1,361 1,618
As % of all contract jobs advertised in London 2.91% 3.73% 3.50%
As % of the Database & Business Intelligence category 11.64% 15.24% 13.99%
Number of daily rates quoted 303 1,065 1,224
Median daily rate £550 £575 £550
Median daily rate % change year-on-year -4.35% +4.55% -
10th Percentile £401 £425 £425
90th Percentile £688 £725 £725
England median daily rate £550 £550 £550
Number of hourly rates quoted 1 7 5
Median hourly rate £35.00 £42.50 £27.50
Median hourly rate % change year-on-year -17.65% +54.55% -
England median hourly rate £35.00 £42.50 £33.75
% change year-on-year -17.65% +25.93% -3.57%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
London
Contract vacancies with a requirement for database or business intelligence skills 3,565 8,931 11,568
As % of all contract IT jobs advertised in London 24.98% 24.50% 25.01%
Number of daily rates quoted 2,388 6,511 8,630
Median daily rate £525 £525 £525
10th Percentile £350 £363 £363
90th Percentile £708 £700 £675
England median daily rate £495 £475 £475
% change year-on-year +4.21% - +5.56%
Number of hourly rates quoted 38 61 53
Median hourly rate £35.00 £35.00 £27.50
Median hourly rate % change year-on-year - +27.27% +1.25%
10th Percentile £24.98 £15.60 £16.85
90th Percentile £53.83 £53.75 £47.70
Median hourly rate £35.00 £31.00 £29.50
% change year-on-year +12.90% +5.08% -3.28%

Big Data
Job Vacancy Trend in London

Job postings citing Big Data as a proportion of all IT jobs advertised in London.

Job vacancy trend for Big Data in London

Big Data
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Big Data in London.

Daily rate trend for Big Data in London

Big Data
Daily Rate Histogram in London

Daily rate distribution for jobs citing Big Data in London over the 6 months to 26 October 2020.

Daily rate histogram for Big Data in London

Big Data
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Big Data in London.

Hourly rate trend for Big Data in London

Big Data
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the London region over the 6 months to 26 October 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
Central London -17 48 £523 -5.00% 59
West London +27 18 £563 +2.27% 16
South London +4 7 £505 -12.17% 6
Big Data
England

For the 6 months to 26 October 2020, IT contractor jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Big Data.

1 191 (46.02%) Python
2 171 (41.20%) Apache Spark
3 151 (36.39%) SQL
4 145 (34.94%) Hadoop
5 139 (33.49%) Agile Software Development
6 115 (27.71%) Java
7 112 (26.99%) Azure
8 100 (24.10%) Analytics
9 99 (23.86%) Kafka
9 99 (23.86%) AWS
10 93 (22.41%) DevOps
11 89 (21.45%) Finance
12 81 (19.52%) Data Science
13 72 (17.35%) Scala
14 69 (16.63%) Data Modelling
15 67 (16.14%) Docker
16 66 (15.90%) ETL
17 59 (14.22%) Apache Hive
17 59 (14.22%) Security Cleared
17 59 (14.22%) Analytical Skills
18 58 (13.98%) Business Intelligence
19 57 (13.73%) Degree
20 56 (13.49%) Computer Science
20 56 (13.49%) Machine Learning
20 56 (13.49%) NoSQL
21 54 (13.01%) Scrum
22 53 (12.77%) Banking
22 53 (12.77%) Jenkins
23 52 (12.53%) SC Cleared
24 51 (12.29%) Data Engineering

Big Data
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 171 (41.20%) Apache Spark
2 20 (4.82%) Apache
3 19 (4.58%) Tomcat
4 15 (3.61%) Apache Airflow
5 12 (2.89%) Elasticsearch
6 10 (2.41%) Confluence
7 7 (1.69%) SAS
8 5 (1.20%) Tornado
9 4 (0.96%) BizTalk Server
10 3 (0.72%) Jupyter
10 3 (0.72%) SharePoint
11 2 (0.48%) Apache Pig
11 2 (0.48%) IIS
11 2 (0.48%) Luigi
12 1 (0.24%) Cloud Foundry
12 1 (0.24%) nginx
12 1 (0.24%) Oracle Coherence
12 1 (0.24%) R Markdown
12 1 (0.24%) Skype for Business
Applications
1 4 (0.96%) Microsoft Excel
2 3 (0.72%) Chatbot
2 3 (0.72%) Microsoft PowerPoint
3 1 (0.24%) Microsoft Office
3 1 (0.24%) Microsoft Project
3 1 (0.24%) MS Visio
3 1 (0.24%) Spreadsheet
Business Applications
1 4 (0.96%) Dynamics AX
1 4 (0.96%) Dynamics CRM
2 3 (0.72%) Sparx Enterprise Architect
3 1 (0.24%) Cognos Business Intelligence
Cloud Services
1 112 (26.99%) Azure
2 99 (23.86%) AWS
3 50 (12.05%) GCP
4 25 (6.02%) Serverless
5 18 (4.34%) Amazon EMR
5 18 (4.34%) Amazon S3
5 18 (4.34%) Datadog
6 17 (4.10%) Amazon CloudWatch
7 15 (3.61%) AWS Lambda
7 15 (3.61%) Azure Data Factory
7 15 (3.61%) Power Platform
8 14 (3.37%) Amazon EC2
8 14 (3.37%) Virtual Private Cloud
9 13 (3.13%) Amazon EKS
10 11 (2.65%) GitHub
11 9 (2.17%) Cloud Computing
12 7 (1.69%) Amazon Kinesis
12 7 (1.69%) IaaS
12 7 (1.69%) PaaS
13 6 (1.45%) Office 365
Communications & Networking
1 7 (1.69%) HTTP
2 4 (0.96%) Internet
2 4 (0.96%) Kerberos
3 3 (0.72%) DNS
3 3 (0.72%) Firewall
3 3 (0.72%) Skype
3 3 (0.72%) SSL
3 3 (0.72%) VPN
4 2 (0.48%) 5G
4 2 (0.48%) Network Security
5 1 (0.24%) 3G
5 1 (0.24%) 4G
5 1 (0.24%) PuTTY
5 1 (0.24%) Wi-Fi
Database & Business Intelligence
1 145 (34.94%) Hadoop
2 59 (14.22%) Apache Hive
3 56 (13.49%) NoSQL
4 43 (10.36%) Data Warehouse
5 37 (8.92%) Tableau
6 36 (8.67%) Data Lake
7 34 (8.19%) MySQL
8 24 (5.78%) Apache Cassandra
8 24 (5.78%) Impala
9 20 (4.82%) Relational Database
10 18 (4.34%) BigQuery
10 18 (4.34%) PostgreSQL
11 16 (3.86%) HBase
11 16 (3.86%) Spark SQL
12 15 (3.61%) Power BI
13 14 (3.37%) Amazon Redshift
13 14 (3.37%) MongoDB
14 13 (3.13%) Data Mining
15 12 (2.89%) Amazon RDS
15 12 (2.89%) SQL Server
Development Applications
1 53 (12.77%) Jenkins
2 49 (11.81%) Git (software)
3 14 (3.37%) GitLab
3 14 (3.37%) JIRA
4 6 (1.45%) kappa
4 6 (1.45%) ProC
5 5 (1.20%) Hudson
6 4 (0.96%) LoadRunner
6 4 (0.96%) PowerDesigner
6 4 (0.96%) Selenium
6 4 (0.96%) SoapUI
7 3 (0.72%) Sonatype Nexus
8 2 (0.48%) Artifactory
8 2 (0.48%) Gradle
8 2 (0.48%) Maven
8 2 (0.48%) MLflow
8 2 (0.48%) Visual Studio Team System
9 1 (0.24%) gulp
9 1 (0.24%) Protractor
9 1 (0.24%) SonarQube
General
1 89 (21.45%) Finance
2 53 (12.77%) Banking
3 33 (7.95%) Marketing
4 22 (5.30%) Public Sector
5 19 (4.58%) Front Office
5 19 (4.58%) Telecoms
6 18 (4.34%) Retail
7 14 (3.37%) Investment Banking
8 13 (3.13%) Manufacturing
9 11 (2.65%) Legal
10 8 (1.93%) Electronics
11 4 (0.96%) Games
12 3 (0.72%) Pharmaceutical
13 2 (0.48%) Financial Institution
13 2 (0.48%) Law
13 2 (0.48%) Military
13 2 (0.48%) Publishing
14 1 (0.24%) Billing
14 1 (0.24%) French Language
14 1 (0.24%) Retail Banking
Job Titles
1 102 (24.58%) Data Engineer
2 101 (24.34%) Developer
3 57 (13.73%) Big Data Engineer
4 50 (12.05%) Architect
5 30 (7.23%) Data Architect
6 29 (6.99%) Python Engineer
7 28 (6.75%) Senior Developer
8 26 (6.27%) DevOps Engineer
9 23 (5.54%) Azure Developer
10 20 (4.82%) Azure Engineer
10 20 (4.82%) Big Data Developer
10 20 (4.82%) Support Engineer
11 18 (4.34%) AWS Engineer
11 18 (4.34%) Data Scientist
11 18 (4.34%) Python Developer
12 17 (4.10%) Applications Engineer
12 17 (4.10%) Applications Support
12 17 (4.10%) Applications Support Engineer
12 17 (4.10%) C# Developer
12 17 (4.10%) Scala Developer
Libraries, Frameworks & Software Standards
1 99 (23.86%) Kafka
2 37 (8.92%) PySpark
3 33 (7.95%) .NET
4 32 (7.71%) HTML
5 26 (6.27%) HTML5
6 21 (5.06%) Web Services
7 19 (4.58%) LAMP
8 18 (4.34%) RESTful
9 17 (4.10%) Velocity
10 16 (3.86%) Sensu
11 15 (3.61%) Akka
11 15 (3.61%) Elastic Stack
12 14 (3.37%) CSS
12 14 (3.37%) scikit-learn
13 13 (3.13%) TensorFlow
14 12 (2.89%) GraphQL
14 12 (2.89%) Spark Streaming
15 11 (2.65%) NumPy
15 11 (2.65%) Pandas
16 10 (2.41%) JSON
Miscellaneous
1 59 (14.22%) Analytical Skills
2 25 (6.02%) Algorithms
3 16 (3.86%) Greenfield Project
4 15 (3.61%) Data Structures
4 15 (3.61%) Linux Command Line
5 14 (3.37%) Cloud Native
6 13 (3.13%) Foreign Exchange (FX)
7 12 (2.89%) FMCG
8 10 (2.41%) Analytical Mindset
9 9 (2.17%) Public Cloud
10 8 (1.93%) Credit Risk
10 8 (1.93%) Renewable Energy
10 8 (1.93%) Smart City
11 7 (1.69%) User Experience
12 5 (1.20%) Hybrid Cloud
12 5 (1.20%) Mobile App
12 5 (1.20%) Social Media
13 4 (0.96%) Grid Computing
13 4 (0.96%) Self-Motivation
14 3 (0.72%) Equities
Operating Systems
1 48 (11.57%) Linux
2 34 (8.19%) Unix
3 5 (1.20%) Windows
4 4 (0.96%) Solaris
5 1 (0.24%) Amazon Linux
5 1 (0.24%) Android
5 1 (0.24%) Apple iOS
5 1 (0.24%) VMS
5 1 (0.24%) Windows Server
Processes & Methodologies
1 139 (33.49%) Agile Software Development
2 100 (24.10%) Analytics
3 93 (22.41%) DevOps
4 81 (19.52%) Data Science
5 69 (16.63%) Data Modelling
6 66 (15.90%) ETL
7 58 (13.98%) Business Intelligence
8 56 (13.49%) Computer Science
8 56 (13.49%) Machine Learning
9 54 (13.01%) Scrum
10 51 (12.29%) Data Engineering
11 46 (11.08%) Problem-Solving
12 42 (10.12%) Microservices
13 39 (9.40%) Data Architecture
14 35 (8.43%) Data Management
15 34 (8.19%) Data Analytics
15 34 (8.19%) Visualisation
16 32 (7.71%) Test Automation
17 30 (7.23%) Mathematics
18 28 (6.75%) Data Analysis
Programming Languages
1 191 (46.02%) Python
2 151 (36.39%) SQL
3 115 (27.71%) Java
4 72 (17.35%) Scala
5 35 (8.43%) C#
6 32 (7.71%) Bash Shell
7 27 (6.51%) C++
8 26 (6.27%) Ruby
9 24 (5.78%) JavaScript
10 16 (3.86%) Shell Script
11 15 (3.61%) R
12 13 (3.13%) Haskell
13 11 (2.65%) PowerShell
14 10 (2.41%) Perl
15 9 (2.17%) Go
16 7 (1.69%) Java 8
17 5 (1.20%) Groovy
18 2 (0.48%) T-SQL
19 1 (0.24%) Korn
19 1 (0.24%) TypeScript
Qualifications
1 59 (14.22%) Security Cleared
2 57 (13.73%) Degree
3 52 (12.53%) SC Cleared
4 30 (7.23%) Master's Degree
5 19 (4.58%) Computer Science Degree
6 11 (2.65%) Numerate Degree
7 8 (1.93%) DV Cleared
8 4 (0.96%) AWS Certification
8 4 (0.96%) PhD
9 3 (0.72%) TOGAF Certification
10 1 (0.24%) BPSS Clearance
10 1 (0.24%) CGEIT
10 1 (0.24%) CISA
10 1 (0.24%) CISM
10 1 (0.24%) CISSP
Quality Assurance & Compliance
1 27 (6.51%) QA
2 19 (4.58%) Data Quality
3 10 (2.41%) MiFID
4 8 (1.93%) PCI DSS
5 2 (0.48%) GDPR
5 2 (0.48%) Section 508
5 2 (0.48%) WAI
6 1 (0.24%) CDISC
6 1 (0.24%) IFRS
6 1 (0.24%) ISO/IEC 20000
6 1 (0.24%) SLA
6 1 (0.24%) Solvency II
System Software
1 67 (16.14%) Docker
2 25 (6.02%) HDFS
3 7 (1.69%) Apache ZooKeeper
4 4 (0.96%) Apache Flume
5 3 (0.72%) Active Directory Lightweight Directory Services
5 3 (0.72%) Virtual Machines
5 3 (0.72%) VMware Infrastructure
6 1 (0.24%) Active Directory
Systems Management
1 48 (11.57%) Kubernetes
2 36 (8.67%) Ansible
3 33 (7.95%) Terraform
4 20 (4.82%) Nagios
5 9 (2.17%) Opscode Chef
6 7 (1.69%) Puppet
7 5 (1.20%) Kibana
8 3 (0.72%) Hadoop YARN
9 2 (0.48%) Argo
9 2 (0.48%) Kubeflow
9 2 (0.48%) Oozie
10 1 (0.24%) Docker Swarm
10 1 (0.24%) Packer
Vendors
1 50 (12.05%) Databricks
2 46 (11.08%) Microsoft
3 38 (9.16%) Cloudera
3 38 (9.16%) Oracle
4 30 (7.23%) Google
5 25 (6.02%) StreamSets
6 22 (5.30%) Splunk
7 17 (4.10%) Hortonworks
7 17 (4.10%) Teradata
8 14 (3.37%) Informatica
9 11 (2.65%) SAP
10 7 (1.69%) IBM
11 5 (1.20%) Sun
11 5 (1.20%) Talend
11 5 (1.20%) VMware
12 4 (0.96%) BiZZdesign
12 4 (0.96%) CA
12 4 (0.96%) Palantir
13 3 (0.72%) NetApp
13 3 (0.72%) Sony