Period
to 20 February 2018

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 20 February 2018 with a comparison to the same period in the previous 2 years.

Big Data
Central London > City of London
6 months to
20 Feb 2018
Same period 2017 Same period 2016
Rank 60 77 55
Rank change year-on-year +17 -22 +80
Permanent jobs citing Big Data 495 423 653
As % of all permanent IT jobs advertised in the City of London 4.61% 4.06% 4.69%
As % of the Database & Business Intelligence category 14.98% 12.86% 15.29%
Number of salaries quoted 451 384 543
City of London median annual salary £70,000 £65,000 £65,000
Median salary % change year-on-year +7.69% - +4.00%
10th Percentile £47,500 £42,500 £43,750
90th Percentile £103,750 £110,000 £105,000
Central London median annual salary £70,000 £65,000 £65,000
% change year-on-year +7.69% - +4.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 3,305 3,289 4,272
As % of all permanent IT jobs advertised in the City of London 30.76% 31.57% 30.68%
Number of salaries quoted 2,964 3,048 3,781
City of London median annual salary £60,500 £57,500 £57,500
Median salary % change year-on-year +5.22% - +4.55%
10th Percentile £41,250 £36,425 £37,250
90th Percentile £90,000 £87,500 £85,000
Central London median annual salary £60,000 £57,500 £57,500
% change year-on-year +4.35% - +4.55%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Salary Trend in the City of London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in the City of London.

Salary trend for Big Data in the City of London

Big Data
Salary Histogram in the City of London

The salary distribution of IT jobs citing Big Data in the City of London over the 6 months to 20 February 2018.

Salary histogram for Big Data in the City of London

Big Data
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the City of London region over the 6 months to 20 February 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Moorgate - 3 £90,000 -
London Bridge - 3 - -
Big Data
Central London

For the 6 months to 20 February 2018, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Big Data.

1 238 (48.08%) Java
2 196 (39.60%) Hadoop
3 184 (37.17%) Agile Software Development
4 170 (34.34%) Python
5 165 (33.33%) Finance
6 161 (32.53%) Apache Spark
7 143 (28.89%) Amazon AWS
8 140 (28.28%) Analytics
9 128 (25.86%) SQL
10 118 (23.84%) Scala
10 118 (23.84%) Machine Learning
11 99 (20.00%) Data Science
12 96 (19.39%) NoSQL
13 84 (16.97%) Fintech
14 82 (16.57%) DevOps
15 69 (13.94%) Microsoft Azure
15 69 (13.94%) TDD
16 66 (13.33%) Business Intelligence
17 64 (12.93%) Linux
18 63 (12.73%) Docker
19 62 (12.53%) MongoDB
20 60 (12.12%) Degree
20 60 (12.12%) Banking
20 60 (12.12%) Microservices
20 60 (12.12%) Kafka
21 56 (11.31%) C#
22 52 (10.51%) Elasticsearch
23 51 (10.30%) Software Engineering
23 51 (10.30%) Computer Science
23 51 (10.30%) Apache Hive

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 161 (32.53%) Apache Spark
2 52 (10.51%) Elasticsearch
3 44 (8.89%) Apache
4 14 (2.83%) SAS
5 12 (2.42%) Apache Solr
6 11 (2.22%) Tomcat
7 8 (1.62%) Apache Pig
8 5 (1.01%) Jetty
9 4 (0.81%) JBoss
9 4 (0.81%) NServiceBus
10 3 (0.61%) Confluence
10 3 (0.61%) nginx
10 3 (0.61%) WebLogic
11 2 (0.40%) Apache Airflow
11 2 (0.40%) Luigi
11 2 (0.40%) OpenStack
11 2 (0.40%) WebSphere
12 1 (0.20%) Apache Geronimo
12 1 (0.20%) Cloud Foundry
12 1 (0.20%) WildFly
Applications
1 7 (1.41%) SPSS
2 6 (1.21%) Microsoft Excel
3 1 (0.20%) Microsoft Office
3 1 (0.20%) Microsoft PowerPoint
Business Applications
1 2 (0.40%) Bloomberg AIM
1 2 (0.40%) Markit EDM
2 1 (0.20%) Dynamics CRM
2 1 (0.20%) SAP CRM
2 1 (0.20%) SAP S/4HANA
Cloud Services
1 143 (28.89%) Amazon AWS
2 69 (13.94%) Microsoft Azure
3 25 (5.05%) Serverless
4 24 (4.85%) AWS Lambda
5 20 (4.04%) SaaS
6 18 (3.64%) Azure Data Factory
7 15 (3.03%) Amazon EC2
7 15 (3.03%) Amazon S3
7 15 (3.03%) GitHub
8 14 (2.83%) Amazon Kinesis
8 14 (2.83%) Cloud Computing
8 14 (2.83%) Cortana Intelligence Suite
9 12 (2.42%) IaaS
10 11 (2.22%) AWS CloudFormation
11 8 (1.62%) Google Cloud Platform
12 7 (1.41%) Amazon EMR
13 4 (0.81%) Amazon CloudWatch
13 4 (0.81%) Amazon ElastiCache
13 4 (0.81%) Virtual Private Cloud
14 3 (0.61%) Datadog
Communications & Networking
1 14 (2.83%) HTTP
2 9 (1.82%) Internet
3 7 (1.41%) Firewall
4 5 (1.01%) TCP/IP
5 3 (0.61%) Broadband
5 3 (0.61%) DNS
5 3 (0.61%) Network Security
5 3 (0.61%) SMTP
5 3 (0.61%) VPN
6 2 (0.40%) Kerberos
6 2 (0.40%) SAN
7 1 (0.20%) GoToMeeting
7 1 (0.20%) Skype
7 1 (0.20%) SMS
7 1 (0.20%) Wireshark
7 1 (0.20%) X.509
Database & Business Intelligence
1 196 (39.60%) Hadoop
2 96 (19.39%) NoSQL
3 62 (12.53%) MongoDB
4 51 (10.30%) Apache Hive
5 50 (10.10%) HBase
6 47 (9.49%) Apache Cassandra
6 47 (9.49%) Data Lake
7 42 (8.48%) SQL Server
8 35 (7.07%) Data Warehouse
9 34 (6.87%) Power BI
10 27 (5.45%) Amazon Redshift
11 23 (4.65%) PostgreSQL
11 23 (4.65%) Relational Database
12 20 (4.04%) MySQL
12 20 (4.04%) SQL Server Analysis Services
12 20 (4.04%) SQL Server Reporting Services
13 17 (3.43%) Data Mining
14 16 (3.23%) Azure SQL Database
14 16 (3.23%) SQL Server Integration Services
15 15 (3.03%) OLAP
Development Applications
1 47 (9.49%) Git (software)
2 22 (4.44%) Jenkins
3 18 (3.64%) Maven
4 14 (2.83%) Visual Studio
5 12 (2.42%) Eclipse
6 11 (2.22%) JUnit
7 9 (1.82%) GoCD
8 8 (1.62%) Sonatype Nexus
9 5 (1.01%) Selenium
9 5 (1.01%) Subversion
9 5 (1.01%) TeamCity
9 5 (1.01%) Travis CI
10 4 (0.81%) CMake
10 4 (0.81%) Octopus Deploy
11 3 (0.61%) AppVeyor
11 3 (0.61%) Artifactory
11 3 (0.61%) Gradle
11 3 (0.61%) JIRA
12 2 (0.40%) Cucumber
12 2 (0.40%) Visual Studio Team System
General
1 165 (33.33%) Finance
2 60 (12.12%) Banking
3 22 (4.44%) Marketing
4 21 (4.24%) Games
5 18 (3.64%) Front Office
6 17 (3.43%) Investment Banking
7 13 (2.63%) Advertising
7 13 (2.63%) Retail
8 12 (2.42%) Publishing
9 10 (2.02%) Law
10 9 (1.82%) Financial Institution
11 4 (0.81%) Automotive
11 4 (0.81%) Telecoms
12 2 (0.40%) Pharmaceutical
12 2 (0.40%) Retail Banking
13 1 (0.20%) Aerospace
13 1 (0.20%) Legal
13 1 (0.20%) Mandarin Language
Job Titles
1 209 (42.22%) Developer
2 101 (20.40%) Java Developer
3 59 (11.92%) Data Engineer
4 44 (8.89%) Big Data Developer
5 40 (8.08%) Big Data Engineer
5 40 (8.08%) Scala Developer
6 33 (6.67%) Analyst
7 29 (5.86%) Architect
7 29 (5.86%) Lead Developer
8 27 (5.45%) Data Scientist
9 25 (5.05%) Lead Java Developer
9 25 (5.05%) Software Engineer
10 24 (4.85%) Python Developer
11 21 (4.24%) Senior Developer
12 20 (4.04%) DevOps Engineer
12 20 (4.04%) Java Scala Developer
13 17 (3.43%) Apache Spark Developer
14 16 (3.23%) Consultant
14 16 (3.23%) Hadoop Developer
15 15 (3.03%) Business Analyst
Libraries, Frameworks & Software Standards
1 60 (12.12%) Kafka
2 45 (9.09%) REST
3 39 (7.88%) Spring
4 33 (6.67%) .NET
5 32 (6.46%) AngularJS
6 30 (6.06%) Web Services
7 26 (5.25%) Node.js
8 25 (5.05%) RESTful
9 23 (4.65%) Akka
10 22 (4.44%) RabbitMQ
11 21 (4.24%) HTML
12 18 (3.64%) JMS
12 18 (3.64%) React
13 17 (3.43%) WPF
14 16 (3.23%) CSS
15 15 (3.03%) Apache Camel
15 15 (3.03%) Natural Language Processing
16 13 (2.63%) ASP.NET MVC
16 13 (2.63%) Django
16 13 (2.63%) HTML5
Miscellaneous
1 84 (16.97%) Fintech
2 51 (10.30%) Computer Science
3 41 (8.28%) Algorithms
4 34 (6.87%) Greenfield Project
5 22 (4.44%) Analytical Skills
5 22 (4.44%) Equities
6 21 (4.24%) Foreign Exchange (FX)
7 19 (3.84%) Fixed Income
8 15 (3.03%) User Experience
9 11 (2.22%) Enterprise Software
9 11 (2.22%) Mobile App
10 10 (2.02%) Linux Command Line
11 8 (1.62%) Hedge funds
12 7 (1.41%) Clustering
12 7 (1.41%) Data Centre
12 7 (1.41%) Data Structures
13 6 (1.21%) Credit Risk
13 6 (1.21%) Virtual Team
14 5 (1.01%) Replication
14 5 (1.01%) Robotics
Operating Systems
1 64 (12.93%) Linux
2 18 (3.64%) Unix
3 14 (2.83%) Windows
4 10 (2.02%) CentOS
5 6 (1.21%) Ubuntu
6 5 (1.01%) Red Hat Enterprise Linux
7 3 (0.61%) Mac OS X
8 2 (0.40%) AIX
8 2 (0.40%) Windows Server
9 1 (0.20%) Android
9 1 (0.20%) Apple iOS
9 1 (0.20%) DC/OS
9 1 (0.20%) HPUX
9 1 (0.20%) Solaris
Processes & Methodologies
1 184 (37.17%) Agile Software Development
2 140 (28.28%) Analytics
3 118 (23.84%) Machine Learning
4 99 (20.00%) Data Science
5 82 (16.57%) DevOps
6 69 (13.94%) TDD
7 66 (13.33%) Business Intelligence
8 60 (12.12%) Microservices
9 51 (10.30%) Software Engineering
10 50 (10.10%) Open Source
11 49 (9.90%) ETL
12 45 (9.09%) Data Analytics
13 42 (8.48%) Scrum
14 41 (8.28%) Multithreading
15 34 (6.87%) Visualisation
16 33 (6.67%) Continuous Integration
17 30 (6.06%) Data Engineering
17 30 (6.06%) Data Modelling
17 30 (6.06%) E-Commerce
18 27 (5.45%) Migration
Programming Languages
1 238 (48.08%) Java
2 170 (34.34%) Python
3 128 (25.86%) SQL
4 118 (23.84%) Scala
5 56 (11.31%) C#
6 42 (8.48%) JavaScript
7 39 (7.88%) R
8 32 (6.46%) C++
9 20 (4.04%) Go
10 18 (3.64%) Ruby
11 17 (3.43%) PHP
12 15 (3.03%) T-SQL
13 14 (2.83%) C
13 14 (2.83%) MATLAB
14 13 (2.63%) Bash Shell
15 10 (2.02%) F#
16 8 (1.62%) Perl
17 6 (1.21%) U-SQL
18 5 (1.01%) CoffeeScript
19 4 (0.81%) Clojure
Qualifications
1 60 (12.12%) Degree
2 30 (6.06%) Computer Science Degree
3 18 (3.64%) PhD
4 10 (2.02%) ISEB
5 7 (1.41%) Security Cleared
6 6 (1.21%) Microsoft Certification
7 4 (0.81%) DV Cleared
7 4 (0.81%) Master's Degree
8 2 (0.40%) CISM
8 2 (0.40%) CISSP
8 2 (0.40%) MBA
8 2 (0.40%) PMP
8 2 (0.40%) SC Cleared
9 1 (0.20%) Numerate Degree
9 1 (0.20%) PMI Certification
9 1 (0.20%) Postgraduate
Quality Assurance & Compliance
1 15 (3.03%) Data Quality
2 13 (2.63%) Solvency II
3 9 (1.82%) Sarbanes-Oxley
4 8 (1.62%) QA
5 6 (1.21%) GDPR
6 4 (0.81%) Actionable Recommendations
6 4 (0.81%) SLA
7 3 (0.61%) EMIR
7 3 (0.61%) MiFID
8 2 (0.40%) ISO/IEC 27001
8 2 (0.40%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
8 2 (0.40%) PMO
9 1 (0.20%) Dodd-Frank
9 1 (0.20%) FATCA
9 1 (0.20%) IFRS
9 1 (0.20%) IFRS 9
System Software
1 63 (12.73%) Docker
2 23 (4.65%) HDFS
3 10 (2.02%) Apache Flume
4 9 (1.82%) Virtual Machines
5 4 (0.81%) Apache ZooKeeper
5 4 (0.81%) VMware Infrastructure
6 2 (0.40%) Hyper-V
7 1 (0.20%) Active Directory
Systems Management
1 37 (7.47%) Kubernetes
2 31 (6.26%) Ansible
3 25 (5.05%) Terraform
4 20 (4.04%) Puppet
5 13 (2.63%) Mesos
6 12 (2.42%) Opscode Chef
7 7 (1.41%) Consul
7 7 (1.41%) Kibana
8 6 (1.21%) Hadoop YARN
8 6 (1.21%) logstash
8 6 (1.21%) Salt
9 5 (1.01%) Graphite
9 5 (1.01%) Oozie
10 3 (0.61%) Docker Swarm
11 2 (0.40%) Control-M
11 2 (0.40%) Red Hat Satellite
11 2 (0.40%) Simian Army
12 1 (0.20%) Grafana
12 1 (0.20%) Rundeck
12 1 (0.20%) ZABBIX
Vendors
1 44 (8.89%) Microsoft
2 39 (7.88%) Google
2 39 (7.88%) Tableau
3 34 (6.87%) Oracle
4 29 (5.86%) Cloudera
5 17 (3.43%) IBM
6 13 (2.63%) Hortonworks
7 9 (1.82%) Cognos
7 9 (1.82%) Informatica
7 9 (1.82%) MapR
7 9 (1.82%) SAP
8 8 (1.62%) Facebook
9 7 (1.41%) Red Hat
10 6 (1.21%) VMware
11 5 (1.01%) Adthena
11 5 (1.01%) DevExpress
11 5 (1.01%) Salesforce.com
11 5 (1.01%) Sybase
12 4 (0.81%) Arqiva
12 4 (0.81%) Splunk