Period
to 20 November 2017

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 20 November 2017 with a comparison to the same period in the previous 2 years.

Big Data
Central London > City of London
6 months to
20 Nov 2017
Same period 2016 Same period 2015
Rank 73 73 65
Rank change year-on-year 0 -8 +71
Permanent jobs citing Big Data 409 484 728
As % of all permanent IT jobs advertised in the City of London 4.01% 4.20% 4.25%
As % of the Database & Business Intelligence category 12.82% 13.90% 14.31%
Number of salaries quoted 369 422 582
City of London median annual salary £70,000 £62,250 £65,000
Median salary % change year-on-year +12.45% -4.23% -
10th Percentile £47,500 £41,550 £42,500
90th Percentile £110,000 £105,000 £100,675
Central London median annual salary £70,000 £62,500 £65,000
% change year-on-year +12.00% -3.85% +4.00%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
City of London
Permanent vacancies with a requirement for database or business intelligence skills 3190 3483 5089
As % of all permanent IT jobs advertised in the City of London 31.25% 30.20% 29.69%
Number of salaries quoted 2918 3197 4424
City of London median annual salary £60,000 £57,500 £57,500
Median salary % change year-on-year +4.35% - +4.55%
10th Percentile £41,250 £36,250 £36,250
90th Percentile £87,500 £86,250 £85,000
Central London median annual salary £60,000 £55,000 £57,000
% change year-on-year +9.09% -3.51% +3.64%

Big Data
Job Vacancy Trend in the City of London

Job postings citing Big Data as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Big Data in the City of London

Big Data
Salary Trend in the City of London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in the City of London.

Salary trend for Big Data in the City of London

Big Data
Salary Histogram in the City of London

The salary distribution of IT jobs citing Big Data in the City of London over the 6 months to 20 November 2017.

Salary histogram for Big Data in the City of London

Big Data
Job Locations in the City of London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the City of London region over the 6 months to 20 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge +14 5 - -
Moorgate - 3 £90,000 -
Big Data
Central London

For the 6 months to 20 November 2017, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads across the City of London region with a requirement for Big Data.

1 191 (46.70%) Java
2 164 (40.10%) Hadoop
3 161 (39.36%) Agile Software Development
4 134 (32.76%) Finance
5 128 (31.30%) Apache Spark
6 127 (31.05%) Python
7 121 (29.58%) SQL
8 105 (25.67%) Amazon AWS
9 98 (23.96%) Analytics
10 93 (22.74%) NoSQL
11 81 (19.80%) Scala
12 79 (19.32%) Machine Learning
13 70 (17.11%) Business Intelligence
14 64 (15.65%) Data Warehouse
15 63 (15.40%) DevOps
16 62 (15.16%) SQL Server
17 59 (14.43%) Microsoft Azure
18 56 (13.69%) Degree
19 54 (13.20%) TDD
20 52 (12.71%) Software Engineering
21 51 (12.47%) Banking
21 51 (12.47%) Microservices
22 49 (11.98%) Elasticsearch
23 48 (11.74%) ETL
23 48 (11.74%) MongoDB
24 47 (11.49%) Apache Hive
24 47 (11.49%) Continuous Integration
25 45 (11.00%) R
25 45 (11.00%) Docker
26 42 (10.27%) Linux

Big Data
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 128 (31.30%) Apache Spark
2 49 (11.98%) Elasticsearch
3 42 (10.27%) Apache
4 19 (4.65%) Apache Solr
5 16 (3.91%) Tomcat
6 15 (3.67%) SAS
7 14 (3.42%) Apache Pig
8 13 (3.18%) WebLogic
9 12 (2.93%) Jetty
9 12 (2.93%) OpenStack
10 11 (2.69%) JBoss
10 11 (2.69%) WebSphere
11 9 (2.20%) WebSphere Application Server
12 4 (0.98%) CMS
12 4 (0.98%) nginx
13 3 (0.73%) Confluence
14 2 (0.49%) IIS
14 2 (0.49%) Sitefinity
14 2 (0.49%) Umbraco
14 2 (0.49%) WildFly
Applications
1 9 (2.20%) Microsoft Excel
2 6 (1.47%) SPSS
3 1 (0.24%) Microsoft Office
3 1 (0.24%) Microsoft PowerPoint
3 1 (0.24%) Spreadsheet
Business Applications
1 4 (0.98%) HFM
1 4 (0.98%) Hyperion Enterprise
2 2 (0.49%) Bloomberg AIM
2 2 (0.49%) Markit EDM
3 1 (0.24%) Dynamics CRM
3 1 (0.24%) Oracle Applications
3 1 (0.24%) Oracle EBS
3 1 (0.24%) Oracle ERP
Cloud Services
1 105 (25.67%) Amazon AWS
2 59 (14.43%) Microsoft Azure
3 24 (5.87%) Google Cloud Platform
4 14 (3.42%) Amazon EC2
5 13 (3.18%) AWS CloudFormation
6 12 (2.93%) Amazon Kinesis
6 12 (2.93%) Amazon S3
7 11 (2.69%) AWS Lambda
7 11 (2.69%) Serverless
8 10 (2.44%) GitHub
8 10 (2.44%) SaaS
9 5 (1.22%) Amazon EMR
9 5 (1.22%) Cloud Computing
9 5 (1.22%) Virtual Private Cloud
10 4 (0.98%) Amazon CloudWatch
10 4 (0.98%) Amazon ElastiCache
11 2 (0.49%) AWS CloudTrail
11 2 (0.49%) Azure Active Directory
11 2 (0.49%) IaaS
11 2 (0.49%) Route 53
Communications & Networking
1 10 (2.44%) HTTP
2 7 (1.71%) Internet
3 3 (0.73%) Firewall
3 3 (0.73%) Network Security
4 2 (0.49%) Broadband
4 2 (0.49%) Kerberos
4 2 (0.49%) LDAP
4 2 (0.49%) TCP/IP
5 1 (0.24%) DNS
5 1 (0.24%) GoToMeeting
5 1 (0.24%) Skype
5 1 (0.24%) SMS
5 1 (0.24%) SSL
5 1 (0.24%) VPN
5 1 (0.24%) Wireshark
5 1 (0.24%) X.509
Database & Business Intelligence
1 164 (40.10%) Hadoop
2 93 (22.74%) NoSQL
3 64 (15.65%) Data Warehouse
4 62 (15.16%) SQL Server
5 48 (11.74%) MongoDB
6 47 (11.49%) Apache Hive
7 38 (9.29%) Apache Cassandra
8 32 (7.82%) HBase
9 25 (6.11%) Amazon Redshift
9 25 (6.11%) MySQL
9 25 (6.11%) SQL Server Integration Services
10 23 (5.62%) Power BI
11 22 (5.38%) SQL Server Analysis Services
12 19 (4.65%) PostgreSQL
13 18 (4.40%) Data Mining
13 18 (4.40%) Redis
14 17 (4.16%) Data Lake
14 17 (4.16%) Relational Database
14 17 (4.16%) SQL Server Reporting Services
15 16 (3.91%) BigQuery
Development Applications
1 31 (7.58%) Git (software)
2 17 (4.16%) Jenkins
3 11 (2.69%) Maven
3 11 (2.69%) Talend Open Studio
4 10 (2.44%) Subversion
5 9 (2.20%) JIRA
6 6 (1.47%) Eclipse
6 6 (1.47%) JUnit
7 5 (1.22%) GoCD
7 5 (1.22%) RStudio
7 5 (1.22%) Selenium
7 5 (1.22%) SQL Server Management Studio (SSMS)
7 5 (1.22%) Travis CI
7 5 (1.22%) Visual Studio
8 3 (0.73%) Cucumber
9 2 (0.49%) CMake
9 2 (0.49%) Codeship
9 2 (0.49%) Gradle
9 2 (0.49%) Sonatype Nexus
10 1 (0.24%) Jasmine
General
1 134 (32.76%) Finance
2 51 (12.47%) Banking
3 29 (7.09%) Marketing
4 24 (5.87%) Games
5 22 (5.38%) Retail
6 19 (4.65%) Investment Banking
7 12 (2.93%) Front Office
8 11 (2.69%) Publishing
9 9 (2.20%) Financial Institution
10 8 (1.96%) Advertising
10 8 (1.96%) Law
11 4 (0.98%) Telecoms
12 3 (0.73%) Back Office
13 2 (0.49%) Legal
13 2 (0.49%) Pharmaceutical
13 2 (0.49%) Retail Banking
14 1 (0.24%) Automotive
Job Titles
1 175 (42.79%) Developer
2 91 (22.25%) Java Developer
3 42 (10.27%) Data Engineer
4 36 (8.80%) Lead Developer
5 34 (8.31%) Architect
6 33 (8.07%) Scala Developer
7 30 (7.33%) Data Scientist
8 28 (6.85%) SQL Developer
9 27 (6.60%) Big Data Developer
10 25 (6.11%) Analyst
11 24 (5.87%) Java Scala Developer
12 21 (5.13%) Big Data Engineer
13 19 (4.65%) Apache Spark Developer
13 19 (4.65%) Hadoop Developer
14 18 (4.40%) Lead Java Developer
14 18 (4.40%) Software Engineer
14 18 (4.40%) Solutions Architect
15 17 (4.16%) Business Intelligence Developer
15 17 (4.16%) Consultant
15 17 (4.16%) Senior Developer
Libraries, Frameworks & Software Standards
1 40 (9.78%) AngularJS
2 37 (9.05%) REST
3 32 (7.82%) Spring
4 30 (7.33%) React
5 28 (6.85%) Node.js
6 27 (6.60%) Kafka
6 27 (6.60%) Web Services
7 25 (6.11%) Akka
8 24 (5.87%) RESTful
9 23 (5.62%) .NET
9 23 (5.62%) HTML
10 18 (4.40%) CSS
10 18 (4.40%) JMS
10 18 (4.40%) Lucene
11 16 (3.91%) Apache Camel
11 16 (3.91%) JSON
12 14 (3.42%) XML
13 12 (2.93%) Elastic Stack
13 12 (2.93%) HTML5
14 10 (2.44%) Dropwizard
Miscellaneous
1 41 (10.02%) Fintech
1 41 (10.02%) Greenfield Project
2 33 (8.07%) Computer Science
3 31 (7.58%) Algorithms
4 24 (5.87%) Analytical Skills
5 20 (4.89%) Enterprise Software
6 14 (3.42%) Equities
7 12 (2.93%) Fixed Income
8 11 (2.69%) Foreign Exchange (FX)
8 11 (2.69%) Mobile App
9 10 (2.44%) Data Structures
10 9 (2.20%) Semantic Web
10 9 (2.20%) Virtual Team
11 8 (1.96%) User Experience
12 7 (1.71%) Social Network
13 6 (1.47%) Data Centre
14 5 (1.22%) Robotics
15 4 (0.98%) BBC
15 4 (0.98%) Clustering
15 4 (0.98%) Digital TV
Operating Systems
1 42 (10.27%) Linux
2 16 (3.91%) Unix
3 10 (2.44%) CentOS
4 7 (1.71%) Windows
5 5 (1.22%) Ubuntu
6 4 (0.98%) Mac OS X
6 4 (0.98%) Red Hat Enterprise Linux
7 2 (0.49%) AIX
8 1 (0.24%) Android
8 1 (0.24%) Apple iOS
Processes & Methodologies
1 161 (39.36%) Agile Software Development
2 98 (23.96%) Analytics
3 79 (19.32%) Machine Learning
4 70 (17.11%) Business Intelligence
5 63 (15.40%) DevOps
6 54 (13.20%) TDD
7 52 (12.71%) Software Engineering
8 51 (12.47%) Microservices
9 48 (11.74%) ETL
10 47 (11.49%) Continuous Integration
11 42 (10.27%) Scrum
12 41 (10.02%) Multithreading
13 33 (8.07%) Data Modelling
14 29 (7.09%) Open Source
15 27 (6.60%) Mentoring
15 27 (6.60%) Visualisation
16 26 (6.36%) Stakeholder Management
17 25 (6.11%) Statistics
18 24 (5.87%) Data Analytics
19 23 (5.62%) Predictive Analytics
Programming Languages
1 191 (46.70%) Java
2 127 (31.05%) Python
3 121 (29.58%) SQL
4 81 (19.80%) Scala
5 45 (11.00%) R
6 37 (9.05%) JavaScript
7 31 (7.58%) C#
8 27 (6.60%) C++
9 26 (6.36%) T-SQL
10 25 (6.11%) Go
11 22 (5.38%) PHP
12 20 (4.89%) Bash Shell
13 17 (4.16%) Perl
14 16 (3.91%) C
15 15 (3.67%) Ruby
16 10 (2.44%) MATLAB
17 4 (0.98%) Clojure
17 4 (0.98%) F#
18 3 (0.73%) CoffeeScript
18 3 (0.73%) Julia
Qualifications
1 56 (13.69%) Degree
2 18 (4.40%) Computer Science Degree
3 16 (3.91%) PhD
4 14 (3.42%) ISEB
5 6 (1.47%) Security Cleared
6 5 (1.22%) CISSP
6 5 (1.22%) DV Cleared
7 4 (0.98%) ACCA
7 4 (0.98%) Microsoft Certification
8 3 (0.73%) Master's Degree
8 3 (0.73%) Numerate Degree
9 2 (0.49%) CISM
9 2 (0.49%) SC Cleared
10 1 (0.24%) CCNP
10 1 (0.24%) Cisco Certification
10 1 (0.24%) Postgraduate
Quality Assurance & Compliance
1 12 (2.93%) Data Quality
2 11 (2.69%) QA
3 9 (2.20%) Sarbanes-Oxley
3 9 (2.20%) Solvency II
4 5 (1.22%) GCP
4 5 (1.22%) SLA
5 4 (0.98%) GDPR
6 3 (0.73%) PMO
7 1 (0.24%) Actionable Recommendations
7 1 (0.24%) IFRS
7 1 (0.24%) IFRS 9
7 1 (0.24%) ISO/IEC 27001
System Software
1 45 (11.00%) Docker
2 25 (6.11%) HDFS
3 10 (2.44%) Apache Flume
4 3 (0.73%) Apache ZooKeeper
5 2 (0.49%) Active Directory
5 2 (0.49%) Virtual Machines
6 1 (0.24%) Cygwin
6 1 (0.24%) KVM
6 1 (0.24%) OpenAM
6 1 (0.24%) vCloud
6 1 (0.24%) VMware Infrastructure
Systems Management
1 26 (6.36%) Ansible
2 22 (5.38%) Puppet
3 18 (4.40%) Opscode Chef
4 17 (4.16%) Kubernetes
5 15 (3.67%) Terraform
6 12 (2.93%) Kibana
6 12 (2.93%) logstash
7 9 (2.20%) Salt
8 4 (0.98%) Mesos
9 3 (0.73%) Graphite
9 3 (0.73%) Oozie
10 2 (0.49%) Hadoop YARN
10 2 (0.49%) ZABBIX
11 1 (0.24%) Rundeck
Vendors
1 42 (10.27%) Microsoft
2 41 (10.02%) Oracle
3 27 (6.60%) Tableau
4 21 (5.13%) Google
5 14 (3.42%) Cloudera
6 11 (2.69%) Salesforce.com
6 11 (2.69%) Talend
7 9 (2.20%) Cognos
7 9 (2.20%) Informatica
7 9 (2.20%) SAP
8 6 (1.47%) Autodesk
8 6 (1.47%) Red Hat
8 6 (1.47%) Teradata
9 5 (1.22%) Adthena
9 5 (1.22%) Hyperion
9 5 (1.22%) Splunk
10 4 (0.98%) Arqiva
10 4 (0.98%) BT
10 4 (0.98%) MicroStrategy
11 3 (0.73%) VMware