Period
to 21 January 2020

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 21 January 2020 with a comparison to the same period in the previous 2 years.

Big Data
UK > England
6 months to
21 Jan 2020
Same period 2019 Same period 2018
Rank 99 85 94
Rank change year-on-year -14 +9 -6
Permanent jobs citing Big Data 3,622 4,986 5,350
As % of all permanent IT jobs advertised in England 3.10% 3.56% 3.32%
As % of the Database & Business Intelligence category 11.58% 12.46% 10.87%
Number of salaries quoted 2,859 3,980 4,434
England median annual salary £70,000 £70,000 £65,000
Median salary % change year-on-year - +7.69% +4.00%
10th Percentile £40,000 £40,000 £37,500
90th Percentile £110,000 £97,500 £95,000
UK median annual salary £70,000 £67,500 £62,500
% change year-on-year +3.70% +8.00% -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 31,285 40,030 49,223
As % of all permanent IT jobs advertised in England 26.80% 28.55% 30.58%
Number of salaries quoted 25,898 33,138 41,208
England median annual salary £52,500 £52,500 £50,000
Median salary % change year-on-year - +5.00% +5.26%
10th Percentile £32,500 £31,250 £30,500
90th Percentile £90,000 £85,000 £77,500
UK median annual salary £52,500 £52,500 £48,000
% change year-on-year - +9.38% +1.05%

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a percentage of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in England.

Salary trend for Big Data in England

Big Data
Salary Histogram in England

The salary distribution of IT jobs citing Big Data in England over the 6 months to 21 January 2020.

Salary histogram for Big Data in England

Big Data
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the England region over the 6 months to 21 January 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -11 2,212 £75,000 - 339
South East -44 473 £57,500 +4.55% 94
North of England +9 310 £54,671 +4.13% 55
South West -33 241 £50,000 -13.04% 31
Midlands +5 232 £60,000 - 37
North West -11 169 £52,500 -6.67% 32
East of England -13 149 £72,500 +16.00% 40
East Midlands +17 143 £70,000 +7.69% 8
Yorkshire +51 102 £55,000 +4.76% 15
West Midlands -27 84 £55,000 - 29
North East +15 40 £45,412 -7.96% 8
Big Data
UK

For the 6 months to 21 January 2020, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Big Data.

1 1,493 (41.22%) Agile Software Development
2 1,442 (39.81%) Python
3 1,331 (36.75%) Analytics
4 1,218 (33.63%) SQL
5 1,188 (32.80%) Java
6 1,148 (31.70%) AWS
7 1,043 (28.80%) Hadoop
8 1,012 (27.94%) Apache Spark
9 969 (26.75%) Machine Learning
10 912 (25.18%) Data Science
11 789 (21.78%) Azure
12 775 (21.40%) Finance
13 684 (18.88%) DevOps
14 675 (18.64%) ETL
15 666 (18.39%) Degree
16 653 (18.03%) Software Engineering
17 612 (16.90%) Artificial Intelligence
18 604 (16.68%) Business Intelligence
19 585 (16.15%) Data Warehouse
20 567 (15.65%) Scala
21 560 (15.46%) NoSQL
22 535 (14.77%) Microservices
23 524 (14.47%) Analytical Skills
24 521 (14.38%) Linux
25 519 (14.33%) Docker
26 511 (14.11%) Kafka
27 506 (13.97%) JavaScript
28 485 (13.39%) Data Modelling
29 483 (13.34%) Data Analytics
30 478 (13.20%) Apache Hive

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,012 (27.94%) Apache Spark
2 214 (5.91%) Elasticsearch
3 163 (4.50%) Apache
4 81 (2.24%) Apache Airflow
5 47 (1.30%) SAS
6 37 (1.02%) Confluence
7 36 (0.99%) OpenStack
8 32 (0.88%) Apache Solr
9 29 (0.80%) Apache Pig
10 23 (0.64%) Jupyter
11 20 (0.55%) Luigi
11 20 (0.55%) Tornado
12 18 (0.50%) IIS
13 16 (0.44%) Cloud Foundry
13 16 (0.44%) nginx
14 13 (0.36%) ArcGIS
14 13 (0.36%) NServiceBus
15 11 (0.30%) SharePoint
16 8 (0.22%) CMS
16 8 (0.22%) JBoss
Applications
1 64 (1.77%) Microsoft Excel
2 20 (0.55%) Microsoft Office
3 19 (0.52%) SPSS
4 10 (0.28%) MS Visio
5 8 (0.22%) Microsoft PowerPoint
6 5 (0.14%) Microsoft Project
7 4 (0.11%) Gephi
8 2 (0.055%) Chatbot
8 2 (0.055%) InVision
8 2 (0.055%) Sketch
8 2 (0.055%) Spreadsheet
9 1 (0.028%) Simulink
9 1 (0.028%) SPSS Modeler
9 1 (0.028%) Stata
Business Applications
1 34 (0.94%) Sparx Enterprise Architect
2 19 (0.52%) SAP S/4HANA
3 8 (0.22%) SAP HCM
4 7 (0.19%) PolarLake
4 7 (0.19%) SAP Payroll
5 6 (0.17%) Dynamics CRM
6 5 (0.14%) SAP MDG
7 4 (0.11%) Eagle PACE
7 4 (0.11%) Markit EDM
8 3 (0.083%) Adobe Campaign
8 3 (0.083%) NetSuite
9 2 (0.055%) Eikon
9 2 (0.055%) Oracle Financials
9 2 (0.055%) SAP BPC
9 2 (0.055%) SAP MM
10 1 (0.028%) FINCAD Analytics
10 1 (0.028%) Oracle BPM
10 1 (0.028%) SAP ERP
10 1 (0.028%) SAP HR
10 1 (0.028%) WebTrends
Cloud Services
1 1,148 (31.70%) AWS
2 789 (21.78%) Azure
3 470 (12.98%) GCP
4 191 (5.27%) Amazon S3
5 173 (4.78%) Power Platform
6 132 (3.64%) Amazon EMR
7 129 (3.56%) Serverless
8 115 (3.18%) SaaS
9 109 (3.01%) Cloud Computing
10 84 (2.32%) AWS Lambda
11 83 (2.29%) Amazon EC2
12 77 (2.13%) Amazon Kinesis
13 72 (1.99%) PaaS
14 62 (1.71%) Azure Data Factory
15 59 (1.63%) Amazon SQS
16 51 (1.41%) GitHub
17 45 (1.24%) Amazon ECS
18 43 (1.19%) IaaS
18 43 (1.19%) OpenShift
19 32 (0.88%) AWS Fargate
Communications & Networking
1 132 (3.64%) Internet
2 60 (1.66%) Firewall
3 43 (1.19%) TCP/IP
4 40 (1.10%) DNS
5 28 (0.77%) DHCP
6 26 (0.72%) HTTP
7 24 (0.66%) DMZ
8 21 (0.58%) HTTPS
9 19 (0.52%) VPN
10 15 (0.41%) Kerberos
11 12 (0.33%) SSH
11 12 (0.33%) SSL
12 11 (0.30%) SNA
13 9 (0.25%) Network Security
13 9 (0.25%) Unified Communications
14 8 (0.22%) SAN
15 5 (0.14%) DSL
15 5 (0.14%) Ethernet
15 5 (0.14%) MPLS
15 5 (0.14%) NAS
Database & Business Intelligence
1 1,043 (28.80%) Hadoop
2 585 (16.15%) Data Warehouse
3 560 (15.46%) NoSQL
4 478 (13.20%) Apache Hive
5 369 (10.19%) SQL Server
6 257 (7.10%) Relational Database
7 244 (6.74%) MongoDB
8 237 (6.54%) Data Lake
9 218 (6.02%) PostgreSQL
10 190 (5.25%) Amazon Redshift
11 176 (4.86%) HBase
12 173 (4.78%) Power BI
13 165 (4.56%) Impala
14 138 (3.81%) MySQL
15 137 (3.78%) Apache Cassandra
16 118 (3.26%) Amazon DynamoDB
16 118 (3.26%) BigQuery
17 110 (3.04%) SQL Server Integration Services
18 100 (2.76%) Data Mining
18 100 (2.76%) Flink
Development Applications
1 451 (12.45%) Git (software)
2 272 (7.51%) Jenkins
3 209 (5.77%) JIRA
4 73 (2.02%) Bitbucket
5 56 (1.55%) Atlassian Bamboo
6 51 (1.41%) GitLab
7 44 (1.21%) Visual Studio
8 37 (1.02%) ERwin
9 35 (0.97%) git-flow
9 35 (0.97%) Vagrant
10 31 (0.86%) JUnit
11 28 (0.77%) Subversion
12 25 (0.69%) Octopus Deploy
12 25 (0.69%) Selenium
13 21 (0.58%) Visual Studio Team System
14 19 (0.52%) Maven
15 18 (0.50%) Bitbucket Server
15 18 (0.50%) Eclipse
16 17 (0.47%) webpack
17 16 (0.44%) Cucumber
General
1 775 (21.40%) Finance
2 188 (5.19%) Marketing
3 185 (5.11%) Banking
4 154 (4.25%) Retail
5 95 (2.62%) Public Sector
6 85 (2.35%) Front Office
7 79 (2.18%) Telecoms
8 75 (2.07%) Games
9 68 (1.88%) Legal
10 58 (1.60%) Advertising
11 55 (1.52%) Law
12 52 (1.44%) Manufacturing
13 41 (1.13%) Automotive
14 40 (1.10%) Pharmaceutical
15 28 (0.77%) Billing
16 22 (0.61%) Financial Institution
17 20 (0.55%) Investment Banking
18 19 (0.52%) Aerospace
19 16 (0.44%) Electronics
20 15 (0.41%) Local Government
Job Titles
1 968 (26.73%) Developer
2 602 (16.62%) Data Engineer
3 462 (12.76%) Java Developer
4 449 (12.40%) Architect
5 257 (7.10%) Software Engineer
6 256 (7.07%) Data Architect
7 226 (6.24%) Senior Developer
8 215 (5.94%) Analyst
9 214 (5.91%) Data Scientist
10 179 (4.94%) Consultant
11 164 (4.53%) Big Data Engineer
12 148 (4.09%) Java Engineer
13 147 (4.06%) Senior Data Engineer
14 146 (4.03%) Python Engineer
15 132 (3.64%) Python Developer
16 117 (3.23%) Solutions Architect
17 110 (3.04%) Data Analyst
18 105 (2.90%) Java Software Engineer
19 101 (2.79%) DevOps Engineer
20 100 (2.76%) Senior Java Developer
Libraries, Frameworks & Software Standards
1 511 (14.11%) Kafka
2 285 (7.87%) Node.js
3 255 (7.04%) React
4 242 (6.68%) .NET
5 238 (6.57%) Web Services
6 219 (6.05%) AngularJS
7 193 (5.33%) HTML
8 182 (5.02%) RESTful
9 167 (4.61%) REST
10 158 (4.36%) Spring
11 152 (4.20%) CSS
12 133 (3.67%) Natural Language Processing
13 113 (3.12%) J2EE
14 102 (2.82%) TensorFlow
15 88 (2.43%) XML
16 81 (2.24%) JSON
17 79 (2.18%) HTML5
18 69 (1.91%) scikit-learn
19 68 (1.88%) ASP.NET
19 68 (1.88%) Pandas
Miscellaneous
1 524 (14.47%) Analytical Skills
2 262 (7.23%) Algorithms
3 198 (5.47%) Data Structures
4 173 (4.78%) Greenfield Project
5 168 (4.64%) User Experience
6 141 (3.89%) Management Information System
7 92 (2.54%) Internet of Things
8 82 (2.26%) Cloud Native
9 78 (2.15%) Enterprise Software
10 67 (1.85%) Public Cloud
11 62 (1.71%) Data Centre
12 58 (1.60%) Linux Command Line
13 55 (1.52%) Social Media
14 48 (1.33%) Mobile App
15 44 (1.21%) Fixed Income
15 44 (1.21%) Reference Data
15 44 (1.21%) Virtual Team
16 40 (1.10%) Equities
16 40 (1.10%) Life Science
16 40 (1.10%) Self-Motivation
Operating Systems
1 521 (14.38%) Linux
2 156 (4.31%) Unix
3 148 (4.09%) Windows
4 38 (1.05%) Red Hat Enterprise Linux
5 37 (1.02%) CentOS
6 32 (0.88%) Android
6 32 (0.88%) Ubuntu
7 28 (0.77%) Apple iOS
8 24 (0.66%) Solaris
9 20 (0.55%) Windows Server
10 16 (0.44%) Windows 7
11 13 (0.36%) Fedora
12 10 (0.28%) Mac OS
13 9 (0.25%) Debian
14 8 (0.22%) Windows 10
15 5 (0.14%) Windows Server 2012
16 4 (0.11%) VME
17 2 (0.055%) Oracle Linux
18 1 (0.028%) Mac OS X
Processes & Methodologies
1 1,493 (41.22%) Agile Software Development
2 1,331 (36.75%) Analytics
3 969 (26.75%) Machine Learning
4 912 (25.18%) Data Science
5 684 (18.88%) DevOps
6 675 (18.64%) ETL
7 653 (18.03%) Software Engineering
8 612 (16.90%) Artificial Intelligence
9 604 (16.68%) Business Intelligence
10 535 (14.77%) Microservices
11 485 (13.39%) Data Modelling
12 483 (13.34%) Data Analytics
13 436 (12.04%) Computer Science
14 384 (10.60%) Problem-Solving
15 358 (9.88%) Visualisation
16 346 (9.55%) Data Engineering
17 307 (8.48%) Scrum
18 289 (7.98%) Project Management
19 277 (7.65%) Open Source
20 263 (7.26%) Data Management
Programming Languages
1 1,442 (39.81%) Python
2 1,218 (33.63%) SQL
3 1,188 (32.80%) Java
4 567 (15.65%) Scala
5 506 (13.97%) JavaScript
6 381 (10.52%) C#
7 320 (8.83%) R
8 241 (6.65%) C
9 218 (6.02%) C++
10 142 (3.92%) Bash Shell
11 141 (3.89%) Java 8
12 113 (3.12%) TypeScript
13 85 (2.35%) PL/SQL
14 84 (2.32%) Shell Script
15 77 (2.13%) PHP
16 76 (2.10%) Go
17 68 (1.88%) T-SQL
18 67 (1.85%) ES6
19 64 (1.77%) PowerShell
20 60 (1.66%) Kotlin
Qualifications
1 666 (18.39%) Degree
2 245 (6.76%) Security Cleared
3 217 (5.99%) Computer Science Degree
4 129 (3.56%) DV Cleared
5 116 (3.20%) SC Cleared
6 102 (2.82%) PhD
7 60 (1.66%) Microsoft Certification
8 55 (1.52%) Master's Degree
9 40 (1.10%) CISSP
10 37 (1.02%) CompTIA Security+
11 36 (0.99%) Network+ Certification
12 35 (0.97%) Cisco Certification
13 30 (0.83%) CCNA
14 29 (0.80%) PMI Certification
14 29 (0.80%) SSCP
15 28 (0.77%) GIAC
15 28 (0.77%) Linux+ Certification
15 28 (0.77%) MCSE
15 28 (0.77%) SANS
16 24 (0.66%) MCP
Quality Assurance & Compliance
1 245 (6.76%) QA
2 223 (6.16%) Data Quality
3 44 (1.21%) GDPR
4 35 (0.97%) SLA
5 29 (0.80%) ISO/IEC 27001
6 7 (0.19%) GMP
6 7 (0.19%) HIPAA
7 6 (0.17%) PCI DSS
7 6 (0.17%) PMO
8 4 (0.11%) PMBOK
8 4 (0.11%) Sarbanes-Oxley
9 3 (0.083%) MiFID
10 2 (0.055%) ISO 26262
11 1 (0.028%) Basel III
11 1 (0.028%) COBIT
11 1 (0.028%) Cyber Essentials
11 1 (0.028%) EMIR
11 1 (0.028%) IFRS
11 1 (0.028%) IFRS 9
11 1 (0.028%) ISO 9001
System Software
1 519 (14.33%) Docker
2 151 (4.17%) HDFS
3 60 (1.66%) Apache Flume
4 43 (1.19%) VMware Infrastructure
5 40 (1.10%) VirtualBox
6 39 (1.08%) Active Directory
7 37 (1.02%) Apache ZooKeeper
7 37 (1.02%) NFS
8 24 (0.66%) Firmware
9 16 (0.44%) VMware ESXi
10 13 (0.36%) Samba
10 13 (0.36%) Xen
11 9 (0.25%) Microsoft App-V
12 5 (0.14%) Virtual Machines
13 4 (0.11%) Hyper-V
14 3 (0.083%) Varnish
14 3 (0.083%) vSphere
15 2 (0.055%) Oracle RAC
15 2 (0.055%) vCloud
16 1 (0.028%) KVM
Systems Management
1 393 (10.85%) Kubernetes
2 259 (7.15%) Ansible
3 186 (5.14%) Terraform
4 122 (3.37%) Puppet
5 100 (2.76%) Oozie
6 71 (1.96%) Hadoop YARN
7 67 (1.85%) Opscode Chef
8 56 (1.55%) Docker Swarm
9 23 (0.64%) Nagios
10 21 (0.58%) Salt
11 20 (0.55%) Kibana
12 18 (0.50%) Ambari
13 15 (0.41%) ZABBIX
14 14 (0.39%) Consul
15 13 (0.36%) OpenNMS
15 13 (0.36%) vCenter Server
16 11 (0.30%) Mesos
16 11 (0.30%) SCCM
17 10 (0.28%) Single Sign-On
18 9 (0.25%) Packer
Vendors
1 399 (11.02%) Google
2 328 (9.06%) Microsoft
3 272 (7.51%) Oracle
4 179 (4.94%) Cloudera
5 168 (4.64%) Tableau
6 134 (3.70%) Informatica
7 132 (3.64%) Hortonworks
8 116 (3.20%) IBM
9 103 (2.84%) SAP
10 86 (2.37%) Databricks
11 83 (2.29%) Talend
12 75 (2.07%) Sage
13 70 (1.93%) Splunk
14 69 (1.91%) Teradata
15 62 (1.71%) VMware
16 54 (1.49%) Salesforce.com
17 44 (1.21%) Facebook
18 35 (0.97%) Red Hat
19 30 (0.83%) Sparx
20 29 (0.80%) Adobe