Period
to 22 November 2019

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 22 November 2019 with a comparison to the same period in the previous 2 years.

Big Data
UK > England
6 months to
22 Nov 2019
Same period 2018 Same period 2017
Rank 100 83 99
Rank change year-on-year -17 +16 -5
Permanent jobs citing Big Data 3,941 5,581 5,419
As % of all permanent IT jobs advertised in England 3.16% 3.68% 3.21%
As % of the Database & Business Intelligence category 11.76% 12.68% 10.64%
Number of salaries quoted 3,184 4,150 4,380
England median annual salary £70,000 £67,500 £62,500
Median salary % change year-on-year +3.70% +8.00% -
10th Percentile £40,000 £38,750 £37,500
90th Percentile £107,500 £97,500 £93,750
UK median annual salary £70,000 £65,000 £62,500
% change year-on-year +7.69% +4.00% -

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 33,514 44,002 50,951
As % of all permanent IT jobs advertised in England 26.83% 29.02% 30.16%
Number of salaries quoted 27,982 36,373 42,342
England median annual salary £52,500 £51,500 £50,000
Median salary % change year-on-year +1.94% +3.00% +5.26%
10th Percentile £31,875 £31,250 £30,000
90th Percentile £87,500 £85,000 £77,500
UK median annual salary £52,500 £50,000 £47,500
% change year-on-year +5.00% +5.26% -

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a percentage of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in England.

Salary trend for Big Data in England

Big Data
Salary Histogram in England

The salary distribution of IT jobs citing Big Data in England over the 6 months to 22 November 2019.

Salary histogram for Big Data in England

Big Data
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the England region over the 6 months to 22 November 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -5 2,415 £77,000 +6.21% 303
South East -52 472 £60,000 +9.09% 80
South West -9 339 £50,000 -13.04% 40
North of England -6 296 £55,000 +10.00% 68
Midlands +10 232 £57,500 -11.54% 37
East of England -16 183 £65,000 +8.33% 41
North West -31 171 £54,486 +8.97% 39
East Midlands +35 155 £57,500 -23.33% 14
Yorkshire +43 95 £55,000 +4.76% 19
West Midlands -38 72 £50,000 -9.09% 23
North East +32 31 £45,412 -24.31% 10
Big Data
UK

For the 6 months to 22 November 2019, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Big Data.

1 1,616 (41.00%) Agile Software Development
2 1,599 (40.57%) Python
3 1,447 (36.72%) Analytics
4 1,308 (33.19%) SQL
5 1,278 (32.43%) Java
6 1,211 (30.73%) AWS
7 1,146 (29.08%) Hadoop
8 1,126 (28.57%) Apache Spark
9 1,042 (26.44%) Machine Learning
10 951 (24.13%) Data Science
11 878 (22.28%) Azure
12 827 (20.98%) Finance
13 723 (18.35%) DevOps
14 700 (17.76%) Degree
15 687 (17.43%) Software Engineering
16 686 (17.41%) ETL
17 651 (16.52%) Business Intelligence
18 629 (15.96%) Data Warehouse
19 613 (15.55%) Linux
20 605 (15.35%) Apache Hive
21 604 (15.33%) Scala
22 603 (15.30%) Artificial Intelligence
23 585 (14.84%) NoSQL
24 570 (14.46%) Docker
25 551 (13.98%) Microservices
26 538 (13.65%) Kafka
27 522 (13.25%) GCP
28 511 (12.97%) Git (software)
29 507 (12.86%) JavaScript
30 502 (12.74%) Analytical Skills

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,126 (28.57%) Apache Spark
2 248 (6.29%) Elasticsearch
3 153 (3.88%) Apache
4 71 (1.80%) Apache Airflow
5 62 (1.57%) SAS
6 58 (1.47%) OpenStack
7 44 (1.12%) Apache Pig
8 35 (0.89%) Apache Solr
9 34 (0.86%) Confluence
10 23 (0.58%) nginx
11 22 (0.56%) Jupyter
12 21 (0.53%) Tornado
13 18 (0.46%) NServiceBus
14 16 (0.41%) IIS
15 15 (0.38%) Luigi
16 11 (0.28%) CMS
16 11 (0.28%) WildFly
17 10 (0.25%) Cloud Foundry
17 10 (0.25%) JBoss
17 10 (0.25%) SharePoint
Applications
1 63 (1.60%) Microsoft Excel
2 20 (0.51%) Microsoft Office
3 11 (0.28%) MS Visio
4 9 (0.23%) SPSS
5 8 (0.20%) Microsoft PowerPoint
6 7 (0.18%) Gephi
7 4 (0.10%) Spreadsheet
8 3 (0.076%) GNU Octave
8 3 (0.076%) Microsoft Project
8 3 (0.076%) Stata
9 1 (0.025%) Adobe Premiere
9 1 (0.025%) InVision
9 1 (0.025%) Simulink
9 1 (0.025%) Sketch
9 1 (0.025%) SPSS Modeler
Business Applications
1 37 (0.94%) Sparx Enterprise Architect
2 20 (0.51%) SAP S/4HANA
3 7 (0.18%) PolarLake
4 6 (0.15%) Dynamics CRM
5 4 (0.10%) Adobe Campaign
5 4 (0.10%) Eagle PACE
5 4 (0.10%) Markit EDM
5 4 (0.10%) SAP HCM
5 4 (0.10%) SAP MDG
5 4 (0.10%) SAP Payroll
6 2 (0.051%) Data Workbench
6 2 (0.051%) Eikon
6 2 (0.051%) NetSuite
6 2 (0.051%) Oracle BPM
6 2 (0.051%) Oracle Financials
6 2 (0.051%) SAP ERP
6 2 (0.051%) WebTrends
7 1 (0.025%) Dynamics AX
7 1 (0.025%) SAP HR
7 1 (0.025%) SAP SCM
Cloud Services
1 1,211 (30.73%) AWS
2 878 (22.28%) Azure
3 522 (13.25%) GCP
4 205 (5.20%) Amazon S3
5 190 (4.82%) Power Platform
6 157 (3.98%) Serverless
7 128 (3.25%) Amazon EMR
8 112 (2.84%) Cloud Computing
9 109 (2.77%) SaaS
10 102 (2.59%) Amazon EC2
10 102 (2.59%) AWS Lambda
11 87 (2.21%) Amazon SQS
12 85 (2.16%) PaaS
13 80 (2.03%) Azure Data Factory
13 80 (2.03%) GitHub
14 70 (1.78%) Amazon Kinesis
15 66 (1.67%) Amazon ECS
16 63 (1.60%) OpenShift
17 51 (1.29%) IaaS
18 45 (1.14%) AWS Fargate
Communications & Networking
1 136 (3.45%) Internet
2 86 (2.18%) Firewall
3 78 (1.98%) TCP/IP
4 45 (1.14%) HTTPS
5 42 (1.07%) DNS
6 31 (0.79%) HTTP
7 29 (0.74%) DHCP
8 25 (0.63%) VPN
9 24 (0.61%) DMZ
10 16 (0.41%) SSL
11 15 (0.38%) Kerberos
11 15 (0.38%) SSH
12 11 (0.28%) Unified Communications
13 10 (0.25%) Network Security
14 8 (0.20%) Ethernet
14 8 (0.20%) MPLS
15 6 (0.15%) NAS
15 6 (0.15%) SAN
16 5 (0.13%) Converged Networks
16 5 (0.13%) Wi-Fi
Database & Business Intelligence
1 1,146 (29.08%) Hadoop
2 629 (15.96%) Data Warehouse
3 605 (15.35%) Apache Hive
4 585 (14.84%) NoSQL
5 396 (10.05%) SQL Server
6 293 (7.43%) Data Lake
7 273 (6.93%) MongoDB
8 254 (6.45%) Relational Database
9 220 (5.58%) HBase
10 215 (5.46%) Impala
11 200 (5.07%) PostgreSQL
12 190 (4.82%) Power BI
13 164 (4.16%) Amazon Redshift
14 163 (4.14%) MySQL
15 142 (3.60%) Apache Cassandra
16 130 (3.30%) BigQuery
17 128 (3.25%) SQL Server Integration Services
18 104 (2.64%) SQL Server Analysis Services
19 98 (2.49%) Data Mining
20 91 (2.31%) Flink
Development Applications
1 511 (12.97%) Git (software)
2 327 (8.30%) Jenkins
3 253 (6.42%) JIRA
4 132 (3.35%) Bitbucket
5 88 (2.23%) git-flow
6 60 (1.52%) GitLab
7 56 (1.42%) Selenium
8 48 (1.22%) Atlassian Bamboo
8 48 (1.22%) Cucumber
8 48 (1.22%) Visual Studio
9 46 (1.17%) Bitbucket Server
10 35 (0.89%) JUnit
11 34 (0.86%) Octopus Deploy
12 28 (0.71%) ERwin
12 28 (0.71%) Vagrant
13 23 (0.58%) Subversion
13 23 (0.58%) Team Foundation Server
14 21 (0.53%) Gradle
15 20 (0.51%) Bower
16 19 (0.48%) Artifactory
General
1 827 (20.98%) Finance
2 221 (5.61%) Retail
3 215 (5.46%) Banking
4 207 (5.25%) Marketing
5 113 (2.87%) Telecoms
6 102 (2.59%) Public Sector
7 100 (2.54%) Games
8 95 (2.41%) Front Office
9 74 (1.88%) Legal
10 58 (1.47%) Manufacturing
11 55 (1.40%) Pharmaceutical
12 53 (1.34%) Advertising
13 46 (1.17%) Law
14 39 (0.99%) Financial Institution
15 35 (0.89%) Automotive
16 34 (0.86%) Investment Banking
17 27 (0.69%) Electronics
18 24 (0.61%) Billing
19 21 (0.53%) Multimedia
19 21 (0.53%) Publishing
Job Titles
1 1,074 (27.25%) Developer
2 667 (16.92%) Data Engineer
3 493 (12.51%) Java Developer
4 453 (11.49%) Architect
5 269 (6.83%) Consultant
6 263 (6.67%) Software Engineer
7 244 (6.19%) Data Scientist
8 238 (6.04%) Data Architect
9 234 (5.94%) Senior Developer
10 198 (5.02%) Analyst
11 192 (4.87%) Big Data Engineer
12 185 (4.69%) Senior Data Engineer
13 183 (4.64%) Python Engineer
14 147 (3.73%) Java Engineer
15 143 (3.63%) Python Developer
16 124 (3.15%) DevOps Engineer
17 119 (3.02%) Solutions Architect
18 113 (2.87%) Java Software Engineer
19 112 (2.84%) Data Analyst
20 111 (2.82%) AWS Engineer
Libraries, Frameworks & Software Standards
1 538 (13.65%) Kafka
2 311 (7.89%) .NET
3 302 (7.66%) Node.js
4 300 (7.61%) Web Services
5 261 (6.62%) React
6 225 (5.71%) AngularJS
7 214 (5.43%) HTML
8 192 (4.87%) REST
9 189 (4.80%) Spring
10 180 (4.57%) RESTful
11 166 (4.21%) CSS
12 105 (2.66%) J2EE
13 104 (2.64%) Natural Language Processing
14 103 (2.61%) Pandas
15 101 (2.56%) ASP.NET
16 95 (2.41%) Elastic Stack
17 93 (2.36%) XML
18 90 (2.28%) TensorFlow
19 88 (2.23%) GraphQL
20 86 (2.18%) JSON
Miscellaneous
1 502 (12.74%) Analytical Skills
2 297 (7.54%) Algorithms
3 211 (5.35%) Data Structures
4 177 (4.49%) Greenfield Project
5 170 (4.31%) Management Information System
6 138 (3.50%) User Experience
7 85 (2.16%) Internet of Things
8 76 (1.93%) Linux Command Line
9 74 (1.88%) Cloud Native
9 74 (1.88%) Enterprise Software
10 69 (1.75%) Data Centre
10 69 (1.75%) Public Cloud
11 62 (1.57%) Mobile App
12 53 (1.34%) Life Science
13 52 (1.32%) Social Media
14 50 (1.27%) Virtual Team
15 49 (1.24%) Equities
16 48 (1.22%) Fixed Income
17 47 (1.19%) Analytical Mindset
18 46 (1.17%) Cyber Kill Chain
Operating Systems
1 613 (15.55%) Linux
2 205 (5.20%) Unix
3 156 (3.96%) Windows
4 71 (1.80%) Android
5 62 (1.57%) Apple iOS
6 42 (1.07%) CentOS
7 36 (0.91%) Red Hat Enterprise Linux
8 32 (0.81%) Ubuntu
9 23 (0.58%) Solaris
9 23 (0.58%) Windows Server
10 11 (0.28%) Debian
11 10 (0.25%) Mac OS
12 9 (0.23%) Fedora
13 8 (0.20%) Windows 10
14 7 (0.18%) Windows 7
15 6 (0.15%) VME
16 5 (0.13%) Oracle Linux
16 5 (0.13%) Windows Server 2012
17 1 (0.025%) Mac OS X
17 1 (0.025%) Windows Server 2008
Processes & Methodologies
1 1,616 (41.00%) Agile Software Development
2 1,447 (36.72%) Analytics
3 1,042 (26.44%) Machine Learning
4 951 (24.13%) Data Science
5 723 (18.35%) DevOps
6 687 (17.43%) Software Engineering
7 686 (17.41%) ETL
8 651 (16.52%) Business Intelligence
9 603 (15.30%) Artificial Intelligence
10 551 (13.98%) Microservices
11 485 (12.31%) Data Analytics
12 471 (11.95%) Data Modelling
13 427 (10.83%) Problem-Solving
14 423 (10.73%) Computer Science
15 378 (9.59%) Scrum
16 358 (9.08%) Visualisation
17 353 (8.96%) Data Engineering
18 289 (7.33%) Open Source
19 288 (7.31%) Mentoring
20 285 (7.23%) Mathematics
Programming Languages
1 1,599 (40.57%) Python
2 1,308 (33.19%) SQL
3 1,278 (32.43%) Java
4 604 (15.33%) Scala
5 507 (12.86%) JavaScript
6 424 (10.76%) R
7 415 (10.53%) C#
8 297 (7.54%) C
9 218 (5.53%) C++
10 187 (4.74%) Bash Shell
11 134 (3.40%) Java 8
12 109 (2.77%) TypeScript
13 101 (2.56%) Shell Script
14 86 (2.18%) PL/SQL
15 83 (2.11%) PHP
16 81 (2.06%) Perl
17 74 (1.88%) Go
17 74 (1.88%) PowerShell
18 70 (1.78%) Ruby
19 68 (1.73%) T-SQL
Qualifications
1 700 (17.76%) Degree
2 231 (5.86%) Security Cleared
3 200 (5.07%) Computer Science Degree
4 126 (3.20%) DV Cleared
5 98 (2.49%) PhD
6 89 (2.26%) SC Cleared
7 81 (2.06%) Microsoft Certification
8 63 (1.60%) Master's Degree
9 55 (1.40%) CISSP
10 49 (1.24%) CompTIA Security+
11 48 (1.22%) Network+ Certification
12 45 (1.14%) Cisco Certification
13 44 (1.12%) CCNA
14 42 (1.07%) GIAC
14 42 (1.07%) MCSE
14 42 (1.07%) SSCP
15 41 (1.04%) SANS
16 40 (1.01%) Linux+ Certification
17 30 (0.76%) Numerate Degree
18 28 (0.71%) PMI Certification
Quality Assurance & Compliance
1 227 (5.76%) QA
2 211 (5.35%) Data Quality
3 53 (1.34%) GDPR
4 38 (0.96%) ISO/IEC 27001
5 30 (0.76%) SLA
6 14 (0.36%) PCI DSS
7 8 (0.20%) PSD2
8 7 (0.18%) HIPAA
8 7 (0.18%) PMO
9 5 (0.13%) COBIT
9 5 (0.13%) MiFID
10 3 (0.076%) GMP
11 2 (0.051%) IFRS
11 2 (0.051%) IFRS 9
11 2 (0.051%) ISO 26262
11 2 (0.051%) Sarbanes-Oxley
12 1 (0.025%) Actionable Recommendations
12 1 (0.025%) Cyber Essentials
12 1 (0.025%) NCSC
12 1 (0.025%) NIST
System Software
1 570 (14.46%) Docker
2 149 (3.78%) HDFS
3 87 (2.21%) Apache Flume
4 45 (1.14%) Active Directory
5 40 (1.01%) VMware Infrastructure
6 33 (0.84%) NFS
7 27 (0.69%) VirtualBox
8 26 (0.66%) Apache ZooKeeper
9 24 (0.61%) Firmware
10 13 (0.33%) VMware ESXi
11 9 (0.23%) Samba
11 9 (0.23%) Xen
12 7 (0.18%) Oracle RAC
13 6 (0.15%) Hyper-V
14 5 (0.13%) Virtual Machines
15 3 (0.076%) Varnish
15 3 (0.076%) vSphere
16 2 (0.051%) vCloud
17 1 (0.025%) Virtual Servers
17 1 (0.025%) VMware Workstation
Systems Management
1 410 (10.40%) Kubernetes
2 260 (6.60%) Ansible
3 199 (5.05%) Terraform
4 136 (3.45%) Oozie
5 107 (2.72%) Puppet
6 103 (2.61%) Hadoop YARN
7 71 (1.80%) Opscode Chef
8 37 (0.94%) Docker Swarm
9 28 (0.71%) Kibana
10 22 (0.56%) Ambari
11 19 (0.48%) Consul
12 12 (0.30%) logstash
13 11 (0.28%) Packer
14 10 (0.25%) Nagios
14 10 (0.25%) Single Sign-On
14 10 (0.25%) ZABBIX
15 9 (0.23%) OpenNMS
15 9 (0.23%) Salt
15 9 (0.23%) vCenter Server
16 7 (0.18%) Enterprise Manager Cloud Control
Vendors
1 432 (10.96%) Google
2 396 (10.05%) Microsoft
3 284 (7.21%) Oracle
4 196 (4.97%) Tableau
5 180 (4.57%) Cloudera
6 142 (3.60%) Hortonworks
7 138 (3.50%) Informatica
8 118 (2.99%) Splunk
9 106 (2.69%) SAP
10 103 (2.61%) IBM
11 98 (2.49%) Databricks
11 98 (2.49%) Teradata
12 70 (1.78%) Talend
13 61 (1.55%) VMware
14 51 (1.29%) Salesforce.com
15 48 (1.22%) Red Hat
16 37 (0.94%) Facebook
17 34 (0.86%) Sage
17 34 (0.86%) Sparx
18 32 (0.81%) Atlassian