Period
to 21 April 2019

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Big Data skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Big Data over the 6 months to 21 April 2019 with a comparison to the same period in the previous 2 years.

Big Data
UK > England
6 months to
21 Apr 2019
Same period 2018 Same period 2017
Rank 83 80 82
Rank change year-on-year -3 +2 +9
Permanent jobs citing Big Data 4,850 6,133 5,454
As % of all permanent IT jobs advertised in England 3.52% 3.69% 3.38%
As % of the Database & Business Intelligence category 12.53% 12.02% 11.12%
Number of salaries quoted 3,812 4,864 4,643
England median annual salary £70,000 £65,000 £62,500
Median salary % change year-on-year +7.69% +4.00% +4.17%
10th Percentile £37,500 £38,750 £36,250
90th Percentile £102,500 £96,250 £96,250
UK median annual salary £67,500 £65,000 £62,500
% change year-on-year +3.85% +4.00% +4.17%

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
England
Permanent vacancies with a requirement for database or business intelligence skills 38,692 51,033 49,037
As % of all permanent IT jobs advertised in England 28.11% 30.71% 30.38%
Number of salaries quoted 31,901 42,758 42,255
England median annual salary £52,500 £50,000 £47,500
Median salary % change year-on-year +5.00% +5.26% -
10th Percentile £31,250 £31,000 £29,750
90th Percentile £86,250 £80,000 £77,500
UK median annual salary £52,500 £50,000 £47,500
% change year-on-year +5.00% +5.26% -

Big Data
Job Vacancy Trend in England

Job postings citing Big Data as a percentage of all IT jobs advertised in England.

Job vacancy trend for Big Data in England

Big Data
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data in England.

Salary trend for Big Data in England

Big Data
Salary Histogram in England

The salary distribution of IT jobs citing Big Data in England over the 6 months to 21 April 2019.

Salary histogram for Big Data in England

Big Data
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data within the England region over the 6 months to 21 April 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -6 2,876 £77,500 +10.71% 217
South East -7 641 £55,000 -4.35% 39
South West +10 440 £55,000 +4.76% 19
North of England -2 402 £50,000 - 42
Midlands +54 272 £44,500 -19.09% 36
North West -2 261 £57,500 +15.00% 30
East of England -5 189 £70,000 +16.67% 17
West Midlands +42 158 £37,500 -31.82% 18
East Midlands +34 114 £52,000 -16.80% 18
Yorkshire -9 108 £50,000 -9.09% 7
North East +33 36 £49,337 +31.57% 5
Big Data
UK

For the 6 months to 21 April 2019, IT jobs citing Big Data also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region with a requirement for Big Data.

1 2,154 (44.41%) Agile Software Development
2 2,000 (41.24%) Python
3 1,927 (39.73%) Java
4 1,750 (36.08%) Analytics
5 1,736 (35.79%) Hadoop
6 1,538 (31.71%) Apache Spark
7 1,476 (30.43%) SQL
8 1,415 (29.18%) Amazon AWS
9 1,246 (25.69%) Machine Learning
10 1,041 (21.46%) Data Science
11 1,039 (21.42%) Finance
12 1,022 (21.07%) DevOps
13 1,010 (20.82%) Kafka
14 989 (20.39%) Software Engineering
15 972 (20.04%) Scala
16 923 (19.03%) Microsoft Azure
17 918 (18.93%) Degree
18 905 (18.66%) NoSQL
19 834 (17.20%) Artificial Intelligence
20 801 (16.52%) Business Intelligence
21 780 (16.08%) Apache Hive
22 770 (15.88%) ETL
23 702 (14.47%) Data Modelling
24 671 (13.84%) Linux
25 656 (13.53%) Data Warehouse
26 645 (13.30%) Data Analytics
27 598 (12.33%) Analytical Skills
28 581 (11.98%) Google Cloud Platform
29 528 (10.89%) Visualisation
30 523 (10.78%) JavaScript

Big Data
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 1,538 (31.71%) Apache Spark
2 412 (8.49%) Elasticsearch
3 368 (7.59%) Apache
4 288 (5.94%) Apache Pig
5 153 (3.15%) SAS
6 105 (2.16%) Apache Solr
7 63 (1.30%) Confluence
8 33 (0.68%) Apache Airflow
9 32 (0.66%) CMS
9 32 (0.66%) SharePoint
9 32 (0.66%) Tomcat
10 23 (0.47%) JBoss
11 22 (0.45%) Adobe Experience Manager
11 22 (0.45%) OpenStack
12 21 (0.43%) NServiceBus
13 18 (0.37%) WebSphere
14 17 (0.35%) Oracle Workflow
15 16 (0.33%) Jupyter
16 14 (0.29%) Oracle SOA Suite
17 13 (0.27%) Luigi
Applications
1 86 (1.77%) Microsoft Excel
2 33 (0.68%) Microsoft PowerPoint
3 26 (0.54%) SPSS
4 24 (0.49%) GNU Octave
5 22 (0.45%) Microsoft Office
6 16 (0.33%) Chatbot
6 16 (0.33%) Weka
7 5 (0.10%) Microsoft Project
7 5 (0.10%) MS Visio
7 5 (0.10%) Stata
8 3 (0.062%) Spreadsheet
9 2 (0.041%) Gephi
9 2 (0.041%) Open Workbench
9 2 (0.041%) S-PLUS
10 1 (0.021%) Adobe Creative Suite
10 1 (0.021%) Adobe Illustrator
10 1 (0.021%) InVision
10 1 (0.021%) OmniGraffle
10 1 (0.021%) Photoshop
10 1 (0.021%) Simulink
Business Applications
1 22 (0.45%) SAP S/4HANA
2 13 (0.27%) Dynamics NAV
3 10 (0.21%) Dynamics CRM
4 9 (0.19%) Distributed Ledger
5 6 (0.12%) nopCommerce
6 5 (0.10%) MetaTrader
6 5 (0.10%) Oracle BPM
7 3 (0.062%) Oracle BRM
7 3 (0.062%) Oracle CRM On Demand
7 3 (0.062%) SAP BPC
7 3 (0.062%) SAP ERP
8 2 (0.041%) Oracle Payables
8 2 (0.041%) Oracle Receivables
8 2 (0.041%) SAP Oil and Gas
9 1 (0.021%) Oracle CRM
9 1 (0.021%) Oracle EBS
9 1 (0.021%) Oracle Financials
9 1 (0.021%) SAP CRM
9 1 (0.021%) SAP FI
9 1 (0.021%) SAP SD
Cloud Services
1 1,415 (29.18%) Amazon AWS
2 923 (19.03%) Microsoft Azure
3 581 (11.98%) Google Cloud Platform
4 187 (3.86%) Serverless
5 137 (2.82%) Cloud Computing
6 129 (2.66%) GitHub
7 116 (2.39%) AWS Lambda
8 114 (2.35%) Amazon EMR
9 108 (2.23%) Amazon EC2
10 107 (2.21%) SaaS
11 106 (2.19%) PaaS
12 92 (1.90%) Amazon S3
13 75 (1.55%) Amazon SQS
14 66 (1.36%) Amazon Kinesis
15 60 (1.24%) Azure Data Factory
16 56 (1.15%) AWS CloudFormation
17 45 (0.93%) IaaS
18 41 (0.85%) Amazon CloudWatch
19 38 (0.78%) Azure Machine Learning
20 30 (0.62%) OpenShift
Communications & Networking
1 168 (3.46%) Internet
2 42 (0.87%) Firewall
3 39 (0.80%) HTTP
3 39 (0.80%) VPN
4 34 (0.70%) TCP/IP
5 27 (0.56%) SSH
6 26 (0.54%) Wireless
7 18 (0.37%) Network Security
8 13 (0.27%) AMQP
8 13 (0.27%) WebEx
9 12 (0.25%) DNS
10 10 (0.21%) Kerberos
10 10 (0.21%) Wi-Fi
11 8 (0.16%) DHCP
11 8 (0.16%) MQTT
11 8 (0.16%) SNMP
11 8 (0.16%) Unified Communications
12 7 (0.14%) SAN
13 6 (0.12%) WAN
14 5 (0.10%) MPLS
Database & Business Intelligence
1 1,736 (35.79%) Hadoop
2 905 (18.66%) NoSQL
3 780 (16.08%) Apache Hive
4 656 (13.53%) Data Warehouse
5 494 (10.19%) SQL Server
6 470 (9.69%) HBase
7 451 (9.30%) Apache Cassandra
8 431 (8.89%) MongoDB
9 332 (6.85%) Amazon Redshift
10 310 (6.39%) Relational Database
11 308 (6.35%) Impala
12 307 (6.33%) Data Lake
13 301 (6.21%) Power BI
14 249 (5.13%) MySQL
15 220 (4.54%) PostgreSQL
16 209 (4.31%) SQL Server Integration Services
17 192 (3.96%) Flink
18 164 (3.38%) Sqoop
19 147 (3.03%) RDBMS
20 133 (2.74%) SQL Server Reporting Services
Development Applications
1 328 (6.76%) Git (software)
2 290 (5.98%) Jenkins
3 203 (4.19%) JIRA
4 113 (2.33%) Maven
5 85 (1.75%) Selenium
6 81 (1.67%) Visual Studio
7 70 (1.44%) Gradle
8 54 (1.11%) Cucumber
9 52 (1.07%) Subversion
10 47 (0.97%) Ant
10 47 (0.97%) Atlassian Bamboo
11 45 (0.93%) Bitbucket
12 43 (0.89%) JUnit
13 36 (0.74%) Team Foundation Server
14 29 (0.60%) Eclipse
14 29 (0.60%) Octopus Deploy
15 26 (0.54%) Visual Studio Team System
16 24 (0.49%) Android Studio
17 23 (0.47%) Mercurial
18 21 (0.43%) JMeter
General
1 1,039 (21.42%) Finance
2 358 (7.38%) Banking
3 337 (6.95%) Retail
4 278 (5.73%) Law
5 241 (4.97%) Marketing
6 215 (4.43%) Military
7 205 (4.23%) Telecoms
8 98 (2.02%) Automotive
9 87 (1.79%) Games
10 84 (1.73%) Investment Banking
11 67 (1.38%) Manufacturing
12 64 (1.32%) Publishing
13 60 (1.24%) Electronics
14 57 (1.18%) Pharmaceutical
15 47 (0.97%) Advertising
16 43 (0.89%) Legal
17 35 (0.72%) Financial Institution
18 24 (0.49%) Front Office
19 21 (0.43%) Billing
20 17 (0.35%) Local Government
Job Titles
1 1,329 (27.40%) Developer
2 798 (16.45%) Data Engineer
3 678 (13.98%) Architect
4 513 (10.58%) Java Developer
5 488 (10.06%) Big Data Engineer
6 360 (7.42%) Data Architect
7 299 (6.16%) Software Engineer
8 278 (5.73%) Data Scientist
9 264 (5.44%) Analyst
10 246 (5.07%) Senior Developer
11 228 (4.70%) Consultant
12 218 (4.49%) Solutions Architect
13 197 (4.06%) Big Data Developer
14 184 (3.79%) DevOps Engineer
15 172 (3.55%) Python Engineer
16 160 (3.30%) Hadoop Engineer
17 152 (3.13%) Senior Data Engineer
18 141 (2.91%) Big Data Architect
19 138 (2.85%) Java Engineer
20 134 (2.76%) Python Developer
Libraries, Frameworks & Software Standards
1 1,010 (20.82%) Kafka
2 368 (7.59%) .NET
3 358 (7.38%) Web Services
4 301 (6.21%) HTML
5 287 (5.92%) Spring
6 253 (5.22%) AngularJS
7 251 (5.18%) RESTful
8 247 (5.09%) REST
9 231 (4.76%) React
10 229 (4.72%) CSS
11 211 (4.35%) Node.js
12 167 (3.44%) Natural Language Processing
13 152 (3.13%) Spark Streaming
14 140 (2.89%) JSON
15 132 (2.72%) Apache NiFi
16 129 (2.66%) HTML5
17 104 (2.14%) ASP.NET
18 99 (2.04%) Middleware
19 97 (2.00%) Pandas
20 96 (1.98%) XML
Miscellaneous
1 598 (12.33%) Analytical Skills
2 414 (8.54%) Algorithms
3 244 (5.03%) Greenfield Project
4 209 (4.31%) Fintech
5 194 (4.00%) User Experience
6 188 (3.88%) Data Structures
7 125 (2.58%) Internet of Things
8 115 (2.37%) Management Information System
9 89 (1.84%) Mobile App
10 65 (1.34%) Public Cloud
11 64 (1.32%) Virtual Team
12 61 (1.26%) Hedge funds
13 60 (1.24%) Enterprise Software
14 58 (1.20%) Data Centre
15 57 (1.18%) Social Media
16 53 (1.09%) Self-Motivation
17 48 (0.99%) Linux Command Line
18 45 (0.93%) Clustering
19 42 (0.87%) Cloud Native
19 42 (0.87%) Semantic Web
Operating Systems
1 671 (13.84%) Linux
2 312 (6.43%) Unix
3 161 (3.32%) Windows
4 129 (2.66%) Android
5 67 (1.38%) Apple iOS
5 67 (1.38%) CentOS
6 63 (1.30%) Ubuntu
7 58 (1.20%) Red Hat Enterprise Linux
8 20 (0.41%) Windows Server
9 8 (0.16%) Debian
10 7 (0.14%) Solaris
11 5 (0.10%) AIX
11 5 (0.10%) Mac OS X
12 4 (0.082%) Oracle Linux
13 3 (0.062%) Fedora
13 3 (0.062%) HPUX
13 3 (0.062%) Windows 10
13 3 (0.062%) Windows 7
14 2 (0.041%) Mac OS
14 2 (0.041%) VMS
Processes & Methodologies
1 2,154 (44.41%) Agile Software Development
2 1,750 (36.08%) Analytics
3 1,246 (25.69%) Machine Learning
4 1,041 (21.46%) Data Science
5 1,022 (21.07%) DevOps
6 989 (20.39%) Software Engineering
7 834 (17.20%) Artificial Intelligence
8 801 (16.52%) Business Intelligence
9 770 (15.88%) ETL
10 702 (14.47%) Data Modelling
11 645 (13.30%) Data Analytics
12 528 (10.89%) Visualisation
13 513 (10.58%) Scrum
14 497 (10.25%) Computer Science
15 488 (10.06%) Continuous Integration
16 487 (10.04%) TDD
17 486 (10.02%) Microservices
18 478 (9.86%) Data Engineering
19 471 (9.71%) Data Analysis
20 453 (9.34%) Mathematics
Programming Languages
1 2,000 (41.24%) Python
2 1,927 (39.73%) Java
3 1,476 (30.43%) SQL
4 972 (20.04%) Scala
5 523 (10.78%) JavaScript
6 503 (10.37%) C#
7 418 (8.62%) R
8 329 (6.78%) C++
9 227 (4.68%) Java 8
10 216 (4.45%) C
11 140 (2.89%) Bash Shell
12 138 (2.85%) T-SQL
13 122 (2.52%) MATLAB
14 97 (2.00%) PHP
14 97 (2.00%) Shell Script
15 81 (1.67%) PL/SQL
16 75 (1.55%) Go
17 71 (1.46%) Ruby
18 70 (1.44%) Groovy
18 70 (1.44%) PowerShell
Qualifications
1 918 (18.93%) Degree
2 282 (5.81%) Security Cleared
3 248 (5.11%) Computer Science Degree
4 170 (3.51%) PhD
5 153 (3.15%) SC Cleared
6 128 (2.64%) DV Cleared
7 82 (1.69%) Numerate Degree
8 60 (1.24%) CISSP
9 51 (1.05%) Master's Degree
10 43 (0.89%) CISM
11 37 (0.76%) Cisco Certification
12 32 (0.66%) PMI Certification
13 30 (0.62%) CISA
14 22 (0.45%) Microsoft Certification
15 21 (0.43%) CEH
15 21 (0.43%) SANS
16 20 (0.41%) CCIE
16 20 (0.41%) GIAC
16 20 (0.41%) SSCP
17 19 (0.39%) ISEB
Quality Assurance & Compliance
1 206 (4.25%) Data Quality
2 198 (4.08%) QA
3 101 (2.08%) GDPR
4 34 (0.70%) ISO/IEC 27001
5 18 (0.37%) COBIT
6 16 (0.33%) MiFID
7 15 (0.31%) IFRS
8 14 (0.29%) BS7799
9 13 (0.27%) PCI DSS
9 13 (0.27%) Solvency II
10 12 (0.25%) Dodd-Frank
11 11 (0.23%) FATCA
12 8 (0.16%) PMO
13 4 (0.082%) Basel III
13 4 (0.082%) COREP
13 4 (0.082%) CRD IV
13 4 (0.082%) SLA
14 3 (0.062%) ISO 20022
14 3 (0.062%) NIST 800
14 3 (0.062%) PA-DSS
System Software
1 517 (10.66%) Docker
2 200 (4.12%) HDFS
3 193 (3.98%) Apache Flume
4 116 (2.39%) Apache ZooKeeper
5 26 (0.54%) VMware Infrastructure
6 23 (0.47%) Oracle RAC
7 22 (0.45%) Active Directory
8 11 (0.23%) VirtualBox
9 8 (0.16%) Virtual Machines
10 7 (0.14%) Hyper-V
10 7 (0.14%) VMware ESXi
10 7 (0.14%) vSphere
11 4 (0.082%) NFS
11 4 (0.082%) Xen
12 3 (0.062%) Firmware
12 3 (0.062%) GridGain
12 3 (0.062%) Samba
12 3 (0.062%) VMware NSX
12 3 (0.062%) XenApp
13 2 (0.041%) KVM
Systems Management
1 276 (5.69%) Kubernetes
2 271 (5.59%) Oozie
3 259 (5.34%) Ansible
4 207 (4.27%) Terraform
5 189 (3.90%) Hadoop YARN
6 145 (2.99%) Puppet
7 101 (2.08%) Opscode Chef
8 76 (1.57%) Ambari
9 48 (0.99%) Kibana
10 42 (0.87%) Nagios
11 40 (0.82%) Mesos
12 20 (0.41%) Enterprise Manager Cloud Control
12 20 (0.41%) Marathon
13 17 (0.35%) logstash
13 17 (0.35%) Salt
14 15 (0.31%) Docker Swarm
15 12 (0.25%) systemd
16 11 (0.23%) Packer
17 8 (0.16%) Graphite
18 7 (0.14%) Grafana
Vendors
1 448 (9.24%) Microsoft
2 440 (9.07%) Oracle
3 399 (8.23%) Cloudera
3 399 (8.23%) Google
4 392 (8.08%) Tableau
5 287 (5.92%) Hortonworks
6 188 (3.88%) SAP
7 166 (3.42%) Informatica
8 158 (3.26%) Databricks
9 132 (2.72%) IBM
10 126 (2.60%) MapR
11 108 (2.23%) Talend
12 84 (1.73%) Teradata
13 77 (1.59%) Red Hat
14 61 (1.26%) Splunk
15 49 (1.01%) Sybase
16 46 (0.95%) VMware
17 42 (0.87%) Salesforce.com
18 39 (0.80%) HP
19 34 (0.70%) Netezza