Period
to 2 June 2020

The median annual salary for a Big Data Engineer was £80,000 in advertised job vacancies in England during the 6 months to 2 June 2020.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Big Data Engineer
UK > England
6 months to
2 Jun 2020
Same period 2019 Same period 2018
Rank 705 647 730
Rank change year-on-year -58 +83 +147
Permanent jobs requiring a Big Data Engineer 150 436 468
As % of all permanent jobs advertised in England 0.18% 0.33% 0.29%
As % of the Job Titles category 0.19% 0.34% 0.30%
Number of salaries quoted 92 380 387
Median annual salary £80,000 £75,000 £70,000
Median salary % change year-on-year +6.67% +7.14% -
10th Percentile £47,875 £52,500 £47,500
90th Percentile £109,750 £95,000 £95,000
UK median annual salary £80,000 £75,000 £70,000
% change year-on-year +6.67% +7.14% -

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies advertised in England. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
England
Permanent vacancies in England with a recognized job title 77,200 127,485 156,314
% of permanent IT jobs with a recognized job title 95.12% 95.99% 96.39%
Number of salaries quoted 62,430 102,090 127,861
Median annual salary £55,000 £52,000 £50,000
Median salary % change year-on-year +5.77% +4.00% +5.26%
10th Percentile £31,000 £28,500 £27,500
90th Percentile £88,750 £85,000 £81,250
UK median annual salary £53,500 £50,000 £50,000
% change year-on-year +7.00% - +5.26%

Big Data Engineer
Job Vacancy Trend in England

Job postings that featured Big Data Engineer in the job title as a proportion of all IT jobs advertised in England.

Job vacancy trend for Big Data Engineer in England

Big Data Engineer
Salary Trend in England

3-month moving average salary quoted in jobs citing Big Data Engineer in England.

Salary trend for Big Data Engineer in England

Big Data Engineer
Salary Histogram in England

Salary distribution for jobs citing Big Data Engineer in England over the 6 months to 2 June 2020.

Salary histogram for Big Data Engineer in England

Big Data Engineer
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data Engineer within the England region over the 6 months to 2 June 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London -65 118 £80,000 - 10
Midlands +96 12 £68,750 +25.00%
South East +117 9 £47,500 -28.30% 2
West Midlands +76 6 £56,250 -
East Midlands +58 6 £85,000 +54.55%
South West +67 5 £56,000 -13.32%
East of England +79 4 £50,000 -23.08%
North of England +94 2 £47,500 -16.40%
North West +84 1 £47,500 -26.92%
Yorkshire +79 1 £60,000 +20.80%
Big Data Engineer
UK

Big Data Engineer Skill Set
Top 30 Co-occurring IT Skills in England

For the 6 months to 2 June 2020, Big Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region featuring Big Data Engineer in the job title.

1 150 (100.00%) Big Data
2 109 (72.67%) Apache Spark
3 101 (67.33%) Python
4 92 (61.33%) Hadoop
5 89 (59.33%) Agile Software Development
6 87 (58.00%) Java
7 77 (51.33%) Scala
8 63 (42.00%) Kafka
9 61 (40.67%) AWS
10 59 (39.33%) Analytics
10 59 (39.33%) Data Science
11 54 (36.00%) SQL
12 40 (26.67%) Software Engineering
12 40 (26.67%) DevOps
13 39 (26.00%) NoSQL
14 37 (24.67%) Apache Hive
14 37 (24.67%) Elasticsearch
14 37 (24.67%) GCP
15 35 (23.33%) Docker
16 32 (21.33%) Machine Learning
16 32 (21.33%) Linux
16 32 (21.33%) Apache
16 32 (21.33%) ETL
17 31 (20.67%) Degree
17 31 (20.67%) Kubernetes
17 31 (20.67%) Data Engineering
18 30 (20.00%) Git (software)
19 29 (19.33%) Azure
19 29 (19.33%) Microservices
20 27 (18.00%) MongoDB

Big Data Engineer Skill Set
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 109 (72.67%) Apache Spark
2 37 (24.67%) Elasticsearch
3 32 (21.33%) Apache
4 10 (6.67%) Apache Solr
5 7 (4.67%) Apache Airflow
6 4 (2.67%) Jupyter
6 4 (2.67%) Tornado
7 3 (2.00%) Apache Pig
7 3 (2.00%) Luigi
8 1 (0.67%) OpenWhisk
Cloud Services
1 61 (40.67%) AWS
2 37 (24.67%) GCP
3 29 (19.33%) Azure
4 13 (8.67%) Amazon EMR
4 13 (8.67%) Serverless
5 12 (8.00%) Azure Data Factory
5 12 (8.00%) Power Platform
6 9 (6.00%) Amazon EC2
7 6 (4.00%) Amazon Kinesis
7 6 (4.00%) Amazon S3
7 6 (4.00%) AWS Data Pipeline
7 6 (4.00%) AWS Lambda
8 5 (3.33%) Amazon ECS
8 5 (3.33%) Dropbox
8 5 (3.33%) Slack
9 4 (2.67%) GitHub
9 4 (2.67%) SaaS
10 2 (1.33%) Amazon EKS
10 2 (1.33%) Azure Functions
10 2 (1.33%) Logic Apps
Communications & Networking
1 5 (3.33%) SSL
2 1 (0.67%) DSL
2 1 (0.67%) Internet
2 1 (0.67%) IPFS
Database & Business Intelligence
1 150 (100.00%) Big Data
2 92 (61.33%) Hadoop
3 39 (26.00%) NoSQL
4 37 (24.67%) Apache Hive
5 27 (18.00%) MongoDB
6 25 (16.67%) HBase
7 21 (14.00%) Relational Database
8 19 (12.67%) Apache Cassandra
8 19 (12.67%) Data Lake
8 19 (12.67%) PostgreSQL
9 18 (12.00%) Flink
10 17 (11.33%) Sqoop
11 15 (10.00%) Data Warehouse
11 15 (10.00%) Impala
12 12 (8.00%) Power BI
12 12 (8.00%) RDBMS
13 10 (6.67%) Amazon DynamoDB
13 10 (6.67%) BigQuery
14 9 (6.00%) SQL Server
15 8 (5.33%) MySQL
Development Applications
1 30 (20.00%) Git (software)
2 16 (10.67%) Jenkins
3 10 (6.67%) JUnit
3 10 (6.67%) Maven
4 8 (5.33%) Artifactory
4 8 (5.33%) GitLab
5 7 (4.67%) Sonatype Nexus
6 6 (4.00%) IBM UrbanCode
7 5 (3.33%) Ant
7 5 (3.33%) JIRA
7 5 (3.33%) Visual Studio Team System
8 3 (2.00%) Octopus Deploy
8 3 (2.00%) TeamCity
9 2 (1.33%) Jasmine
9 2 (1.33%) Mocha
9 2 (1.33%) Selenium
10 1 (0.67%) CircleCI
10 1 (0.67%) GoCD
10 1 (0.67%) Gradle
General
1 20 (13.33%) Finance
2 16 (10.67%) Banking
3 14 (9.33%) Retail
4 11 (7.33%) Public Sector
5 5 (3.33%) Telecoms
6 4 (2.67%) Aerospace
6 4 (2.67%) Games
7 1 (0.67%) Front Office
Libraries, Frameworks & Software Standards
1 63 (42.00%) Kafka
2 15 (10.00%) PySpark
3 12 (8.00%) Web Services
4 9 (6.00%) Apache Flex
4 9 (6.00%) RabbitMQ
5 8 (5.33%) ADO
6 7 (4.67%) HTML
7 6 (4.00%) .NET
8 5 (3.33%) Apache Beam
8 5 (3.33%) Natural Language Processing
8 5 (3.33%) Spark Streaming
9 4 (2.67%) LAMP
9 4 (2.67%) Node.js
9 4 (2.67%) Spring
9 4 (2.67%) Spring Boot
10 3 (2.00%) Apache NiFi
10 3 (2.00%) Flask
10 3 (2.00%) JSON
10 3 (2.00%) REST
11 2 (1.33%) Jest
Miscellaneous
1 16 (10.67%) Data Structures
2 11 (7.33%) Enterprise Software
3 8 (5.33%) Algorithms
3 8 (5.33%) PMI
4 7 (4.67%) Public Cloud
5 6 (4.00%) Hedge funds
6 5 (3.33%) Analytical Skills
6 5 (3.33%) Equities
6 5 (3.33%) Greenfield Project
6 5 (3.33%) Hybrid Cloud
6 5 (3.33%) User Experience
6 5 (3.33%) Virtual Team
7 3 (2.00%) Cloud Native
8 2 (1.33%) Data Centre
9 1 (0.67%) Internet of Things
9 1 (0.67%) Management Information System
9 1 (0.67%) Reinsurance
Operating Systems
1 32 (21.33%) Linux
2 7 (4.67%) Windows
3 4 (2.67%) Unix
Processes & Methodologies
1 89 (59.33%) Agile Software Development
2 59 (39.33%) Analytics
2 59 (39.33%) Data Science
3 40 (26.67%) DevOps
3 40 (26.67%) Software Engineering
4 32 (21.33%) ETL
4 32 (21.33%) Machine Learning
5 31 (20.67%) Data Engineering
6 29 (19.33%) Microservices
7 21 (14.00%) Continuous Integration
7 21 (14.00%) Creative Thinking
7 21 (14.00%) Fintech
7 21 (14.00%) Open Source
8 19 (12.67%) Business Intelligence
9 18 (12.00%) Computer Science
9 18 (12.00%) Scrum
10 17 (11.33%) TDD
11 16 (10.67%) Cybersecurity
11 16 (10.67%) Mathematics
12 15 (10.00%) Mentoring
Programming Languages
1 101 (67.33%) Python
2 87 (58.00%) Java
3 77 (51.33%) Scala
4 54 (36.00%) SQL
5 15 (10.00%) C++
6 12 (8.00%) R
7 7 (4.67%) C#
8 5 (3.33%) Bash Shell
8 5 (3.33%) HiveQL
9 3 (2.00%) Go
9 3 (2.00%) Shell Script
9 3 (2.00%) T-SQL
10 2 (1.33%) C
10 2 (1.33%) Cypher
10 2 (1.33%) JavaScript
11 1 (0.67%) Groovy
11 1 (0.67%) Korn
Qualifications
1 31 (20.67%) Degree
2 20 (13.33%) Computer Science Degree
3 10 (6.67%) DV Cleared
3 10 (6.67%) SC Cleared
3 10 (6.67%) Security Cleared
4 8 (5.33%) PMI Certification
5 4 (2.67%) Microsoft Certification
6 1 (0.67%) Master's Degree
Quality Assurance & Compliance
1 8 (5.33%) Data Quality
2 7 (4.67%) QA
System Software
1 35 (23.33%) Docker
2 17 (11.33%) HDFS
3 16 (10.67%) Apache Flume
4 4 (2.67%) Apache ZooKeeper
5 1 (0.67%) Alluxio
5 1 (0.67%) Ceph
5 1 (0.67%) etcd
5 1 (0.67%) Gluster
Systems Management
1 31 (20.67%) Kubernetes
2 9 (6.00%) Hadoop YARN
3 8 (5.33%) Ansible
3 8 (5.33%) Terraform
4 7 (4.67%) Oozie
5 4 (2.67%) BMC PATROL
5 4 (2.67%) Chronos
5 4 (2.67%) Grafana
5 4 (2.67%) HAProxy
5 4 (2.67%) Mesos
5 4 (2.67%) Nagios
5 4 (2.67%) Opscode Chef
5 4 (2.67%) Prometheus
6 3 (2.00%) Puppet
7 1 (0.67%) Istio
7 1 (0.67%) Kibana
7 1 (0.67%) Knative
7 1 (0.67%) logstash
Vendors
1 24 (16.00%) Google
2 15 (10.00%) Cloudera
3 12 (8.00%) Splunk
4 11 (7.33%) Databricks
4 11 (7.33%) Oracle
5 7 (4.67%) Hortonworks
6 6 (4.00%) Microsoft
7 5 (3.33%) CrowdStrike
7 5 (3.33%) MapR
8 4 (2.67%) StreamSets
9 3 (2.00%) Percona
10 2 (1.33%) Tableau
11 1 (0.67%) Talend