Period
to 25 August 2019

The median annual salary for a Big Data Engineer was £75,000 in advertised job vacancies in England during the 6 months to 25 August 2019.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Big Data Engineer
UK > England
6 months to
25 Aug 2019
Same period 2018 Same period 2017
Rank 725 698 901
Rank change year-on-year -27 +203 +102
Permanent jobs requiring a Big Data Engineer 351 476 286
As % of all permanent IT jobs advertised in England 0.27% 0.30% 0.17%
As % of the Job Titles category 0.28% 0.31% 0.18%
Number of salaries quoted 301 354 228
England median annual salary £75,000 £70,000 £67,500
Median salary % change year-on-year +7.14% +3.70% +3.85%
10th Percentile £55,000 £51,475 £48,750
90th Percentile £96,250 £92,500 £87,500
UK median annual salary £75,000 £70,000 £67,500
% change year-on-year +7.14% +3.70% +8.00%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies advertised in England. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
England
Permanent vacancies in England with a recognized job title 125,214 152,472 159,833
% of permanent IT jobs with a recognized job title 95.84% 96.20% 96.04%
Number of salaries quoted 100,583 123,648 129,495
England median annual salary £51,000 £50,000 £47,500
Median salary % change year-on-year +2.00% +5.26% -
10th Percentile £28,250 £27,500 £27,500
90th Percentile £85,000 £82,500 £78,750
UK median annual salary £50,000 £50,000 £47,500
% change year-on-year - +5.26% -

Big Data Engineer
Job Vacancy Trend in England

Job postings that featured Big Data Engineer in the job title as a percentage of all IT jobs advertised in England.

Job vacancy trend for Big Data Engineer in England

Big Data Engineer
Salary Trend in England

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data Engineer in England.

Salary trend for Big Data Engineer in England

Big Data Engineer
Salary Histogram in England

The salary distribution of IT jobs citing Big Data Engineer in England over the 6 months to 25 August 2019.

Salary histogram for Big Data Engineer in England

Big Data Engineer
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data Engineer within the England region over the 6 months to 25 August 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +34 270 £80,000 +14.29% 21
North of England +43 30 £57,275 +4.14% 1
South West +26 23 £65,000 +18.18% 1
South East -40 14 £67,500 +3.85% 4
Yorkshire +16 13 £57,275 +34.76%
East of England +76 11 £70,000 +13.82% 1
North West +25 11 £90,000 +63.64% 1
North East - 6 £57,275 -
Midlands +33 5 £65,000 -
West Midlands - 3 - -
East Midlands +9 2 £65,000 -
Big Data Engineer
UK

Big Data Engineer Skill Set
Top 30 Co-occurring IT Skills in England

For the 6 months to 25 August 2019, Big Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the England region featuring Big Data Engineer in the job title.

1 351 (100.00%) Big Data
2 274 (78.06%) Python
3 258 (73.50%) Apache Spark
4 257 (73.22%) Hadoop
5 219 (62.39%) Scala
6 197 (56.13%) Java
7 179 (51.00%) Apache Hive
8 171 (48.72%) SQL
9 170 (48.43%) Kafka
10 164 (46.72%) Agile Software Development
11 154 (43.87%) Analytics
12 148 (42.17%) AWS
13 124 (35.33%) NoSQL
14 119 (33.90%) Cloudera
15 118 (33.62%) Machine Learning
16 112 (31.91%) ETL
17 102 (29.06%) Data Engineering
18 98 (27.92%) HBase
19 96 (27.35%) DevOps
20 90 (25.64%) Business Intelligence
21 88 (25.07%) Data Science
22 84 (23.93%) Azure
23 82 (23.36%) Oozie
24 81 (23.08%) Sqoop
25 79 (22.51%) MongoDB
26 71 (20.23%) Impala
26 71 (20.23%) Analytical Skills
27 68 (19.37%) GCP
27 68 (19.37%) Apache Pig
28 67 (19.09%) Software Engineering

Big Data Engineer Skill Set
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 258 (73.50%) Apache Spark
2 68 (19.37%) Apache Pig
3 36 (10.26%) Apache
4 30 (8.55%) Elasticsearch
5 13 (3.70%) Apache Solr
6 9 (2.56%) Confluence
7 8 (2.28%) Apache Airflow
8 6 (1.71%) SAS
9 2 (0.57%) Hyperledger
10 1 (0.28%) MS Exchange
10 1 (0.28%) SharePoint
10 1 (0.28%) WebLogic Portal
Applications
1 15 (4.27%) Microsoft Excel
Cloud Services
1 148 (42.17%) AWS
2 84 (23.93%) Azure
3 68 (19.37%) GCP
4 48 (13.68%) Power Platform
5 28 (7.98%) Amazon EMR
6 20 (5.70%) Amazon S3
7 18 (5.13%) Amazon ECS
8 14 (3.99%) Serverless
9 12 (3.42%) Amazon Kinesis
9 12 (3.42%) AWS Lambda
10 9 (2.56%) Amazon EKS
10 9 (2.56%) Amazon SQS
10 9 (2.56%) AWS Fargate
10 9 (2.56%) GitHub
11 8 (2.28%) AWS CloudFormation
12 5 (1.42%) Google Analytics
13 4 (1.14%) Azure Data Factory
14 3 (0.85%) Amazon EC2
14 3 (0.85%) PaaS
14 3 (0.85%) SaaS
Communications & Networking
1 11 (3.13%) Wi-Fi
2 5 (1.42%) Internet
2 5 (1.42%) Kerberos
3 1 (0.28%) DNS
3 1 (0.28%) SSL
Database & Business Intelligence
1 351 (100.00%) Big Data
2 257 (73.22%) Hadoop
3 179 (51.00%) Apache Hive
4 124 (35.33%) NoSQL
5 98 (27.92%) HBase
6 81 (23.08%) Sqoop
7 79 (22.51%) MongoDB
8 71 (20.23%) Impala
9 61 (17.38%) Data Warehouse
10 52 (14.81%) Apache Cassandra
11 48 (13.68%) Power BI
12 39 (11.11%) SQL Server
13 34 (9.69%) Data Lake
14 25 (7.12%) QlikView
15 24 (6.84%) Flink
16 23 (6.55%) Amazon Redshift
17 20 (5.70%) Apache Kudu
18 17 (4.84%) MySQL
19 13 (3.70%) Blockchain
20 12 (3.42%) Presto
Development Applications
1 27 (7.69%) Git (software)
2 24 (6.84%) Jenkins
3 10 (2.85%) JIRA
4 8 (2.28%) GitLab
5 7 (1.99%) Maven
6 4 (1.14%) Atlassian Bamboo
6 4 (1.14%) Cucumber
6 4 (1.14%) JUnit
6 4 (1.14%) Selenium
7 3 (0.85%) Octopus Deploy
7 3 (0.85%) TeamCity
8 2 (0.57%) Ant
8 2 (0.57%) Artifactory
8 2 (0.57%) Bitbucket
8 2 (0.57%) Gradle
9 1 (0.28%) Eclipse
9 1 (0.28%) HP UFT
9 1 (0.28%) SilkTest
9 1 (0.28%) Visual Studio
9 1 (0.28%) WinRunner
General
1 66 (18.80%) Law
2 45 (12.82%) Finance
3 13 (3.70%) Banking
4 8 (2.28%) Games
4 8 (2.28%) Telecoms
5 6 (1.71%) Retail
6 2 (0.57%) Public Sector
7 1 (0.28%) Investment Banking
7 1 (0.28%) Manufacturing
7 1 (0.28%) Marketing
Libraries, Frameworks & Software Standards
1 170 (48.43%) Kafka
2 60 (17.09%) Apache NiFi
3 29 (8.26%) Spark Streaming
4 19 (5.41%) Web Services
5 14 (3.99%) PySpark
6 13 (3.70%) .NET
7 11 (3.13%) Elastic Stack
7 11 (3.13%) NumPy
7 11 (3.13%) Pandas
7 11 (3.13%) REST
8 9 (2.56%) pytest
9 8 (2.28%) React
9 8 (2.28%) RESTful
10 6 (1.71%) AngularJS
10 6 (1.71%) CSS
10 6 (1.71%) HTML
10 6 (1.71%) JSON
10 6 (1.71%) Samza
11 5 (1.42%) Apache Beam
11 5 (1.42%) Node.js
Miscellaneous
1 71 (20.23%) Analytical Skills
2 22 (6.27%) Algorithms
3 19 (5.41%) Data Structures
4 13 (3.70%) Greenfield Project
5 12 (3.42%) Mobile App
6 11 (3.13%) Virtual Team
7 6 (1.71%) Management Information System
8 3 (0.85%) Social Media
8 3 (0.85%) User Experience
8 3 (0.85%) Xbox
9 2 (0.57%) Credit Risk
9 2 (0.57%) Private Cloud
9 2 (0.57%) Public Cloud
10 1 (0.28%) Client/Server
10 1 (0.28%) Data Protection Act
10 1 (0.28%) Linux Command Line
Operating Systems
1 31 (8.83%) Unix
2 29 (8.26%) Linux
3 5 (1.42%) Red Hat Enterprise Linux
3 5 (1.42%) Windows
Processes & Methodologies
1 164 (46.72%) Agile Software Development
2 154 (43.87%) Analytics
3 118 (33.62%) Machine Learning
4 112 (31.91%) ETL
5 102 (29.06%) Data Engineering
6 96 (27.35%) DevOps
7 90 (25.64%) Business Intelligence
8 88 (25.07%) Data Science
9 67 (19.09%) Software Engineering
10 63 (17.95%) Data Modelling
11 56 (15.95%) Scrum
12 49 (13.96%) MapReduce
12 49 (13.96%) Visualisation
13 42 (11.97%) Open Source
14 40 (11.40%) Artificial Intelligence
15 37 (10.54%) Data Ingestion
16 29 (8.26%) Data Visualisation
17 27 (7.69%) Data Architecture
18 25 (7.12%) SDLC
19 24 (6.84%) Data Analytics
Programming Languages
1 274 (78.06%) Python
2 219 (62.39%) Scala
3 197 (56.13%) Java
4 171 (48.72%) SQL
5 20 (5.70%) R
6 13 (3.70%) JavaScript
7 12 (3.42%) Ruby
8 11 (3.13%) PL/SQL
8 11 (3.13%) Shell Script
9 9 (2.56%) Clojure
10 8 (2.28%) C#
10 8 (2.28%) C++
11 6 (1.71%) PHP
12 5 (1.42%) Go
13 4 (1.14%) C
13 4 (1.14%) Java 8
14 3 (0.85%) Bash Shell
14 3 (0.85%) TypeScript
15 2 (0.57%) Data Analysis Expressions (DAX)
15 2 (0.57%) Groovy
Qualifications
1 15 (4.27%) PMI Certification
1 15 (4.27%) PMP
2 12 (3.42%) Degree
2 12 (3.42%) Security Cleared
3 11 (3.13%) SC Cleared
4 4 (1.14%) AWS Certification
5 3 (0.85%) Computer Science Degree
6 1 (0.28%) CCA
6 1 (0.28%) DV Cleared
6 1 (0.28%) Master's Degree
6 1 (0.28%) Sun Certification
Quality Assurance & Compliance
1 13 (3.70%) Data Quality
2 7 (1.99%) QA
3 2 (0.57%) GDPR
System Software
1 61 (17.38%) Apache ZooKeeper
2 35 (9.97%) HDFS
3 27 (7.69%) Apache Flume
3 27 (7.69%) Docker
4 3 (0.85%) Active Directory
5 1 (0.28%) Oracle RAC
Systems Management
1 82 (23.36%) Oozie
2 36 (10.26%) Hadoop YARN
3 34 (9.69%) Ambari
4 19 (5.41%) Terraform
5 15 (4.27%) Kubernetes
6 8 (2.28%) Ansible
7 5 (1.42%) Puppet
8 4 (1.14%) Chukwa
9 2 (0.57%) Control-M
9 2 (0.57%) Nagios
9 2 (0.57%) Opscode Chef
10 1 (0.28%) Grafana
10 1 (0.28%) Prometheus
Vendors
1 119 (33.90%) Cloudera
2 41 (11.68%) Hortonworks
3 39 (11.11%) Tableau
4 38 (10.83%) Oracle
5 36 (10.26%) Informatica
6 23 (6.55%) MapR
7 17 (4.84%) Databricks
8 15 (4.27%) Google
9 13 (3.70%) Ab Initio
10 11 (3.13%) Teradata
11 8 (2.28%) Microsoft
12 5 (1.42%) Red Hat
13 4 (1.14%) Talend
14 3 (0.85%) Cognos
15 2 (0.57%) Dataiku
15 2 (0.57%) Netezza
15 2 (0.57%) Salesforce.com
16 1 (0.28%) Atlassian
16 1 (0.28%) Green Hat
16 1 (0.28%) Splunk