Period
to 21 August 2018

The median annual salary for a Big Data Engineer was £65,000 in advertised job vacancies in the South East during the 6 months to 21 August 2018.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Big Data Engineer
England > South East
6 months to
21 Aug 2018
Same period 2017 Same period 2016
Rank 438 482 578
Rank change year-on-year +44 +96 +63
Permanent jobs requiring a Big Data Engineer 95 53 31
As % of all permanent IT jobs advertised in the South East 0.32% 0.18% 0.084%
As % of the Job Titles category 0.33% 0.19% 0.086%
Number of salaries quoted 45 39 22
South East median annual salary £65,000 £65,000 £48,750
Median salary % change year-on-year - +33.33% +14.71%
10th Percentile £47,500 £46,250 £35,750
90th Percentile £85,000 £77,500 £60,625
England median annual salary £70,000 £67,500 £65,000
% change year-on-year +3.70% +3.85% -

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies advertised in the South East. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
South East
Permanent vacancies in the South East with a recognized job title 28,694 28,161 35,843
% of permanent IT jobs with a recognized job title 96.82% 96.71% 97.14%
Number of salaries quoted 23,828 23,551 30,338
South East median annual salary £45,500 £45,000 £45,000
Median salary % change year-on-year +1.11% - +2.27%
10th Percentile £27,000 £26,250 £26,250
90th Percentile £70,000 £67,500 £67,500
England median annual salary £50,000 £47,500 £47,500
% change year-on-year +5.26% - +5.56%

Big Data Engineer
Job Vacancy Trend in the South East

Job postings that featured Big Data Engineer in the job title as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for Big Data Engineer in the South East

Big Data Engineer
Salary Trend in the South East

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data Engineer in the South East.

Salary trend for Big Data Engineer in the South East

Big Data Engineer
Salary Histogram in the South East

The salary distribution of IT jobs citing Big Data Engineer in the South East over the 6 months to 21 August 2018.

Salary histogram for Big Data Engineer in the South East

Big Data Engineer
Job Locations in the South East

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data Engineer within the South East region over the 6 months to 21 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
East Sussex +12 39 - -
Thames Valley -3 38 £60,000 -12.73% 5
Buckinghamshire +11 18 £55,000 -15.38% 1
Berkshire +7 14 £60,000 +14.29% 4
Surrey +24 12 £66,250 +20.45%
Oxfordshire -22 6 £64,250 -11.99%
Hampshire -13 5 £70,000 +7.69%
Middlesex - 1 £54,000 -
Big Data Engineer
England

Big Data Engineer Skill Set
Top 30 Co-occurring IT Skills in the South East

For the 6 months to 21 August 2018, Big Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the South East region featuring Big Data Engineer in the job title.

1 95 (100.00%) Big Data
2 73 (76.84%) Hadoop
3 64 (67.37%) Java
4 60 (63.16%) Apache Hive
5 57 (60.00%) Agile Software Development
6 54 (56.84%) Linux
6 54 (56.84%) Continuous Integration
7 52 (54.74%) Python
7 52 (54.74%) Impala
8 42 (44.21%) Machine Learning
8 42 (44.21%) Apache Flume
9 41 (43.16%) Cloudera
9 41 (43.16%) Data Warehouse
10 40 (42.11%) Kafka
10 40 (42.11%) Git (software)
10 40 (42.11%) Jenkins
11 39 (41.05%) Go
11 39 (41.05%) Scala
12 38 (40.00%) MapReduce
13 37 (38.95%) Hadoop YARN
13 37 (38.95%) TensorFlow
14 34 (35.79%) Keras
14 34 (35.79%) MLlib
14 34 (35.79%) Deep Learning
14 34 (35.79%) Hortonworks
14 34 (35.79%) Sqoop
14 34 (35.79%) TeamCity
14 34 (35.79%) Shell Script
15 29 (30.53%) Analytics
16 28 (29.47%) Data Engineering

Big Data Engineer Skill Set
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 26 (27.37%) Apache Spark
2 12 (12.63%) Elasticsearch
3 10 (10.53%) Apache Pig
4 7 (7.37%) Apache
5 5 (5.26%) Tomcat
5 5 (5.26%) WildFly
6 2 (2.11%) JBoss
Applications
1 5 (5.26%) GNU Octave
Cloud Services
1 5 (5.26%) Amazon AWS
Database & Business Intelligence
1 95 (100.00%) Big Data
2 73 (76.84%) Hadoop
3 60 (63.16%) Apache Hive
4 52 (54.74%) Impala
5 41 (43.16%) Data Warehouse
6 34 (35.79%) Sqoop
7 23 (24.21%) PostgreSQL
8 21 (22.11%) NoSQL
9 17 (17.89%) HBase
10 15 (15.79%) Neo4j
11 10 (10.53%) Relational Database
12 8 (8.42%) MongoDB
13 5 (5.26%) Amazon DynamoDB
13 5 (5.26%) MySQL
13 5 (5.26%) Redis
14 4 (4.21%) Apache Cassandra
15 2 (2.11%) Oracle Database
16 1 (1.05%) Amazon RDS
16 1 (1.05%) Amazon Redshift
Development Applications
1 40 (42.11%) Git (software)
1 40 (42.11%) Jenkins
2 34 (35.79%) TeamCity
3 11 (11.58%) JUnit
4 2 (2.11%) JIRA
5 1 (1.05%) Eclipse
5 1 (1.05%) Maven
5 1 (1.05%) Subversion
General
1 17 (17.89%) Marketing
2 5 (5.26%) Advertising
3 2 (2.11%) Finance
4 1 (1.05%) Retail
Libraries, Frameworks & Software Standards
1 40 (42.11%) Kafka
2 37 (38.95%) TensorFlow
3 34 (35.79%) Keras
3 34 (35.79%) MLlib
4 5 (5.26%) LAMP
4 5 (5.26%) Middleware
4 5 (5.26%) NumPy
4 5 (5.26%) Pandas
5 2 (2.11%) Akka
5 2 (2.11%) Apache Camel
5 2 (2.11%) J2EE
5 2 (2.11%) J2SE
6 1 (1.05%) JSON
6 1 (1.05%) REST
6 1 (1.05%) Spring
Miscellaneous
1 23 (24.21%) User Experience
2 14 (14.74%) Computer Science
2 14 (14.74%) Greenfield Project
3 13 (13.68%) Analytical Skills
4 3 (3.16%) Algorithms
Operating Systems
1 54 (56.84%) Linux
2 12 (12.63%) Windows
3 5 (5.26%) CentOS
3 5 (5.26%) Ubuntu
4 3 (3.16%) Unix
Processes & Methodologies
1 57 (60.00%) Agile Software Development
2 54 (56.84%) Continuous Integration
3 42 (44.21%) Machine Learning
4 38 (40.00%) MapReduce
5 34 (35.79%) Deep Learning
6 29 (30.53%) Analytics
7 28 (29.47%) Data Engineering
8 23 (24.21%) Operations Research
8 23 (24.21%) Software Delivery
9 18 (18.95%) TDD
10 17 (17.89%) Data Science
11 16 (16.84%) Data Analysis
11 16 (16.84%) Digital Marketing
12 15 (15.79%) DevOps
12 15 (15.79%) Visualisation
13 14 (14.74%) Integration Testing
14 12 (12.63%) Change Management
14 12 (12.63%) Configuration Management
14 12 (12.63%) Low Latency
14 12 (12.63%) Release Management
Programming Languages
1 64 (67.37%) Java
2 52 (54.74%) Python
3 39 (41.05%) Go
3 39 (41.05%) Scala
4 34 (35.79%) Shell Script
5 25 (26.32%) SQL
6 12 (12.63%) C
7 7 (7.37%) C++
7 7 (7.37%) R
8 3 (3.16%) PL/SQL
9 2 (2.11%) JavaScript
10 1 (1.05%) Java 8
10 1 (1.05%) MATLAB
Qualifications
1 13 (13.68%) Degree
2 12 (12.63%) DV Cleared
2 12 (12.63%) Security Cleared
3 5 (5.26%) PhD
Quality Assurance & Compliance
1 4 (4.21%) Data Quality
System Software
1 42 (44.21%) Apache Flume
2 22 (23.16%) HDFS
3 12 (12.63%) Virtual Machines
4 3 (3.16%) Apache ZooKeeper
Systems Management
1 37 (38.95%) Hadoop YARN
2 17 (17.89%) Puppet
3 12 (12.63%) Kibana
4 5 (5.26%) Host Intrusion Detection System
4 5 (5.26%) Xymon
4 5 (5.26%) ZABBIX
5 2 (2.11%) Ambari
6 1 (1.05%) Control-M
Vendors
1 41 (43.16%) Cloudera
2 34 (35.79%) Hortonworks
3 12 (12.63%) Atlassian
4 5 (5.26%) Red Hat
5 4 (4.21%) Oracle
6 2 (2.11%) RapidMiner
6 2 (2.11%) Talend
7 1 (1.05%) Capita
7 1 (1.05%) HP