Period
to 18 October 2018

The median annual salary for a Big Data Engineer was £61,000 in advertised job vacancies in the South East during the 6 months to 18 October 2018.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Big Data Engineer
England > South East
6 months to
18 Oct 2018
Same period 2017 Same period 2016
Rank 469 505 578
Rank change year-on-year +36 +73 +50
Permanent jobs requiring a Big Data Engineer 67 41 26
As % of all permanent IT jobs advertised in the South East 0.23% 0.14% 0.073%
As % of the Job Titles category 0.24% 0.15% 0.075%
Number of salaries quoted 29 38 24
South East median annual salary £61,000 £65,000 £50,000
Median salary % change year-on-year -6.15% +30.00% +17.65%
10th Percentile £47,000 £46,250 £35,750
90th Percentile £85,000 £77,500 £85,000
England median annual salary £70,000 £70,000 £65,000
% change year-on-year - +7.69% -

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies advertised in the South East. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
South East
Permanent vacancies in the South East with a recognized job title 28,094 28,013 34,515
% of permanent IT jobs with a recognized job title 96.43% 96.71% 97.05%
Number of salaries quoted 23,335 23,376 29,019
South East median annual salary £47,500 £45,000 £45,000
Median salary % change year-on-year +5.56% - +3.45%
10th Percentile £26,750 £26,250 £26,250
90th Percentile £70,000 £67,500 £67,500
England median annual salary £50,000 £50,000 £47,500
% change year-on-year - +5.26% +5.56%

Big Data Engineer
Job Vacancy Trend in the South East

Job postings that featured Big Data Engineer in the job title as a percentage of all IT jobs advertised in the South East.

Job vacancy trend for Big Data Engineer in the South East

Big Data Engineer
Salary Trend in the South East

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Big Data Engineer in the South East.

Salary trend for Big Data Engineer in the South East

Big Data Engineer
Salary Histogram in the South East

The salary distribution of IT jobs citing Big Data Engineer in the South East over the 6 months to 18 October 2018.

Salary histogram for Big Data Engineer in the South East

Big Data Engineer
Job Locations in the South East

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Big Data Engineer within the South East region over the 6 months to 18 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
East Sussex +3 26 - - 1
Thames Valley -15 25 £60,000 -14.29% 3
Berkshire +7 16 £60,000 +14.29% 2
Surrey +33 9 £65,000 +18.18% 3
Buckinghamshire +3 7 £55,000 -18.52%
Hampshire -13 6 £70,000 +7.69% 1
Oxfordshire -23 2 £61,000 -16.44% 1
Kent +10 1 - -
Big Data Engineer
England

Big Data Engineer Skill Set
Top 30 Co-occurring IT Skills in the South East

For the 6 months to 18 October 2018, Big Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the South East region featuring Big Data Engineer in the job title.

1 67 (100.00%) Big Data
2 46 (68.66%) Hadoop
3 44 (65.67%) Apache Hive
4 42 (62.69%) Linux
5 37 (55.22%) Agile Software Development
5 37 (55.22%) Impala
6 33 (49.25%) Java
6 33 (49.25%) Python
7 30 (44.78%) Continuous Integration
8 29 (43.28%) Apache Flume
9 28 (41.79%) Kafka
9 28 (41.79%) Data Warehouse
10 27 (40.30%) Cloudera
10 27 (40.30%) Machine Learning
11 26 (38.81%) Jenkins
11 26 (38.81%) Git (software)
11 26 (38.81%) Go
12 25 (37.31%) MapReduce
13 24 (35.82%) Hadoop YARN
14 23 (34.33%) TensorFlow
14 23 (34.33%) Scala
15 21 (31.34%) TeamCity
15 21 (31.34%) Hortonworks
15 21 (31.34%) Sqoop
15 21 (31.34%) Shell Script
15 21 (31.34%) Data Engineering
15 21 (31.34%) Apache Spark
15 21 (31.34%) MLlib
15 21 (31.34%) Deep Learning
15 21 (31.34%) Keras

Big Data Engineer Skill Set
Co-occurring IT Skills in the South East by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 21 (31.34%) Apache Spark
2 11 (16.42%) Elasticsearch
3 8 (11.94%) Apache Pig
4 7 (10.45%) Apache
5 5 (7.46%) Tomcat
5 5 (7.46%) WildFly
6 2 (2.99%) JBoss
7 1 (1.49%) SharePoint
Applications
1 3 (4.48%) GNU Octave
Cloud Services
1 3 (4.48%) Amazon AWS
2 1 (1.49%) Azure Data Factory
2 1 (1.49%) Data Lake Analytics
2 1 (1.49%) Microsoft Azure
Communications & Networking
1 1 (1.49%) Internet
Database & Business Intelligence
1 67 (100.00%) Big Data
2 46 (68.66%) Hadoop
3 44 (65.67%) Apache Hive
4 37 (55.22%) Impala
5 28 (41.79%) Data Warehouse
6 21 (31.34%) Sqoop
7 15 (22.39%) HBase
7 15 (22.39%) PostgreSQL
8 11 (16.42%) NoSQL
9 10 (14.93%) Relational Database
10 6 (8.96%) MongoDB
11 5 (7.46%) MySQL
11 5 (7.46%) Redis
12 4 (5.97%) Neo4j
13 3 (4.48%) Amazon DynamoDB
13 3 (4.48%) Apache Cassandra
14 2 (2.99%) Oracle Database
15 1 (1.49%) Data Lake
15 1 (1.49%) Power BI
15 1 (1.49%) PowerPivot
Development Applications
1 26 (38.81%) Git (software)
1 26 (38.81%) Jenkins
2 21 (31.34%) TeamCity
3 6 (8.96%) JUnit
General
1 12 (17.91%) Marketing
2 5 (7.46%) Advertising
3 1 (1.49%) Finance
3 1 (1.49%) Retail
3 1 (1.49%) Telecoms
Libraries, Frameworks & Software Standards
1 28 (41.79%) Kafka
2 23 (34.33%) TensorFlow
3 21 (31.34%) Keras
3 21 (31.34%) MLlib
4 5 (7.46%) LAMP
4 5 (7.46%) Middleware
5 3 (4.48%) NumPy
5 3 (4.48%) Pandas
6 2 (2.99%) Akka
6 2 (2.99%) Apache Camel
7 1 (1.49%) Elastic Stack
7 1 (1.49%) JSON
7 1 (1.49%) REST
7 1 (1.49%) Spring
7 1 (1.49%) Web Services
7 1 (1.49%) XML
Miscellaneous
1 15 (22.39%) User Experience
2 12 (17.91%) Analytical Skills
3 11 (16.42%) Computer Science
4 9 (13.43%) Greenfield Project
5 3 (4.48%) Algorithms
Operating Systems
1 42 (62.69%) Linux
2 11 (16.42%) Windows
3 5 (7.46%) CentOS
3 5 (7.46%) Ubuntu
4 4 (5.97%) Unix
Processes & Methodologies
1 37 (55.22%) Agile Software Development
2 30 (44.78%) Continuous Integration
3 27 (40.30%) Machine Learning
4 25 (37.31%) MapReduce
5 21 (31.34%) Data Engineering
5 21 (31.34%) Deep Learning
6 20 (29.85%) Analytics
7 17 (25.37%) DevOps
8 16 (23.88%) Software Delivery
9 15 (22.39%) Data Analysis
9 15 (22.39%) Operations Research
10 13 (19.40%) Data Science
10 13 (19.40%) Integration Testing
10 13 (19.40%) Visualisation
11 11 (16.42%) Change Management
11 11 (16.42%) Configuration Management
11 11 (16.42%) Digital Marketing
11 11 (16.42%) Low Latency
11 11 (16.42%) Release Management
12 8 (11.94%) Scrum
Programming Languages
1 33 (49.25%) Java
1 33 (49.25%) Python
2 26 (38.81%) Go
3 23 (34.33%) Scala
4 21 (31.34%) Shell Script
5 13 (19.40%) SQL
6 11 (16.42%) C
7 5 (7.46%) R
8 3 (4.48%) C++
8 3 (4.48%) PL/SQL
9 2 (2.99%) JavaScript
10 1 (1.49%) U-SQL
Qualifications
1 14 (20.90%) Degree
2 11 (16.42%) DV Cleared
2 11 (16.42%) Security Cleared
3 3 (4.48%) PhD
Quality Assurance & Compliance
1 3 (4.48%) Data Quality
System Software
1 29 (43.28%) Apache Flume
2 15 (22.39%) HDFS
3 11 (16.42%) Virtual Machines
4 3 (4.48%) Apache ZooKeeper
Systems Management
1 24 (35.82%) Hadoop YARN
2 16 (23.88%) Puppet
3 11 (16.42%) Kibana
4 5 (7.46%) Host Intrusion Detection System
4 5 (7.46%) Xymon
4 5 (7.46%) ZABBIX
5 2 (2.99%) Ambari
6 1 (1.49%) Ansible
Vendors
1 27 (40.30%) Cloudera
2 21 (31.34%) Hortonworks
3 11 (16.42%) Atlassian
4 5 (7.46%) Oracle
4 5 (7.46%) Red Hat
5 2 (2.99%) RapidMiner
5 2 (2.99%) Talend
6 1 (1.49%) Microsoft
6 1 (1.49%) SaltStack
6 1 (1.49%) Tableau