Period
to 15 December 2018

The median annual salary for a Senior Data Engineer was £75,000 in advertised job vacancies during the 6 months to 15 December 2018.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Senior Data Engineer
UK
6 months to
15 Dec 2018
Same period 2017 Same period 2016
Rank 914 1114 1184
Rank change year-on-year +200 +70 +91
Permanent jobs requiring a Senior Data Engineer 221 112 48
As % of all permanent IT jobs advertised in the UK 0.14% 0.062% 0.026%
As % of the Job Titles category 0.15% 0.065% 0.027%
Number of salaries quoted 153 101 42
UK median annual salary £75,000 £75,000 £65,000
Median salary % change year-on-year - +15.38% +15.04%
10th Percentile £50,200 £52,500 £51,250
90th Percentile £96,250 £98,750 £94,750
UK excluding London median annual salary £65,000 £57,500 £40,000
% change year-on-year +13.04% +43.75% -20.00%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 151,510 172,360 178,969
% of permanent IT jobs with a recognized job title 95.84% 96.05% 96.59%
Number of salaries quoted 121,415 138,723 149,394
UK median annual salary £50,000 £49,000 £47,500
Median salary % change year-on-year +2.04% +3.16% +5.56%
10th Percentile £27,750 £27,500 £27,000
90th Percentile £82,500 £78,750 £77,500
UK excluding London median annual salary £45,000 £42,500 £42,500
% change year-on-year +5.88% - +3.03%

Senior Data Engineer
Job Vacancy Trend

Job postings that featured Senior Data Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Senior Data Engineer in the UK

Senior Data Engineer
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Senior Data Engineer.

Salary trend for Senior Data Engineer in the UK

Senior Data Engineer
Salary Histogram

The salary distribution of IT jobs citing Senior Data Engineer over the 6 months to 15 December 2018.

Salary histogram for Senior Data Engineer in the UK

Senior Data Engineer
Top 13 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Senior Data Engineer within the UK over the 6 months to 15 December 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +178 218 £75,000 - 45
London +97 131 £80,000 - 33
UK excluding London +116 90 £65,000 +13.04% 13
South East +47 39 £67,500 +7.14% 2
North of England +45 30 £65,000 +4.00% 3
North West +40 25 £65,000 +4.00% 3
South West +18 16 £62,138 +24.28% 3
North East - 3 £47,500 -
Midlands +45 2 £50,000 - 3
Wales +2 2 £52,000 -13.33%
Yorkshire - 2 £56,499 -
East Midlands - 2 £50,000 -
Scotland +7 1 - - 1

Senior Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 15 December 2018, Senior Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads featuring Senior Data Engineer in the job title.

1 147 (66.52%) Python
2 139 (62.90%) Big Data
3 117 (52.94%) Agile Software Development
4 115 (52.04%) Hadoop
5 107 (48.42%) Scala
6 103 (46.61%) Java
6 103 (46.61%) Apache Spark
7 90 (40.72%) Amazon AWS
8 89 (40.27%) Data Engineering
8 89 (40.27%) Data Science
9 86 (38.91%) NoSQL
10 81 (36.65%) Analytics
11 80 (36.20%) Kafka
12 77 (34.84%) ETL
13 70 (31.67%) SQL
14 68 (30.77%) Data Modelling
15 62 (28.05%) Apache Hive
15 62 (28.05%) Degree
16 56 (25.34%) Amazon Redshift
17 50 (22.62%) Microsoft Azure
18 44 (19.91%) Scrum
19 41 (18.55%) MongoDB
19 41 (18.55%) Flink
20 39 (17.65%) HBase
20 39 (17.65%) Data Warehouse
21 38 (17.19%) Machine Learning
22 36 (16.29%) Cloudera
23 34 (15.38%) Finance
24 33 (14.93%) SAP
25 32 (14.48%) TDD

Senior Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 103 (46.61%) Apache Spark
2 30 (13.57%) Apache
2 30 (13.57%) Elasticsearch
3 27 (12.22%) Apache Pig
4 6 (2.71%) Apache Solr
5 3 (1.36%) Apache Airflow
6 2 (0.90%) SAS
7 1 (0.45%) Luigi
Applications
1 3 (1.36%) Microsoft Excel
2 1 (0.45%) Microsoft PowerPoint
Cloud Services
1 90 (40.72%) Amazon AWS
2 50 (22.62%) Microsoft Azure
3 29 (13.12%) Amazon EMR
4 25 (11.31%) Cloud Computing
5 24 (10.86%) Amazon EC2
6 19 (8.60%) Google Cloud Platform
7 6 (2.71%) Amazon S3
8 5 (2.26%) Google Analytics
9 4 (1.81%) Serverless
10 3 (1.36%) SaaS
11 2 (0.90%) Amazon SQS
11 2 (0.90%) AWS Data Pipeline
11 2 (0.90%) AWS Lambda
11 2 (0.90%) IaaS
11 2 (0.90%) PaaS
12 1 (0.45%) AWS Elastic Beanstalk
12 1 (0.45%) Azure Data Factory
12 1 (0.45%) GitHub
Communications & Networking
1 3 (1.36%) Internet
2 2 (0.90%) Structured Cabling
3 1 (0.45%) Broadband
3 1 (0.45%) MQTT
3 1 (0.45%) SMS
3 1 (0.45%) WAN
Database & Business Intelligence
1 139 (62.90%) Big Data
2 115 (52.04%) Hadoop
3 86 (38.91%) NoSQL
4 62 (28.05%) Apache Hive
5 56 (25.34%) Amazon Redshift
6 41 (18.55%) Flink
6 41 (18.55%) MongoDB
7 39 (17.65%) Data Warehouse
7 39 (17.65%) HBase
8 30 (13.57%) Impala
9 26 (11.76%) Amazon Athena
10 25 (11.31%) Apache Cassandra
11 24 (10.86%) SAP BW
12 23 (10.41%) PostgreSQL
13 18 (8.14%) Relational Database
14 17 (7.69%) Couchbase
14 17 (7.69%) CouchDB
15 15 (6.79%) Data Lake
16 14 (6.33%) SQL Server
16 14 (6.33%) Sqoop
Development Applications
1 21 (9.50%) JIRA
2 12 (5.43%) Jenkins
3 9 (4.07%) Git (software)
4 6 (2.71%) TeamCity
5 2 (0.90%) CircleCI
6 1 (0.45%) Artifactory
6 1 (0.45%) GoCD
6 1 (0.45%) Maven
6 1 (0.45%) Robot Framework
6 1 (0.45%) RStudio
6 1 (0.45%) Vagrant
6 1 (0.45%) Visual Studio
General
1 34 (15.38%) Finance
2 20 (9.05%) Marketing
3 17 (7.69%) Retail
4 16 (7.24%) Telecoms
5 11 (4.98%) Banking
5 11 (4.98%) Law
6 9 (4.07%) Electronics
6 9 (4.07%) Manufacturing
6 9 (4.07%) Military
7 6 (2.71%) Advertising
7 6 (2.71%) Investment Banking
8 2 (0.90%) Games
9 1 (0.45%) Digital Economy
9 1 (0.45%) Financial Institution
9 1 (0.45%) Legal
Libraries, Frameworks & Software Standards
1 80 (36.20%) Kafka
2 30 (13.57%) Spark Streaming
3 27 (12.22%) Web Services
4 10 (4.52%) TensorFlow
4 10 (4.52%) XML
5 9 (4.07%) JSON
6 7 (3.17%) Natural Language Processing
7 6 (2.71%) HTML
7 6 (2.71%) Keras
7 6 (2.71%) MLlib
8 5 (2.26%) .NET
8 5 (2.26%) D3.js
9 4 (1.81%) Akka
9 4 (1.81%) Highcharts JS
9 4 (1.81%) LAMP
10 3 (1.36%) RESTful
11 2 (0.90%) NumPy
11 2 (0.90%) OAuth
11 2 (0.90%) SciPy
11 2 (0.90%) Velocity
Miscellaneous
1 24 (10.86%) Algorithms
1 24 (10.86%) FMCG
2 15 (6.79%) Data Structures
3 14 (6.33%) Analytical Skills
3 14 (6.33%) Fintech
4 11 (4.98%) User Experience
5 7 (3.17%) Self-Motivation
6 5 (2.26%) Market Risk
6 5 (2.26%) Mobile App
6 5 (2.26%) Social Media
7 4 (1.81%) Derivative
8 3 (1.36%) Linux Command Line
8 3 (1.36%) Marketing Technology
9 2 (0.90%) Credit Risk
9 2 (0.90%) Driving Licence
9 2 (0.90%) Public Cloud
10 1 (0.45%) Data Centre
10 1 (0.45%) Equities
10 1 (0.45%) Online Games
10 1 (0.45%) Semantic Web
Operating Systems
1 19 (8.60%) Linux
2 13 (5.88%) Unix
3 5 (2.26%) Apple iOS
4 3 (1.36%) Windows
Processes & Methodologies
1 117 (52.94%) Agile Software Development
2 89 (40.27%) Data Engineering
2 89 (40.27%) Data Science
3 81 (36.65%) Analytics
4 77 (34.84%) ETL
5 68 (30.77%) Data Modelling
6 44 (19.91%) Scrum
7 38 (17.19%) Machine Learning
8 32 (14.48%) DevOps
8 32 (14.48%) TDD
9 31 (14.03%) Computer Science
10 30 (13.57%) Data Management
11 29 (13.12%) Data Integration
11 29 (13.12%) Mathematics
12 28 (12.67%) Data Analysis
12 28 (12.67%) Data Security
12 28 (12.67%) Visualisation
13 27 (12.22%) Open Source
14 26 (11.76%) Business Intelligence
14 26 (11.76%) MapReduce
Programming Languages
1 147 (66.52%) Python
2 107 (48.42%) Scala
3 103 (46.61%) Java
4 70 (31.67%) SQL
5 30 (13.57%) R
6 20 (9.05%) Bash Shell
7 14 (6.33%) PowerShell
8 13 (5.88%) C#
9 12 (5.43%) Shell Script
10 11 (4.98%) Go
11 8 (3.62%) C++
12 7 (3.17%) JavaScript
13 5 (2.26%) PL/SQL
14 4 (1.81%) C
15 3 (1.36%) Haskell
15 3 (1.36%) Perl
15 3 (1.36%) PHP
16 2 (0.90%) Groovy
16 2 (0.90%) Ruby
16 2 (0.90%) T-SQL
Qualifications
1 62 (28.05%) Degree
2 23 (10.41%) Computer Science Degree
3 22 (9.95%) Numerate Degree
4 12 (5.43%) AWS Certification
5 4 (1.81%) Security Cleared
6 2 (0.90%) ISEB
6 2 (0.90%) ISTQB
6 2 (0.90%) PhD
6 2 (0.90%) SC Cleared
Quality Assurance & Compliance
1 8 (3.62%) ISO/IEC 27001
2 3 (1.36%) Data Quality
2 3 (1.36%) GDPR
2 3 (1.36%) QA
System Software
1 31 (14.03%) Apache Flume
2 17 (7.69%) Docker
3 8 (3.62%) HDFS
4 6 (2.71%) Apache ZooKeeper
5 1 (0.45%) Virtual Machines
Systems Management
1 31 (14.03%) Hadoop YARN
2 27 (12.22%) Oozie
3 14 (6.33%) Kubernetes
4 4 (1.81%) Ansible
5 2 (0.90%) Salt
6 1 (0.45%) Ambari
6 1 (0.45%) Consul
6 1 (0.45%) Kibana
6 1 (0.45%) Opscode Chef
6 1 (0.45%) Packer
6 1 (0.45%) Puppet
6 1 (0.45%) Terraform
Vendors
1 36 (16.29%) Cloudera
2 33 (14.93%) SAP
3 31 (14.03%) Hortonworks
4 27 (12.22%) Microsoft
5 21 (9.50%) CA Agile Central
5 21 (9.50%) MapR
6 19 (8.60%) Databricks
7 17 (7.69%) Google
8 15 (6.79%) Tableau
9 14 (6.33%) Oracle
10 12 (5.43%) Informatica
11 9 (4.07%) Teradata
12 8 (3.62%) Netezza
13 7 (3.17%) Ab Initio
14 4 (1.81%) Talend
15 3 (1.36%) Salesforce.com
15 3 (1.36%) Splunk
16 2 (0.90%) RapidMiner
17 1 (0.45%) Facebook
17 1 (0.45%) Twitter