Period
to 19 March 2019

The median annual salary for a Senior Data Engineer was £75,000 in advertised job vacancies during the 6 months to 19 March 2019.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Senior Data Engineer
UK
6 months to
19 Mar 2019
Same period 2018 Same period 2017
Rank 826 1049 1140
Rank change year-on-year +223 +91 +103
Permanent jobs requiring a Senior Data Engineer 268 143 63
As % of all permanent IT jobs advertised in the UK 0.18% 0.081% 0.037%
As % of the Job Titles category 0.19% 0.084% 0.038%
Number of salaries quoted 212 124 50
UK median annual salary £75,000 £77,500 £75,000
Median salary % change year-on-year -3.23% +3.33% +35.14%
10th Percentile £55,149 £47,500 £54,750
90th Percentile £95,000 £100,000 £98,500
UK excluding London median annual salary £63,354 £53,750 £55,000
% change year-on-year +17.87% -2.27% +10.00%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 142,396 169,478 166,063
% of permanent IT jobs with a recognized job title 95.92% 96.40% 96.57%
Number of salaries quoted 113,818 139,244 137,809
UK median annual salary £50,000 £50,000 £47,500
Median salary % change year-on-year - +5.26% -
10th Percentile £28,500 £27,500 £27,000
90th Percentile £83,750 £80,000 £77,500
UK excluding London median annual salary £45,000 £43,000 £42,500
% change year-on-year +4.65% +1.18% -

Senior Data Engineer
Job Vacancy Trend

Job postings that featured Senior Data Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Senior Data Engineer in the UK

Senior Data Engineer
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Senior Data Engineer.

Salary trend for Senior Data Engineer in the UK

Senior Data Engineer
Salary Histogram

The salary distribution of IT jobs citing Senior Data Engineer over the 6 months to 19 March 2019.

Salary histogram for Senior Data Engineer in the UK

Senior Data Engineer
Top 14 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Senior Data Engineer within the UK over the 6 months to 19 March 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +215 259 £77,500 -1.59% 56
London +156 178 £85,000 -5.56% 40
UK excluding London +104 89 £63,354 +17.87% 17
North of England +70 33 £65,000 +8.33% 3
South East +65 30 £26,000 -57.38% 2
North West +73 24 £65,000 - 3
South West +9 16 £62,138 +24.28% 6
Yorkshire +30 8 £63,354 +36.98%
Scotland +20 6 £67,500 - 1
Wales +9 2 £52,000 -13.33%
East of England +52 1 £80,000 -5.88% 4
Midlands +37 1 £50,000 - 1
East Midlands +24 1 £50,000 - 1
North East - 1 £60,000 -

Senior Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 19 March 2019, Senior Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads featuring Senior Data Engineer in the job title.

1 194 (72.39%) Python
2 161 (60.07%) Apache Spark
3 150 (55.97%) Big Data
4 147 (54.85%) Java
5 145 (54.10%) Hadoop
6 141 (52.61%) Agile Software Development
7 129 (48.13%) Scala
8 128 (47.76%) Amazon AWS
9 107 (39.93%) NoSQL
10 104 (38.81%) Data Engineering
11 101 (37.69%) SQL
12 99 (36.94%) Data Modelling
12 99 (36.94%) Data Science
13 97 (36.19%) Analytics
14 94 (35.07%) Kafka
15 86 (32.09%) ETL
16 73 (27.24%) Apache Hive
17 69 (25.75%) MongoDB
17 69 (25.75%) Microsoft Azure
18 67 (25.00%) Degree
19 64 (23.88%) Amazon Redshift
20 62 (23.13%) Data Warehouse
21 59 (22.01%) DevOps
22 57 (21.27%) Cloudera
23 55 (20.52%) Machine Learning
23 55 (20.52%) HBase
24 51 (19.03%) Amazon EMR
25 49 (18.28%) Apache
26 46 (17.16%) Open Source
26 46 (17.16%) Data Integration

Senior Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 161 (60.07%) Apache Spark
2 49 (18.28%) Apache
3 35 (13.06%) Apache Pig
4 26 (9.70%) Elasticsearch
5 6 (2.24%) Apache Airflow
5 6 (2.24%) Apache Solr
6 5 (1.87%) SAS
7 1 (0.37%) Jupyter
7 1 (0.37%) Luigi
Applications
1 1 (0.37%) Microsoft Excel
1 1 (0.37%) Microsoft PowerPoint
Business Applications
1 2 (0.75%) PolarLake
Cloud Services
1 128 (47.76%) Amazon AWS
2 69 (25.75%) Microsoft Azure
3 51 (19.03%) Amazon EMR
4 38 (14.18%) Google Cloud Platform
5 30 (11.19%) Cloud Computing
6 26 (9.70%) Amazon EC2
7 19 (7.09%) Amazon S3
8 11 (4.10%) Amazon Kinesis
8 11 (4.10%) Serverless
9 9 (3.36%) AWS Lambda
9 9 (3.36%) GitHub
10 6 (2.24%) PaaS
11 4 (1.49%) Google Analytics
12 3 (1.12%) Amazon SQS
12 3 (1.12%) AWS Data Pipeline
12 3 (1.12%) Azure Data Factory
12 3 (1.12%) SaaS
13 2 (0.75%) Apigee
13 2 (0.75%) AWS Fargate
13 2 (0.75%) IaaS
Communications & Networking
1 8 (2.99%) Structured Cabling
2 2 (0.75%) HTTP
2 2 (0.75%) Internet
3 1 (0.37%) Broadband
3 1 (0.37%) MQTT
3 1 (0.37%) WAN
Database & Business Intelligence
1 150 (55.97%) Big Data
2 145 (54.10%) Hadoop
3 107 (39.93%) NoSQL
4 73 (27.24%) Apache Hive
5 69 (25.75%) MongoDB
6 64 (23.88%) Amazon Redshift
7 62 (23.13%) Data Warehouse
8 55 (20.52%) HBase
9 41 (15.30%) Apache Cassandra
10 39 (14.55%) Flink
11 37 (13.81%) Sqoop
12 31 (11.57%) Amazon Athena
13 28 (10.45%) PostgreSQL
14 27 (10.07%) Data Lake
15 26 (9.70%) MySQL
16 24 (8.96%) Impala
16 24 (8.96%) SQL Server
17 17 (6.34%) SAP BW
18 14 (5.22%) Apache Kudu
19 13 (4.85%) Redis
Development Applications
1 25 (9.33%) JIRA
2 10 (3.73%) Jenkins
3 9 (3.36%) Git (software)
4 5 (1.87%) Artifactory
5 2 (0.75%) CircleCI
5 2 (0.75%) GitLab
6 1 (0.37%) GoCD
6 1 (0.37%) Gradle
6 1 (0.37%) Visual Studio
6 1 (0.37%) Visual Studio Team System
General
1 35 (13.06%) Finance
2 31 (11.57%) Law
3 27 (10.07%) Military
4 19 (7.09%) Retail
5 12 (4.48%) Telecoms
6 11 (4.10%) Banking
7 6 (2.24%) Marketing
8 5 (1.87%) Legal
9 3 (1.12%) Investment Banking
10 2 (0.75%) Electronics
10 2 (0.75%) Games
10 2 (0.75%) Manufacturing
11 1 (0.37%) Digital Economy
11 1 (0.37%) Front Office
11 1 (0.37%) International Banking
Libraries, Frameworks & Software Standards
1 94 (35.07%) Kafka
2 44 (16.42%) Spark Streaming
3 38 (14.18%) Web Services
4 27 (10.07%) Apache NiFi
5 20 (7.46%) LAMP
6 16 (5.97%) LAPP Stack
7 15 (5.60%) RESTful
8 6 (2.24%) Apache Beam
8 6 (2.24%) Pandas
9 5 (1.87%) PySpark
9 5 (1.87%) XML
10 4 (1.49%) HTML
10 4 (1.49%) JSON
10 4 (1.49%) Natural Language Processing
10 4 (1.49%) Node.js
10 4 (1.49%) NumPy
10 4 (1.49%) OAuth
10 4 (1.49%) OAuth2
11 3 (1.12%) .NET
11 3 (1.12%) REST
Miscellaneous
1 23 (8.58%) Algorithms
1 23 (8.58%) Data Structures
2 17 (6.34%) Fintech
2 17 (6.34%) FMCG
3 14 (5.22%) Analytical Skills
4 13 (4.85%) User Experience
5 9 (3.36%) Mobile App
6 8 (2.99%) Driving Licence
7 5 (1.87%) Greenfield Project
7 5 (1.87%) Linux Command Line
8 4 (1.49%) Cloud Native
8 4 (1.49%) Linked Data
8 4 (1.49%) Self-Motivation
9 3 (1.12%) Analytical Mindset
9 3 (1.12%) Derivative
9 3 (1.12%) Hybrid Cloud
9 3 (1.12%) Market Risk
9 3 (1.12%) Marketing Technology
10 2 (0.75%) Bitcoin
10 2 (0.75%) Public Cloud
Operating Systems
1 41 (15.30%) Linux
2 13 (4.85%) Unix
3 8 (2.99%) Apple iOS
4 7 (2.61%) Windows
5 4 (1.49%) Mac OS X
Processes & Methodologies
1 141 (52.61%) Agile Software Development
2 104 (38.81%) Data Engineering
3 99 (36.94%) Data Modelling
3 99 (36.94%) Data Science
4 97 (36.19%) Analytics
5 86 (32.09%) ETL
6 59 (22.01%) DevOps
7 55 (20.52%) Machine Learning
8 46 (17.16%) Data Integration
8 46 (17.16%) Open Source
9 42 (15.67%) Business Intelligence
10 39 (14.55%) Visualisation
11 38 (14.18%) Data Analysis
12 35 (13.06%) Scrum
13 34 (12.69%) Computer Science
13 34 (12.69%) TDD
14 31 (11.57%) Data Security
15 28 (10.45%) Data Ingestion
16 27 (10.07%) Mathematics
17 26 (9.70%) Data Management
Programming Languages
1 194 (72.39%) Python
2 147 (54.85%) Java
3 129 (48.13%) Scala
4 101 (37.69%) SQL
5 26 (9.70%) R
6 15 (5.60%) C#
7 10 (3.73%) Go
8 8 (2.99%) Bash Shell
8 8 (2.99%) C++
8 8 (2.99%) T-SQL
9 7 (2.61%) C
9 7 (2.61%) JavaScript
9 7 (2.61%) Shell Script
10 6 (2.24%) PowerShell
11 4 (1.49%) Clojure
12 3 (1.12%) Haskell
12 3 (1.12%) Ruby
13 2 (0.75%) MATLAB
14 1 (0.37%) Groovy
14 1 (0.37%) U-SQL
Qualifications
1 67 (25.00%) Degree
2 24 (8.96%) Numerate Degree
3 23 (8.58%) Computer Science Degree
4 8 (2.99%) Security Cleared
5 4 (1.49%) AWS Certification
6 3 (1.12%) PhD
7 1 (0.37%) Master's Degree
Quality Assurance & Compliance
1 14 (5.22%) Data Quality
2 13 (4.85%) QA
3 10 (3.73%) GDPR
4 3 (1.12%) ISO/IEC 27001
System Software
1 33 (12.31%) Apache Flume
2 24 (8.96%) HDFS
3 19 (7.09%) Apache ZooKeeper
4 15 (5.60%) Docker
5 1 (0.37%) Virtual Machines
Systems Management
1 36 (13.43%) Oozie
2 24 (8.96%) Hadoop YARN
3 16 (5.97%) Kubernetes
4 15 (5.60%) Ansible
5 13 (4.85%) Salt
6 6 (2.24%) Terraform
7 2 (0.75%) Puppet
8 1 (0.37%) Consul
8 1 (0.37%) Kibana
8 1 (0.37%) logstash
8 1 (0.37%) Opscode Chef
Vendors
1 57 (21.27%) Cloudera
2 33 (12.31%) Hortonworks
3 24 (8.96%) SAP
4 22 (8.21%) CA Agile Central
4 22 (8.21%) Oracle
5 20 (7.46%) Microsoft
6 18 (6.72%) Google
6 18 (6.72%) Informatica
6 18 (6.72%) Tableau
7 17 (6.34%) Databricks
7 17 (6.34%) MapR
8 15 (5.60%) Talend
9 14 (5.22%) Teradata
10 7 (2.61%) Ab Initio
10 7 (2.61%) Netezza
11 2 (0.75%) Bloomberg
11 2 (0.75%) Foundry
11 2 (0.75%) Splunk
12 1 (0.37%) Facebook
12 1 (0.37%) Twitter