Period
to 15 September 2019

The median annual salary for a Senior Data Engineer was £73,436 in advertised job vacancies during the 6 months to 15 September 2019.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Senior Data Engineer
UK
6 months to
15 Sep 2019
Same period 2018 Same period 2017
Rank 761 975 1135
Rank change year-on-year +214 +160 +97
Permanent jobs requiring a Senior Data Engineer 331 198 86
As % of all permanent IT jobs advertised in the UK 0.24% 0.12% 0.048%
As % of the Job Titles category 0.25% 0.12% 0.050%
Number of salaries quoted 297 122 70
UK median annual salary £73,436 £75,000 £72,500
Median salary % change year-on-year -2.09% +3.45% +11.54%
10th Percentile £48,250 £45,000 £57,500
90th Percentile £96,750 £95,875 £91,375
UK excluding London median annual salary £61,500 £50,000 £75,000
% change year-on-year +23.00% -33.33% +15.38%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 134,047 160,256 170,386
% of permanent IT jobs with a recognized job title 95.78% 96.08% 96.03%
Number of salaries quoted 106,749 129,076 136,555
UK median annual salary £50,000 £50,000 £47,500
Median salary % change year-on-year - +5.26% -
10th Percentile £28,000 £27,500 £27,500
90th Percentile £85,000 £82,500 £78,750
UK excluding London median annual salary £45,000 £45,000 £42,500
% change year-on-year - +5.88% -

Senior Data Engineer
Job Vacancy Trend

Job postings that featured Senior Data Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Senior Data Engineer in the UK

Senior Data Engineer
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Senior Data Engineer.

Salary trend for Senior Data Engineer in the UK

Senior Data Engineer
Salary Histogram

The salary distribution of IT jobs citing Senior Data Engineer over the 6 months to 15 September 2019.

Salary histogram for Senior Data Engineer in the UK

Senior Data Engineer
Top 15 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Senior Data Engineer within the UK over the 6 months to 15 September 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +212 315 £75,000 - 43
London +184 199 £80,000 - 29
UK excluding London +101 127 £61,500 +23.00% 18
South West +32 44 £61,500 +2.50% 5
North of England +31 34 £57,275 +27.28% 3
North West +30 21 £70,000 +7.69% 3
Midlands +43 16 £55,000 +2.33% 2
East of England +84 15 £67,500 - 3
West Midlands +39 14 £55,000 -8.33% 2
Yorkshire -4 9 £57,275 +27.28%
Scotland - 8 £65,000 - 2
South East +13 7 £70,000 +3.70% 1
North East +23 4 £57,275 +30.91%
Wales - 3 £45,000 - 2
East Midlands +18 2 £68,750 +37.50%

Senior Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 15 September 2019, Senior Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads featuring Senior Data Engineer in the job title.

1 266 (80.36%) Python
2 214 (64.65%) Big Data
3 174 (52.57%) SQL
4 167 (50.45%) Apache Spark
5 157 (47.43%) Scala
6 155 (46.83%) Hadoop
7 141 (42.60%) Agile Software Development
8 139 (41.99%) Analytics
9 133 (40.18%) AWS
10 132 (39.88%) Java
11 127 (38.37%) Data Engineering
12 125 (37.76%) ETL
13 113 (34.14%) Apache Hive
14 112 (33.84%) Data Science
15 102 (30.82%) Azure
16 79 (23.87%) Machine Learning
17 78 (23.56%) NoSQL
18 74 (22.36%) Business Intelligence
19 73 (22.05%) DevOps
20 71 (21.45%) Data Warehouse
21 68 (20.54%) GCP
22 67 (20.24%) Finance
23 66 (19.94%) Data Modelling
24 65 (19.64%) Kafka
25 58 (17.52%) SQL Server
26 57 (17.22%) Analytical Skills
27 52 (15.71%) MongoDB
28 49 (14.80%) Sqoop
28 49 (14.80%) Oozie
28 49 (14.80%) Google

Senior Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 167 (50.45%) Apache Spark
2 32 (9.67%) Apache
3 21 (6.34%) Apache Airflow
3 21 (6.34%) Apache Pig
4 13 (3.93%) Elasticsearch
5 12 (3.63%) SAS
6 7 (2.11%) Confluence
6 7 (2.11%) Jupyter
6 7 (2.11%) Luigi
7 5 (1.51%) Apache Solr
8 2 (0.60%) SharePoint
9 1 (0.30%) WebLogic Portal
Applications
1 3 (0.91%) Microsoft Excel
Business Applications
1 3 (0.91%) Dynamics CRM
2 1 (0.30%) Eikon
Cloud Services
1 133 (40.18%) AWS
2 102 (30.82%) Azure
3 68 (20.54%) GCP
4 45 (13.60%) Amazon S3
5 35 (10.57%) Serverless
6 30 (9.06%) Amazon EMR
7 24 (7.25%) Amazon ECS
7 24 (7.25%) Amazon Kinesis
8 20 (6.04%) Amazon SQS
8 20 (6.04%) AWS Lambda
8 20 (6.04%) Power Platform
9 16 (4.83%) AWS Fargate
10 14 (4.23%) IaaS
11 11 (3.32%) AWS CloudFormation
12 8 (2.42%) Amazon EKS
12 8 (2.42%) Google Analytics
13 7 (2.11%) Azure Data Factory
14 5 (1.51%) GitHub
14 5 (1.51%) PaaS
14 5 (1.51%) SaaS
Communications & Networking
1 7 (2.11%) Broadband
2 5 (1.51%) Internet
3 1 (0.30%) Network Security
Database & Business Intelligence
1 214 (64.65%) Big Data
2 155 (46.83%) Hadoop
3 113 (34.14%) Apache Hive
4 78 (23.56%) NoSQL
5 71 (21.45%) Data Warehouse
6 58 (17.52%) SQL Server
7 52 (15.71%) MongoDB
8 49 (14.80%) Sqoop
9 48 (14.50%) HBase
10 42 (12.69%) Data Lake
11 38 (11.48%) PostgreSQL
12 37 (11.18%) Relational Database
13 35 (10.57%) Apache Cassandra
14 32 (9.67%) Impala
15 28 (8.46%) Amazon Athena
16 26 (7.85%) MySQL
17 25 (7.55%) Presto
18 23 (6.95%) Amazon Redshift
19 22 (6.65%) Apache Kudu
19 22 (6.65%) DataStage
Development Applications
1 27 (8.16%) Jenkins
1 27 (8.16%) JIRA
2 17 (5.14%) Git (software)
3 12 (3.63%) Selenium
4 9 (2.72%) Team Foundation Server
5 8 (2.42%) HP UFT
6 5 (1.51%) Visual Studio Team System
7 4 (1.21%) GitLab
8 3 (0.91%) ProC
9 2 (0.60%) GoCD
10 1 (0.30%) Artifactory
10 1 (0.30%) Cucumber
10 1 (0.30%) JUnit
10 1 (0.30%) Maven
10 1 (0.30%) Sonatype Nexus
General
1 67 (20.24%) Finance
2 20 (6.04%) Law
2 20 (6.04%) Retail
3 14 (4.23%) Banking
4 12 (3.63%) Games
5 11 (3.32%) Publishing
6 4 (1.21%) Legal
7 3 (0.91%) Advertising
8 1 (0.30%) Aerospace
8 1 (0.30%) Multimedia
8 1 (0.30%) Public Sector
Libraries, Frameworks & Software Standards
1 65 (19.64%) Kafka
2 35 (10.57%) Pandas
3 31 (9.37%) Apache NiFi
4 30 (9.06%) PySpark
5 26 (7.85%) Web Services
6 17 (5.14%) scikit-learn
7 16 (4.83%) pytest
8 15 (4.53%) Keras
9 14 (4.23%) Apache Beam
10 13 (3.93%) TensorFlow
11 10 (3.02%) GraphQL
11 10 (3.02%) Spark Streaming
12 8 (2.42%) Velocity
13 7 (2.11%) LAPP Stack
13 7 (2.11%) NumPy
14 6 (1.81%) Akka
14 6 (1.81%) JSON
14 6 (1.81%) XML
15 5 (1.51%) RabbitMQ
15 5 (1.51%) REST
Miscellaneous
1 57 (17.22%) Analytical Skills
2 25 (7.55%) Data Structures
3 24 (7.25%) Algorithms
4 10 (3.02%) Linux Command Line
4 10 (3.02%) Management Information System
5 4 (1.21%) Public Cloud
5 4 (1.21%) Taxonomies
6 3 (0.91%) Analytical Mindset
6 3 (0.91%) Greenfield Project
6 3 (0.91%) Mobile Games
6 3 (0.91%) Self-Motivation
6 3 (0.91%) User Experience
7 2 (0.60%) Hedge funds
7 2 (0.60%) Virtual Team
8 1 (0.30%) Enterprise Software
8 1 (0.30%) Grid Computing
8 1 (0.30%) Media Streaming
Operating Systems
1 48 (14.50%) Linux
2 38 (11.48%) Unix
3 2 (0.60%) Windows
Processes & Methodologies
1 141 (42.60%) Agile Software Development
2 139 (41.99%) Analytics
3 127 (38.37%) Data Engineering
4 125 (37.76%) ETL
5 112 (33.84%) Data Science
6 79 (23.87%) Machine Learning
7 74 (22.36%) Business Intelligence
8 73 (22.05%) DevOps
9 66 (19.94%) Data Modelling
10 45 (13.60%) Data Architecture
11 41 (12.39%) Mentoring
12 33 (9.97%) Coaching
13 32 (9.67%) Computer Science
14 31 (9.37%) Data Management
15 29 (8.76%) Continuous Improvement
16 27 (8.16%) Data Development
16 27 (8.16%) MapReduce
17 26 (7.85%) Problem-Solving
18 25 (7.55%) Data Integration
19 23 (6.95%) Test Automation
Programming Languages
1 266 (80.36%) Python
2 174 (52.57%) SQL
3 157 (47.43%) Scala
4 132 (39.88%) Java
5 32 (9.67%) R
6 24 (7.25%) C#
7 18 (5.44%) Shell Script
8 12 (3.63%) C++
9 11 (3.32%) Clojure
9 11 (3.32%) JavaScript
10 10 (3.02%) Bash Shell
10 10 (3.02%) TypeScript
11 8 (2.42%) PL/SQL
11 8 (2.42%) T-SQL
12 7 (2.11%) PowerShell
12 7 (2.11%) U-SQL
13 3 (0.91%) C
13 3 (0.91%) VBA
14 2 (0.60%) Go
15 1 (0.30%) PHP
Qualifications
1 42 (12.69%) Degree
2 13 (3.93%) Computer Science Degree
3 10 (3.02%) Master's Degree
3 10 (3.02%) PhD
4 4 (1.21%) SC Cleared
4 4 (1.21%) Security Cleared
Quality Assurance & Compliance
1 37 (11.18%) Data Quality
2 21 (6.34%) QA
3 6 (1.81%) GDPR
4 4 (1.21%) ISO/IEC 27001
System Software
1 47 (14.20%) Docker
2 42 (12.69%) HDFS
3 30 (9.06%) Apache ZooKeeper
4 12 (3.63%) Apache Flume
Systems Management
1 49 (14.80%) Oozie
2 37 (11.18%) Hadoop YARN
3 35 (10.57%) Kubernetes
4 31 (9.37%) Terraform
5 10 (3.02%) Consul
6 5 (1.51%) Chukwa
6 5 (1.51%) Mesos
7 4 (1.21%) Ansible
7 4 (1.21%) Istio
7 4 (1.21%) linkerd
8 2 (0.60%) Kibana
9 1 (0.30%) Ambari
9 1 (0.30%) Chronos
9 1 (0.30%) Rancher
Vendors
1 49 (14.80%) Google
2 43 (12.99%) Cloudera
3 39 (11.78%) Informatica
4 28 (8.46%) Microsoft
5 25 (7.55%) Teradata
6 24 (7.25%) Oracle
7 19 (5.74%) Ab Initio
8 18 (5.44%) Databricks
9 16 (4.83%) Tableau
10 15 (4.53%) Hortonworks
11 7 (2.11%) Talend
12 6 (1.81%) IBM
12 6 (1.81%) Salesforce.com
13 5 (1.51%) Netezza
13 5 (1.51%) SAP
14 4 (1.21%) Splunk
15 3 (0.91%) DataFlux
15 3 (0.91%) MapR
16 2 (0.60%) Cognos
16 2 (0.60%) Samsung