Period
to 19 August 2018

The median annual salary for a Senior Data Engineer was £75,000 in advertised job vacancies during the 6 months to 19 August 2018.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Senior Data Engineer
UK
6 months to
19 Aug 2018
Same period 2017 Same period 2016
Rank 982 1112 1224
Rank change year-on-year +130 +112 +46
Permanent jobs requiring a Senior Data Engineer 187 89 57
As % of all permanent IT jobs advertised in the UK 0.11% 0.050% 0.029%
As % of the Job Titles category 0.12% 0.052% 0.030%
Number of salaries quoted 115 70 50
UK median annual salary £75,000 £72,500 £65,000
Median salary % change year-on-year +3.45% +11.54% -
10th Percentile £45,000 £57,500 £51,250
90th Percentile £92,500 £90,000 £120,000
UK excluding London median annual salary £50,000 £75,000 £50,000
% change year-on-year -33.33% +50.00% -

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 162,496 170,230 190,494
% of permanent IT jobs with a recognized job title 96.15% 96.08% 96.59%
Number of salaries quoted 130,855 137,468 160,221
UK median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £27,500 £27,500 £26,750
90th Percentile £81,250 £78,000 £77,500
UK excluding London median annual salary £45,000 £42,500 £42,500
% change year-on-year +5.88% - +6.25%

Senior Data Engineer
Job Vacancy Trend

Job postings that featured Senior Data Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Senior Data Engineer in the UK

Senior Data Engineer
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Senior Data Engineer.

Salary trend for Senior Data Engineer in the UK

Senior Data Engineer
Salary Histogram

The salary distribution of IT jobs citing Senior Data Engineer over the 6 months to 19 August 2018.

Salary histogram for Senior Data Engineer in the UK

Senior Data Engineer
Top 14 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Senior Data Engineer within the UK over the 6 months to 19 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +102 178 £68,750 -5.17% 23
London +72 102 £80,000 +10.34% 18
UK excluding London +86 80 £50,000 -33.33% 6
South East +45 35 £62,500 +4.17% 2
North of England +21 18 £45,000 -40.00% 1
South West +27 13 £50,000 -9.09% 2
Yorkshire - 12 £45,000 -
Midlands +34 8 £50,000 -
East Midlands - 7 £50,000 -
North West +9 4 £65,000 -13.33% 1
Northern Ireland - 4 - -
East of England +13 2 - -
North East -20 2 £43,750 -51.39%
West Midlands +26 1 £60,000 -

Senior Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 19 August 2018, Senior Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads featuring Senior Data Engineer in the job title.

1 127 (67.91%) Python
2 118 (63.10%) Big Data
3 94 (50.27%) Analytics
3 94 (50.27%) Hadoop
4 92 (49.20%) SQL
5 91 (48.66%) Agile Software Development
6 90 (48.13%) Java
7 86 (45.99%) Scala
8 77 (41.18%) Apache Spark
9 76 (40.64%) Apache Hive
10 71 (37.97%) ETL
11 69 (36.90%) Kafka
12 65 (34.76%) Amazon AWS
13 60 (32.09%) Data Warehouse
14 56 (29.95%) Data Engineering
15 50 (26.74%) Data Science
16 49 (26.20%) Apache Flume
17 48 (25.67%) Impala
18 46 (24.60%) NoSQL
18 46 (24.60%) Machine Learning
19 45 (24.06%) MapReduce
20 43 (22.99%) PostgreSQL
21 40 (21.39%) Linux
21 40 (21.39%) Business Intelligence
22 39 (20.86%) Cloudera
23 35 (18.72%) Relational Database
24 34 (18.18%) MLlib
24 34 (18.18%) Microsoft Azure
25 32 (17.11%) Data Analytics
25 32 (17.11%) Scrum

Senior Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 77 (41.18%) Apache Spark
2 23 (12.30%) Apache Pig
2 23 (12.30%) Elasticsearch
3 5 (2.67%) Apache Solr
4 4 (2.14%) Apache
5 2 (1.07%) Apache Airflow
6 1 (0.53%) Oracle Workflow
Applications
1 5 (2.67%) Microsoft Excel
Cloud Services
1 65 (34.76%) Amazon AWS
2 34 (18.18%) Microsoft Azure
3 14 (7.49%) Amazon Kinesis
4 13 (6.95%) Amazon EMR
5 12 (6.42%) GitHub
6 9 (4.81%) Cloud Computing
7 7 (3.74%) Amazon EC2
8 6 (3.21%) Amazon S3
8 6 (3.21%) Google Analytics
8 6 (3.21%) Google Cloud Platform
9 4 (2.14%) AWS Lambda
9 4 (2.14%) Serverless
10 2 (1.07%) Azure Data Factory
10 2 (1.07%) PaaS
11 1 (0.53%) Data Lake Analytics
Communications & Networking
1 1 (0.53%) SMS
Database & Business Intelligence
1 118 (63.10%) Big Data
2 94 (50.27%) Hadoop
3 76 (40.64%) Apache Hive
4 60 (32.09%) Data Warehouse
5 48 (25.67%) Impala
6 46 (24.60%) NoSQL
7 43 (22.99%) PostgreSQL
8 35 (18.72%) Relational Database
9 32 (17.11%) Amazon Redshift
10 29 (15.51%) Sqoop
11 24 (12.83%) HBase
12 23 (12.30%) SQL Server
13 22 (11.76%) Power BI
14 16 (8.56%) Presto
14 16 (8.56%) SQL Server Integration Services
15 15 (8.02%) MongoDB
16 14 (7.49%) BigQuery
17 13 (6.95%) RDBMS
17 13 (6.95%) Spotfire
18 12 (6.42%) MySQL
Development Applications
1 30 (16.04%) Git (software)
2 27 (14.44%) Jenkins
3 23 (12.30%) TeamCity
4 13 (6.95%) JIRA
5 2 (1.07%) CircleCI
5 2 (1.07%) GitLab
5 2 (1.07%) Maven
6 1 (0.53%) GoCD
6 1 (0.53%) Octopus Deploy
6 1 (0.53%) Robot Framework
6 1 (0.53%) Vagrant
6 1 (0.53%) Visual Studio Team System
General
1 19 (10.16%) Finance
2 13 (6.95%) Marketing
3 11 (5.88%) Retail
3 11 (5.88%) Telecoms
4 8 (4.28%) Electronics
5 7 (3.74%) Banking
6 6 (3.21%) Advertising
7 5 (2.67%) Financial Institution
7 5 (2.67%) Investment Banking
7 5 (2.67%) Manufacturing
8 4 (2.14%) Games
9 1 (0.53%) Aerospace
9 1 (0.53%) Pharmaceutical
Libraries, Frameworks & Software Standards
1 69 (36.90%) Kafka
2 34 (18.18%) MLlib
3 27 (14.44%) TensorFlow
4 23 (12.30%) Keras
5 12 (6.42%) .NET
5 12 (6.42%) Pandas
6 9 (4.81%) Akka
7 8 (4.28%) Web Services
8 7 (3.74%) RESTful
9 5 (2.67%) HTML
9 5 (2.67%) JSON
10 4 (2.14%) D3.js
10 4 (2.14%) Highcharts JS
10 4 (2.14%) RabbitMQ
10 4 (2.14%) Spark Streaming
10 4 (2.14%) Spring
10 4 (2.14%) XML
11 3 (1.60%) REST
12 2 (1.07%) Natural Language Processing
12 2 (1.07%) WebKit
Miscellaneous
1 28 (14.97%) User Experience
2 21 (11.23%) Computer Science
3 20 (10.70%) Algorithms
4 18 (9.63%) Analytical Skills
5 16 (8.56%) Fintech
6 12 (6.42%) Clustering
6 12 (6.42%) Data Structures
7 8 (4.28%) Self-Motivation
8 5 (2.67%) Cyberthreat
9 4 (2.14%) Linux Command Line
10 2 (1.07%) Greenfield Project
10 2 (1.07%) Mobile Wallet
10 2 (1.07%) Online Gambling
10 2 (1.07%) Social Media
11 1 (0.53%) Derivative
11 1 (0.53%) Equities
11 1 (0.53%) Life Science
11 1 (0.53%) Management Information System
11 1 (0.53%) Online Games
11 1 (0.53%) Video on Demand
Operating Systems
1 40 (21.39%) Linux
2 9 (4.81%) Unix
3 1 (0.53%) Windows
Processes & Methodologies
1 94 (50.27%) Analytics
2 91 (48.66%) Agile Software Development
3 71 (37.97%) ETL
4 56 (29.95%) Data Engineering
5 50 (26.74%) Data Science
6 46 (24.60%) Machine Learning
7 45 (24.06%) MapReduce
8 40 (21.39%) Business Intelligence
9 32 (17.11%) Data Analytics
9 32 (17.11%) Scrum
10 31 (16.58%) DevOps
10 31 (16.58%) Visualisation
11 29 (15.51%) Data Modelling
12 28 (14.97%) Continuous Integration
13 27 (14.44%) Software Delivery
14 24 (12.83%) Deep Learning
15 23 (12.30%) Operations Research
16 21 (11.23%) Open Source
17 16 (8.56%) Coaching
17 16 (8.56%) TDD
Programming Languages
1 127 (67.91%) Python
2 92 (49.20%) SQL
3 90 (48.13%) Java
4 86 (45.99%) Scala
5 29 (15.51%) C#
6 28 (14.97%) Shell Script
7 23 (12.30%) Go
8 19 (10.16%) R
9 13 (6.95%) C++
9 13 (6.95%) T-SQL
10 11 (5.88%) Perl
11 9 (4.81%) Bash Shell
12 8 (4.28%) PowerShell
13 7 (3.74%) JavaScript
14 5 (2.67%) PL/SQL
15 3 (1.60%) Groovy
15 3 (1.60%) Ruby
16 1 (0.53%) F#
16 1 (0.53%) Korn
16 1 (0.53%) VBA
Qualifications
1 17 (9.09%) Degree
2 8 (4.28%) Computer Science Degree
3 3 (1.60%) AWS Certification
3 3 (1.60%) PhD
4 2 (1.07%) ISEB
4 2 (1.07%) ISTQB
4 2 (1.07%) SC Cleared
4 2 (1.07%) Security Cleared
5 1 (0.53%) Master's Degree
5 1 (0.53%) MBA
5 1 (0.53%) MCSA
5 1 (0.53%) MCSD
5 1 (0.53%) Microsoft Certification
5 1 (0.53%) Numerate Degree
Quality Assurance & Compliance
1 12 (6.42%) Data Quality
2 7 (3.74%) GDPR
3 3 (1.60%) GCP
3 3 (1.60%) ISO/IEC 27001
4 2 (1.07%) QA
System Software
1 49 (26.20%) Apache Flume
2 30 (16.04%) Docker
3 13 (6.95%) HDFS
4 2 (1.07%) Apache ZooKeeper
5 1 (0.53%) Cronacle
5 1 (0.53%) Virtual Machines
5 1 (0.53%) VMware ESXi
5 1 (0.53%) VMware Infrastructure
Systems Management
1 32 (17.11%) Hadoop YARN
2 18 (9.63%) Oozie
3 8 (4.28%) Kubernetes
4 3 (1.60%) Ansible
5 2 (1.07%) Ambari
6 1 (0.53%) BMC PATROL
6 1 (0.53%) Consul
6 1 (0.53%) Control-M
6 1 (0.53%) Kibana
6 1 (0.53%) Packer
6 1 (0.53%) Terraform
Vendors
1 39 (20.86%) Cloudera
2 31 (16.58%) Hortonworks
3 23 (12.30%) Tableau
4 12 (6.42%) Google
4 12 (6.42%) Oracle
5 11 (5.88%) Atlassian
5 11 (5.88%) Informatica
6 6 (3.21%) MapR
6 6 (3.21%) SAP
7 5 (2.67%) Databricks
8 4 (2.14%) Microsoft
8 4 (2.14%) Salesforce.com
8 4 (2.14%) Talend
9 2 (1.07%) RapidMiner
10 1 (0.53%) CA Agile Central
10 1 (0.53%) MuleSoft
10 1 (0.53%) Solace
10 1 (0.53%) Splunk
10 1 (0.53%) TIBCO
10 1 (0.53%) Vertica