Period
to 16 October 2018

The median annual salary for a Senior Data Engineer was £75,000 in advertised job vacancies during the 6 months to 16 October 2018.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Senior Data Engineer
UK
6 months to
16 Oct 2018
Same period 2017 Same period 2016
Rank 942 1097 1187
Rank change year-on-year +155 +90 +93
Permanent jobs requiring a Senior Data Engineer 215 86 39
As % of all permanent IT jobs advertised in the UK 0.13% 0.049% 0.020%
As % of the Job Titles category 0.14% 0.051% 0.021%
Number of salaries quoted 138 77 34
UK median annual salary £75,000 £75,000 £65,000
Median salary % change year-on-year - +15.38% +14.04%
10th Percentile £45,000 £57,500 £51,250
90th Percentile £99,750 £97,500 £103,750
UK excluding London median annual salary £57,500 £75,000 £65,000
% change year-on-year -23.33% +15.38% +30.00%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 157,980 168,274 183,899
% of permanent IT jobs with a recognized job title 95.93% 95.95% 96.55%
Number of salaries quoted 127,315 134,818 154,230
UK median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £27,500 £27,500 £26,750
90th Percentile £82,500 £78,750 £77,500
UK excluding London median annual salary £45,000 £42,500 £42,500
% change year-on-year +5.88% - +6.25%

Senior Data Engineer
Job Vacancy Trend

Job postings that featured Senior Data Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Senior Data Engineer in the UK

Senior Data Engineer
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Senior Data Engineer.

Salary trend for Senior Data Engineer in the UK

Senior Data Engineer
Salary Histogram

The salary distribution of IT jobs citing Senior Data Engineer over the 6 months to 16 October 2018.

Salary histogram for Senior Data Engineer in the UK

Senior Data Engineer
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Senior Data Engineer within the UK over the 6 months to 16 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +174 208 £75,000 - 32
London +99 126 £80,000 +6.67% 19
UK excluding London +80 86 £57,500 -23.33% 17
South East +55 37 £55,000 -8.33% 3
North of England +37 23 £46,250 -38.33% 3
South West +28 16 £62,138 +12.98% 3
North West +16 11 £65,000 -13.33% 2
Yorkshire - 10 £45,000 - 1
Midlands +24 5 £50,000 - 3
East Midlands - 4 £50,000 - 2
North East - 2 £43,750 -
Wales - 2 £52,000 - 4
West Midlands +33 1 £60,000 - 1
East of England +14 1 - - 1
Northern Ireland - 1 - -
Scotland - 1 - -

Senior Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 16 October 2018, Senior Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads featuring Senior Data Engineer in the job title.

1 136 (63.26%) Python
2 130 (60.47%) Big Data
3 99 (46.05%) Hadoop
4 94 (43.72%) SQL
4 94 (43.72%) Agile Software Development
5 89 (41.40%) Java
5 89 (41.40%) Analytics
6 87 (40.47%) Scala
7 85 (39.53%) ETL
8 77 (35.81%) Apache Spark
9 71 (33.02%) Data Science
9 71 (33.02%) Amazon AWS
10 68 (31.63%) Data Engineering
11 67 (31.16%) Kafka
12 64 (29.77%) Apache Hive
13 57 (26.51%) NoSQL
14 53 (24.65%) Data Warehouse
15 47 (21.86%) Data Modelling
16 41 (19.07%) Business Intelligence
16 41 (19.07%) Microsoft Azure
16 41 (19.07%) Machine Learning
17 39 (18.14%) Apache Flume
17 39 (18.14%) Scrum
18 35 (16.28%) Degree
18 35 (16.28%) Amazon Redshift
19 34 (15.81%) Impala
19 34 (15.81%) Hortonworks
19 34 (15.81%) Cloudera
19 34 (15.81%) MapReduce
19 34 (15.81%) Finance

Senior Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 77 (35.81%) Apache Spark
2 21 (9.77%) Apache Pig
2 21 (9.77%) Elasticsearch
3 12 (5.58%) Apache
4 4 (1.86%) Apache Solr
5 3 (1.40%) Apache Airflow
6 1 (0.47%) Luigi
6 1 (0.47%) Oracle Workflow
6 1 (0.47%) SAS
Applications
1 6 (2.79%) Microsoft Excel
2 1 (0.47%) Microsoft PowerPoint
Cloud Services
1 71 (33.02%) Amazon AWS
2 41 (19.07%) Microsoft Azure
3 15 (6.98%) Amazon EMR
4 11 (5.12%) Cloud Computing
4 11 (5.12%) Google Cloud Platform
5 10 (4.65%) Amazon EC2
6 6 (2.79%) Google Analytics
7 5 (2.33%) Amazon Kinesis
7 5 (2.33%) Amazon S3
7 5 (2.33%) GitHub
8 4 (1.86%) AWS Lambda
8 4 (1.86%) Serverless
9 2 (0.93%) Amazon SQS
9 2 (0.93%) Azure Data Factory
9 2 (0.93%) PaaS
10 1 (0.47%) AWS Data Pipeline
10 1 (0.47%) SaaS
Communications & Networking
1 1 (0.47%) Broadband
1 1 (0.47%) Internet
1 1 (0.47%) SMS
1 1 (0.47%) WAN
Database & Business Intelligence
1 130 (60.47%) Big Data
2 99 (46.05%) Hadoop
3 64 (29.77%) Apache Hive
4 57 (26.51%) NoSQL
5 53 (24.65%) Data Warehouse
6 35 (16.28%) Amazon Redshift
7 34 (15.81%) Impala
8 33 (15.35%) PostgreSQL
9 28 (13.02%) Relational Database
10 26 (12.09%) HBase
11 22 (10.23%) SQL Server
12 21 (9.77%) MongoDB
13 19 (8.84%) SQL Server Integration Services
13 19 (8.84%) Sqoop
14 18 (8.37%) Flink
14 18 (8.37%) Power BI
15 15 (6.98%) Apache Cassandra
15 15 (6.98%) Data Lake
16 14 (6.51%) Amazon Athena
17 12 (5.58%) BigQuery
Development Applications
1 20 (9.30%) Jenkins
2 19 (8.84%) Git (software)
3 15 (6.98%) TeamCity
4 10 (4.65%) JIRA
5 2 (0.93%) GitLab
6 1 (0.47%) CircleCI
6 1 (0.47%) GoCD
6 1 (0.47%) Maven
6 1 (0.47%) Robot Framework
6 1 (0.47%) RStudio
6 1 (0.47%) Vagrant
6 1 (0.47%) Visual Studio
General
1 34 (15.81%) Finance
2 20 (9.30%) Marketing
3 14 (6.51%) Retail
4 13 (6.05%) Banking
4 13 (6.05%) Telecoms
5 10 (4.65%) Investment Banking
6 9 (4.19%) Electronics
6 9 (4.19%) Manufacturing
7 6 (2.79%) Advertising
8 5 (2.33%) Financial Institution
9 3 (1.40%) Games
9 3 (1.40%) Law
10 1 (0.47%) Digital Economy
10 1 (0.47%) Military
10 1 (0.47%) Pharmaceutical
Libraries, Frameworks & Software Standards
1 67 (31.16%) Kafka
2 19 (8.84%) MLlib
3 18 (8.37%) TensorFlow
4 15 (6.98%) Keras
5 13 (6.05%) Web Services
6 11 (5.12%) .NET
7 9 (4.19%) Spark Streaming
7 9 (4.19%) XML
8 8 (3.72%) JSON
9 7 (3.26%) Akka
9 7 (3.26%) HTML
10 5 (2.33%) D3.js
10 5 (2.33%) Natural Language Processing
10 5 (2.33%) RESTful
10 5 (2.33%) Spring
11 4 (1.86%) Highcharts JS
11 4 (1.86%) Pandas
12 3 (1.40%) Velocity
13 2 (0.93%) PySpark
13 2 (0.93%) RabbitMQ
Miscellaneous
1 30 (13.95%) Algorithms
2 23 (10.70%) Analytical Skills
3 21 (9.77%) Computer Science
4 19 (8.84%) User Experience
5 13 (6.05%) Data Structures
5 13 (6.05%) Fintech
6 12 (5.58%) FMCG
7 9 (4.19%) Self-Motivation
8 5 (2.33%) Clustering
8 5 (2.33%) Cyberthreat
8 5 (2.33%) Market Risk
8 5 (2.33%) Social Media
9 4 (1.86%) Derivative
9 4 (1.86%) Linux Command Line
10 2 (0.93%) Credit Risk
11 1 (0.47%) Equities
11 1 (0.47%) Greenfield Project
11 1 (0.47%) Mobile App
11 1 (0.47%) Online Gambling
11 1 (0.47%) Online Games
Operating Systems
1 29 (13.49%) Linux
2 11 (5.12%) Unix
3 2 (0.93%) Windows
4 1 (0.47%) Apple iOS
Processes & Methodologies
1 94 (43.72%) Agile Software Development
2 89 (41.40%) Analytics
3 85 (39.53%) ETL
4 71 (33.02%) Data Science
5 68 (31.63%) Data Engineering
6 47 (21.86%) Data Modelling
7 41 (19.07%) Business Intelligence
7 41 (19.07%) Machine Learning
8 39 (18.14%) Scrum
9 34 (15.81%) MapReduce
10 32 (14.88%) Visualisation
11 23 (10.70%) Data Management
11 23 (10.70%) DevOps
12 22 (10.23%) Data Analytics
13 20 (9.30%) Continuous Integration
13 20 (9.30%) Data Analysis
13 20 (9.30%) Mathematics
13 20 (9.30%) TDD
14 18 (8.37%) Data Integration
15 17 (7.91%) Data Security
Programming Languages
1 136 (63.26%) Python
2 94 (43.72%) SQL
3 89 (41.40%) Java
4 87 (40.47%) Scala
5 32 (14.88%) R
6 22 (10.23%) C#
7 19 (8.84%) Shell Script
8 16 (7.44%) Bash Shell
8 16 (7.44%) Go
9 15 (6.98%) PowerShell
10 14 (6.51%) C++
11 12 (5.58%) Perl
12 11 (5.12%) JavaScript
13 10 (4.65%) T-SQL
14 7 (3.26%) PL/SQL
15 4 (1.86%) Ruby
16 3 (1.40%) C
16 3 (1.40%) Haskell
16 3 (1.40%) PHP
17 2 (0.93%) Groovy
Qualifications
1 35 (16.28%) Degree
2 11 (5.12%) AWS Certification
3 9 (4.19%) Computer Science Degree
4 7 (3.26%) Numerate Degree
5 2 (0.93%) ISEB
5 2 (0.93%) ISTQB
5 2 (0.93%) PhD
5 2 (0.93%) SC Cleared
5 2 (0.93%) Security Cleared
6 1 (0.47%) Master's Degree
6 1 (0.47%) MBA
6 1 (0.47%) MCSA
6 1 (0.47%) MCSD
6 1 (0.47%) Microsoft Certification
Quality Assurance & Compliance
1 9 (4.19%) Data Quality
2 8 (3.72%) ISO/IEC 27001
3 6 (2.79%) GDPR
4 3 (1.40%) QA
System Software
1 39 (18.14%) Apache Flume
2 23 (10.70%) Docker
3 11 (5.12%) HDFS
4 2 (0.93%) Apache ZooKeeper
5 1 (0.47%) Virtual Machines
Systems Management
1 29 (13.49%) Hadoop YARN
2 21 (9.77%) Oozie
3 12 (5.58%) Kubernetes
4 2 (0.93%) Ansible
5 1 (0.47%) Ambari
5 1 (0.47%) Consul
5 1 (0.47%) Kibana
5 1 (0.47%) Opscode Chef
5 1 (0.47%) Packer
5 1 (0.47%) Puppet
5 1 (0.47%) Terraform
Vendors
1 34 (15.81%) Cloudera
1 34 (15.81%) Hortonworks
2 21 (9.77%) SAP
3 19 (8.84%) Tableau
4 17 (7.91%) Google
5 16 (7.44%) Microsoft
6 14 (6.51%) MapR
6 14 (6.51%) Oracle
7 13 (6.05%) Informatica
8 12 (5.58%) Databricks
9 6 (2.79%) CA Agile Central
9 6 (2.79%) Netezza
10 5 (2.33%) Ab Initio
10 5 (2.33%) Teradata
11 4 (1.86%) Atlassian
11 4 (1.86%) Salesforce.com
11 4 (1.86%) Talend
12 2 (0.93%) RapidMiner
13 1 (0.47%) MuleSoft
13 1 (0.47%) Vertica