Period
to 23 September 2019

The median annual salary for a Data Engineer was £65,000 in advertised job vacancies during the 6 months to 23 September 2019.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Data Engineer
UK
6 months to
23 Sep 2019
Same period 2018 Same period 2017
Rank 294 431 653
Rank change year-on-year +137 +222 +140
Permanent jobs requiring a Data Engineer 1,558 1,203 637
As % of all permanent IT jobs advertised in the UK 1.11% 0.73% 0.36%
As % of the Job Titles category 1.16% 0.76% 0.38%
Number of salaries quoted 1,273 894 532
UK median annual salary £65,000 £67,500 £62,500
Median salary % change year-on-year -3.70% +8.00% +13.64%
10th Percentile £40,498 £41,250 £38,750
90th Percentile £92,500 £92,500 £85,000
UK excluding London median annual salary £51,000 £52,500 £52,000
% change year-on-year -2.86% +0.96% +30.00%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 134,078 158,754 168,682
% of permanent IT jobs with a recognized job title 95.77% 96.03% 96.01%
Number of salaries quoted 106,768 127,893 135,219
UK median annual salary £50,000 £50,000 £47,500
Median salary % change year-on-year - +5.26% -
10th Percentile £28,000 £27,500 £27,500
90th Percentile £85,000 £82,500 £78,750
UK excluding London median annual salary £45,000 £45,000 £42,500
% change year-on-year - +5.88% -

Data Engineer
Job Vacancy Trend

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Data Engineer in the UK

Data Engineer
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Engineer.

Salary trend for Data Engineer in the UK

Data Engineer
Salary Histogram

The salary distribution of IT jobs citing Data Engineer over the 6 months to 23 September 2019.

Salary histogram for Data Engineer in the UK

Data Engineer
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineer within the UK over the 6 months to 23 September 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +115 1,431 £67,500 - 283
London +69 983 £72,500 +3.57% 171
UK excluding London +171 550 £51,000 -2.86% 148
South West +116 161 £53,000 +24.71% 16
North of England +74 111 £55,000 +12.82% 34
South East 0 101 £50,000 -11.11% 31
Scotland +91 88 £40,000 -11.11% 33
North West +63 66 £62,500 +13.64% 25
Midlands +37 50 £52,500 -12.50% 19
Yorkshire +3 34 £49,337 +9.64% 8
West Midlands +54 32 £55,000 +4.76% 13
East of England +63 24 £67,500 +22.73% 12
East Midlands +2 18 £51,250 -18.00% 6
Wales - 16 £30,000 - 3
North East +35 11 £53,638 +22.60% 1
Northern Ireland -10 1 - -

Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 23 September 2019, Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads featuring Data Engineer in the job title.

1 1,085 (69.64%) Python
2 882 (56.61%) SQL
3 763 (48.97%) Big Data
4 628 (40.31%) Apache Spark
5 616 (39.54%) AWS
6 603 (38.70%) Hadoop
7 589 (37.80%) Agile Software Development
8 587 (37.68%) Analytics
9 578 (37.10%) ETL
10 525 (33.70%) Data Science
11 469 (30.10%) Scala
12 468 (30.04%) Data Warehouse
13 459 (29.46%) Java
14 447 (28.69%) Business Intelligence
15 443 (28.43%) Data Engineering
16 424 (27.21%) Azure
17 344 (22.08%) Machine Learning
18 318 (20.41%) Apache Hive
18 318 (20.41%) Data Modelling
19 294 (18.87%) NoSQL
20 291 (18.68%) GCP
21 279 (17.91%) Kafka
22 233 (14.96%) DevOps
23 228 (14.63%) Analytical Skills
24 222 (14.25%) Finance
25 210 (13.48%) Google
25 210 (13.48%) SQL Server
26 188 (12.07%) Visualisation
27 187 (12.00%) Software Engineering
28 178 (11.42%) Tableau

Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 628 (40.31%) Apache Spark
2 122 (7.83%) Apache
3 81 (5.20%) Apache Airflow
4 57 (3.66%) Elasticsearch
5 52 (3.34%) Apache Pig
6 29 (1.86%) Confluence
7 26 (1.67%) SAS
8 24 (1.54%) Luigi
9 19 (1.22%) Apache Solr
10 16 (1.03%) Jupyter
11 7 (0.45%) nginx
12 6 (0.39%) Tomcat
13 3 (0.19%) ArcGIS
13 3 (0.19%) SharePoint
14 1 (0.064%) OpenStack
14 1 (0.064%) WebLogic Portal
Applications
1 41 (2.63%) Microsoft Excel
2 4 (0.26%) SPSS
3 3 (0.19%) Stata
4 1 (0.064%) Adobe Premiere
4 1 (0.064%) Chatbot
4 1 (0.064%) Spreadsheet
4 1 (0.064%) Weka
Business Applications
1 3 (0.19%) Dynamics CRM
2 1 (0.064%) Eikon
2 1 (0.064%) Markit EDM
2 1 (0.064%) Siebel CRM
Cloud Services
1 616 (39.54%) AWS
2 424 (27.21%) Azure
3 291 (18.68%) GCP
4 128 (8.22%) Power Platform
5 109 (7.00%) Amazon S3
6 92 (5.91%) Amazon EMR
7 81 (5.20%) Serverless
8 48 (3.08%) AWS Lambda
9 47 (3.02%) Amazon Kinesis
10 42 (2.70%) Azure Data Factory
10 42 (2.70%) Cloud Computing
11 37 (2.37%) PaaS
12 32 (2.05%) Amazon ECS
13 30 (1.93%) Amazon SQS
13 30 (1.93%) SaaS
14 28 (1.80%) Google Analytics
15 27 (1.73%) GitHub
16 24 (1.54%) IaaS
17 23 (1.48%) AWS Fargate
18 20 (1.28%) AWS CloudFormation
Communications & Networking
1 30 (1.93%) Internet
2 13 (0.83%) Firewall
3 10 (0.64%) Broadband
4 7 (0.45%) Wi-Fi
5 4 (0.26%) FTP
5 4 (0.26%) Network Security
6 3 (0.19%) Kerberos
7 2 (0.13%) Cisco Nexus
7 2 (0.13%) HTTP
7 2 (0.13%) LAN
7 2 (0.13%) WAN
8 1 (0.064%) ATM
8 1 (0.064%) Cisco Firepower
8 1 (0.064%) Ethernet
8 1 (0.064%) Frame Relay
8 1 (0.064%) iSCSI
8 1 (0.064%) NAS
8 1 (0.064%) SDH
8 1 (0.064%) VPLS
8 1 (0.064%) Wireless
Database & Business Intelligence
1 763 (48.97%) Big Data
2 603 (38.70%) Hadoop
3 468 (30.04%) Data Warehouse
4 318 (20.41%) Apache Hive
5 294 (18.87%) NoSQL
6 210 (13.48%) SQL Server
7 175 (11.23%) Data Lake
8 142 (9.11%) Relational Database
9 128 (8.22%) HBase
9 128 (8.22%) Power BI
10 123 (7.89%) MongoDB
11 121 (7.77%) PostgreSQL
12 118 (7.57%) Amazon Redshift
13 111 (7.12%) Impala
14 105 (6.74%) Apache Cassandra
15 101 (6.48%) BigQuery
16 90 (5.78%) MySQL
17 86 (5.52%) SQL Server Integration Services
18 81 (5.20%) Sqoop
19 66 (4.24%) Amazon Athena
Development Applications
1 136 (8.73%) Git (software)
2 114 (7.32%) Jenkins
3 67 (4.30%) JIRA
4 21 (1.35%) Selenium
5 19 (1.22%) GitLab
6 18 (1.16%) Maven
7 16 (1.03%) Atlassian Bamboo
8 14 (0.90%) Artifactory
9 13 (0.83%) Bitbucket
9 13 (0.83%) Cucumber
10 11 (0.71%) Team Foundation Server
11 10 (0.64%) ERwin
11 10 (0.64%) Visual Studio Team System
12 8 (0.51%) HP UFT
12 8 (0.51%) ProC
12 8 (0.51%) Vagrant
13 7 (0.45%) Subversion
14 6 (0.39%) Oracle APEX
14 6 (0.39%) Travis CI
14 6 (0.39%) Visual Studio
General
1 222 (14.25%) Finance
2 103 (6.61%) Retail
3 98 (6.29%) Banking
4 55 (3.53%) Games
5 53 (3.40%) Law
6 27 (1.73%) Publishing
7 21 (1.35%) Marketing
8 20 (1.28%) Telecoms
9 18 (1.16%) Public Sector
10 11 (0.71%) Advertising
11 10 (0.64%) Housing Association
12 9 (0.58%) Legal
13 8 (0.51%) Electronics
14 6 (0.39%) Automotive
14 6 (0.39%) Manufacturing
15 5 (0.32%) Aerospace
16 4 (0.26%) Front Office
16 4 (0.26%) Pharmaceutical
17 2 (0.13%) Financial Institution
17 2 (0.13%) Social Housing
Libraries, Frameworks & Software Standards
1 279 (17.91%) Kafka
2 87 (5.58%) Pandas
3 86 (5.52%) Web Services
4 65 (4.17%) PySpark
5 57 (3.66%) Apache NiFi
6 48 (3.08%) Spark Streaming
7 45 (2.89%) scikit-learn
8 44 (2.82%) NumPy
9 40 (2.57%) TensorFlow
10 38 (2.44%) Apache Beam
11 28 (1.80%) HTML
12 27 (1.73%) .NET
12 27 (1.73%) RabbitMQ
13 26 (1.67%) JSON
13 26 (1.67%) Keras
13 26 (1.67%) XML
14 25 (1.60%) REST
15 23 (1.48%) pytest
16 22 (1.41%) Node.js
17 20 (1.28%) GraphQL
Miscellaneous
1 228 (14.63%) Analytical Skills
2 103 (6.61%) Data Structures
3 86 (5.52%) Algorithms
4 69 (4.43%) Greenfield Project
5 44 (2.82%) Management Information System
6 20 (1.28%) Virtual Team
7 16 (1.03%) Linux Command Line
8 14 (0.90%) Self-Motivation
9 12 (0.77%) Enterprise Software
9 12 (0.77%) User Experience
10 11 (0.71%) Online Games
10 11 (0.71%) PMI
10 11 (0.71%) Public Cloud
11 9 (0.58%) Hedge funds
11 9 (0.58%) Mobile Games
11 9 (0.58%) NHS
12 7 (0.45%) Data Centre
12 7 (0.45%) Market Risk
12 7 (0.45%) Mobile App
13 6 (0.39%) Internet of Things
Operating Systems
1 159 (10.21%) Linux
2 95 (6.10%) Unix
3 21 (1.35%) Windows
4 16 (1.03%) Red Hat Enterprise Linux
5 2 (0.13%) CentOS
6 1 (0.064%) Oracle Linux
Processes & Methodologies
1 589 (37.80%) Agile Software Development
2 587 (37.68%) Analytics
3 578 (37.10%) ETL
4 525 (33.70%) Data Science
5 447 (28.69%) Business Intelligence
6 443 (28.43%) Data Engineering
7 344 (22.08%) Machine Learning
8 318 (20.41%) Data Modelling
9 233 (14.96%) DevOps
10 188 (12.07%) Visualisation
11 187 (12.00%) Software Engineering
12 137 (8.79%) Data Analytics
13 131 (8.41%) Data Architecture
14 126 (8.09%) Problem-Solving
15 118 (7.57%) Computer Science
16 117 (7.51%) Data Management
17 111 (7.12%) Artificial Intelligence
18 110 (7.06%) Mentoring
19 101 (6.48%) Data Integration
20 98 (6.29%) Open Source
Programming Languages
1 1,085 (69.64%) Python
2 882 (56.61%) SQL
3 469 (30.10%) Scala
4 459 (29.46%) Java
5 170 (10.91%) R
6 103 (6.61%) C#
7 69 (4.43%) JavaScript
8 57 (3.66%) PL/SQL
9 47 (3.02%) C++
10 42 (2.70%) T-SQL
11 38 (2.44%) Shell Script
12 36 (2.31%) HiveQL
13 34 (2.18%) Bash Shell
14 29 (1.86%) C
15 25 (1.60%) Go
15 25 (1.60%) PowerShell
16 24 (1.54%) TypeScript
17 16 (1.03%) Data Analysis Expressions (DAX)
18 15 (0.96%) Ruby
19 12 (0.77%) MATLAB
Qualifications
1 139 (8.92%) Degree
2 42 (2.70%) Security Cleared
3 34 (2.18%) Computer Science Degree
4 27 (1.73%) PhD
5 26 (1.67%) PMI Certification
5 26 (1.67%) SC Cleared
6 23 (1.48%) AWS Certification
7 20 (1.28%) DV Cleared
8 16 (1.03%) Master's Degree
9 15 (0.96%) PMP
10 2 (0.13%) ISEB
11 1 (0.064%) CCDP
11 1 (0.064%) CCNP
11 1 (0.064%) Cisco Certification
11 1 (0.064%) ISTQB
11 1 (0.064%) ISTQB Foundation Certification
11 1 (0.064%) Postgraduate
11 1 (0.064%) SAS Certification
Quality Assurance & Compliance
1 91 (5.84%) Data Quality
2 65 (4.17%) QA
3 9 (0.58%) GDPR
4 6 (0.39%) ISO/IEC 27001
System Software
1 155 (9.95%) Docker
2 105 (6.74%) HDFS
3 51 (3.27%) Apache ZooKeeper
4 28 (1.80%) Apache Flume
5 8 (0.51%) VirtualBox
6 4 (0.26%) Cronacle
6 4 (0.26%) IAG
7 2 (0.13%) Active Directory
Systems Management
1 113 (7.25%) Kubernetes
2 96 (6.16%) Oozie
3 79 (5.07%) Hadoop YARN
4 70 (4.49%) Terraform
5 28 (1.80%) Ansible
6 15 (0.96%) Consul
7 14 (0.90%) Ambari
8 13 (0.83%) Control-M
9 8 (0.51%) Docker Swarm
9 8 (0.51%) Puppet
10 7 (0.45%) Mesos
10 7 (0.45%) Opscode Chef
11 6 (0.39%) Istio
11 6 (0.39%) linkerd
12 5 (0.32%) Kibana
13 4 (0.26%) Chukwa
14 3 (0.19%) BladeLogic
14 3 (0.19%) Chronos
14 3 (0.19%) Rancher
15 2 (0.13%) Thomson Reuters DACS
Vendors
1 210 (13.48%) Google
2 178 (11.42%) Tableau
3 148 (9.50%) Cloudera
4 138 (8.86%) Oracle
5 124 (7.96%) Informatica
6 116 (7.45%) Microsoft
7 83 (5.33%) Databricks
8 78 (5.01%) Teradata
9 57 (3.66%) Hortonworks
10 51 (3.27%) Talend
11 32 (2.05%) Ab Initio
12 26 (1.67%) Alteryx
13 24 (1.54%) Netezza
14 23 (1.48%) MapR
15 19 (1.22%) IBM
16 16 (1.03%) Red Hat
17 15 (0.96%) SAP
18 14 (0.90%) Splunk
19 9 (0.58%) Salesforce.com
20 8 (0.51%) Atlassian