Period
to 21 May 2019

The median annual salary for a Data Engineer was £67,500 in advertised job vacancies during the 6 months to 21 May 2019.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Data Engineer
UK
6 months to
21 May 2019
Same period 2018 Same period 2017
Rank 312 450 596
Rank change year-on-year +138 +146 +194
Permanent jobs requiring a Data Engineer 1,513 1,155 689
As % of all permanent IT jobs advertised in the UK 1.05% 0.67% 0.41%
As % of the Job Titles category 1.09% 0.70% 0.42%
Number of salaries quoted 1,260 899 563
UK median annual salary £67,500 £62,500 £62,500
Median salary % change year-on-year +8.00% - +13.64%
10th Percentile £42,500 £40,000 £40,000
90th Percentile £95,000 £92,500 £87,500
UK excluding London median annual salary £52,500 £55,000 £50,000
% change year-on-year -4.55% +10.00% +11.11%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 138,416 165,583 162,929
% of permanent IT jobs with a recognized job title 96.01% 96.41% 96.50%
Number of salaries quoted 109,868 134,836 134,784
UK median annual salary £50,000 £50,000 £47,500
Median salary % change year-on-year - +5.26% -
10th Percentile £28,500 £27,500 £27,500
90th Percentile £85,000 £80,000 £77,500
UK excluding London median annual salary £45,000 £45,000 £42,500
% change year-on-year - +5.88% -

Data Engineer
Job Vacancy Trend

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Data Engineer in the UK

Data Engineer
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Engineer.

Salary trend for Data Engineer in the UK

Data Engineer
Salary Histogram

The salary distribution of IT jobs citing Data Engineer over the 6 months to 21 May 2019.

Salary histogram for Data Engineer in the UK

Data Engineer
Top 16 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineer within the UK over the 6 months to 21 May 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +142 1,399 £67,500 +3.85% 310
London +121 1,036 £72,500 +7.41% 171
UK excluding London +106 449 £52,500 -4.55% 165
South West +98 115 £54,000 +8.00% 30
North of England +69 101 £49,337 -1.33% 31
South East -25 83 £50,000 -13.79% 32
Scotland +45 68 £51,000 +7.37% 24
North West +52 47 £65,000 +18.18% 18
East of England +95 43 £60,000 -2.44% 20
Yorkshire +18 39 £45,000 - 10
Midlands +13 21 £45,000 -14.29% 26
Wales +17 18 £30,000 -14.29%
North East - 15 £49,337 - 3
East Midlands +30 13 £45,000 -21.74% 11
West Midlands +12 8 £45,000 -14.29% 15
Northern Ireland -37 2 - - 2

Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 21 May 2019, Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads featuring Data Engineer in the job title.

1 1,108 (73.23%) Python
2 823 (54.40%) Big Data
3 815 (53.87%) SQL
4 763 (50.43%) Apache Spark
5 745 (49.24%) Hadoop
6 641 (42.37%) Java
7 589 (38.93%) Scala
8 583 (38.53%) Analytics
9 576 (38.07%) Agile Software Development
10 563 (37.21%) Amazon AWS
11 510 (33.71%) ETL
12 479 (31.66%) Data Science
13 453 (29.94%) Data Engineering
14 442 (29.21%) Kafka
15 414 (27.36%) Machine Learning
16 401 (26.50%) Data Warehouse
17 396 (26.17%) NoSQL
18 386 (25.51%) Apache Hive
19 364 (24.06%) Business Intelligence
20 359 (23.73%) Microsoft Azure
21 341 (22.54%) Data Modelling
22 262 (17.32%) Google Cloud Platform
23 261 (17.25%) DevOps
24 260 (17.18%) Cloudera
25 244 (16.13%) HBase
26 230 (15.20%) Finance
27 224 (14.81%) Analytical Skills
28 221 (14.61%) Visualisation
29 209 (13.81%) Software Engineering
30 195 (12.89%) MongoDB

Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 763 (50.43%) Apache Spark
2 154 (10.18%) Apache Pig
3 140 (9.25%) Apache
4 94 (6.21%) Elasticsearch
5 49 (3.24%) Apache Airflow
6 42 (2.78%) Apache Solr
7 30 (1.98%) SAS
8 14 (0.93%) Confluence
9 12 (0.79%) Luigi
10 6 (0.40%) Jupyter
10 6 (0.40%) nginx
10 6 (0.40%) Tomcat
11 2 (0.13%) ArcGIS
11 2 (0.13%) Drupal
Applications
1 23 (1.52%) Microsoft Excel
2 11 (0.73%) MS Visio
3 6 (0.40%) SPSS
4 3 (0.20%) Stata
5 2 (0.13%) Microsoft PowerPoint
6 1 (0.066%) Chatbot
6 1 (0.066%) Simulink
6 1 (0.066%) Spreadsheet
Business Applications
1 2 (0.13%) Adobe Campaign
1 2 (0.13%) PolarLake
Cloud Services
1 563 (37.21%) Amazon AWS
2 359 (23.73%) Microsoft Azure
3 262 (17.32%) Google Cloud Platform
4 148 (9.78%) Power Platform
5 89 (5.88%) Amazon EMR
6 84 (5.55%) Amazon S3
7 66 (4.36%) Azure Data Factory
8 63 (4.16%) Serverless
9 45 (2.97%) AWS Lambda
10 38 (2.51%) Amazon Kinesis
11 37 (2.45%) Cloud Computing
12 35 (2.31%) GitHub
13 33 (2.18%) Amazon EC2
14 29 (1.92%) PaaS
15 26 (1.72%) SaaS
16 17 (1.12%) Google Analytics
17 15 (0.99%) Amazon SQS
18 14 (0.93%) AWS Data Pipeline
18 14 (0.93%) AWS Fargate
19 11 (0.73%) Azure Functions
Communications & Networking
1 24 (1.59%) Internet
2 12 (0.79%) Wi-Fi
3 10 (0.66%) Broadband
4 8 (0.53%) FTP
5 7 (0.46%) Structured Cabling
6 6 (0.40%) MQTT
7 5 (0.33%) HTTP
7 5 (0.33%) Kerberos
8 4 (0.26%) DNS
9 1 (0.066%) SSL
Database & Business Intelligence
1 823 (54.40%) Big Data
2 745 (49.24%) Hadoop
3 401 (26.50%) Data Warehouse
4 396 (26.17%) NoSQL
5 386 (25.51%) Apache Hive
6 244 (16.13%) HBase
7 195 (12.89%) MongoDB
8 170 (11.24%) Apache Cassandra
9 169 (11.17%) SQL Server
10 161 (10.64%) Data Lake
10 161 (10.64%) Impala
11 156 (10.31%) Amazon Redshift
12 151 (9.98%) Sqoop
13 148 (9.78%) Power BI
14 129 (8.53%) PostgreSQL
15 120 (7.93%) Relational Database
16 97 (6.41%) SQL Server Integration Services
17 84 (5.55%) MySQL
18 69 (4.56%) Flink
19 55 (3.64%) Amazon Athena
Development Applications
1 112 (7.40%) Git (software)
2 73 (4.82%) Jenkins
3 39 (2.58%) JIRA
4 27 (1.78%) Maven
5 21 (1.39%) Artifactory
6 19 (1.26%) Gradle
7 15 (0.99%) GitLab
8 12 (0.79%) Ant
9 10 (0.66%) Selenium
10 9 (0.59%) Mercurial
11 8 (0.53%) Visual Studio Team System
12 7 (0.46%) Atlassian Bamboo
12 7 (0.46%) Cucumber
12 7 (0.46%) Oracle APEX
12 7 (0.46%) Visual Studio
13 6 (0.40%) Octopus Deploy
13 6 (0.40%) TeamCity
13 6 (0.40%) tSQLt
14 5 (0.33%) Team Foundation Server
14 5 (0.33%) Vagrant
General
1 230 (15.20%) Finance
2 144 (9.52%) Law
3 96 (6.35%) Banking
4 94 (6.21%) Retail
5 48 (3.17%) Telecoms
6 29 (1.92%) Games
6 29 (1.92%) Marketing
7 8 (0.53%) Legal
8 6 (0.40%) Advertising
8 6 (0.40%) Pharmaceutical
9 5 (0.33%) Publishing
10 4 (0.26%) Electronics
10 4 (0.26%) Front Office
11 3 (0.20%) International Banking
11 3 (0.20%) Investment Banking
12 2 (0.13%) Financial Institution
12 2 (0.13%) Manufacturing
12 2 (0.13%) Military
13 1 (0.066%) Digital Economy
13 1 (0.066%) French Language
Libraries, Frameworks & Software Standards
1 442 (29.21%) Kafka
2 108 (7.14%) Apache NiFi
3 97 (6.41%) Spark Streaming
4 81 (5.35%) Web Services
5 78 (5.16%) Pandas
6 63 (4.16%) PySpark
7 51 (3.37%) NumPy
8 34 (2.25%) REST
9 33 (2.18%) SciPy
10 32 (2.12%) Natural Language Processing
10 32 (2.12%) scikit-learn
11 31 (2.05%) LAPP Stack
12 30 (1.98%) .NET
12 30 (1.98%) LAMP
13 28 (1.85%) Elastic Stack
13 28 (1.85%) RESTful
14 21 (1.39%) JSON
15 18 (1.19%) TensorFlow
15 18 (1.19%) XML
16 16 (1.06%) pytest
Miscellaneous
1 224 (14.81%) Analytical Skills
2 128 (8.46%) Data Structures
3 97 (6.41%) Algorithms
4 93 (6.15%) Fintech
5 49 (3.24%) Greenfield Project
6 28 (1.85%) User Experience
7 24 (1.59%) Mobile App
8 17 (1.12%) Self-Motivation
8 17 (1.12%) Virtual Team
9 11 (0.73%) NHS
10 10 (0.66%) Driving Licence
10 10 (0.66%) Hedge funds
10 10 (0.66%) Linked Data
10 10 (0.66%) Robotics
11 9 (0.59%) Analytical Mindset
12 8 (0.53%) Cloud Native
12 8 (0.53%) Fibre Optics
13 7 (0.46%) Linux Command Line
13 7 (0.46%) Management Information System
13 7 (0.46%) Market Risk
Operating Systems
1 160 (10.58%) Linux
2 104 (6.87%) Unix
3 33 (2.18%) Windows
4 14 (0.93%) Apple iOS
5 4 (0.26%) Mac OS X
6 3 (0.20%) Android
7 2 (0.13%) Red Hat Enterprise Linux
8 1 (0.066%) Ubuntu
8 1 (0.066%) Windows 10
Processes & Methodologies
1 583 (38.53%) Analytics
2 576 (38.07%) Agile Software Development
3 510 (33.71%) ETL
4 479 (31.66%) Data Science
5 453 (29.94%) Data Engineering
6 414 (27.36%) Machine Learning
7 364 (24.06%) Business Intelligence
8 341 (22.54%) Data Modelling
9 261 (17.25%) DevOps
10 221 (14.61%) Visualisation
11 209 (13.81%) Software Engineering
12 156 (10.31%) Data Analysis
13 155 (10.24%) Open Source
14 150 (9.91%) Artificial Intelligence
15 133 (8.79%) Data Integration
16 130 (8.59%) Data Analytics
17 129 (8.53%) Data Visualisation
18 121 (8.00%) MapReduce
19 115 (7.60%) Scrum
20 113 (7.47%) Problem-Solving
Programming Languages
1 1,108 (73.23%) Python
2 815 (53.87%) SQL
3 641 (42.37%) Java
4 589 (38.93%) Scala
5 125 (8.26%) R
6 114 (7.53%) C#
7 56 (3.70%) C++
8 55 (3.64%) T-SQL
9 41 (2.71%) PL/SQL
10 38 (2.51%) Go
11 37 (2.45%) C
12 34 (2.25%) Shell Script
13 32 (2.12%) JavaScript
14 31 (2.05%) HiveQL
15 27 (1.78%) Ruby
16 22 (1.45%) PowerShell
17 21 (1.39%) MATLAB
18 18 (1.19%) Clojure
19 17 (1.12%) Perl
20 16 (1.06%) Bash Shell
Qualifications
1 131 (8.66%) Degree
2 51 (3.37%) Security Cleared
3 39 (2.58%) SC Cleared
4 33 (2.18%) Computer Science Degree
5 26 (1.72%) DV Cleared
6 24 (1.59%) AWS Certification
7 13 (0.86%) PhD
8 11 (0.73%) MCSA
8 11 (0.73%) Microsoft Certification
9 10 (0.66%) Numerate Degree
9 10 (0.66%) PMI Certification
9 10 (0.66%) PMP
10 5 (0.33%) CCNA
10 5 (0.33%) Cisco Certification
10 5 (0.33%) JNCIA
11 4 (0.26%) Master's Degree
12 3 (0.20%) VCP6
12 3 (0.20%) VMware Certified Professional (VCP)
13 1 (0.066%) SAS Certification
Quality Assurance & Compliance
1 77 (5.09%) Data Quality
2 25 (1.65%) QA
3 17 (1.12%) GDPR
4 4 (0.26%) ISO/IEC 27001
5 2 (0.13%) MiFID
5 2 (0.13%) SLA
System Software
1 119 (7.87%) Docker
2 117 (7.73%) HDFS
3 110 (7.27%) Apache Flume
4 92 (6.08%) Apache ZooKeeper
5 5 (0.33%) VirtualBox
6 4 (0.26%) IAG
7 3 (0.20%) VMware Infrastructure
8 2 (0.13%) Active Directory
8 2 (0.13%) Oracle RAC
8 2 (0.13%) Virtual Machines
9 1 (0.066%) KVM
Systems Management
1 172 (11.37%) Oozie
2 95 (6.28%) Hadoop YARN
2 95 (6.28%) Kubernetes
3 56 (3.70%) Terraform
4 55 (3.64%) Ansible
5 48 (3.17%) Ambari
6 17 (1.12%) Salt
7 12 (0.79%) Nagios
8 9 (0.59%) Kibana
9 7 (0.46%) Puppet
10 5 (0.33%) Docker Swarm
10 5 (0.33%) logstash
11 4 (0.26%) Chukwa
11 4 (0.26%) Mesos
11 4 (0.26%) Opscode Chef
12 3 (0.20%) Consul
12 3 (0.20%) Packer
13 2 (0.13%) Chronos
14 1 (0.066%) Graylog
14 1 (0.066%) Thomson Reuters DACS
Vendors
1 260 (17.18%) Cloudera
2 162 (10.71%) Tableau
3 148 (9.78%) Oracle
4 132 (8.72%) Hortonworks
5 130 (8.59%) Google
6 121 (8.00%) Microsoft
7 93 (6.15%) Databricks
8 73 (4.82%) Informatica
9 65 (4.30%) MapR
10 52 (3.44%) Talend
11 46 (3.04%) Teradata
12 26 (1.72%) SAP
13 24 (1.59%) IBM
14 20 (1.32%) Netezza
15 19 (1.26%) Ab Initio
16 13 (0.86%) Alteryx
17 10 (0.66%) CA Agile Central
18 8 (0.53%) Virgin Media
19 7 (0.46%) Cognos
20 6 (0.40%) Cognizant