Period
to 20 June 2018

The median annual salary for a Data Engineer was £62,500 in advertised job vacancies during the 6 months to 20 June 2018.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Data Engineer
UK
6 months to
20 Jun 2018
Same period 2017 Same period 2016
Rank 437 612 785
Rank change year-on-year +175 +173 +206
Permanent jobs requiring a Data Engineer 1,191 672 522
As % of all permanent IT jobs advertised in the UK 0.69% 0.39% 0.26%
As % of the Job Titles category 0.72% 0.41% 0.27%
Number of salaries quoted 915 541 411
UK median annual salary £62,500 £62,500 £55,000
Median salary % change year-on-year - +13.64% -4.35%
10th Percentile £40,000 £40,000 £37,500
90th Percentile £90,000 £86,250 £85,000
UK excluding London median annual salary £55,000 £52,500 £45,000
% change year-on-year +4.76% +16.67% +32.35%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 166,024 165,879 194,238
% of permanent IT jobs with a recognized job title 96.33% 96.25% 96.61%
Number of salaries quoted 135,024 136,627 163,207
UK median annual salary £50,000 £47,500 £47,500
Median salary % change year-on-year +5.26% - +5.56%
10th Percentile £27,500 £27,500 £26,500
90th Percentile £80,000 £77,500 £76,250
UK excluding London median annual salary £45,000 £42,500 £42,091
% change year-on-year +5.88% +0.97% +5.23%

Data Engineer
Job Vacancy Trend

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Data Engineer in the UK

Data Engineer
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Engineer.

Salary trend for Data Engineer in the UK

Data Engineer
Salary Histogram

The salary distribution of IT jobs citing Data Engineer over the 6 months to 20 June 2018.

Salary histogram for Data Engineer in the UK

Data Engineer
Top 15 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineer within the UK over the 6 months to 20 June 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +163 1,121 £62,500 - 218
London +125 770 £67,500 +3.85% 140
UK excluding London +164 383 £55,000 +4.76% 94
South East +91 161 £55,000 +10.00% 29
North of England +31 70 £47,500 -9.52% 21
South West +16 44 £50,000 -2.44% 6
Midlands +25 39 £52,500 -12.50% 10
Yorkshire +43 38 £45,000 +42.86% 6
North West -17 32 £53,750 -2.27% 14
East of England +22 30 £61,500 +36.67% 12
Scotland -19 27 £47,500 +6.74% 13
West Midlands +32 21 £52,500 -12.50% 8
East Midlands +27 18 £57,500 +160.18% 2
Wales - 7 £35,000 - 3
Northern Ireland - 5 £30,000 -

Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 20 June 2018, Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads featuring Data Engineer in the job title.

1 758 (63.64%) Big Data
2 715 (60.03%) Python
3 650 (54.58%) Hadoop
4 598 (50.21%) Apache Spark
5 565 (47.44%) SQL
6 470 (39.46%) ETL
7 468 (39.29%) Analytics
8 454 (38.12%) Java
9 397 (33.33%) Scala
10 369 (30.98%) Agile Software Development
11 367 (30.81%) Amazon AWS
11 367 (30.81%) Kafka
12 353 (29.64%) Data Science
13 340 (28.55%) NoSQL
14 313 (26.28%) Apache Hive
15 293 (24.60%) Machine Learning
16 241 (20.24%) Data Warehouse
17 232 (19.48%) Data Engineering
18 219 (18.39%) Cloudera
19 207 (17.38%) Microsoft Azure
20 197 (16.54%) Linux
21 182 (15.28%) Business Intelligence
22 175 (14.69%) Finance
22 175 (14.69%) Apache Cassandra
23 174 (14.61%) Visualisation
24 173 (14.53%) Impala
25 172 (14.44%) Continuous Integration
26 167 (14.02%) R
27 165 (13.85%) Data Analytics
28 163 (13.69%) SQL Server

Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 598 (50.21%) Apache Spark
2 116 (9.74%) Elasticsearch
3 81 (6.80%) Apache
4 75 (6.30%) Apache Solr
5 60 (5.04%) Apache Pig
6 24 (2.02%) Apache Airflow
7 17 (1.43%) SAS
8 9 (0.76%) Luigi
9 4 (0.34%) Confluence
10 2 (0.17%) JBoss
10 2 (0.17%) Jupyter
11 1 (0.084%) Alfresco
11 1 (0.084%) Apache Qpid
11 1 (0.084%) IIS
11 1 (0.084%) nginx
11 1 (0.084%) Oracle Workflow
11 1 (0.084%) Tomcat
Applications
1 13 (1.09%) Microsoft Excel
2 5 (0.42%) GNU Octave
2 5 (0.42%) Spreadsheet
3 3 (0.25%) SPSS
3 3 (0.25%) Stata
4 2 (0.17%) Microsoft PowerPoint
4 2 (0.17%) MS Visio
Business Applications
1 5 (0.42%) Cognos Business Intelligence
2 1 (0.084%) MetaTrader
Cloud Services
1 367 (30.81%) Amazon AWS
2 207 (17.38%) Microsoft Azure
3 94 (7.89%) Google Cloud Platform
4 79 (6.63%) Amazon EMR
5 71 (5.96%) Amazon Kinesis
6 51 (4.28%) Serverless
7 50 (4.20%) AWS Lambda
8 42 (3.53%) GitHub
9 40 (3.36%) Amazon S3
10 28 (2.35%) Azure Data Factory
11 22 (1.85%) Amazon EC2
12 16 (1.34%) IBM Cloud
13 15 (1.26%) Cloud Computing
14 9 (0.76%) Google Analytics
15 7 (0.59%) AWS CloudFormation
16 6 (0.50%) Amazon SageMaker
17 5 (0.42%) Data Lake Analytics
17 5 (0.42%) PaaS
17 5 (0.42%) SaaS
18 4 (0.34%) AWS Elastic Beanstalk
Communications & Networking
1 16 (1.34%) Kerberos
2 14 (1.18%) Internet
3 9 (0.76%) HTTP
4 8 (0.67%) SMS
5 7 (0.59%) LAN
5 7 (0.59%) VLAN
5 7 (0.59%) WAN
6 5 (0.42%) MQTT
6 5 (0.42%) Wireless
7 4 (0.34%) ADSL
7 4 (0.34%) DHCP
7 4 (0.34%) DNS
7 4 (0.34%) Ethernet
8 3 (0.25%) BGP
8 3 (0.25%) DAB
8 3 (0.25%) F5 BIG-IP GTM
8 3 (0.25%) F5 BIG-IP LTM
8 3 (0.25%) Firewall
8 3 (0.25%) OSPF
8 3 (0.25%) VPN
Database & Business Intelligence
1 758 (63.64%) Big Data
2 650 (54.58%) Hadoop
3 340 (28.55%) NoSQL
4 313 (26.28%) Apache Hive
5 241 (20.24%) Data Warehouse
6 175 (14.69%) Apache Cassandra
7 173 (14.53%) Impala
8 163 (13.69%) SQL Server
9 160 (13.43%) HBase
10 136 (11.42%) MongoDB
11 132 (11.08%) PostgreSQL
12 129 (10.83%) Amazon Redshift
12 129 (10.83%) Relational Database
13 113 (9.49%) MySQL
14 101 (8.48%) Data Lake
15 90 (7.56%) Power BI
16 85 (7.14%) Sqoop
17 79 (6.63%) SQL Server Integration Services
18 78 (6.55%) Neo4j
19 76 (6.38%) SQL Server Reporting Services
Development Applications
1 129 (10.83%) Jenkins
2 109 (9.15%) Git (software)
3 58 (4.87%) TeamCity
4 47 (3.95%) JIRA
5 22 (1.85%) Atlassian Bamboo
6 21 (1.76%) Octopus Deploy
6 21 (1.76%) RStudio
7 19 (1.60%) Cucumber
7 19 (1.60%) Vagrant
8 15 (1.26%) JUnit
9 12 (1.01%) SQL Server Management Studio (SSMS)
10 11 (0.92%) Subversion
11 10 (0.84%) GitLab
11 10 (0.84%) Visual Studio Team System
12 8 (0.67%) Artifactory
12 8 (0.67%) Gradle
12 8 (0.67%) Maven
13 6 (0.50%) ERwin
14 5 (0.42%) Visual Studio
15 4 (0.34%) Sonatype Nexus
General
1 175 (14.69%) Finance
2 69 (5.79%) Banking
3 45 (3.78%) Investment Banking
3 45 (3.78%) Marketing
4 43 (3.61%) Retail
5 40 (3.36%) Financial Institution
6 35 (2.94%) Telecoms
7 29 (2.43%) Advertising
8 22 (1.85%) Front Office
9 20 (1.68%) Games
10 19 (1.60%) Law
11 16 (1.34%) Electronics
12 14 (1.18%) Manufacturing
12 14 (1.18%) Pharmaceutical
13 11 (0.92%) Legal
14 3 (0.25%) Publishing
15 2 (0.17%) Aerospace
15 2 (0.17%) Billing
16 1 (0.084%) Automotive
16 1 (0.084%) Back Office
Libraries, Frameworks & Software Standards
1 367 (30.81%) Kafka
2 65 (5.46%) Pandas
3 61 (5.12%) .NET
4 58 (4.87%) MLlib
5 56 (4.70%) TensorFlow
6 51 (4.28%) Spark Streaming
7 47 (3.95%) Web Services
8 46 (3.86%) RabbitMQ
9 41 (3.44%) NumPy
10 36 (3.02%) Keras
11 35 (2.94%) HTML
11 35 (2.94%) XML
12 32 (2.69%) REST
12 32 (2.69%) scikit-learn
13 29 (2.43%) Natural Language Processing
14 24 (2.02%) Middleware
15 23 (1.93%) RESTful
16 22 (1.85%) Django
17 19 (1.60%) Elastic Stack
17 19 (1.60%) Flask
Miscellaneous
1 145 (12.17%) Analytical Skills
2 138 (11.59%) Algorithms
3 130 (10.92%) Computer Science
4 86 (7.22%) Fintech
5 57 (4.79%) Data Structures
6 52 (4.37%) Greenfield Project
7 48 (4.03%) User Experience
8 37 (3.11%) Cyberthreat
9 28 (2.35%) Clustering
10 18 (1.51%) Hedge funds
10 18 (1.51%) Linux Command Line
10 18 (1.51%) Self-Motivation
11 17 (1.43%) Management Information System
12 16 (1.34%) Enterprise Software
13 15 (1.26%) Tandem
14 13 (1.09%) Fixed Income
15 12 (1.01%) Public Cloud
16 10 (0.84%) Equities
17 8 (0.67%) Blog
17 8 (0.67%) Smart Energy
Operating Systems
1 197 (16.54%) Linux
2 91 (7.64%) Unix
3 31 (2.60%) Windows
4 12 (1.01%) CentOS
5 9 (0.76%) Red Hat Enterprise Linux
6 6 (0.50%) Windows Server
7 5 (0.42%) VMS
7 5 (0.42%) Windows Server 2012
8 2 (0.17%) Mac OS X
9 1 (0.084%) Windows Embedded Compact
9 1 (0.084%) Windows Server 2008
Processes & Methodologies
1 470 (39.46%) ETL
2 468 (39.29%) Analytics
3 369 (30.98%) Agile Software Development
4 353 (29.64%) Data Science
5 293 (24.60%) Machine Learning
6 232 (19.48%) Data Engineering
7 182 (15.28%) Business Intelligence
8 174 (14.61%) Visualisation
9 172 (14.44%) Continuous Integration
10 165 (13.85%) Data Analytics
11 158 (13.27%) MapReduce
12 153 (12.85%) Data Modelling
12 153 (12.85%) Software Engineering
13 144 (12.09%) DevOps
14 132 (11.08%) TDD
15 125 (10.50%) Problem-Solving
16 122 (10.24%) Open Source
17 106 (8.90%) Scrum
18 95 (7.98%) Mathematics
19 90 (7.56%) Artificial Intelligence
Programming Languages
1 715 (60.03%) Python
2 565 (47.44%) SQL
3 454 (38.12%) Java
4 397 (33.33%) Scala
5 167 (14.02%) R
6 93 (7.81%) C#
7 77 (6.47%) JavaScript
8 62 (5.21%) Shell Script
9 61 (5.12%) T-SQL
10 59 (4.95%) C++
10 59 (4.95%) Go
11 48 (4.03%) Bash Shell
12 46 (3.86%) Perl
13 32 (2.69%) MATLAB
14 29 (2.43%) C
15 19 (1.60%) PowerShell
16 18 (1.51%) PL/SQL
17 14 (1.18%) Ruby
18 13 (1.09%) Java 8
19 10 (0.84%) VBA
Qualifications
1 135 (11.34%) Degree
2 65 (5.46%) Computer Science Degree
3 31 (2.60%) Security Cleared
4 25 (2.10%) PhD
5 17 (1.43%) Numerate Degree
6 16 (1.34%) Master's Degree
7 12 (1.01%) DV Cleared
8 6 (0.50%) AWS Certification
8 6 (0.50%) Microsoft Certification
8 6 (0.50%) SC Cleared
9 5 (0.42%) MBA
9 5 (0.42%) MCSA
10 4 (0.34%) MCP
10 4 (0.34%) MCSE
11 3 (0.25%) ISTQB
12 2 (0.17%) ISEB
13 1 (0.084%) MCSD
Quality Assurance & Compliance
1 47 (3.95%) Data Quality
2 29 (2.43%) GCP
3 23 (1.93%) QA
4 11 (0.92%) GDPR
5 9 (0.76%) SLA
6 4 (0.34%) ISO/IEC 27001
7 3 (0.25%) Actionable Recommendations
System Software
1 150 (12.59%) Apache Flume
2 149 (12.51%) HDFS
3 125 (10.50%) Docker
4 23 (1.93%) VirtualBox
5 16 (1.34%) Active Directory
6 14 (1.18%) Apache ZooKeeper
7 6 (0.50%) Virtual Machines
8 4 (0.34%) Hyper-V
9 3 (0.25%) Oracle RAC
10 1 (0.084%) Cronacle
10 1 (0.084%) VMware ESXi
10 1 (0.084%) VMware Infrastructure
Systems Management
1 108 (9.07%) Hadoop YARN
2 60 (5.04%) Oozie
3 54 (4.53%) Ansible
4 42 (3.53%) Puppet
5 32 (2.69%) Kubernetes
6 30 (2.52%) Mesos
7 24 (2.02%) Docker Swarm
8 23 (1.93%) Terraform
9 16 (1.34%) Kibana
10 14 (1.18%) Opscode Chef
11 13 (1.09%) Prometheus
12 12 (1.01%) Grafana
13 8 (0.67%) logstash
14 3 (0.25%) Ambari
14 3 (0.25%) Salt
15 2 (0.17%) Control-M
15 2 (0.17%) SolarWinds Orion
15 2 (0.17%) Tivoli Storage Manager
16 1 (0.084%) BMC PATROL
16 1 (0.084%) Chronos
Vendors
1 219 (18.39%) Cloudera
2 149 (12.51%) Hortonworks
3 124 (10.41%) Tableau
4 117 (9.82%) Google
5 105 (8.82%) Microsoft
5 105 (8.82%) Talend
6 87 (7.30%) Oracle
7 69 (5.79%) Informatica
8 43 (3.61%) IBM
9 34 (2.85%) Sybase
10 28 (2.35%) WorldPay
11 27 (2.27%) Atlassian
12 24 (2.02%) MapR
13 22 (1.85%) MuleSoft
14 18 (1.51%) Greenplum
15 17 (1.43%) Cognos
16 14 (1.18%) Netezza
16 14 (1.18%) Salesforce.com
17 13 (1.09%) Capita
18 12 (1.01%) Twitter