Period
to 25 February 2018

The median annual salary for a Data Engineer was £62,500 in advertised job vacancies during the 6 months to 25 February 2018.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Data Engineer
UK
6 months to
25 Feb 2018
Same period 2017 Same period 2016
Rank 510 645 842
Rank change year-on-year +135 +197 +153
Permanent jobs requiring a Data Engineer 907 592 477
As % of all permanent IT jobs advertised in the UK 0.52% 0.34% 0.23%
As % of the Job Titles category 0.54% 0.35% 0.23%
Number of salaries quoted 761 470 385
UK median annual salary £62,500 £60,000 £56,500
Median salary % change year-on-year +4.17% +6.19% +2.73%
10th Percentile £38,750 £34,875 £31,750
90th Percentile £97,500 £88,750 £85,000
UK excluding London median annual salary £50,000 £45,000 £42,500
% change year-on-year +11.11% +5.88% +4.29%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 167,644 168,402 203,675
% of permanent IT jobs with a recognized job title 96.27% 96.50% 96.65%
Number of salaries quoted 137,716 139,840 170,323
UK median annual salary £50,000 £47,500 £46,367
Median salary % change year-on-year +5.26% +2.44% +3.04%
10th Percentile £27,500 £27,000 £26,750
90th Percentile £80,000 £77,500 £76,000
UK excluding London median annual salary £42,500 £42,500 £42,000
% change year-on-year - +1.19% +5.00%

Data Engineer
Job Vacancy Trend

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Data Engineer in the UK

Data Engineer
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Engineer.

Salary trend for Data Engineer in the UK

Data Engineer
Salary Histogram

The salary distribution of IT jobs citing Data Engineer over the 6 months to 25 February 2018.

Salary histogram for Data Engineer in the UK

Data Engineer
Top 15 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineer within the UK over the 6 months to 25 February 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +134 830 £65,000 +4.00% 243
London +86 597 £70,000 - 139
UK excluding London +120 295 £50,000 +11.11% 120
South East +40 86 £55,000 +23.60% 28
South West +41 54 £50,000 -9.09% 12
North of England +19 42 £48,750 +54.76% 30
Scotland -9 37 £53,750 +19.44% 13
East of England +14 31 £60,000 +20.00% 12
North West +12 29 £45,000 +16.13% 13
Wales +23 21 £37,500 -34.78% 3
Midlands +16 20 £52,500 +16.67% 22
West Midlands +18 15 £62,500 +25.00% 14
Yorkshire +12 13 £50,000 +66.67% 15
East Midlands 0 5 £40,000 -11.11% 8
Northern Ireland - 4 £30,000 -

Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 25 February 2018, Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads featuring Data Engineer in the job title.

1 575 (63.40%) Big Data
2 542 (59.76%) Python
3 524 (57.77%) Apache Spark
4 519 (57.22%) Hadoop
5 378 (41.68%) Java
6 367 (40.46%) SQL
7 338 (37.27%) Analytics
8 324 (35.72%) Scala
9 302 (33.30%) ETL
10 295 (32.52%) Data Science
11 286 (31.53%) Amazon AWS
12 274 (30.21%) Kafka
13 272 (29.99%) Agile Software Development
14 263 (29.00%) Machine Learning
15 236 (26.02%) NoSQL
16 235 (25.91%) Apache Hive
17 179 (19.74%) Apache Cassandra
18 175 (19.29%) Data Warehouse
19 171 (18.85%) Cloudera
20 165 (18.19%) HBase
21 164 (18.08%) Data Engineering
22 160 (17.64%) Software Engineering
23 155 (17.09%) Linux
24 152 (16.76%) Microsoft Azure
25 150 (16.54%) Business Intelligence
26 149 (16.43%) MongoDB
27 129 (14.22%) Finance
28 123 (13.56%) Open Source
29 122 (13.45%) Data Analytics
30 121 (13.34%) Analytical Skills

Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 524 (57.77%) Apache Spark
2 114 (12.57%) Elasticsearch
3 65 (7.17%) Apache Solr
4 60 (6.62%) Apache
5 56 (6.17%) Apache Pig
6 26 (2.87%) Apache Airflow
7 21 (2.32%) SAS
8 13 (1.43%) OpenStack
9 12 (1.32%) Luigi
10 4 (0.44%) Confluence
11 2 (0.22%) GeoServer
11 2 (0.22%) Jetty
11 2 (0.22%) nginx
12 1 (0.11%) Alfresco
12 1 (0.11%) Oracle SOA Suite
Applications
1 8 (0.88%) Microsoft Excel
2 2 (0.22%) Microsoft PowerPoint
2 2 (0.22%) Spreadsheet
3 1 (0.11%) MS Visio
Business Applications
1 1 (0.11%) Dynamics CRM
1 1 (0.11%) MetaTrader
Cloud Services
1 286 (31.53%) Amazon AWS
2 152 (16.76%) Microsoft Azure
3 83 (9.15%) Google Cloud Platform
4 58 (6.39%) Amazon Kinesis
5 48 (5.29%) Amazon EMR
6 46 (5.07%) GitHub
7 35 (3.86%) Amazon S3
8 32 (3.53%) AWS Lambda
8 32 (3.53%) Serverless
9 21 (2.32%) Azure Data Factory
10 20 (2.21%) Cloud Computing
11 17 (1.87%) SaaS
12 15 (1.65%) Amazon EC2
13 8 (0.88%) Google Compute Engine
14 7 (0.77%) PaaS
15 6 (0.66%) AWS CloudFormation
16 5 (0.55%) AWS Elastic Beanstalk
16 5 (0.55%) Virtual Private Cloud
17 3 (0.33%) Data Lake Analytics
17 3 (0.33%) IaaS
Communications & Networking
1 16 (1.76%) HTTP
2 11 (1.21%) TCP/IP
3 10 (1.10%) Internet
4 8 (0.88%) InfiniBand
5 6 (0.66%) Ethernet
6 5 (0.55%) DAB
6 5 (0.55%) Firewall
7 4 (0.44%) Kerberos
7 4 (0.44%) VLAN
7 4 (0.44%) Wireless
8 3 (0.33%) DHCP
8 3 (0.33%) DNS
8 3 (0.33%) LAN
8 3 (0.33%) WAN
9 2 (0.22%) AMQP
9 2 (0.22%) SAN
9 2 (0.22%) VoIP
9 2 (0.22%) Wi-Fi
10 1 (0.11%) DKIM
10 1 (0.11%) MQTT
Database & Business Intelligence
1 575 (63.40%) Big Data
2 519 (57.22%) Hadoop
3 236 (26.02%) NoSQL
4 235 (25.91%) Apache Hive
5 179 (19.74%) Apache Cassandra
6 175 (19.29%) Data Warehouse
7 165 (18.19%) HBase
8 149 (16.43%) MongoDB
9 115 (12.68%) Impala
10 100 (11.03%) Amazon Redshift
11 98 (10.80%) SQL Server
12 87 (9.59%) MySQL
12 87 (9.59%) Relational Database
13 76 (8.38%) Data Lake
14 61 (6.73%) Sqoop
15 57 (6.28%) PostgreSQL
16 55 (6.06%) Power BI
17 52 (5.73%) Flink
18 50 (5.51%) Neo4j
19 47 (5.18%) RDBMS
Development Applications
1 72 (7.94%) Jenkins
2 71 (7.83%) Git (software)
3 32 (3.53%) JIRA
4 23 (2.54%) TeamCity
5 16 (1.76%) Cucumber
5 16 (1.76%) Maven
6 11 (1.21%) Octopus Deploy
7 9 (0.99%) Sonatype Nexus
7 9 (0.99%) Visual Studio Team System
8 8 (0.88%) JUnit
9 7 (0.77%) Mercurial
10 5 (0.55%) GitLab
10 5 (0.55%) Subversion
11 4 (0.44%) Artifactory
11 4 (0.44%) ERwin
11 4 (0.44%) Vagrant
12 3 (0.33%) Atlassian Bamboo
12 3 (0.33%) Team Foundation Server
12 3 (0.33%) Travis CI
12 3 (0.33%) Visual Studio
General
1 129 (14.22%) Finance
2 46 (5.07%) Marketing
3 42 (4.63%) Telecoms
4 35 (3.86%) Retail
5 33 (3.64%) Banking
6 31 (3.42%) Advertising
7 30 (3.31%) Electronics
8 18 (1.98%) Legal
8 18 (1.98%) Manufacturing
9 17 (1.87%) Law
10 14 (1.54%) Games
11 12 (1.32%) Pharmaceutical
12 9 (0.99%) Financial Institution
13 8 (0.88%) Front Office
14 6 (0.66%) Investment Banking
15 5 (0.55%) Publishing
16 3 (0.33%) Automotive
17 2 (0.22%) Billing
18 1 (0.11%) iGaming
18 1 (0.11%) Music Industry
Libraries, Frameworks & Software Standards
1 274 (30.21%) Kafka
2 54 (5.95%) Web Services
3 48 (5.29%) Pandas
4 43 (4.74%) Spark Streaming
5 42 (4.63%) XML
6 41 (4.52%) REST
7 36 (3.97%) RabbitMQ
8 32 (3.53%) MLlib
8 32 (3.53%) NumPy
9 29 (3.20%) Natural Language Processing
10 28 (3.09%) JSON
10 28 (3.09%) TensorFlow
11 21 (2.32%) .NET
12 20 (2.21%) Middleware
12 20 (2.21%) scikit-learn
13 16 (1.76%) HTML
14 15 (1.65%) Keras
15 14 (1.54%) Akka
15 14 (1.54%) Elastic Stack
15 14 (1.54%) SciPy
Miscellaneous
1 121 (13.34%) Analytical Skills
2 104 (11.47%) Computer Science
3 96 (10.58%) Algorithms
4 60 (6.62%) Fintech
5 42 (4.63%) Data Structures
6 36 (3.97%) Greenfield Project
7 28 (3.09%) User Experience
8 24 (2.65%) Clustering
9 14 (1.54%) Hedge funds
9 14 (1.54%) Management Information System
10 12 (1.32%) Linux Command Line
11 10 (1.10%) Internet of Things
11 10 (1.10%) iSeries
12 8 (0.88%) Tandem
13 7 (0.77%) Enterprise Software
14 6 (0.66%) Data Centre
14 6 (0.66%) Hybrid Cloud
14 6 (0.66%) LIMS
14 6 (0.66%) Mobile App
14 6 (0.66%) Public Cloud
Operating Systems
1 155 (17.09%) Linux
2 93 (10.25%) Unix
3 25 (2.76%) Windows
4 8 (0.88%) CentOS
5 6 (0.66%) Red Hat Enterprise Linux
6 5 (0.55%) VMS
7 4 (0.44%) Mac OS X
8 2 (0.22%) Windows Server
9 1 (0.11%) Ubuntu
9 1 (0.11%) Windows Server 2003
9 1 (0.11%) Windows Server 2008
9 1 (0.11%) Windows Server 2012
Processes & Methodologies
1 338 (37.27%) Analytics
2 302 (33.30%) ETL
3 295 (32.52%) Data Science
4 272 (29.99%) Agile Software Development
5 263 (29.00%) Machine Learning
6 164 (18.08%) Data Engineering
7 160 (17.64%) Software Engineering
8 150 (16.54%) Business Intelligence
9 123 (13.56%) Open Source
10 122 (13.45%) Data Analytics
11 119 (13.12%) Visualisation
12 105 (11.58%) DevOps
13 98 (10.80%) MapReduce
14 96 (10.58%) TDD
15 87 (9.59%) Data Analysis
16 86 (9.48%) Continuous Integration
17 81 (8.93%) Data Visualisation
18 74 (8.16%) Data Modelling
19 69 (7.61%) Scrum
20 64 (7.06%) Data Architecture
Programming Languages
1 542 (59.76%) Python
2 378 (41.68%) Java
3 367 (40.46%) SQL
4 324 (35.72%) Scala
5 105 (11.58%) R
6 61 (6.73%) C#
7 41 (4.52%) JavaScript
8 39 (4.30%) Bash Shell
9 37 (4.08%) Go
10 26 (2.87%) Shell Script
11 22 (2.43%) C++
12 20 (2.21%) C
13 19 (2.09%) MATLAB
13 19 (2.09%) T-SQL
14 18 (1.98%) Perl
15 14 (1.54%) PL/SQL
16 13 (1.43%) PowerShell
17 9 (0.99%) PHP
17 9 (0.99%) Ruby
18 4 (0.44%) XPath
Qualifications
1 118 (13.01%) Degree
2 53 (5.84%) Computer Science Degree
3 30 (3.31%) PhD
4 24 (2.65%) Security Cleared
5 22 (2.43%) Master's Degree
6 17 (1.87%) DV Cleared
7 5 (0.55%) AWS Certification
7 5 (0.55%) Microsoft Certification
8 4 (0.44%) MCP
8 4 (0.44%) MCSA
8 4 (0.44%) MCSE
9 3 (0.33%) Numerate Degree
10 2 (0.22%) HND
10 2 (0.22%) SC Cleared
11 1 (0.11%) CISSP
11 1 (0.11%) GIAC
11 1 (0.11%) ISTQB
11 1 (0.11%) Postgraduate
11 1 (0.11%) SANS
11 1 (0.11%) SSCP
Quality Assurance & Compliance
1 42 (4.63%) Data Quality
2 22 (2.43%) QA
3 11 (1.21%) GCP
4 8 (0.88%) SLA
5 5 (0.55%) Actionable Recommendations
6 4 (0.44%) ISO/IEC 27001
7 2 (0.22%) GDPR
7 2 (0.22%) HL7
8 1 (0.11%) BS7666
8 1 (0.11%) Disclosure Scotland
System Software
1 118 (13.01%) Apache Flume
2 83 (9.15%) Docker
3 80 (8.82%) HDFS
4 9 (0.99%) Apache ZooKeeper
5 8 (0.88%) Ceph
5 8 (0.88%) GPFS
5 8 (0.88%) Slurm Workload Manager
6 4 (0.44%) Active Directory
7 3 (0.33%) Hyper-V
7 3 (0.33%) Virtual Machines
8 2 (0.22%) NFS
Systems Management
1 88 (9.70%) Hadoop YARN
2 35 (3.86%) Ansible
3 34 (3.75%) Oozie
4 33 (3.64%) Puppet
5 24 (2.65%) Opscode Chef
6 12 (1.32%) Kubernetes
6 12 (1.32%) Mesos
6 12 (1.32%) Terraform
7 11 (1.21%) Grafana
8 8 (0.88%) Icinga
9 6 (0.66%) Kibana
10 4 (0.44%) Rundeck
11 3 (0.33%) Salt
12 2 (0.22%) Ambari
12 2 (0.22%) logstash
13 1 (0.11%) Control-M
13 1 (0.11%) Docker Swarm
13 1 (0.11%) Simian Army
Vendors
1 171 (18.85%) Cloudera
2 114 (12.57%) Google
3 95 (10.47%) Tableau
4 87 (9.59%) Hortonworks
5 78 (8.60%) Microsoft
6 57 (6.28%) Oracle
7 49 (5.40%) Talend
8 39 (4.30%) MapR
9 32 (3.53%) Informatica
10 29 (3.20%) SAP
11 24 (2.65%) IBM
12 22 (2.43%) Atlassian
13 20 (2.21%) MuleSoft
14 18 (1.98%) Greenplum
15 13 (1.43%) Twitter
16 12 (1.32%) Salesforce.com
17 11 (1.21%) Teradata
18 10 (1.10%) Facebook
18 10 (1.10%) Sybase
19 8 (0.88%) WorldPay