Period
to 23 November 2017

The median annual salary for a Data Engineer was £65,000 in advertised job vacancies during the 6 months to 23 November 2017.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Data Engineer
UK
6 months to
23 Nov 2017
Same period 2016 Same period 2015
Rank 611 735 963
Rank change year-on-year +124 +228 +37
Permanent jobs requiring a Data Engineer 674 540 339
As % of all permanent IT jobs advertised in the UK 0.37% 0.28% 0.16%
As % of the Job Titles category 0.39% 0.29% 0.16%
Number of salaries quoted 559 429 304
UK median annual salary £65,000 £55,000 £57,000
Median salary % change year-on-year +18.18% -3.51% -5.00%
10th Percentile £38,750 £33,750 £31,075
90th Percentile £93,000 £87,500 £90,000
UK excluding London median annual salary £50,000 £42,500 £40,000
% change year-on-year +17.65% +6.25% -

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 172559 183130 209788
% of permanent IT jobs with a recognized job title 95.79% 96.48% 96.46%
Number of salaries quoted 138476 153185 174290
UK median annual salary £48,000 £47,500 £45,000
Median salary % change year-on-year +1.05% +5.56% -
10th Percentile £27,500 £27,000 £26,250
90th Percentile £78,750 £77,500 £75,000
UK excluding London median annual salary £42,500 £42,500 £41,000
% change year-on-year - +3.66% +2.50%

Data Engineer
Job Vacancy Trend

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Data Engineer in the UK

Data Engineer
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Engineer.

Salary trend for Data Engineer in the UK

Data Engineer
Salary Histogram

The salary distribution of IT jobs citing Data Engineer over the 6 months to 23 November 2017.

Salary histogram for Data Engineer in the UK

Data Engineer
Top 14 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineer within the UK over the 6 months to 23 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +116 647 £65,000 +13.04% 95
London +54 447 £70,000 +7.69% 71
UK excluding London +80 220 £50,000 +17.65% 27
South East +43 77 £50,000 +33.33% 5
South West +10 40 £50,000 -9.09% 5
North of England +22 35 £42,500 +38.21% 10
North West -5 26 £40,000 +6.67% 6
East of England +17 22 £45,000 - 3
Midlands +34 20 £44,000 -2.22% 1
Scotland -14 18 £51,250 +24.24% 1
West Midlands +21 11 £44,000 -2.22% 1
East Midlands +36 9 £46,250 +2.78%
Yorkshire +31 9 £50,000 +66.67% 4
Wales +10 8 £40,000 -30.43% 1

Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 23 November 2017, Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads featuring Data Engineer in the job title.

1 419 (62.17%) Big Data
2 381 (56.53%) Apache Spark
3 370 (54.90%) Python
4 361 (53.56%) Hadoop
5 283 (41.99%) Java
6 272 (40.36%) SQL
7 247 (36.65%) Agile Software Development
8 236 (35.01%) Scala
9 233 (34.57%) Analytics
10 200 (29.67%) ETL
11 181 (26.85%) Amazon AWS
12 175 (25.96%) Machine Learning
13 171 (25.37%) NoSQL
14 154 (22.85%) Apache Hive
15 147 (21.81%) Kafka
15 147 (21.81%) Data Warehouse
16 140 (20.77%) Business Intelligence
17 114 (16.91%) Degree
18 110 (16.32%) Finance
19 109 (16.17%) Analytical Skills
20 100 (14.84%) Software Engineering
21 98 (14.54%) Linux
22 96 (14.24%) TDD
22 96 (14.24%) Computer Science
23 93 (13.80%) Data Engineering
24 91 (13.50%) Relational Database
25 88 (13.06%) Apache Cassandra
25 88 (13.06%) HBase
26 87 (12.91%) Open Source
27 84 (12.46%) MongoDB

Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 381 (56.53%) Apache Spark
2 72 (10.68%) Apache
3 44 (6.53%) Elasticsearch
4 29 (4.30%) Apache Solr
5 27 (4.01%) SAS
6 26 (3.86%) Apache Pig
7 16 (2.37%) OpenStack
8 12 (1.78%) Apache Airflow
9 5 (0.74%) Confluence
10 4 (0.59%) GeoServer
11 2 (0.30%) Jetty
11 2 (0.30%) nginx
12 1 (0.15%) Jupyter
12 1 (0.15%) Luigi
12 1 (0.15%) Oracle SOA Suite
12 1 (0.15%) SharePoint
Applications
1 13 (1.93%) Microsoft Excel
2 4 (0.59%) Microsoft Office
2 4 (0.59%) Microsoft PowerPoint
Business Applications
1 2 (0.30%) Dynamics CRM
2 1 (0.15%) Eikon
Cloud Services
1 181 (26.85%) Amazon AWS
2 83 (12.31%) Microsoft Azure
3 48 (7.12%) Google Cloud Platform
4 32 (4.75%) Amazon Kinesis
5 31 (4.60%) Amazon S3
6 26 (3.86%) Cloud Computing
7 22 (3.26%) Amazon EMR
8 19 (2.82%) SaaS
9 18 (2.67%) Amazon EC2
10 17 (2.52%) GitHub
11 14 (2.08%) AWS Lambda
12 12 (1.78%) Azure Data Factory
12 12 (1.78%) Serverless
13 8 (1.19%) Google Compute Engine
14 7 (1.04%) PaaS
15 4 (0.59%) AWS Elastic Beanstalk
15 4 (0.59%) Virtual Private Cloud
16 3 (0.45%) Azure Machine Learning
16 3 (0.45%) IaaS
17 2 (0.30%) Route 53
Communications & Networking
1 10 (1.48%) TCP/IP
2 7 (1.04%) InfiniBand
3 6 (0.89%) Ethernet
3 6 (0.89%) Firewall
4 4 (0.59%) HTTP
4 4 (0.59%) LAN
4 4 (0.59%) Wi-Fi
5 3 (0.45%) Internet
5 3 (0.45%) Kerberos
5 3 (0.45%) VLAN
6 2 (0.30%) AMQP
6 2 (0.30%) DAB
6 2 (0.30%) DHCP
6 2 (0.30%) DNS
6 2 (0.30%) SAN
6 2 (0.30%) SMS
6 2 (0.30%) VoIP
6 2 (0.30%) WAN
6 2 (0.30%) Wireless
7 1 (0.15%) UMTS
Database & Business Intelligence
1 419 (62.17%) Big Data
2 361 (53.56%) Hadoop
3 171 (25.37%) NoSQL
4 154 (22.85%) Apache Hive
5 147 (21.81%) Data Warehouse
6 91 (13.50%) Relational Database
7 88 (13.06%) Apache Cassandra
7 88 (13.06%) HBase
8 84 (12.46%) MongoDB
9 81 (12.02%) SQL Server
10 77 (11.42%) Amazon Redshift
11 52 (7.72%) Sqoop
12 49 (7.27%) Impala
13 48 (7.12%) MySQL
14 46 (6.82%) RDBMS
15 38 (5.64%) PostgreSQL
16 35 (5.19%) Data Mining
17 34 (5.04%) Data Lake
18 33 (4.90%) SQL Server Integration Services
19 30 (4.45%) Power BI
Development Applications
1 50 (7.42%) Git (software)
2 30 (4.45%) Jenkins
3 25 (3.71%) Talend Open Studio
4 14 (2.08%) Maven
5 12 (1.78%) JUnit
6 11 (1.63%) JIRA
7 9 (1.34%) Mercurial
8 7 (1.04%) Sonatype Nexus
9 6 (0.89%) Rational Rhapsody
9 6 (0.89%) Subversion
10 4 (0.59%) Artifactory
10 4 (0.59%) Cucumber
10 4 (0.59%) Travis CI
10 4 (0.59%) Vagrant
11 3 (0.45%) Team Foundation Server
11 3 (0.45%) Visual Studio
12 2 (0.30%) Gradle
13 1 (0.15%) Mockito
13 1 (0.15%) Oracle Forms
13 1 (0.15%) Selenium
General
1 110 (16.32%) Finance
2 52 (7.72%) Marketing
3 40 (5.93%) Retail
4 36 (5.34%) Banking
5 30 (4.45%) Telecoms
6 24 (3.56%) Advertising
7 20 (2.97%) Electronics
8 19 (2.82%) Legal
8 19 (2.82%) Manufacturing
9 15 (2.23%) Pharmaceutical
10 12 (1.78%) Financial Institution
11 11 (1.63%) Games
12 10 (1.48%) Publishing
13 6 (0.89%) Investment Banking
14 4 (0.59%) Front Office
15 3 (0.45%) Automotive
16 1 (0.15%) iGaming
16 1 (0.15%) Law
16 1 (0.15%) Military
16 1 (0.15%) Retail Banking
Libraries, Frameworks & Software Standards
1 147 (21.81%) Kafka
2 35 (5.19%) Web Services
3 29 (4.30%) JSON
3 29 (4.30%) XML
4 27 (4.01%) Pandas
4 27 (4.01%) REST
5 24 (3.56%) Natural Language Processing
5 24 (3.56%) Spark Streaming
6 20 (2.97%) NumPy
7 17 (2.52%) RabbitMQ
8 15 (2.23%) Flask
9 13 (1.93%) TensorFlow
10 12 (1.78%) D3.js
10 12 (1.78%) Node.js
11 11 (1.63%) .NET
11 11 (1.63%) HTML
12 9 (1.34%) Elastic Stack
12 9 (1.34%) MLlib
13 8 (1.19%) Akka
13 8 (1.19%) scikit-learn
Miscellaneous
1 109 (16.17%) Analytical Skills
2 96 (14.24%) Computer Science
3 65 (9.64%) Algorithms
4 51 (7.57%) Data Structures
5 41 (6.08%) Fintech
6 33 (4.90%) Greenfield Project
7 10 (1.48%) Semantic Web
8 9 (1.34%) Hedge funds
9 6 (0.89%) Life Science
9 6 (0.89%) LIMS
9 6 (0.89%) Linux Command Line
9 6 (0.89%) Management Information System
9 6 (0.89%) User Experience
9 6 (0.89%) Virtual Team
10 5 (0.74%) Clustering
10 5 (0.74%) Data Centre
10 5 (0.74%) Foreign Exchange (FX)
11 4 (0.59%) Internet of Things
11 4 (0.59%) Mobile App
11 4 (0.59%) Replication
Operating Systems
1 98 (14.54%) Linux
2 53 (7.86%) Unix
3 19 (2.82%) Windows
4 4 (0.59%) Mac OS X
5 3 (0.45%) Ubuntu
6 2 (0.30%) CentOS
6 2 (0.30%) Windows Server
7 1 (0.15%) Android
7 1 (0.15%) Apple iOS
7 1 (0.15%) Red Hat Enterprise Linux
7 1 (0.15%) Windows Server 2003
7 1 (0.15%) Windows Server 2008
7 1 (0.15%) Windows Server 2012
Processes & Methodologies
1 247 (36.65%) Agile Software Development
2 233 (34.57%) Analytics
3 200 (29.67%) ETL
4 175 (25.96%) Machine Learning
5 140 (20.77%) Business Intelligence
6 100 (14.84%) Software Engineering
7 96 (14.24%) TDD
8 93 (13.80%) Data Engineering
9 87 (12.91%) Open Source
10 81 (12.02%) Data Analytics
11 72 (10.68%) Data Analysis
12 66 (9.79%) Scrum
13 65 (9.64%) Visualisation
14 64 (9.50%) DevOps
15 61 (9.05%) MapReduce
16 55 (8.16%) Data Modelling
17 50 (7.42%) Data Visualisation
18 47 (6.97%) Continuous Integration
19 46 (6.82%) Data Architecture
20 42 (6.23%) Data Integration
Programming Languages
1 370 (54.90%) Python
2 283 (41.99%) Java
3 272 (40.36%) SQL
4 236 (35.01%) Scala
5 73 (10.83%) R
6 40 (5.93%) C#
7 36 (5.34%) JavaScript
8 28 (4.15%) C
9 18 (2.67%) C++
10 17 (2.52%) T-SQL
11 15 (2.23%) Go
11 15 (2.23%) PL/SQL
12 14 (2.08%) MATLAB
13 11 (1.63%) Bash Shell
14 10 (1.48%) Perl
15 7 (1.04%) Shell Script
16 6 (0.89%) Ruby
16 6 (0.89%) VBA
17 5 (0.74%) Clojure
17 5 (0.74%) PHP
Qualifications
1 114 (16.91%) Degree
2 46 (6.82%) Computer Science Degree
3 28 (4.15%) Security Cleared
4 26 (3.86%) DV Cleared
4 26 (3.86%) PhD
5 13 (1.93%) Master's Degree
6 8 (1.19%) SC Cleared
7 1 (0.15%) AWS Certification
7 1 (0.15%) CCNA
7 1 (0.15%) CCNP
7 1 (0.15%) Cisco Certification
7 1 (0.15%) CISSP
7 1 (0.15%) CSSLP
7 1 (0.15%) GIAC
7 1 (0.15%) HND
7 1 (0.15%) ISTQB
7 1 (0.15%) SANS
7 1 (0.15%) SSCP
Quality Assurance & Compliance
1 31 (4.60%) Data Quality
2 16 (2.37%) QA
3 5 (0.74%) GCP
4 4 (0.59%) SLA
5 2 (0.30%) Actionable Recommendations
5 2 (0.30%) HL7
6 1 (0.15%) Disclosure Scotland
6 1 (0.15%) GDPR
System Software
1 63 (9.35%) Docker
2 59 (8.75%) Apache Flume
3 38 (5.64%) HDFS
4 7 (1.04%) Ceph
4 7 (1.04%) GPFS
4 7 (1.04%) Slurm Workload Manager
5 4 (0.59%) Apache ZooKeeper
6 3 (0.45%) Virtual Machines
7 1 (0.15%) NFS
Systems Management
1 28 (4.15%) Hadoop YARN
2 18 (2.67%) Ansible
3 16 (2.37%) Opscode Chef
4 15 (2.23%) Mesos
4 15 (2.23%) Terraform
5 13 (1.93%) Oozie
6 10 (1.48%) Grafana
6 10 (1.48%) Kubernetes
7 8 (1.19%) Puppet
8 7 (1.04%) Icinga
9 4 (0.59%) Rundeck
10 3 (0.45%) Ambari
11 2 (0.30%) Kibana
Vendors
1 72 (10.68%) Cloudera
2 61 (9.05%) Google
3 48 (7.12%) Oracle
4 47 (6.97%) Microsoft
5 45 (6.68%) Tableau
6 31 (4.60%) Hortonworks
7 29 (4.30%) SAP
8 26 (3.86%) MapR
9 25 (3.71%) Talend
10 22 (3.26%) Informatica
11 14 (2.08%) Teradata
12 11 (1.63%) MuleSoft
13 9 (1.34%) Atlassian
13 9 (1.34%) Vertica
14 8 (1.19%) Sybase
15 7 (1.04%) SaltStack
16 6 (0.89%) IBM
16 6 (0.89%) Intel
16 6 (0.89%) Netezza
17 5 (0.74%) Twitter