Period
to 19 September 2017

The median annual salary for a Data Engineer was £62,500 in advertised job vacancies during the 6 months to 19 September 2017.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Data Engineer
UK
6 months to
19 Sep 2017
Same period 2016 Same period 2015
Rank 624 784 971
Rank change year-on-year +160 +187 +38
Permanent jobs requiring a Data Engineer 639 495 348
As % of all permanent IT jobs advertised in the UK 0.36% 0.26% 0.16%
As % of the Job Titles category 0.38% 0.26% 0.16%
Number of salaries quoted 536 405 295
UK median annual salary £62,500 £55,000 £60,000
Median salary % change year-on-year +13.64% -8.33% -
10th Percentile £38,750 £35,000 £37,500
90th Percentile £83,750 £86,250 £86,500
UK excluding London median annual salary £52,000 £40,000 £37,500
% change year-on-year +30.00% +6.67% -6.25%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 169773 187120 211546
% of permanent IT jobs with a recognized job title 95.82% 96.47% 96.45%
Number of salaries quoted 136138 157303 175314
UK median annual salary £47,500 £47,500 £45,000
Median salary % change year-on-year - +5.56% -
10th Percentile £27,500 £26,750 £26,250
90th Percentile £78,750 £77,500 £75,000
UK excluding London median annual salary £42,500 £42,500 £40,000
% change year-on-year - +6.25% -

Data Engineer
Job Vacancy Trend

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Data Engineer in the UK

Data Engineer
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Engineer.

Salary trend for Data Engineer in the UK

Data Engineer
Salary Histogram

The salary distribution of IT jobs citing Data Engineer over the 6 months to 19 September 2017.

Salary histogram for Data Engineer in the UK

Data Engineer
Top 14 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineer within the UK over the 6 months to 19 September 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +174 625 £62,500 +13.64% 66
London +93 438 £65,000 +8.33% 45
UK excluding London +84 192 £52,000 +30.00% 22
South East +93 80 £52,500 +44.83% 7
North of England +14 49 £52,500 +31.25% 7
North West +11 38 £75,000 +82.93% 5
South West 0 28 £50,000 -6.98% 2
Midlands +40 15 £50,000 +11.11% 2
Scotland -6 12 £55,000 +37.50%
West Midlands +23 10 £44,000 -2.22% 2
Yorkshire +18 10 £36,250 +47.96% 2
East of England +8 9 £45,000 - 3
East Midlands +34 6 £22,100 -
North East - 1 £90,000 -

Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 19 September 2017, Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all job ads featuring Data Engineer in the job title.

1 395 (61.82%) Big Data
2 343 (53.68%) Python
3 334 (52.27%) Apache Spark
4 314 (49.14%) Hadoop
5 301 (47.10%) SQL
6 269 (42.10%) Java
7 253 (39.59%) Agile Software Development
8 221 (34.59%) Analytics
9 204 (31.92%) ETL
10 200 (31.30%) Scala
11 181 (28.33%) NoSQL
12 169 (26.45%) Amazon AWS
13 168 (26.29%) Data Warehouse
14 152 (23.79%) Business Intelligence
15 133 (20.81%) Machine Learning
16 126 (19.72%) Apache Hive
17 114 (17.84%) Kafka
18 111 (17.37%) Relational Database
19 109 (17.06%) Finance
20 105 (16.43%) Degree
21 101 (15.81%) TDD
22 92 (14.40%) Analytical Skills
23 90 (14.08%) Data Engineering
24 88 (13.77%) Scrum
25 87 (13.62%) SQL Server
26 85 (13.30%) Linux
27 84 (13.15%) Computer Science
28 80 (12.52%) Open Source
29 73 (11.42%) Marketing
30 72 (11.27%) Microsoft Azure

Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 334 (52.27%) Apache Spark
2 66 (10.33%) Apache
3 30 (4.69%) Elasticsearch
4 27 (4.23%) Apache Solr
5 22 (3.44%) Apache Pig
6 20 (3.13%) SAS
7 17 (2.66%) OpenStack
8 14 (2.19%) Apache Airflow
9 8 (1.25%) Luigi
10 5 (0.78%) CMS
10 5 (0.78%) Confluence
10 5 (0.78%) Sitecore CMS
11 2 (0.31%) GeoServer
11 2 (0.31%) SharePoint
12 1 (0.16%) Jupyter
12 1 (0.16%) Mule
Applications
1 16 (2.50%) Microsoft Excel
2 9 (1.41%) Microsoft Office
2 9 (1.41%) Microsoft PowerPoint
3 2 (0.31%) SPSS
4 1 (0.16%) MS Visio
4 1 (0.16%) SPSS Modeler
Business Applications
1 5 (0.78%) Salesforce.com CRM
2 4 (0.63%) SAP CO
2 4 (0.63%) SAP FI
2 4 (0.63%) SAP FI/CO
2 4 (0.63%) SAP FSCM
2 4 (0.63%) SAP MM
2 4 (0.63%) SAP PS
2 4 (0.63%) SAP SD
3 1 (0.16%) Dynamics CRM
3 1 (0.16%) Eikon
Cloud Services
1 169 (26.45%) Amazon AWS
2 72 (11.27%) Microsoft Azure
3 70 (10.95%) Google Cloud Platform
4 24 (3.76%) Amazon S3
5 20 (3.13%) Cloud Computing
6 18 (2.82%) Amazon Kinesis
7 15 (2.35%) Amazon EC2
7 15 (2.35%) Amazon EMR
7 15 (2.35%) SaaS
8 9 (1.41%) Azure Data Factory
9 7 (1.10%) IaaS
9 7 (1.10%) PaaS
10 6 (0.94%) AWS Lambda
11 5 (0.78%) GitHub
12 4 (0.63%) AWS Elastic Beanstalk
13 2 (0.31%) Amazon Glacier
13 2 (0.31%) Azure Machine Learning
13 2 (0.31%) Google Analytics
13 2 (0.31%) Google Compute Engine
14 1 (0.16%) OneDrive
Communications & Networking
1 5 (0.78%) Firewall
2 4 (0.63%) Kerberos
2 4 (0.63%) TCP/IP
3 3 (0.47%) LAN
4 2 (0.31%) AMQP
4 2 (0.31%) Ethernet
4 2 (0.31%) GSM
4 2 (0.31%) HTTP
4 2 (0.31%) InfiniBand
4 2 (0.31%) Internet
4 2 (0.31%) UMTS
4 2 (0.31%) Wi-Fi
5 1 (0.16%) 4G
5 1 (0.16%) Cisco Nexus
5 1 (0.16%) Diameter Protocol
5 1 (0.16%) LTE
5 1 (0.16%) MQTT
5 1 (0.16%) Spanning Tree
5 1 (0.16%) Structured Cabling
5 1 (0.16%) Wireless
Database & Business Intelligence
1 395 (61.82%) Big Data
2 314 (49.14%) Hadoop
3 181 (28.33%) NoSQL
4 168 (26.29%) Data Warehouse
5 126 (19.72%) Apache Hive
6 111 (17.37%) Relational Database
7 87 (13.62%) SQL Server
8 70 (10.95%) HBase
9 69 (10.80%) Amazon Redshift
10 65 (10.17%) MongoDB
11 57 (8.92%) RDBMS
12 56 (8.76%) Apache Cassandra
13 55 (8.61%) PostgreSQL
14 44 (6.89%) MySQL
15 37 (5.79%) Sqoop
16 36 (5.63%) Impala
16 36 (5.63%) SQL Server Integration Services
17 32 (5.01%) BigQuery
18 23 (3.60%) Data Mining
18 23 (3.60%) Pentaho
Development Applications
1 46 (7.20%) Talend Open Studio
2 38 (5.95%) Git (software)
3 18 (2.82%) Jenkins
4 13 (2.03%) JIRA
5 12 (1.88%) JUnit
6 11 (1.72%) Maven
7 9 (1.41%) Rational Rhapsody
8 7 (1.10%) Sonatype Nexus
9 4 (0.63%) Mercurial
10 3 (0.47%) Cucumber
10 3 (0.47%) Selenium
10 3 (0.47%) Subversion
11 2 (0.31%) Gradle
11 2 (0.31%) Hudson
11 2 (0.31%) Travis CI
12 1 (0.16%) JIRA Agile
12 1 (0.16%) Mockito
12 1 (0.16%) Oracle Forms
12 1 (0.16%) SonarQube
General
1 109 (17.06%) Finance
2 73 (11.42%) Marketing
3 35 (5.48%) Retail
4 33 (5.16%) Telecoms
5 32 (5.01%) Banking
6 30 (4.69%) Electronics
6 30 (4.69%) Manufacturing
7 20 (3.13%) Games
8 18 (2.82%) Legal
8 18 (2.82%) Pharmaceutical
9 16 (2.50%) Financial Institution
9 16 (2.50%) Publishing
10 10 (1.56%) Advertising
11 9 (1.41%) Investment Banking
12 4 (0.63%) Front Office
13 3 (0.47%) Law
14 2 (0.31%) Automotive
15 1 (0.16%) Digital Economy
15 1 (0.16%) iGaming
15 1 (0.16%) Retail Banking
Libraries, Frameworks & Software Standards
1 114 (17.84%) Kafka
2 31 (4.85%) Web Services
3 23 (3.60%) Flask
3 23 (3.60%) REST
4 22 (3.44%) Pandas
5 18 (2.82%) JSON
5 18 (2.82%) XML
6 16 (2.50%) Natural Language Processing
7 15 (2.35%) RabbitMQ
8 13 (2.03%) .NET
8 13 (2.03%) Lucene
9 11 (1.72%) D3.js
9 11 (1.72%) scikit-learn
10 10 (1.56%) NumPy
10 10 (1.56%) Spring
10 10 (1.56%) TensorFlow
11 9 (1.41%) AngularJS
12 8 (1.25%) ActiveMQ
12 8 (1.25%) Django
12 8 (1.25%) HTML
Miscellaneous
1 92 (14.40%) Analytical Skills
2 84 (13.15%) Computer Science
3 63 (9.86%) Algorithms
4 35 (5.48%) Data Structures
5 32 (5.01%) Fintech
6 28 (4.38%) Greenfield Project
7 18 (2.82%) Semantic Web
8 10 (1.56%) Life Science
9 9 (1.41%) Virtual Team
10 7 (1.10%) Hedge funds
11 6 (0.94%) Management Information System
12 5 (0.78%) Digital Media
12 5 (0.78%) Online Games
13 4 (0.63%) Data Centre
13 4 (0.63%) Replication
13 4 (0.63%) Social Media
14 3 (0.47%) Foreign Exchange (FX)
14 3 (0.47%) Grid Computing
15 2 (0.31%) LIMS
15 2 (0.31%) PKI
Operating Systems
1 85 (13.30%) Linux
2 23 (3.60%) Unix
3 21 (3.29%) Windows
4 7 (1.10%) Ubuntu
5 4 (0.63%) Mac OS X
6 2 (0.31%) Windows Server
7 1 (0.16%) Android
7 1 (0.16%) Apple iOS
7 1 (0.16%) CentOS
7 1 (0.16%) Mesosphere
7 1 (0.16%) Red Hat Enterprise Linux
Processes & Methodologies
1 253 (39.59%) Agile Software Development
2 221 (34.59%) Analytics
3 204 (31.92%) ETL
4 152 (23.79%) Business Intelligence
5 133 (20.81%) Machine Learning
6 101 (15.81%) TDD
7 90 (14.08%) Data Engineering
8 88 (13.77%) Scrum
9 80 (12.52%) Open Source
10 70 (10.95%) Software Engineering
11 67 (10.49%) Data Modelling
12 66 (10.33%) DevOps
13 65 (10.17%) Data Analytics
14 61 (9.55%) MapReduce
15 59 (9.23%) Data Analysis
16 55 (8.61%) Visualisation
17 48 (7.51%) E-Commerce
18 47 (7.36%) Continuous Integration
19 40 (6.26%) BDD
19 40 (6.26%) Data Visualisation
Programming Languages
1 343 (53.68%) Python
2 301 (47.10%) SQL
3 269 (42.10%) Java
4 200 (31.30%) Scala
5 64 (10.02%) R
6 37 (5.79%) T-SQL
7 33 (5.16%) C
8 30 (4.69%) C#
8 30 (4.69%) JavaScript
9 25 (3.91%) C++
10 17 (2.66%) PL/SQL
11 10 (1.56%) Clojure
11 10 (1.56%) Go
12 8 (1.25%) Ruby
13 7 (1.10%) Haskell
13 7 (1.10%) MATLAB
13 7 (1.10%) Perl
14 6 (0.94%) Bash Shell
14 6 (0.94%) PowerShell
14 6 (0.94%) VBA
Qualifications
1 105 (16.43%) Degree
2 41 (6.42%) Computer Science Degree
3 21 (3.29%) Security Cleared
4 19 (2.97%) DV Cleared
5 18 (2.82%) PhD
6 11 (1.72%) Master's Degree
7 10 (1.56%) SC Cleared
8 3 (0.47%) Microsoft Certification
9 2 (0.31%) Cisco Certification
9 2 (0.31%) MCP
9 2 (0.31%) MCSA
10 1 (0.16%) CCNA
10 1 (0.16%) CCNP
10 1 (0.16%) ISTQB
10 1 (0.16%) Numerate Degree
Quality Assurance & Compliance
1 49 (7.67%) Data Quality
2 19 (2.97%) QA
3 8 (1.25%) GCP
4 4 (0.63%) GDPR
4 4 (0.63%) SLA
5 2 (0.31%) HL7
6 1 (0.16%) Actionable Recommendations
System Software
1 55 (8.61%) Docker
2 44 (6.89%) HDFS
3 38 (5.95%) Apache Flume
4 9 (1.41%) Slurm Workload Manager
5 4 (0.63%) Apache ZooKeeper
6 3 (0.47%) Virtual Machines
7 2 (0.31%) Active Directory
7 2 (0.31%) Ceph
7 2 (0.31%) GPFS
7 2 (0.31%) Hyper-V
8 1 (0.16%) Cronacle
8 1 (0.16%) Oracle RAC
Systems Management
1 22 (3.44%) Kubernetes
2 17 (2.66%) Ansible
3 15 (2.35%) Mesos
4 13 (2.03%) Opscode Chef
5 12 (1.88%) Oozie
6 10 (1.56%) Kibana
6 10 (1.56%) Terraform
7 8 (1.25%) Puppet
8 7 (1.10%) Hadoop YARN
9 5 (0.78%) Grafana
10 3 (0.47%) Ambari
11 2 (0.31%) Icinga
12 1 (0.16%) Control-M
12 1 (0.16%) Packer
Vendors
1 72 (11.27%) Google
2 58 (9.08%) Cloudera
3 46 (7.20%) Microsoft
3 46 (7.20%) Oracle
3 46 (7.20%) Talend
4 40 (6.26%) SAP
4 40 (6.26%) Tableau
5 30 (4.69%) Hortonworks
5 30 (4.69%) Informatica
6 22 (3.44%) MapR
7 14 (2.19%) MuleSoft
8 9 (1.41%) Sybase
8 9 (1.41%) Teradata
9 8 (1.25%) Alteryx
10 5 (0.78%) Salesforce.com
10 5 (0.78%) Sitecore
10 5 (0.78%) Vertica
11 4 (0.63%) Cisco
11 4 (0.63%) MicroStrategy
11 4 (0.63%) Reuters