Period
to 9 July 2020

The median annual salary for a Data Engineer was £67,500 in advertised job vacancies during the 6 months to 9 July 2020.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Data Engineer
UK
6 months to
9 Jul 2020
Same period 2019 Same period 2018
Rank 216 314 439
Rank change year-on-year +98 +125 +192
Permanent jobs requiring a Data Engineer 1,209 1,562 1,240
As % of all permanent jobs advertised in the UK 1.55% 1.06% 0.70%
As % of the Job Titles category 1.63% 1.11% 0.73%
Number of salaries quoted 946 1,342 966
Median annual salary £67,500 £65,000 £65,000
Median salary % change year-on-year +3.85% - +4.00%
10th Percentile £42,500 £40,050 £40,000
90th Percentile £95,000 £95,000 £90,000
UK excluding London median annual salary £55,000 £53,000 £54,500
% change year-on-year +3.77% -2.75% +9.00%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 74,068 141,117 170,919
% of permanent IT jobs with a recognized job title 95.09% 95.88% 96.23%
Number of salaries quoted 59,680 112,643 138,569
Median annual salary £55,000 £50,000 £50,000
Median salary % change year-on-year +10.00% - +5.26%
10th Percentile £31,250 £28,250 £27,500
90th Percentile £87,500 £85,000 £81,250
UK excluding London median annual salary £47,500 £45,000 £45,000
% change year-on-year +5.56% - +5.88%

Data Engineer
Job Vacancy Trend

Job postings that featured Data Engineer in the job title as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineer in the UK

Data Engineer
Salary Trend

3-month moving average salary quoted in jobs citing Data Engineer.

Salary trend for Data Engineer in the UK

Data Engineer
Salary Histogram

Salary distribution for jobs citing Data Engineer over the 6 months to 9 July 2020.

Salary histogram for Data Engineer in the UK

Data Engineer
Top 18 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineer within the UK over the 6 months to 9 July 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +94 1,157 £67,500 - 121
London +73 812 £72,500 - 75
UK excluding London +131 385 £55,000 +3.77% 54
South East +172 116 £60,000 +11.11% 13
Midlands +144 78 £55,000 - 14
West Midlands +146 67 £55,000 - 13
North of England +109 62 £55,000 +11.48% 9
Work from Home +74 59 £65,000 +18.18% 21
South West +5 54 £45,000 -16.67% 5
North West +84 35 £48,750 -11.36% 5
Scotland +28 34 £55,000 +10.00% 5
East of England +83 29 £67,500 +12.50% 5
Yorkshire +103 25 £55,000 +11.48% 3
East Midlands +67 11 £48,750 -9.30% 1
Wales +14 10 £47,500 +58.33% 2
North East +18 2 £42,500 -13.86% 1
Northern Ireland +22 1 - -
Channel Islands - 1 £70,000 - 1

Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 9 July 2020, Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads featuring Data Engineer in the job title.

1 806 (66.67%) Python
2 665 (55.00%) SQL
3 538 (44.50%) AWS
4 515 (42.60%) ETL
5 491 (40.61%) Big Data
6 485 (40.12%) Analytics
7 449 (37.14%) Azure
8 382 (31.60%) Apache Spark
9 374 (30.93%) Business Intelligence
10 365 (30.19%) Data Warehouse
11 348 (28.78%) Agile Software Development
12 335 (27.71%) Data Science
13 327 (27.05%) Data Engineering
14 310 (25.64%) Hadoop
15 305 (25.23%) Java
16 300 (24.81%) Kafka
16 300 (24.81%) GCP
17 289 (23.90%) Scala
18 268 (22.17%) Data Lake
19 245 (20.26%) Machine Learning
20 236 (19.52%) SQL Server
21 234 (19.35%) Finance
22 229 (18.94%) NoSQL
23 224 (18.53%) Power BI
23 224 (18.53%) Power Platform
24 216 (17.87%) Data Modelling
25 213 (17.62%) DevOps
26 189 (15.63%) Tableau
27 181 (14.97%) Degree
28 180 (14.89%) Amazon Redshift

Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 382 (31.60%) Apache Spark
2 116 (9.59%) Apache Airflow
3 115 (9.51%) Apache
4 47 (3.89%) Luigi
5 34 (2.81%) Elasticsearch
6 23 (1.90%) SAS
7 21 (1.74%) Jupyter
8 15 (1.24%) Confluence
9 10 (0.83%) Apache Synapse
10 4 (0.33%) Apache Pig
10 4 (0.33%) Cloud Foundry
10 4 (0.33%) Oracle Workflow
11 3 (0.25%) Apache Solr
11 3 (0.25%) nginx
11 3 (0.25%) Tornado
12 2 (0.17%) OpenStack
12 2 (0.17%) SharePoint
13 1 (0.083%) BizTalk Server
13 1 (0.083%) MS Exchange
13 1 (0.083%) Pachyderm
Applications
1 17 (1.41%) Microsoft Excel
2 7 (0.58%) S-PLUS
3 6 (0.50%) MS Visio
4 1 (0.083%) Microsoft Project
Business Applications
1 4 (0.33%) Adobe Campaign
1 4 (0.33%) Dynamics CRM
1 4 (0.33%) Raiser's Edge
2 3 (0.25%) Cognos Business Intelligence
3 2 (0.17%) Cognos TM1
4 1 (0.083%) Eikon
4 1 (0.083%) NetSuite
4 1 (0.083%) Refinitiv Enterprise Platform
4 1 (0.083%) RMDS
4 1 (0.083%) SAP Business One
4 1 (0.083%) Teamcenter
Cloud Services
1 538 (44.50%) AWS
2 449 (37.14%) Azure
3 300 (24.81%) GCP
4 224 (18.53%) Power Platform
5 108 (8.93%) Amazon S3
6 105 (8.68%) Azure Data Factory
7 92 (7.61%) Amazon EMR
8 70 (5.79%) Serverless
9 57 (4.71%) Amazon Kinesis
10 51 (4.22%) AWS Lambda
11 50 (4.14%) Amazon EC2
12 49 (4.05%) SaaS
13 25 (2.07%) Amazon SQS
14 23 (1.90%) Amazon ECS
14 23 (1.90%) PaaS
15 18 (1.49%) GitHub
16 14 (1.16%) Apigee
16 14 (1.16%) Data Lake Analytics
16 14 (1.16%) IBM Cloud
17 13 (1.08%) Google Analytics
Communications & Networking
1 11 (0.91%) WAN
2 9 (0.74%) Structured Cabling
2 9 (0.74%) Wireless
3 8 (0.66%) Wi-Fi
4 6 (0.50%) BGP
4 6 (0.50%) Internet
5 5 (0.41%) LAN
5 5 (0.41%) SSL
6 4 (0.33%) HTTP
6 4 (0.33%) Network Security
7 3 (0.25%) Skype
8 2 (0.17%) Cisco Nexus
8 2 (0.17%) Firewall
8 2 (0.17%) HTTPS
8 2 (0.17%) IP Telephony
8 2 (0.17%) PABX
9 1 (0.083%) DSL
9 1 (0.083%) FTP
9 1 (0.083%) Kerberos
9 1 (0.083%) PBX
Database & Business Intelligence
1 491 (40.61%) Big Data
2 365 (30.19%) Data Warehouse
3 310 (25.64%) Hadoop
4 268 (22.17%) Data Lake
5 236 (19.52%) SQL Server
6 229 (18.94%) NoSQL
7 224 (18.53%) Power BI
8 180 (14.89%) Amazon Redshift
9 136 (11.25%) BigQuery
10 122 (10.09%) PostgreSQL
10 122 (10.09%) SQL Server Integration Services
11 120 (9.93%) Apache Hive
12 114 (9.43%) Relational Database
12 114 (9.43%) Snowflake Schema
13 82 (6.78%) Apache Cassandra
14 78 (6.45%) Amazon Athena
15 74 (6.12%) SQL Server Analysis Services
16 73 (6.04%) MongoDB
17 69 (5.71%) MySQL
18 63 (5.21%) Azure SQL Database
Development Applications
1 142 (11.75%) Git (software)
2 98 (8.11%) Jenkins
3 31 (2.56%) Artifactory
4 27 (2.23%) GitLab
5 22 (1.82%) JIRA
6 16 (1.32%) Maven
7 15 (1.24%) Vagrant
8 13 (1.08%) Atlassian Bamboo
8 13 (1.08%) JUnit
8 13 (1.08%) Octopus Deploy
9 12 (0.99%) Bitbucket
9 12 (0.99%) Cucumber
9 12 (0.99%) Sonatype Nexus
9 12 (0.99%) Visual Studio Team System
10 8 (0.66%) Jasmine
10 8 (0.66%) Karma Test Runner
10 8 (0.66%) NUnit
11 6 (0.50%) GoCD
11 6 (0.50%) Team Foundation Server
11 6 (0.50%) TeamCity
General
1 234 (19.35%) Finance
2 78 (6.45%) Marketing
3 64 (5.29%) Banking
4 56 (4.63%) Retail
5 37 (3.06%) Legal
6 31 (2.56%) Advertising
7 27 (2.23%) Public Sector
8 18 (1.49%) Manufacturing
9 16 (1.32%) Games
10 15 (1.24%) Aerospace
11 14 (1.16%) Law
12 13 (1.08%) Automotive
13 10 (0.83%) Pharmaceutical
14 9 (0.74%) Telecoms
15 8 (0.66%) Front Office
16 5 (0.41%) Financial Institution
17 3 (0.25%) Police
18 2 (0.17%) Back Office
19 1 (0.083%) Investment Banking
19 1 (0.083%) Publishing
Libraries, Frameworks & Software Standards
1 300 (24.81%) Kafka
2 67 (5.54%) PySpark
3 59 (4.88%) .NET
4 45 (3.72%) Spark Streaming
5 35 (2.89%) Web Services
6 34 (2.81%) Pandas
7 30 (2.48%) Natural Language Processing
8 29 (2.40%) HTML
9 28 (2.32%) Apache NiFi
10 27 (2.23%) NumPy
11 26 (2.15%) RabbitMQ
11 26 (2.15%) REST
11 26 (2.15%) TensorFlow
12 24 (1.99%) D3.js
13 23 (1.90%) ASP.NET
13 23 (1.90%) CSS
14 21 (1.74%) MDX
14 21 (1.74%) React
15 19 (1.57%) scikit-learn
16 17 (1.41%) ASP.NET Web API
Miscellaneous
1 173 (14.31%) Analytical Skills
2 99 (8.19%) Data Structures
3 81 (6.70%) Greenfield Project
4 60 (4.96%) Algorithms
5 47 (3.89%) Hedge funds
6 27 (2.23%) Equities
7 26 (2.15%) Self-Motivation
8 20 (1.65%) Hybrid Cloud
9 19 (1.57%) Management Information System
10 16 (1.32%) User Experience
11 15 (1.24%) Acoustics
12 13 (1.08%) Blog
13 10 (0.83%) Data Centre
13 10 (0.83%) Enterprise Software
14 9 (0.74%) CCTV
14 9 (0.74%) Cloud Native
14 9 (0.74%) Fibre Optics
15 8 (0.66%) PMI
15 8 (0.66%) Social Media
16 5 (0.41%) Linux Command Line
Operating Systems
1 81 (6.70%) Linux
2 53 (4.38%) Unix
3 8 (0.66%) Windows
4 3 (0.25%) Red Hat Enterprise Linux
5 1 (0.083%) Windows Server
Processes & Methodologies
1 515 (42.60%) ETL
2 485 (40.12%) Analytics
3 374 (30.93%) Business Intelligence
4 348 (28.78%) Agile Software Development
5 335 (27.71%) Data Science
6 327 (27.05%) Data Engineering
7 245 (20.26%) Machine Learning
8 216 (17.87%) Data Modelling
9 213 (17.62%) DevOps
10 162 (13.40%) Data Analytics
11 143 (11.83%) Visualisation
12 138 (11.41%) Software Engineering
13 135 (11.17%) Artificial Intelligence
14 105 (8.68%) Fintech
15 101 (8.35%) Data Analysis
16 98 (8.11%) Data Integration
17 96 (7.94%) Computer Science
18 94 (7.78%) Microservices
19 86 (7.11%) Scrum
20 83 (6.87%) Mentoring
Programming Languages
1 806 (66.67%) Python
2 665 (55.00%) SQL
3 305 (25.23%) Java
4 289 (23.90%) Scala
5 134 (11.08%) R
6 87 (7.20%) C#
7 85 (7.03%) C++
8 71 (5.87%) JavaScript
9 39 (3.23%) Go
10 34 (2.81%) Data Analysis Expressions (DAX)
11 32 (2.65%) PL/SQL
12 30 (2.48%) C
13 25 (2.07%) T-SQL
14 21 (1.74%) Shell Script
15 18 (1.49%) HiveQL
16 17 (1.41%) Bash Shell
17 15 (1.24%) Ruby
18 14 (1.16%) Perl
18 14 (1.16%) U-SQL
19 12 (0.99%) PowerShell
Qualifications
1 181 (14.97%) Degree
2 63 (5.21%) Computer Science Degree
3 42 (3.47%) Security Cleared
4 26 (2.15%) SC Cleared
5 20 (1.65%) PhD
6 17 (1.41%) DV Cleared
7 10 (0.83%) BPSS Clearance
8 9 (0.74%) AWS Certification
9 8 (0.66%) Microsoft Certification
9 8 (0.66%) PMI Certification
10 5 (0.41%) Numerate Degree
11 2 (0.17%) CCNA
11 2 (0.17%) Cisco Certification
11 2 (0.17%) ITIL Foundation Certificate
11 2 (0.17%) Master's Degree
Quality Assurance & Compliance
1 53 (4.38%) Data Quality
2 34 (2.81%) QA
3 31 (2.56%) GAAP
4 5 (0.41%) GDPR
5 1 (0.083%) COBIT
5 1 (0.083%) NIST
System Software
1 178 (14.72%) Docker
2 41 (3.39%) HDFS
3 13 (1.08%) Apache Flume
3 13 (1.08%) VirtualBox
4 6 (0.50%) Apache ZooKeeper
5 4 (0.33%) Active Directory
5 4 (0.33%) Virtual Machines
6 2 (0.17%) VMware Infrastructure
7 1 (0.083%) Firmware
7 1 (0.083%) zsh
Systems Management
1 153 (12.66%) Kubernetes
2 77 (6.37%) Terraform
3 44 (3.64%) Ansible
4 24 (1.99%) Hadoop YARN
5 20 (1.65%) Oozie
6 18 (1.49%) Docker Swarm
7 17 (1.41%) Opscode Chef
8 12 (0.99%) Puppet
9 8 (0.66%) Rancher
10 7 (0.58%) Salt
11 4 (0.33%) Ambari
11 4 (0.33%) Kibana
11 4 (0.33%) Mesos
12 3 (0.25%) Argo
12 3 (0.25%) Grafana
12 3 (0.25%) Nagios
12 3 (0.25%) Prometheus
13 2 (0.17%) Graphite
13 2 (0.17%) Istio
13 2 (0.17%) linkerd
Vendors
1 189 (15.63%) Tableau
2 163 (13.48%) Google
3 150 (12.41%) Microsoft
4 129 (10.67%) Oracle
5 117 (9.68%) Databricks
6 73 (6.04%) Talend
7 64 (5.29%) Informatica
8 59 (4.88%) Cloudera
9 47 (3.89%) Teradata
10 41 (3.39%) Alteryx
11 33 (2.73%) Automation Anywhere
11 33 (2.73%) Blue Prism
11 33 (2.73%) Cadence
11 33 (2.73%) UiPath
12 31 (2.56%) Hortonworks
13 30 (2.48%) Splunk
14 17 (1.41%) IBM
15 16 (1.32%) Ab Initio
15 16 (1.32%) Salesforce.com
16 10 (0.83%) SAP