Period
to 26 November 2020

The median annual salary for a Data Engineer was £60,000 in advertised job vacancies during the 6 months to 26 November 2020.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Data Engineer
UK
6 months to
26 Nov 2020
Same period 2019 Same period 2018
Rank 181 284 410
Rank change year-on-year +103 +126 +231
Permanent jobs requiring a Data Engineer 1,018 1,523 1,232
As % of all permanent jobs advertised in the UK 1.85% 1.12% 0.77%
As % of the Job Titles category 1.95% 1.17% 0.80%
Number of salaries quoted 948 1,307 983
Median annual salary £60,000 £66,500 £67,500
Median salary % change year-on-year -9.77% -1.48% +8.00%
10th Percentile £42,500 £42,500 £41,850
90th Percentile £88,750 £95,000 £92,500
UK excluding London median annual salary £55,000 £51,500 £55,000
% change year-on-year +6.80% -6.36% +10.00%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
UK
Permanent vacancies in the UK with a recognized job title 52,250 129,810 154,389
% of permanent IT jobs with a recognized job title 95.11% 95.60% 95.87%
Number of salaries quoted 43,533 103,899 124,411
Median annual salary £55,000 £50,000 £50,000
Median salary % change year-on-year +10.00% - +3.09%
10th Percentile £32,500 £28,375 £27,500
90th Percentile £87,500 £85,000 £82,500
UK excluding London median annual salary £47,500 £45,000 £45,000
% change year-on-year +5.56% - +5.88%

Data Engineer
Job Vacancy Trend

Job postings that featured Data Engineer in the job title as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineer in the UK

Data Engineer
Salary Trend

3-month moving average salary quoted in jobs citing Data Engineer.

Salary trend for Data Engineer in the UK

Data Engineer
Salary Histogram

Salary distribution for jobs citing Data Engineer over the 6 months to 26 November 2020.

Salary histogram for Data Engineer in the UK

Data Engineer
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineer within the UK over the 6 months to 26 November 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +114 944 £60,000 -14.29% 172
London +78 578 £67,500 -6.90% 86
UK excluding London +181 417 £55,000 +6.80% 91
Work from Home +47 134 £60,000 +4.35% 32
North of England +134 123 £55,000 - 27
South East +174 88 £55,000 +22.22% 21
North West +125 76 £55,000 -8.33% 13
Midlands +130 67 £52,500 - 17
South West +41 47 £50,000 -1.96% 12
West Midlands +97 45 £57,500 +9.52% 7
Yorkshire +91 43 £47,500 -13.12% 8
Scotland +35 36 £55,000 +31.45% 2
East of England +139 29 £70,000 - 8
Wales +60 26 £47,500 +5.56% 3
East Midlands +90 21 £50,000 -4.76% 10
North East +13 4 £50,000 -8.54% 6
Northern Ireland - 1 £55,000 - 1

Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 26 November 2020, Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads featuring Data Engineer in the job title.

1 691 (67.88%) Python
2 575 (56.48%) SQL
3 496 (48.72%) AWS
4 454 (44.60%) Azure
5 416 (40.86%) ETL
6 352 (34.58%) Data Warehouse
7 342 (33.60%) Analytics
8 321 (31.53%) Business Intelligence
9 313 (30.75%) Big Data
10 309 (30.35%) Data Engineering
11 300 (29.47%) Agile Software Development
12 270 (26.52%) Apache Spark
13 229 (22.50%) Data Science
14 227 (22.30%) Hadoop
15 226 (22.20%) GCP
15 226 (22.20%) Java
16 215 (21.12%) Data Modelling
17 212 (20.83%) Power BI
17 212 (20.83%) Power Platform
18 204 (20.04%) Data Lake
18 204 (20.04%) Kafka
19 195 (19.16%) Finance
20 189 (18.57%) SQL Server
21 185 (18.17%) NoSQL
22 182 (17.88%) Machine Learning
23 166 (16.31%) Visualisation
24 162 (15.91%) Amazon Redshift
25 161 (15.82%) Scala
26 141 (13.85%) Databricks
26 141 (13.85%) DevOps

Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 270 (26.52%) Apache Spark
2 84 (8.25%) Apache
3 63 (6.19%) SAS
4 56 (5.50%) Apache Airflow
5 23 (2.26%) Elasticsearch
6 14 (1.38%) Luigi
7 13 (1.28%) Jupyter
8 12 (1.18%) Apache Synapse
9 9 (0.88%) Cloud Foundry
10 7 (0.69%) Confluence
11 6 (0.59%) OpenStack
12 5 (0.49%) Oracle Workflow
13 2 (0.20%) IBM Domino
14 1 (0.098%) Apache Pig
14 1 (0.098%) MS Exchange
14 1 (0.098%) SharePoint
14 1 (0.098%) Tornado
Applications
1 13 (1.28%) Microsoft Excel
2 2 (0.20%) S-PLUS
Business Applications
1 6 (0.59%) SAP Business One
2 3 (0.29%) Dynamics CRM
3 2 (0.20%) Markit EDM
4 1 (0.098%) JDE OneWorld
4 1 (0.098%) Refinitiv Enterprise Platform
4 1 (0.098%) SAP IS-U
Cloud Services
1 496 (48.72%) AWS
2 454 (44.60%) Azure
3 226 (22.20%) GCP
4 212 (20.83%) Power Platform
5 107 (10.51%) Azure Data Factory
6 87 (8.55%) Amazon S3
7 57 (5.60%) Serverless
8 51 (5.01%) AWS Lambda
9 42 (4.13%) Amazon Kinesis
10 34 (3.34%) Amazon EMR
11 27 (2.65%) SaaS
12 25 (2.46%) Amazon EC2
13 20 (1.96%) AWS CloudFormation
14 18 (1.77%) GitHub
15 13 (1.28%) Azure Stack
16 10 (0.98%) Amazon SQS
17 9 (0.88%) Amazon ECS
17 9 (0.88%) AWS CodePipeline
18 8 (0.79%) Amazon SageMaker
19 6 (0.59%) Logic Apps
Communications & Networking
1 4 (0.39%) DNS
2 2 (0.20%) Internet
3 1 (0.098%) BGP
3 1 (0.098%) Kerberos
3 1 (0.098%) Multicast
3 1 (0.098%) TCP/IP
3 1 (0.098%) WAN
Database & Business Intelligence
1 352 (34.58%) Data Warehouse
2 313 (30.75%) Big Data
3 227 (22.30%) Hadoop
4 212 (20.83%) Power BI
5 204 (20.04%) Data Lake
6 189 (18.57%) SQL Server
7 185 (18.17%) NoSQL
8 162 (15.91%) Amazon Redshift
9 119 (11.69%) Tableau
10 117 (11.49%) SQL Server Integration Services
11 115 (11.30%) Snowflake Schema
12 111 (10.90%) BigQuery
13 94 (9.23%) Apache Hive
14 89 (8.74%) Relational Database
15 73 (7.17%) Pentaho
16 64 (6.29%) PostgreSQL
17 61 (5.99%) Oracle Database
18 58 (5.70%) Azure SQL Database
19 56 (5.50%) Amazon Athena
20 55 (5.40%) MongoDB
Development Applications
1 79 (7.76%) Git (software)
2 71 (6.97%) Jenkins
3 25 (2.46%) Bitbucket
4 23 (2.26%) Maven
5 22 (2.16%) Artifactory
6 16 (1.57%) Visual Studio
7 14 (1.38%) Cucumber
8 10 (0.98%) JIRA
9 8 (0.79%) GitLab
10 7 (0.69%) Atlassian Bamboo
11 5 (0.49%) JUnit
11 5 (0.49%) Team Foundation Server
12 3 (0.29%) SQL Server Management Studio (SSMS)
12 3 (0.29%) TeamCity
13 2 (0.20%) GoCD
13 2 (0.20%) Selenium
13 2 (0.20%) Visual Studio Code
14 1 (0.098%) CircleCI
14 1 (0.098%) ERwin
14 1 (0.098%) Sonatype Nexus
General
1 195 (19.16%) Finance
2 59 (5.80%) Banking
3 45 (4.42%) Marketing
4 41 (4.03%) Retail
5 28 (2.75%) Law
6 26 (2.55%) Public Sector
7 17 (1.67%) Advertising
8 10 (0.98%) Games
9 7 (0.69%) Front Office
9 7 (0.69%) Manufacturing
10 6 (0.59%) Digital Economy
11 5 (0.49%) Pharmaceutical
12 4 (0.39%) Investment Banking
13 3 (0.29%) Police
14 2 (0.20%) Automotive
15 1 (0.098%) Aerospace
15 1 (0.098%) Back Office
15 1 (0.098%) Electronics
15 1 (0.098%) Legal
15 1 (0.098%) Telecoms
Libraries, Frameworks & Software Standards
1 204 (20.04%) Kafka
2 47 (4.62%) PySpark
3 40 (3.93%) Natural Language Processing
4 30 (2.95%) .NET
5 27 (2.65%) Web Services
6 23 (2.26%) Spring
7 22 (2.16%) Pandas
8 20 (1.96%) Spring Boot
9 14 (1.38%) NumPy
10 13 (1.28%) Flask
10 13 (1.28%) REST
11 12 (1.18%) Apache NiFi
12 11 (1.08%) Lambda Expressions
12 11 (1.08%) scikit-learn
12 11 (1.08%) TensorFlow
13 10 (0.98%) Spark Streaming
14 9 (0.88%) AngularJS
14 9 (0.88%) ASP.NET
14 9 (0.88%) RabbitMQ
14 9 (0.88%) React
Miscellaneous
1 120 (11.79%) Analytical Skills
2 60 (5.89%) Greenfield Project
3 59 (5.80%) Algorithms
4 54 (5.30%) Data Structures
5 24 (2.36%) Management Information System
6 23 (2.26%) Self-Motivation
7 17 (1.67%) Equities
8 16 (1.57%) Cloud Native
8 16 (1.57%) Hedge funds
9 9 (0.88%) Credit Risk
9 9 (0.88%) Data Centre
9 9 (0.88%) Market Risk
10 7 (0.69%) Fixed Income
10 7 (0.69%) Hybrid Cloud
10 7 (0.69%) Online Banking
11 6 (0.59%) Enterprise Software
11 6 (0.59%) Private Cloud
11 6 (0.59%) Social Media
11 6 (0.59%) Virtual Team
12 5 (0.49%) Public Cloud
Operating Systems
1 52 (5.11%) Linux
1 52 (5.11%) Unix
2 7 (0.69%) Windows Server 2016
3 6 (0.59%) VMS
4 3 (0.29%) Red Hat Enterprise Linux
5 1 (0.098%) Windows
Processes & Methodologies
1 416 (40.86%) ETL
2 342 (33.60%) Analytics
3 321 (31.53%) Business Intelligence
4 309 (30.35%) Data Engineering
5 300 (29.47%) Agile Software Development
6 229 (22.50%) Data Science
7 215 (21.12%) Data Modelling
8 182 (17.88%) Machine Learning
9 166 (16.31%) Visualisation
10 141 (13.85%) DevOps
11 134 (13.16%) Data Analytics
12 101 (9.92%) Data Visualisation
13 100 (9.82%) Scrum
14 93 (9.14%) Software Engineering
15 92 (9.04%) Fintech
16 85 (8.35%) Computer Science
16 85 (8.35%) Data Management
17 81 (7.96%) Artificial Intelligence
17 81 (7.96%) Mathematics
18 74 (7.27%) Data Analysis
Programming Languages
1 691 (67.88%) Python
2 575 (56.48%) SQL
3 226 (22.20%) Java
4 161 (15.82%) Scala
5 115 (11.30%) R
6 81 (7.96%) C#
7 63 (6.19%) JavaScript
8 60 (5.89%) PL/SQL
9 48 (4.72%) T-SQL
10 45 (4.42%) Shell Script
11 38 (3.73%) HiveQL
12 20 (1.96%) Bash Shell
13 16 (1.57%) C++
14 14 (1.38%) Go
14 14 (1.38%) Julia
14 14 (1.38%) PowerShell
15 12 (1.18%) Ruby
16 8 (0.79%) C
17 7 (0.69%) Java 8
18 4 (0.39%) MATLAB
Qualifications
1 117 (11.49%) Degree
2 44 (4.32%) Computer Science Degree
3 40 (3.93%) Security Cleared
4 35 (3.44%) SC Cleared
5 30 (2.95%) BPSS Clearance
6 21 (2.06%) PhD
7 11 (1.08%) Microsoft Certification
8 10 (0.98%) Numerate Degree
9 5 (0.49%) AWS Certification
10 4 (0.39%) DV Cleared
11 2 (0.20%) Master's Degree
12 1 (0.098%) HND
Quality Assurance & Compliance
1 59 (5.80%) Data Quality
2 21 (2.06%) QA
3 17 (1.67%) GDPR
4 7 (0.69%) SLA
System Software
1 93 (9.14%) Docker
2 49 (4.81%) HDFS
3 6 (0.59%) Apache Flume
4 2 (0.20%) VMware Infrastructure
5 1 (0.098%) Active Directory
5 1 (0.098%) VirtualBox
5 1 (0.098%) zsh
Systems Management
1 87 (8.55%) Kubernetes
2 81 (7.96%) Terraform
3 44 (4.32%) Ansible
4 12 (1.18%) Puppet
5 10 (0.98%) Oozie
6 6 (0.59%) Opscode Chef
7 2 (0.20%) Graphite
7 2 (0.20%) Hadoop YARN
7 2 (0.20%) Nagios
7 2 (0.20%) Opsview
8 1 (0.098%) Grafana
8 1 (0.098%) Kibana
8 1 (0.098%) logstash
8 1 (0.098%) Mesos
8 1 (0.098%) vRealize Orchestrator
Vendors
1 141 (13.85%) Databricks
2 125 (12.28%) Microsoft
3 101 (9.92%) Oracle
4 98 (9.63%) Talend
5 79 (7.76%) Google
6 70 (6.88%) Cloudera
7 53 (5.21%) Informatica
8 11 (1.08%) Alteryx
8 11 (1.08%) Sybase
9 10 (0.98%) SAP
9 10 (0.98%) StreamSets
10 9 (0.88%) Vertica
11 8 (0.79%) Cognos
12 7 (0.69%) Splunk
13 6 (0.59%) MuleSoft
13 6 (0.59%) Salesforce.com
13 6 (0.59%) Teradata
14 5 (0.49%) Hortonworks
15 4 (0.39%) Ab Initio
15 4 (0.39%) Guidewire