Period
to 4 April 2020

The median annual salary for a Data Engineer was £72,500 in advertised job vacancies in London during the 6 months to 4 April 2020.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Data Engineer
England > London
6 months to
4 Apr 2020
Same period 2019 Same period 2018
Rank 170 202 341
Rank change year-on-year +32 +139 +63
Permanent jobs requiring a Data Engineer 1,002 1,069 639
As % of all permanent jobs advertised in London 2.09% 1.75% 0.92%
As % of the Job Titles category 2.21% 1.84% 0.96%
Number of salaries quoted 828 938 554
Median annual salary £72,500 £72,500 £70,000
Median salary % change year-on-year - +3.57% -
10th Percentile £47,500 £49,451 £49,125
90th Percentile £97,500 £96,625 £98,750
England median annual salary £70,000 £67,500 £65,000
% change year-on-year +3.70% +3.85% +8.33%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies advertised in London. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
London
Permanent vacancies in London with a recognized job title 45,322 58,222 66,784
% of permanent IT jobs with a recognized job title 94.58% 95.41% 95.67%
Number of salaries quoted 36,804 47,632 55,495
Median annual salary £65,000 £62,500 £60,000
Median salary % change year-on-year +4.00% +4.17% +4.35%
10th Percentile £36,250 £35,000 £33,750
90th Percentile £100,000 £95,000 £91,250
England median annual salary £52,500 £52,000 £50,000
% change year-on-year +0.96% +4.00% +5.26%

Data Engineer
Job Vacancy Trend in London

Job postings that featured Data Engineer in the job title as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Engineer in London

Data Engineer
Salary Trend in London

3-month moving average salary quoted in jobs citing Data Engineer in London.

Salary trend for Data Engineer in London

Data Engineer
Salary Histogram in London

Salary distribution for jobs citing Data Engineer in London over the 6 months to 4 April 2020.

Salary histogram for Data Engineer in London

Data Engineer
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineer within the London region over the 6 months to 4 April 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +69 203 £72,500 +3.57% 59
South London +59 46 £75,000 -11.76% 8
West London +29 25 £65,000 - 24
East London +17 17 £78,250 +11.79% 6
North London -15 8 - -
Data Engineer
England

Data Engineer Skill Set
Top 30 Co-occurring IT Skills in London

For the 6 months to 4 April 2020, Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region featuring Data Engineer in the job title.

1 705 (70.36%) Python
2 551 (54.99%) SQL
3 468 (46.71%) AWS
4 419 (41.82%) ETL
5 404 (40.32%) Big Data
6 393 (39.22%) Analytics
7 353 (35.23%) Data Science
8 345 (34.43%) Apache Spark
9 334 (33.33%) Azure
10 325 (32.44%) Agile Software Development
11 305 (30.44%) Scala
12 296 (29.54%) Java
13 290 (28.94%) Hadoop
13 290 (28.94%) Kafka
14 263 (26.25%) Data Warehouse
15 257 (25.65%) Business Intelligence
16 245 (24.45%) Data Engineering
17 244 (24.35%) GCP
18 226 (22.55%) NoSQL
19 208 (20.76%) Finance
20 199 (19.86%) SQL Server
21 192 (19.16%) Data Modelling
22 179 (17.86%) Data Lake
23 175 (17.47%) Machine Learning
24 162 (16.17%) Google
25 161 (16.07%) DevOps
26 158 (15.77%) Tableau
27 141 (14.07%) Analytical Skills
28 140 (13.97%) Amazon Redshift
29 136 (13.57%) Visualisation

Data Engineer Skill Set
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 345 (34.43%) Apache Spark
2 107 (10.68%) Apache Airflow
3 62 (6.19%) Apache
4 45 (4.49%) Luigi
5 35 (3.49%) Elasticsearch
6 12 (1.20%) Confluence
7 9 (0.90%) SAS
8 8 (0.80%) Jupyter
9 4 (0.40%) Apache Pig
9 4 (0.40%) Oracle Workflow
10 3 (0.30%) Apache Solr
10 3 (0.30%) ArcGIS
10 3 (0.30%) Tornado
11 2 (0.20%) SharePoint
12 1 (0.100%) BizTalk Server
12 1 (0.100%) OpenStack
12 1 (0.100%) OpenWhisk
Applications
1 5 (0.50%) Microsoft Excel
2 1 (0.100%) Simulink
2 1 (0.100%) S-PLUS
2 1 (0.100%) SPSS
Business Applications
1 3 (0.30%) Cognos Business Intelligence
2 2 (0.20%) Dynamics CRM
2 2 (0.20%) Raiser's Edge
3 1 (0.100%) Eikon
3 1 (0.100%) NetSuite
3 1 (0.100%) RMDS
Cloud Services
1 468 (46.71%) AWS
2 334 (33.33%) Azure
3 244 (24.35%) GCP
4 131 (13.07%) Power Platform
5 102 (10.18%) Amazon S3
6 93 (9.28%) Amazon EMR
7 82 (8.18%) Azure Data Factory
8 76 (7.58%) Amazon Kinesis
9 67 (6.69%) Serverless
10 53 (5.29%) Amazon EC2
11 40 (3.99%) AWS Lambda
12 34 (3.39%) SaaS
13 33 (3.29%) PaaS
14 22 (2.20%) Amazon SQS
15 19 (1.90%) Data Lake Analytics
16 18 (1.80%) IBM Cloud
17 14 (1.40%) Amazon Glacier
17 14 (1.40%) Cloud Computing
18 12 (1.20%) AWS Data Pipeline
19 9 (0.90%) Amazon ECS
Communications & Networking
1 10 (1.00%) Internet
2 9 (0.90%) Structured Cabling
3 5 (0.50%) Firewall
3 5 (0.50%) FTP
3 5 (0.50%) Network Security
4 4 (0.40%) HTTP
5 3 (0.30%) LAN
5 3 (0.30%) WAN
5 3 (0.30%) Wireless
6 2 (0.20%) DNS
6 2 (0.20%) HTTPS
6 2 (0.20%) Kerberos
6 2 (0.20%) Skype
6 2 (0.20%) VPN
7 1 (0.100%) 4G
7 1 (0.100%) Broadband
7 1 (0.100%) IPFS
Database & Business Intelligence
1 404 (40.32%) Big Data
2 290 (28.94%) Hadoop
3 263 (26.25%) Data Warehouse
4 226 (22.55%) NoSQL
5 199 (19.86%) SQL Server
6 179 (17.86%) Data Lake
7 140 (13.97%) Amazon Redshift
8 131 (13.07%) Power BI
9 116 (11.58%) PostgreSQL
10 105 (10.48%) Relational Database
11 102 (10.18%) Apache Cassandra
12 101 (10.08%) SQL Server Integration Services
13 98 (9.78%) Apache Hive
14 93 (9.28%) Amazon DynamoDB
15 90 (8.98%) BigQuery
16 84 (8.38%) Amazon Athena
17 60 (5.99%) MongoDB
17 60 (5.99%) Snowflake Schema
18 57 (5.69%) Redis
19 51 (5.09%) MySQL
Development Applications
1 128 (12.77%) Git (software)
2 68 (6.79%) Jenkins
3 37 (3.69%) Visual Studio Team System
4 30 (2.99%) Octopus Deploy
5 27 (2.69%) Jasmine
5 27 (2.69%) Karma Test Runner
5 27 (2.69%) NUnit
6 24 (2.40%) JIRA
7 20 (2.00%) Maven
8 19 (1.90%) Vagrant
9 18 (1.80%) Atlassian Bamboo
10 16 (1.60%) Artifactory
11 12 (1.20%) Bitbucket
12 8 (0.80%) JUnit
12 8 (0.80%) TeamCity
13 7 (0.70%) CircleCI
13 7 (0.70%) GoCD
14 5 (0.50%) Flyway
14 5 (0.50%) IBM UrbanCode
14 5 (0.50%) Sonatype Nexus
General
1 208 (20.76%) Finance
2 55 (5.49%) Banking
2 55 (5.49%) Marketing
2 55 (5.49%) Retail
3 42 (4.19%) Legal
4 28 (2.79%) Public Sector
5 27 (2.69%) Games
6 18 (1.80%) Automotive
7 15 (1.50%) Manufacturing
8 13 (1.30%) Advertising
8 13 (1.30%) Law
9 8 (0.80%) Financial Institution
10 6 (0.60%) Telecoms
11 3 (0.30%) Back Office
12 2 (0.20%) Front Office
12 2 (0.20%) iGaming
12 2 (0.20%) Publishing
13 1 (0.100%) Investment Banking
13 1 (0.100%) Police
Libraries, Frameworks & Software Standards
1 290 (28.94%) Kafka
2 52 (5.19%) RabbitMQ
3 42 (4.19%) Spark Streaming
4 32 (3.19%) Pandas
4 32 (3.19%) TensorFlow
5 31 (3.09%) PySpark
6 27 (2.69%) Enzyme
6 27 (2.69%) Jest
7 26 (2.59%) NumPy
8 24 (2.40%) .NET
9 22 (2.20%) Apache NiFi
9 22 (2.20%) MDX
10 21 (2.10%) Node.js
11 20 (2.00%) scikit-learn
12 19 (1.90%) Web Services
13 18 (1.80%) D3.js
13 18 (1.80%) REST
14 17 (1.70%) React
14 17 (1.70%) XML
15 16 (1.60%) Natural Language Processing
Miscellaneous
1 141 (14.07%) Analytical Skills
2 87 (8.68%) Data Structures
3 66 (6.59%) Algorithms
4 65 (6.49%) Greenfield Project
5 43 (4.29%) Self-Motivation
6 22 (2.20%) Management Information System
7 20 (2.00%) Hedge funds
8 17 (1.70%) Enterprise Software
9 15 (1.50%) Blog
10 14 (1.40%) Acoustics
10 14 (1.40%) Data Centre
10 14 (1.40%) User Experience
11 10 (1.00%) Cloud Native
12 9 (0.90%) CCTV
12 9 (0.90%) Fibre Optics
12 9 (0.90%) Social Media
12 9 (0.90%) Virtual Team
13 7 (0.70%) PMI
14 6 (0.60%) Equities
14 6 (0.60%) Linux Command Line
Operating Systems
1 95 (9.48%) Linux
2 38 (3.79%) Unix
3 8 (0.80%) Windows
4 1 (0.100%) Windows Server
4 1 (0.100%) Windows Server 2008
4 1 (0.100%) Windows Server 2012
4 1 (0.100%) Windows Server 2016
Processes & Methodologies
1 419 (41.82%) ETL
2 393 (39.22%) Analytics
3 353 (35.23%) Data Science
4 325 (32.44%) Agile Software Development
5 257 (25.65%) Business Intelligence
6 245 (24.45%) Data Engineering
7 192 (19.16%) Data Modelling
8 175 (17.47%) Machine Learning
9 161 (16.07%) DevOps
10 136 (13.57%) Visualisation
11 114 (11.38%) Data Analytics
12 111 (11.08%) Software Engineering
13 99 (9.88%) Artificial Intelligence
14 94 (9.38%) Data Visualisation
15 86 (8.58%) Computer Science
16 85 (8.48%) Fintech
17 82 (8.18%) Data Analysis
17 82 (8.18%) Data Integration
18 65 (6.49%) Continuous Integration
18 65 (6.49%) Scrum
Programming Languages
1 705 (70.36%) Python
2 551 (54.99%) SQL
3 305 (30.44%) Scala
4 296 (29.54%) Java
5 80 (7.98%) C#
6 77 (7.68%) R
7 67 (6.69%) C++
8 33 (3.29%) Go
9 32 (3.19%) JavaScript
10 21 (2.10%) PL/SQL
11 20 (2.00%) T-SQL
12 19 (1.90%) Data Analysis Expressions (DAX)
12 19 (1.90%) U-SQL
13 14 (1.40%) Bash Shell
14 13 (1.30%) PowerShell
15 12 (1.20%) TypeScript
16 8 (0.80%) PHP
17 7 (0.70%) C
17 7 (0.70%) Ruby
18 6 (0.60%) Shell Script
Qualifications
1 124 (12.38%) Degree
2 48 (4.79%) Computer Science Degree
3 16 (1.60%) Security Cleared
4 12 (1.20%) PhD
5 9 (0.90%) SC Cleared
6 8 (0.80%) DV Cleared
7 7 (0.70%) Master's Degree
7 7 (0.70%) PMI Certification
8 5 (0.50%) AWS Certification
9 2 (0.20%) Microsoft Certification
10 1 (0.100%) Numerate Degree
Quality Assurance & Compliance
1 46 (4.59%) Data Quality
2 31 (3.09%) QA
3 27 (2.69%) GAAP
4 6 (0.60%) GDPR
5 5 (0.50%) ISO/IEC 27001
6 3 (0.30%) SLA
7 1 (0.100%) COBIT
7 1 (0.100%) NIST
System Software
1 135 (13.47%) Docker
2 27 (2.69%) HDFS
3 15 (1.50%) VirtualBox
4 14 (1.40%) Apache Flume
5 9 (0.90%) Apache ZooKeeper
6 4 (0.40%) Virtual Machines
7 1 (0.100%) Alluxio
7 1 (0.100%) Ceph
7 1 (0.100%) etcd
7 1 (0.100%) Gluster
Systems Management
1 124 (12.38%) Kubernetes
2 95 (9.48%) Terraform
3 61 (6.09%) Ansible
4 27 (2.69%) Oozie
5 21 (2.10%) Hadoop YARN
6 19 (1.90%) Docker Swarm
7 18 (1.80%) Opscode Chef
8 16 (1.60%) Puppet
9 10 (1.00%) Istio
9 10 (1.00%) Salt
10 9 (0.90%) linkerd
11 8 (0.80%) Grafana
11 8 (0.80%) Prometheus
12 5 (0.50%) Kubeflow
12 5 (0.50%) Mesos
13 4 (0.40%) Chronos
13 4 (0.40%) HAProxy
13 4 (0.40%) Kibana
13 4 (0.40%) Nagios
14 3 (0.30%) Consul
Vendors
1 162 (16.17%) Google
2 158 (15.77%) Tableau
3 114 (11.38%) Oracle
4 84 (8.38%) Databricks
5 80 (7.98%) Microsoft
6 62 (6.19%) Talend
7 54 (5.39%) Informatica
8 45 (4.49%) Teradata
9 41 (4.09%) Cloudera
10 33 (3.29%) Alteryx
11 29 (2.89%) Automation Anywhere
11 29 (2.89%) Blue Prism
11 29 (2.89%) Cadence
11 29 (2.89%) UiPath
12 27 (2.69%) Hortonworks
13 19 (1.90%) IBM
14 15 (1.50%) Ab Initio
15 10 (1.00%) EXASOL
16 9 (0.90%) Facebook
17 8 (0.80%) SnapLogic