Period
to 6 June 2020

The median annual salary for a Data Engineer was £72,500 in advertised job vacancies in the City of London during the 6 months to 6 June 2020.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Data Engineer
Central London > City of London
6 months to
6 Jun 2020
Same period 2019 Same period 2018
Rank 128 193 238
Rank change year-on-year +65 +45 +69
Permanent jobs requiring a Data Engineer 130 138 114
As % of all permanent jobs advertised in the City of London 1.99% 1.37% 1.05%
As % of the Job Titles category 2.10% 1.43% 1.09%
Number of salaries quoted 111 128 114
Median annual salary £72,500 £70,000 £67,500
Median salary % change year-on-year +3.57% +3.70% +12.50%
10th Percentile £50,000 £45,000 £51,250
90th Percentile £96,250 £105,375 £97,500
Central London median annual salary £72,500 £70,000 £67,500
% change year-on-year +3.57% +3.70% +8.00%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies advertised in the City of London. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
City of London
Permanent vacancies in the City of London with a recognized job title 6,180 9,620 10,469
% of permanent IT jobs with a recognized job title 94.42% 95.29% 95.98%
Number of salaries quoted 5,375 8,543 9,285
Median annual salary £67,500 £65,000 £61,500
Median salary % change year-on-year +3.85% +5.69% +2.50%
10th Percentile £38,925 £35,550 £36,250
90th Percentile £97,500 £95,000 £92,500
Central London median annual salary £67,500 £65,000 £60,000
% change year-on-year +3.85% +8.33% +4.35%

Data Engineer
Job Vacancy Trend in the City of London

Job postings that featured Data Engineer in the job title as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Data Engineer in the City of London

Data Engineer
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Data Engineer in the City of London.

Salary trend for Data Engineer in the City of London

Data Engineer
Salary Histogram in the City of London

Salary distribution for jobs citing Data Engineer in the City of London over the 6 months to 6 June 2020.

Salary histogram for Data Engineer in the City of London

Data Engineer Skill Set
Top 30 Co-occurring IT Skills in the City of London

For the 6 months to 6 June 2020, Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region featuring Data Engineer in the job title.

1 84 (64.62%) Python
2 74 (56.92%) SQL
3 65 (50.00%) AWS
4 59 (45.38%) ETL
5 54 (41.54%) Data Science
6 53 (40.77%) Apache Spark
7 52 (40.00%) Big Data
8 51 (39.23%) Analytics
9 49 (37.69%) Kafka
9 49 (37.69%) Scala
10 47 (36.15%) Machine Learning
11 46 (35.38%) Hadoop
12 45 (34.62%) GCP
12 45 (34.62%) Java
13 42 (32.31%) Data Engineering
14 38 (29.23%) Data Warehouse
15 36 (27.69%) Azure
16 35 (26.92%) NoSQL
17 29 (22.31%) Agile Software Development
18 28 (21.54%) Degree
19 27 (20.77%) Business Intelligence
20 26 (20.00%) Google
21 25 (19.23%) Finance
22 23 (17.69%) Apache Hive
23 22 (16.92%) Apache Airflow
24 20 (15.38%) Apache Cassandra
24 20 (15.38%) Kubernetes
25 19 (14.62%) PostgreSQL
26 18 (13.85%) Data Modelling
26 18 (13.85%) Algorithms

Data Engineer Skill Set
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 53 (40.77%) Apache Spark
2 22 (16.92%) Apache Airflow
3 14 (10.77%) Luigi
4 13 (10.00%) Apache
5 6 (4.62%) Elasticsearch
6 4 (3.08%) Apache Pig
7 3 (2.31%) SAS
8 1 (0.77%) BizTalk Server
Applications
1 1 (0.77%) Microsoft Excel
Business Applications
1 3 (2.31%) Cognos Business Intelligence
Cloud Services
1 65 (50.00%) AWS
2 45 (34.62%) GCP
3 36 (27.69%) Azure
4 18 (13.85%) Amazon S3
4 18 (13.85%) Power Platform
5 16 (12.31%) Amazon EMR
6 10 (7.69%) Amazon Kinesis
7 4 (3.08%) Amazon EC2
7 4 (3.08%) Serverless
8 3 (2.31%) Firebase
9 2 (1.54%) Amazon SQS
9 2 (1.54%) AWS IoT
10 1 (0.77%) Azure Data Factory
10 1 (0.77%) Google Analytics
10 1 (0.77%) Google Sheets
10 1 (0.77%) IBM Cloud
Communications & Networking
1 2 (1.54%) FTP
Database & Business Intelligence
1 52 (40.00%) Big Data
2 46 (35.38%) Hadoop
3 38 (29.23%) Data Warehouse
4 35 (26.92%) NoSQL
5 23 (17.69%) Apache Hive
6 20 (15.38%) Apache Cassandra
7 19 (14.62%) PostgreSQL
8 18 (13.85%) Amazon Redshift
8 18 (13.85%) Power BI
9 17 (13.08%) BigQuery
10 16 (12.31%) Relational Database
10 16 (12.31%) SQL Server
11 14 (10.77%) MongoDB
12 12 (9.23%) Data Lake
13 10 (7.69%) Amazon Athena
13 10 (7.69%) SQL Server Integration Services
14 9 (6.92%) Amazon DynamoDB
14 9 (6.92%) RDBMS
15 8 (6.15%) OLAP
16 7 (5.38%) HDInsight
Development Applications
1 17 (13.08%) Jenkins
2 13 (10.00%) Git (software)
3 5 (3.85%) Visual Studio Team System
4 4 (3.08%) Flyway
4 4 (3.08%) Liquibase
5 3 (2.31%) Artifactory
5 3 (2.31%) Bitbucket
5 3 (2.31%) JIRA
5 3 (2.31%) JUnit
5 3 (2.31%) Maven
5 3 (2.31%) Octopus Deploy
5 3 (2.31%) TeamCity
6 2 (1.54%) Visual Studio
7 1 (0.77%) Atlassian Bamboo
7 1 (0.77%) Selenium
7 1 (0.77%) Vagrant
General
1 25 (19.23%) Finance
2 13 (10.00%) Marketing
3 5 (3.85%) Legal
3 5 (3.85%) Retail
4 4 (3.08%) Automotive
5 3 (2.31%) Banking
5 3 (2.31%) Games
5 3 (2.31%) Law
5 3 (2.31%) Pharmaceutical
6 2 (1.54%) Advertising
6 2 (1.54%) Public Sector
6 2 (1.54%) Telecoms
7 1 (0.77%) Manufacturing
Libraries, Frameworks & Software Standards
1 49 (37.69%) Kafka
2 13 (10.00%) Pandas
3 11 (8.46%) NumPy
3 11 (8.46%) TensorFlow
4 8 (6.15%) Matplotlib
5 7 (5.38%) GraphQL
5 7 (5.38%) PySpark
5 7 (5.38%) REST
5 7 (5.38%) scikit-learn
6 6 (4.62%) SOAP
7 5 (3.85%) .NET
7 5 (3.85%) Elastic Stack
7 5 (3.85%) Node.js
7 5 (3.85%) React
7 5 (3.85%) RESTful
7 5 (3.85%) Spark Streaming
8 4 (3.08%) Apache Beam
8 4 (3.08%) Apache NiFi
8 4 (3.08%) CSS
8 4 (3.08%) JSON
Miscellaneous
1 18 (13.85%) Algorithms
2 10 (7.69%) Analytical Skills
3 5 (3.85%) Greenfield Project
4 2 (1.54%) Data Structures
4 2 (1.54%) Hedge funds
4 2 (1.54%) Hybrid Cloud
4 2 (1.54%) Management Information System
4 2 (1.54%) Social Media
5 1 (0.77%) Acoustics
5 1 (0.77%) Blog
5 1 (0.77%) Derivative
5 1 (0.77%) Equities
5 1 (0.77%) Foreign Exchange (FX)
5 1 (0.77%) Public Cloud
5 1 (0.77%) Robotics
5 1 (0.77%) Self-Motivation
5 1 (0.77%) Taxonomies
Operating Systems
1 5 (3.85%) Linux
2 4 (3.08%) Windows
3 3 (2.31%) Unix
4 1 (0.77%) Windows Server
Processes & Methodologies
1 59 (45.38%) ETL
2 54 (41.54%) Data Science
3 51 (39.23%) Analytics
4 47 (36.15%) Machine Learning
5 42 (32.31%) Data Engineering
6 29 (22.31%) Agile Software Development
7 27 (20.77%) Business Intelligence
8 18 (13.85%) Data Modelling
9 17 (13.08%) Fintech
9 17 (13.08%) Visualisation
10 16 (12.31%) Computer Science
10 16 (12.31%) DevOps
11 15 (11.54%) Artificial Intelligence
11 15 (11.54%) Software Engineering
11 15 (11.54%) TDD
12 13 (10.00%) Continuous Integration
12 13 (10.00%) Data Integration
13 12 (9.23%) Data Analytics
14 11 (8.46%) Data Visualisation
15 9 (6.92%) Data Ingestion
Programming Languages
1 84 (64.62%) Python
2 74 (56.92%) SQL
3 49 (37.69%) Scala
4 45 (34.62%) Java
5 14 (10.77%) C#
5 14 (10.77%) R
6 12 (9.23%) C++
7 11 (8.46%) Go
7 11 (8.46%) JavaScript
8 5 (3.85%) PL/SQL
8 5 (3.85%) Ruby
9 4 (3.08%) T-SQL
10 3 (2.31%) Shell Script
11 2 (1.54%) Data Analysis Expressions (DAX)
11 2 (1.54%) Julia
11 2 (1.54%) MATLAB
12 1 (0.77%) PowerShell
12 1 (0.77%) Rust
12 1 (0.77%) TypeScript
12 1 (0.77%) XPath
Qualifications
1 28 (21.54%) Degree
2 5 (3.85%) Computer Science Degree
3 3 (2.31%) PhD
3 3 (2.31%) SC Cleared
3 3 (2.31%) Security Cleared
Quality Assurance & Compliance
1 11 (8.46%) Data Quality
2 1 (0.77%) COBIT
2 1 (0.77%) NIST
2 1 (0.77%) QA
System Software
1 18 (13.85%) Docker
2 5 (3.85%) Apache Flume
3 3 (2.31%) HDFS
4 1 (0.77%) VirtualBox
Systems Management
1 20 (15.38%) Kubernetes
2 17 (13.08%) Terraform
3 16 (12.31%) Ansible
4 5 (3.85%) Oozie
4 5 (3.85%) Opscode Chef
4 5 (3.85%) Puppet
4 5 (3.85%) Salt
5 4 (3.08%) Hadoop YARN
6 3 (2.31%) Argo
7 2 (1.54%) Istio
7 2 (1.54%) linkerd
8 1 (0.77%) Docker Swarm
8 1 (0.77%) Grafana
8 1 (0.77%) Kibana
8 1 (0.77%) Prometheus
Vendors
1 26 (20.00%) Google
2 16 (12.31%) Tableau
3 14 (10.77%) Oracle
4 7 (5.38%) Cloudera
5 5 (3.85%) Databricks
5 5 (3.85%) Hortonworks
6 4 (3.08%) SnapLogic
7 3 (2.31%) Ab Initio
7 3 (2.31%) Cognos
7 3 (2.31%) Informatica
7 3 (2.31%) Intapp
7 3 (2.31%) MapR
7 3 (2.31%) Microsoft
8 2 (1.54%) Salesforce.com
8 2 (1.54%) Splunk
9 1 (0.77%) Alteryx
9 1 (0.77%) IBM
9 1 (0.77%) Remedy
9 1 (0.77%) Talend
9 1 (0.77%) TOWER Software