Job Vacancy Trend Salary Trend Salary Histogram Job Locations Data Engineer Skill Set in London
Period
to 26 July 2021

The median annual salary for a Data Engineer was £70,000 in advertised job vacancies in London during the 6 months to 26 July 2021.

The first table below provides salary benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Data Engineer
England > London
6 months to
26 Jul 2021		 Same period 2020 Same period 2019
Rank 141 133 209
Rank change year-on-year -8 +76 +95
Permanent jobs requiring a Data Engineer 1,125 758 998
As % of all permanent jobs advertised in London 2.51% 2.58% 1.73%
As % of the Job Titles category 2.80% 2.74% 1.81%
Number of salaries quoted 910 556 891
10th Percentile £46,250 £46,250 £47,500
25th Percentile £52,500 £57,500 £57,500
Median annual salary (50th Percentile) £70,000 £72,500 £72,500
Median % change year-on-year -3.45% - +3.57%
75th Percentile £86,250 £87,500 £87,500
90th Percentile £97,500 £100,000 £103,750
England median annual salary £65,000 £67,500 £70,000
% change year-on-year -3.70% -3.57% +7.69%

The following table is for comparison with the above and includes summary statistics for all permanent IT job vacancies advertised in London. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of permanent jobs in our overall sample.

All Permanent IT Job Vacancies
London
Permanent vacancies in London with a recognized job title 40,190 27,617 55,113
% of permanent IT jobs with a recognized job title 89.61% 94.02% 95.31%
Number of salaries quoted 27,965 22,823 45,797
10th Percentile £41,250 £38,750 £35,000
25th Percentile £51,750 £50,000 £46,250
Median annual salary (50th Percentile) £70,000 £67,500 £62,500
Median % change year-on-year +3.70% +8.00% +4.17%
75th Percentile £87,500 £85,000 £81,250
90th Percentile £102,500 £101,250 £96,250
England median annual salary £55,000 £55,000 £52,000
% change year-on-year - +5.77% +4.00%

Data Engineer
Job Vacancy Trend in London

Job postings that featured Data Engineer in the job title as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Engineer in London

Data Engineer
Salary Trend in London

3-month moving average salary quoted in jobs citing Data Engineer in London.

Salary trend for Data Engineer in London

Data Engineer
Salary Histogram in London

Salary distribution for jobs citing Data Engineer in London over the 6 months to 26 July 2021.

Salary histogram for Data Engineer in London

Data Engineer
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineer within the London region over the 6 months to 26 July 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Permanent
IT Job Ads		 Median Salary
Past 6 Months		 Median Salary
% Change
on Same Period
Last Year		 Live
Job
Vacancies
Central London +58 222 £72,500 - 43
South London -29 14 £60,000 -11.11% 5
West London -32 9 £70,000 +27.27% 14
East London -8 6 £67,500 -6.90% 11
North London +8 1 - - 1
Data Engineer
England

Data Engineer Skill Set
Top 30 Co-occurring IT Skills in London

For the 6 months to 26 July 2021, Data Engineer job roles required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region featuring Data Engineer in the job title.

1 842 (74.84%) Python
2 714 (63.47%) SQL
3 615 (54.67%) AWS
4 507 (45.07%) ETL
5 455 (40.44%) Analytics
6 441 (39.20%) Data Pipeline
7 440 (39.11%) Azure
8 414 (36.80%) Data Engineering
9 409 (36.36%) Data Science
10 395 (35.11%) Data Warehouse
11 380 (33.78%) Apache Spark
12 367 (32.62%) Big Data
13 344 (30.58%) Business Intelligence
14 337 (29.96%) GCP
15 306 (27.20%) Agile Software Development
16 290 (25.78%) Java
17 284 (25.24%) Kafka
18 274 (24.36%) Data Modelling
19 250 (22.22%) Finance
20 247 (21.96%) Hadoop
21 234 (20.80%) Artificial Intelligence
21 234 (20.80%) Kubernetes
22 226 (20.09%) Docker
23 203 (18.04%) Apache Airflow
24 194 (17.24%) Data Lake
25 189 (16.80%) NoSQL
26 188 (16.71%) Power BI
26 188 (16.71%) Power Platform
27 186 (16.53%) Machine Learning
28 184 (16.36%) Visualisation

Data Engineer Skill Set
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 380 (33.78%) Apache Spark
2 203 (18.04%) Apache Airflow
3 100 (8.89%) Apache
4 47 (4.18%) Luigi
5 44 (3.91%) Elasticsearch
6 22 (1.96%) Apache Pig
7 17 (1.51%) Gunicorn
8 10 (0.89%) Oracle Workflow
9 9 (0.80%) Confluence
10 8 (0.71%) SAS
10 8 (0.71%) SharePoint
11 4 (0.36%) Oracle Application Server
12 3 (0.27%) Jupyter
13 2 (0.18%) Apache Pulsar
13 2 (0.18%) Mule
14 1 (0.089%) Apache Synapse
14 1 (0.089%) CMS
14 1 (0.089%) OpenStack
Applications
1 18 (1.60%) Microsoft Excel
2 3 (0.27%) Microsoft Office
3 2 (0.18%) Spreadsheet
4 1 (0.089%) Microsoft PowerPoint
4 1 (0.089%) MS Visio
Business Applications
1 5 (0.44%) SAP Oil and Gas
2 3 (0.27%) Sentinel
3 1 (0.089%) Eikon
3 1 (0.089%) Refinitiv Enterprise Platform
Cloud Services
1 615 (54.67%) AWS
2 440 (39.11%) Azure
3 337 (29.96%) GCP
4 188 (16.71%) Power Platform
5 163 (14.49%) Snowflake
6 145 (12.89%) Serverless
7 108 (9.60%) Azure Data Factory
8 86 (7.64%) Amazon S3
9 80 (7.11%) Amazon EMR
10 76 (6.76%) AWS Lambda
11 74 (6.58%) Amazon EC2
12 71 (6.31%) Amazon Kinesis
13 44 (3.91%) Azure Synapse Analytics
14 37 (3.29%) Amazon ECS
15 36 (3.20%) IBM Cloud
16 34 (3.02%) Cloud Functions
16 34 (3.02%) SaaS
17 27 (2.40%) Azure Functions
18 25 (2.22%) dbt
19 23 (2.04%) Google Analytics
Communications & Networking
1 10 (0.89%) SSH
2 6 (0.53%) FTP
3 5 (0.44%) IPsec
3 5 (0.44%) VPN
4 4 (0.36%) HTTP
5 3 (0.27%) DHCP
5 3 (0.27%) DNS
5 3 (0.27%) HTTPS
5 3 (0.27%) IPv4
5 3 (0.27%) IPv6
5 3 (0.27%) SMTP
5 3 (0.27%) SNMP
5 3 (0.27%) TCP/IP
6 2 (0.18%) Network Security
7 1 (0.089%) ATM
7 1 (0.089%) Cisco IPT
7 1 (0.089%) Intranet
7 1 (0.089%) PuTTY
7 1 (0.089%) Structured Cabling
7 1 (0.089%) Wireless
Database & Business Intelligence
1 395 (35.11%) Data Warehouse
2 367 (32.62%) Big Data
3 247 (21.96%) Hadoop
4 194 (17.24%) Data Lake
5 189 (16.80%) NoSQL
6 188 (16.71%) Power BI
7 171 (15.20%) Amazon Redshift
8 129 (11.47%) SQL Server
9 127 (11.29%) Tableau
10 101 (8.98%) BigQuery
11 96 (8.53%) PostgreSQL
12 87 (7.73%) Amazon Athena
13 77 (6.84%) Relational Database
14 69 (6.13%) SQL Server Analysis Services
15 55 (4.89%) SQL Server Integration Services
16 52 (4.62%) Neo4j
17 51 (4.53%) Apache Hive
18 49 (4.36%) Amazon RDS
18 49 (4.36%) Azure SQL Database
19 47 (4.18%) MongoDB
Development Applications
1 103 (9.16%) Jenkins
2 83 (7.38%) Git (software)
3 47 (4.18%) Atlassian Bamboo
4 45 (4.00%) Vagrant
5 31 (2.76%) JIRA
6 11 (0.98%) Selenium
7 8 (0.71%) Team Foundation Server
8 7 (0.62%) CircleCI
8 7 (0.62%) Oracle APEX
9 6 (0.53%) Hudson
9 6 (0.53%) Sonatype Nexus
10 5 (0.44%) Artifactory
10 5 (0.44%) GitLab
10 5 (0.44%) Spinnaker
11 4 (0.36%) Arsenale Dataplane
11 4 (0.36%) Bitbucket
11 4 (0.36%) Gradle
11 4 (0.36%) MLflow
11 4 (0.36%) Visual Studio
12 2 (0.18%) PowerDesigner
General
1 250 (22.22%) Finance
2 149 (13.24%) Social Skills
3 76 (6.76%) Analytical Skills
4 74 (6.58%) Banking
5 47 (4.18%) Marketing
5 47 (4.18%) Retail
6 29 (2.58%) Advertising
7 25 (2.22%) Telecoms
8 21 (1.87%) Games
9 19 (1.69%) Publishing
10 15 (1.33%) Law
10 15 (1.33%) Russian Language
11 13 (1.16%) Front Office
11 13 (1.16%) Manufacturing
11 13 (1.16%) Public Sector
12 12 (1.07%) Financial Institution
13 10 (0.89%) Legal
14 8 (0.71%) Czech Language
14 8 (0.71%) Organisational Skills
15 7 (0.62%) Investment Banking
Libraries, Frameworks & Software Standards
1 284 (25.24%) Kafka
2 69 (6.13%) PySpark
3 57 (5.07%) Spark Streaming
4 56 (4.98%) Web Services
5 49 (4.36%) Apache Beam
5 49 (4.36%) REST
6 39 (3.47%) Pandas
7 35 (3.11%) .NET
7 35 (3.11%) JSON
8 33 (2.93%) NumPy
9 25 (2.22%) gRPC
9 25 (2.22%) Node.js
10 20 (1.78%) HTML
11 17 (1.51%) pytest
11 17 (1.51%) scikit-learn
12 15 (1.33%) React
12 15 (1.33%) XML
13 13 (1.16%) Scrapy
14 12 (1.07%) Akka
14 12 (1.07%) Flask
Miscellaneous
1 59 (5.24%) Data Structures
2 49 (4.36%) Algorithms
3 44 (3.91%) Hedge funds
4 41 (3.64%) Hybrid Cloud
5 29 (2.58%) Equities
6 28 (2.49%) Greenfield Project
7 24 (2.13%) Cloud Native
7 24 (2.13%) Management Information System
7 24 (2.13%) Pricing Data
8 18 (1.60%) Renewable Energy
9 13 (1.16%) Fixed Income
9 13 (1.16%) Foreign Exchange (FX)
9 13 (1.16%) User Experience
10 11 (0.98%) Self-Motivation
10 11 (0.98%) Social Media
11 10 (0.89%) Blog
12 9 (0.80%) Reference Data
13 8 (0.71%) Derivative
14 7 (0.62%) Linux Command Line
14 7 (0.62%) NHS
Operating Systems
1 79 (7.02%) Linux
2 21 (1.87%) Unix
3 12 (1.07%) Apple iOS
4 8 (0.71%) Windows
5 6 (0.53%) Android
6 1 (0.089%) OS/2
Processes & Methodologies
1 507 (45.07%) ETL
2 455 (40.44%) Analytics
3 441 (39.20%) Data Pipeline
4 414 (36.80%) Data Engineering
5 409 (36.36%) Data Science
6 344 (30.58%) Business Intelligence
7 306 (27.20%) Agile Software Development
8 274 (24.36%) Data Modelling
9 234 (20.80%) Artificial Intelligence
10 186 (16.53%) Machine Learning
11 184 (16.36%) Visualisation
12 166 (14.76%) Data Management
13 148 (13.16%) DevOps
14 141 (12.53%) Data Architecture
15 136 (12.09%) Software Engineering
16 134 (11.91%) Data Analytics
17 103 (9.16%) Data Visualisation
18 102 (9.07%) Microservices
19 93 (8.27%) Continuous Integration
20 81 (7.20%) Data Transformation
Programming Languages
1 842 (74.84%) Python
2 714 (63.47%) SQL
3 290 (25.78%) Java
4 163 (14.49%) Scala
5 87 (7.73%) R
6 65 (5.78%) C#
7 51 (4.53%) JavaScript
8 40 (3.56%) PowerShell
9 39 (3.47%) Bash Shell
10 29 (2.58%) T-SQL
11 28 (2.49%) Go
12 25 (2.22%) C++
13 22 (1.96%) C
14 18 (1.60%) Kotlin
15 16 (1.42%) Data Analysis Expressions (DAX)
16 15 (1.33%) Clojure
16 15 (1.33%) PL/SQL
17 13 (1.16%) VB
17 13 (1.16%) XPath
18 12 (1.07%) Apple Swift
Qualifications
1 99 (8.80%) Degree
2 42 (3.73%) Computer Science Degree
3 22 (1.96%) Security Cleared
4 14 (1.24%) SC Cleared
5 9 (0.80%) Microsoft Certification
6 7 (0.62%) AWS Certification
6 7 (0.62%) Numerate Degree
7 6 (0.53%) DV Cleared
7 6 (0.53%) PhD
8 3 (0.27%) DBS Check
9 2 (0.18%) Master's Degree
10 1 (0.089%) (ISC)2 CCSP
10 1 (0.089%) BPSS Clearance
10 1 (0.089%) Cisco Certification
10 1 (0.089%) CISSP
10 1 (0.089%) SAS Certification
Quality Assurance & Compliance
1 89 (7.91%) QA
2 65 (5.78%) Data Quality
3 41 (3.64%) GDPR
4 17 (1.51%) GRC
5 6 (0.53%) Accessibility
6 2 (0.18%) PCI DSS
6 2 (0.18%) SOC 2
7 1 (0.089%) SLA
System Software
1 226 (20.09%) Docker
2 39 (3.47%) VirtualBox
3 10 (0.89%) HDFS
4 3 (0.27%) Apache ZooKeeper
5 2 (0.18%) Apache Flume
6 1 (0.089%) Active Directory
Systems Management
1 234 (20.80%) Kubernetes
2 120 (10.67%) Terraform
3 57 (5.07%) Ansible
4 45 (4.00%) Docker Swarm
5 26 (2.31%) Puppet
6 25 (2.22%) Opscode Chef
7 21 (1.87%) Grafana
8 16 (1.42%) Prometheus
9 11 (0.98%) Hadoop YARN
10 8 (0.71%) Oozie
11 6 (0.53%) Consul
11 6 (0.53%) Graphite
11 6 (0.53%) Nagios
11 6 (0.53%) Opsview
11 6 (0.53%) Packer
11 6 (0.53%) Salt
11 6 (0.53%) ZABBIX
12 4 (0.36%) Ambari
13 2 (0.18%) Control-M
13 2 (0.18%) Kubeflow
Vendors
1 172 (15.29%) Google
2 129 (11.47%) Microsoft
3 125 (11.11%) Databricks
4 68 (6.04%) Talend
5 61 (5.42%) Cloudera
6 54 (4.80%) Informatica
7 52 (4.62%) Oracle
8 50 (4.44%) Hortonworks
9 37 (3.29%) IBM
10 26 (2.31%) Alteryx
11 23 (2.04%) SAP
12 13 (1.16%) Teradata
13 12 (1.07%) Dataiku
14 8 (0.71%) Salesforce.com
15 7 (0.62%) Ab Initio
15 7 (0.62%) StreamSets
15 7 (0.62%) Sybase
16 4 (0.36%) Alibaba
16 4 (0.36%) BT
17 3 (0.27%) Monetate