Period
to 23 September 2021

The following table provides summary statistics for permanent job vacancies advertised in the City of London with a requirement for Data Engineering skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Engineering over the 6 months to 23 September 2021 with a comparison to the same period in the previous 2 years.

Data Engineering
Central London > City of London
6 months to
23 Sep 2021
Same period 2020 Same period 2019
Rank 109 170 243
Rank change year-on-year +61 +73 +48
Permanent jobs citing Data Engineering 152 30 88
As % of all permanent jobs advertised in the City of London 2.58% 0.77% 0.88%
As % of the Processes & Methodologies category 2.73% 0.82% 0.94%
Number of salaries quoted 130 26 78
10th Percentile £52,500 £45,625 £50,000
25th Percentile £64,063 £56,875 £60,313
Median annual salary (50th Percentile) £80,000 £85,000 £72,500
Median % change year-on-year -5.88% +17.24% -9.38%
75th Percentile £95,000 £104,375 £82,500
90th Percentile £115,000 £121,250 £92,500
Central London median annual salary £80,000 £70,000 £70,000
% change year-on-year +14.29% - -12.50%

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the City of London with a requirement for process or methodology skills.

All Process and Methodology Skills
City of London
Permanent vacancies with a requirement for process or methodology skills 5,572 3,665 9,401
As % of all permanent IT jobs advertised in the City of London 94.44% 94.43% 93.89%
Number of salaries quoted 4,973 3,180 8,332
10th Percentile £42,500 £44,000 £37,500
25th Percentile £55,000 £53,750 £51,250
Median annual salary (50th Percentile) £72,500 £70,000 £67,500
Median % change year-on-year +3.57% +3.70% +3.85%
75th Percentile £91,250 £86,250 £82,500
90th Percentile £106,250 £102,500 £97,500
Central London median annual salary £70,750 £70,000 £65,000
% change year-on-year +1.07% +7.69% +4.00%

Data Engineering
Job Vacancy Trend in the City of London

Job postings citing Data Engineering as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Data Engineering in the City of London

Data Engineering
Salary Trend in the City of London

3-month moving average salary quoted in jobs citing Data Engineering in the City of London.

Salary trend for Data Engineering in the City of London

Data Engineering
Salary Histogram in the City of London

Salary distribution for jobs citing Data Engineering in the City of London over the 6 months to 23 September 2021.

Salary histogram for Data Engineering in the City of London

For the 6 months to 23 September 2021, IT jobs citing Data Engineering also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the City of London region with a requirement for Data Engineering.

1 93 (61.18%) Analytics
2 71 (46.71%) Python
3 63 (41.45%) SQL
4 62 (40.79%) Azure
5 57 (37.50%) Agile Software Development
6 53 (34.87%) Data Warehouse
7 52 (34.21%) AWS
8 51 (33.55%) Apache Spark
9 48 (31.58%) ETL
10 44 (28.95%) Java
11 43 (28.29%) Data Lake
12 42 (27.63%) Data Modelling
13 41 (26.97%) Business Intelligence
14 40 (26.32%) GCP
14 40 (26.32%) Big Data
15 38 (25.00%) Microsoft
16 37 (24.34%) Data Pipeline
17 35 (23.03%) Data Science
18 33 (21.71%) Hadoop
19 32 (21.05%) Amazon Redshift
19 32 (21.05%) Databricks
20 31 (20.39%) Finance
21 30 (19.74%) DevOps
22 28 (18.42%) Software Engineering
23 26 (17.11%) Data Architecture
24 25 (16.45%) Social Skills
25 24 (15.79%) Power Platform
25 24 (15.79%) Azure Data Factory
25 24 (15.79%) Power BI
25 24 (15.79%) Scala

Data Engineering
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 51 (33.55%) Apache Spark
2 16 (10.53%) Apache Airflow
3 9 (5.92%) Apache
4 5 (3.29%) Elasticsearch
Applications
1 6 (3.95%) Microsoft Excel
2 4 (2.63%) Microsoft PowerPoint
3 1 (0.66%) Microsoft Office
Cloud Services
1 62 (40.79%) Azure
2 52 (34.21%) AWS
3 40 (26.32%) GCP
4 24 (15.79%) Azure Data Factory
4 24 (15.79%) Power Platform
5 16 (10.53%) Amazon S3
6 14 (9.21%) SaaS
7 6 (3.95%) Amazon EMR
7 6 (3.95%) Serverless
8 5 (3.29%) AWS CloudFormation
8 5 (3.29%) Azure Logic Apps
9 4 (2.63%) Amazon EC2
9 4 (2.63%) Azure Cosmos DB
9 4 (2.63%) Trello
10 3 (1.97%) AWS Lambda
10 3 (1.97%) Azure Functions
10 3 (1.97%) PaaS
11 2 (1.32%) Amazon SQS
11 2 (1.32%) Azure Synapse Analytics
11 2 (1.32%) Snowflake
Communications & Networking
1 4 (2.63%) Broadband
2 3 (1.97%) 5G
3 1 (0.66%) DNS
3 1 (0.66%) TCP/IP
Database & Business Intelligence
1 53 (34.87%) Data Warehouse
2 43 (28.29%) Data Lake
3 40 (26.32%) Big Data
4 33 (21.71%) Hadoop
5 32 (21.05%) Amazon Redshift
6 24 (15.79%) Power BI
7 19 (12.50%) Azure SQL Database
7 19 (12.50%) BigQuery
8 11 (7.24%) MongoDB
8 11 (7.24%) PostgreSQL
9 10 (6.58%) Delta Lake
9 10 (6.58%) NoSQL
10 8 (5.26%) Apache Hive
10 8 (5.26%) MySQL
11 6 (3.95%) Metadata
11 6 (3.95%) Neo4j
11 6 (3.95%) Relational Database
12 5 (3.29%) Electronic Patient Records
12 5 (3.29%) SQL Server Integration Services
12 5 (3.29%) Tableau
Development Applications
1 6 (3.95%) Git (software)
2 5 (3.29%) Gradle
2 5 (3.29%) Selenium
3 4 (2.63%) Cucumber
3 4 (2.63%) JIRA
3 4 (2.63%) JMeter
3 4 (2.63%) MSTest
3 4 (2.63%) NUnit
3 4 (2.63%) Postman
3 4 (2.63%) ReSharper
3 4 (2.63%) SpecFlow
3 4 (2.63%) Team Foundation Server
3 4 (2.63%) Visual Studio
3 4 (2.63%) Visual Studio Coded UI
3 4 (2.63%) Visual Studio Team System
3 4 (2.63%) WebDriver
4 2 (1.32%) Jenkins
4 2 (1.32%) Subversion
5 1 (0.66%) GitLab
5 1 (0.66%) Vagrant
General
1 31 (20.39%) Finance
2 25 (16.45%) Social Skills
3 14 (9.21%) Analytical Skills
4 10 (6.58%) Advertising
4 10 (6.58%) Marketing
5 7 (4.61%) Law
6 3 (1.97%) Front Office
6 3 (1.97%) Telecoms
7 2 (1.32%) Influencing Skills
7 2 (1.32%) Legal
7 2 (1.32%) Manufacturing
7 2 (1.32%) Retail
8 1 (0.66%) Banking
8 1 (0.66%) Financial Institution
8 1 (0.66%) Presentation Skills
8 1 (0.66%) Public Sector
Job Titles
1 72 (47.37%) Data Engineer
2 24 (15.79%) Big Data Engineer
2 24 (15.79%) Senior Data Engineer
3 17 (11.18%) Software Engineer
4 16 (10.53%) Data Analytics Engineer
5 15 (9.87%) Big Data Software Engineer
5 15 (9.87%) Java Engineer
5 15 (9.87%) Java Software Engineer
6 13 (8.55%) Azure Engineer
6 13 (8.55%) Data Manager
7 9 (5.92%) Developer
8 8 (5.26%) Architect
8 8 (5.26%) AWS Engineer
8 8 (5.26%) Product Manager
9 7 (4.61%) Data Architect
10 6 (3.95%) Business Intelligence Developer
10 6 (3.95%) Engineering Manager
11 5 (3.29%) Azure Architect
11 5 (3.29%) Scala Engineer
11 5 (3.29%) Senior Scala Engineer
Libraries, Frameworks & Software Standards
1 23 (15.13%) Kafka
2 13 (8.55%) PySpark
3 7 (4.61%) .NET
3 7 (4.61%) AngularJS
4 6 (3.95%) RESTful
5 5 (3.29%) MDX
5 5 (3.29%) TensorFlow
6 4 (2.63%) .NET Framework
6 4 (2.63%) ASP.NET Web API
6 4 (2.63%) Gherkin
6 4 (2.63%) HTML
6 4 (2.63%) RabbitMQ
7 3 (1.97%) Web Services
8 2 (1.32%) Django
8 2 (1.32%) JSON
8 2 (1.32%) Middleware
8 2 (1.32%) Node.js
8 2 (1.32%) Pandas
8 2 (1.32%) React
8 2 (1.32%) React Native
Miscellaneous
1 7 (4.61%) Algorithms
1 7 (4.61%) Data Structures
1 7 (4.61%) Greenfield Project
2 5 (3.29%) Data Centre
2 5 (3.29%) Virtual Team
3 4 (2.63%) Self-Motivation
3 4 (2.63%) Social Media
3 4 (2.63%) User Experience
4 2 (1.32%) Blog
4 2 (1.32%) Enterprise Cloud
4 2 (1.32%) Mobile App
4 2 (1.32%) Renewable Energy
5 1 (0.66%) Acoustics
5 1 (0.66%) Enterprise Software
5 1 (0.66%) Hedge funds
5 1 (0.66%) Legacy Systems
5 1 (0.66%) Media Streaming
Operating Systems
1 3 (1.97%) Linux
Processes & Methodologies
1 93 (61.18%) Analytics
2 57 (37.50%) Agile Software Development
3 48 (31.58%) ETL
4 42 (27.63%) Data Modelling
5 41 (26.97%) Business Intelligence
6 37 (24.34%) Data Pipeline
7 35 (23.03%) Data Science
8 30 (19.74%) DevOps
9 28 (18.42%) Software Engineering
10 26 (17.11%) Data Architecture
11 22 (14.47%) Computer Science
11 22 (14.47%) Machine Learning
12 21 (13.82%) Data Strategy
13 18 (11.84%) Open Source
13 18 (11.84%) Scrum
14 17 (11.18%) Data Analytics
15 16 (10.53%) Artificial Intelligence
16 15 (9.87%) Problem-Solving
17 14 (9.21%) DataOps
18 13 (8.55%) Release Management
Programming Languages
1 71 (46.71%) Python
2 63 (41.45%) SQL
3 44 (28.95%) Java
4 24 (15.79%) Scala
5 8 (5.26%) Data Analysis Expressions (DAX)
6 5 (3.29%) Cypher
6 5 (3.29%) JavaScript
7 4 (2.63%) ANSI SQL
7 4 (2.63%) C#
7 4 (2.63%) PL/SQL
7 4 (2.63%) PowerShell
7 4 (2.63%) T-SQL
8 2 (1.32%) Bash Shell
8 2 (1.32%) R
9 1 (0.66%) C
Qualifications
1 15 (9.87%) Degree
2 7 (4.61%) Computer Science Degree
3 4 (2.63%) Master's Degree
4 3 (1.97%) Numerate Degree
5 2 (1.32%) SC Cleared
5 2 (1.32%) Security Cleared
6 1 (0.66%) IBM Certification
6 1 (0.66%) Microsoft Certification
Quality Assurance & Compliance
1 15 (9.87%) Data Quality
2 9 (5.92%) QA
3 3 (1.97%) AIFMD
3 3 (1.97%) MiFID
4 2 (1.32%) GDPR
System Software
1 6 (3.95%) Docker
2 3 (1.97%) HDFS
3 1 (0.66%) VirtualBox
Systems Management
1 8 (5.26%) Kubernetes
2 6 (3.95%) Terraform
3 1 (0.66%) Ansible
3 1 (0.66%) Docker Swarm
3 1 (0.66%) Puppet
Vendors
1 38 (25.00%) Microsoft
2 32 (21.05%) Databricks
3 10 (6.58%) Oracle
4 5 (3.29%) Google
5 4 (2.63%) Cloudera
5 4 (2.63%) Xamarin
6 2 (1.32%) IBM
7 1 (0.66%) Dataiku
7 1 (0.66%) Facebook
7 1 (0.66%) Hortonworks
7 1 (0.66%) Informatica
7 1 (0.66%) StreamSets