Period
to 3 August 2021

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Engineering skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Engineering over the 6 months to 3 August 2021 with a comparison to the same period in the previous 2 years.

Data Engineering
England > London
6 months to
3 Aug 2021
Same period 2020 Same period 2019
Rank 167 249 319
Rank change year-on-year +82 +70 +165
Permanent jobs citing Data Engineering 1,013 363 563
As % of all permanent jobs advertised in London 2.24% 1.30% 0.98%
As % of the Processes & Methodologies category 2.35% 1.39% 1.05%
Number of salaries quoted 713 282 477
10th Percentile £46,300 £45,125 £52,000
25th Percentile £55,000 £57,500 £62,500
Median annual salary (50th Percentile) £77,500 £74,000 £75,000
Median % change year-on-year +4.73% -1.33% -
75th Percentile £88,750 £93,750 £95,000
90th Percentile £97,500 £107,500 £110,000
England median annual salary £70,000 £67,500 £70,000
% change year-on-year +3.70% -3.57% -

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for process or methodology skills.

All Process and Methodology Skills
London
Permanent vacancies with a requirement for process or methodology skills 43,177 26,200 53,504
As % of all permanent IT jobs advertised in London 95.29% 94.02% 93.59%
Number of salaries quoted 28,577 21,477 43,993
10th Percentile £42,500 £41,250 £36,250
25th Percentile £52,500 £51,250 £47,500
Median annual salary (50th Percentile) £70,000 £69,835 £65,000
Median % change year-on-year +0.24% +7.44% +8.33%
75th Percentile £87,500 £85,000 £82,500
90th Percentile £105,000 £105,000 £97,500
England median annual salary £57,500 £55,000 £52,500
% change year-on-year +4.55% +4.76% +5.00%

Data Engineering
Job Vacancy Trend in London

Job postings citing Data Engineering as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Engineering in London

Data Engineering
Salary Trend in London

3-month moving average salary quoted in jobs citing Data Engineering in London.

Salary trend for Data Engineering in London

Data Engineering
Salary Histogram in London

Salary distribution for jobs citing Data Engineering in London over the 6 months to 3 August 2021.

Salary histogram for Data Engineering in London

Data Engineering
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineering within the London region over the 6 months to 3 August 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +98 179 £80,000 +8.11% 27
South London -6 18 £60,000 -7.69% 1
West London -27 16 £76,250 +17.31% 11
East London -4 3 £65,000 -10.34% 8
North London +14 1 £37,500 -31.82% 1
Data Engineering
England

For the 6 months to 3 August 2021, IT jobs citing Data Engineering also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Data Engineering.

1 668 (65.94%) Python
2 543 (53.60%) Analytics
3 513 (50.64%) SQL
4 504 (49.75%) AWS
5 456 (45.01%) Data Science
6 419 (41.36%) Azure
7 388 (38.30%) ETL
8 350 (34.55%) GCP
9 342 (33.76%) Agile Software Development
10 337 (33.27%) Data Pipeline
11 293 (28.92%) Business Intelligence
12 287 (28.33%) Big Data
13 281 (27.74%) Data Warehouse
14 269 (26.55%) Apache Spark
15 248 (24.48%) Artificial Intelligence
16 242 (23.89%) Software Engineering
17 241 (23.79%) Docker
18 228 (22.51%) DevOps
19 223 (22.01%) Kubernetes
20 219 (21.62%) Java
21 218 (21.52%) Social Skills
22 211 (20.83%) Google
23 209 (20.63%) Data Modelling
23 209 (20.63%) Machine Learning
24 198 (19.55%) Finance
25 193 (19.05%) Hadoop
26 182 (17.97%) Visualisation
27 179 (17.67%) Amazon Redshift
28 177 (17.47%) Power BI
28 177 (17.47%) Power Platform

Data Engineering
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 269 (26.55%) Apache Spark
2 141 (13.92%) Apache Airflow
3 57 (5.63%) Apache
4 42 (4.15%) Elasticsearch
5 36 (3.55%) Luigi
6 17 (1.68%) Gunicorn
7 14 (1.38%) SAS
8 13 (1.28%) Confluence
9 12 (1.18%) Apache Pig
10 8 (0.79%) SharePoint
11 2 (0.20%) CMS
12 1 (0.099%) IBM Domino
12 1 (0.099%) Jupyter
12 1 (0.099%) Tomcat
12 1 (0.099%) Tornado
Applications
1 36 (3.55%) Microsoft Excel
2 6 (0.59%) Microsoft PowerPoint
3 1 (0.099%) Microsoft Office
3 1 (0.099%) MS Visio
Business Applications
1 16 (1.58%) FastStats
2 3 (0.30%) Sentinel
3 2 (0.20%) Oracle EBS
3 2 (0.20%) SAP MDG
Cloud Services
1 504 (49.75%) AWS
2 419 (41.36%) Azure
3 350 (34.55%) GCP
4 177 (17.47%) Power Platform
5 175 (17.28%) Snowflake
6 101 (9.97%) Serverless
7 81 (8.00%) Amazon EMR
8 69 (6.81%) SaaS
9 68 (6.71%) IBM Cloud
10 67 (6.61%) Azure Data Factory
11 50 (4.94%) AWS Lambda
12 42 (4.15%) PaaS
13 36 (3.55%) Cloud Functions
13 36 (3.55%) Google Compute Engine
14 34 (3.36%) Amazon S3
14 34 (3.36%) AWS CloudFormation
15 33 (3.26%) Google App Engine
16 32 (3.16%) Amazon Kinesis
16 32 (3.16%) GitHub
17 29 (2.86%) Google Container Engine
Communications & Networking
1 9 (0.89%) FTP
2 8 (0.79%) IPsec
2 8 (0.79%) VPN
3 7 (0.69%) Broadband
3 7 (0.69%) SSH
4 6 (0.59%) TCP/IP
5 3 (0.30%) 5G
5 3 (0.30%) Internet
6 2 (0.20%) Network Security
6 2 (0.20%) tcpdump
7 1 (0.099%) Extranet
7 1 (0.099%) HTTP
Database & Business Intelligence
1 287 (28.33%) Big Data
2 281 (27.74%) Data Warehouse
3 193 (19.05%) Hadoop
4 179 (17.67%) Amazon Redshift
5 177 (17.47%) Power BI
6 165 (16.29%) NoSQL
7 160 (15.79%) Tableau
8 143 (14.12%) Data Lake
9 111 (10.96%) BigQuery
10 84 (8.29%) Amazon Athena
11 76 (7.50%) Neo4j
12 75 (7.40%) SQL Server
13 74 (7.31%) PostgreSQL
14 70 (6.91%) Relational Database
15 66 (6.52%) Electronic Patient Records
16 55 (5.43%) Looker
16 55 (5.43%) MongoDB
17 52 (5.13%) SQL Server Integration Services
18 40 (3.95%) SQL Server Analysis Services
19 37 (3.65%) Azure SQL Database
Development Applications
1 124 (12.24%) Jenkins
2 94 (9.28%) Git (software)
3 82 (8.09%) Atlassian Bamboo
4 75 (7.40%) Vagrant
5 27 (2.67%) JIRA
6 21 (2.07%) GitLab
7 12 (1.18%) Bitbucket
8 10 (0.99%) TeamCity
8 10 (0.99%) Travis CI
9 8 (0.79%) Team Foundation Server
10 7 (0.69%) CircleCI
10 7 (0.69%) Hudson
10 7 (0.69%) MLflow
11 6 (0.59%) IBM UrbanCode
11 6 (0.59%) Octopus Deploy
12 5 (0.49%) Sonatype Nexus
13 4 (0.39%) Arsenale Dataplane
13 4 (0.39%) Artifactory
13 4 (0.39%) Gradle
13 4 (0.39%) webpack
General
1 218 (21.52%) Social Skills
2 198 (19.55%) Finance
3 138 (13.62%) Analytical Skills
4 107 (10.56%) Marketing
5 67 (6.61%) Retail
6 49 (4.84%) Banking
7 38 (3.75%) Advertising
8 31 (3.06%) Telecoms
9 29 (2.86%) Public Sector
10 21 (2.07%) Brand Awareness
10 21 (2.07%) Electronics
11 20 (1.97%) Presentation Skills
12 19 (1.88%) Manufacturing
13 18 (1.78%) Law
14 16 (1.58%) Italian Language
14 16 (1.58%) Spanish Language
15 15 (1.48%) Games
15 15 (1.48%) Publishing
15 15 (1.48%) Russian Language
16 14 (1.38%) Czech Language
Job Titles
1 418 (41.26%) Data Engineer
2 101 (9.97%) Senior Data Engineer
3 89 (8.79%) Architect
4 77 (7.60%) Developer
5 73 (7.21%) Python Engineer
6 69 (6.81%) Data Architect
7 62 (6.12%) Analyst
8 61 (6.02%) Big Data Engineer
9 58 (5.73%) AWS Engineer
10 55 (5.43%) Software Engineer
11 44 (4.34%) Azure Engineer
12 41 (4.05%) Data Manager
12 41 (4.05%) Platform Engineer
13 40 (3.95%) Consultant
14 35 (3.46%) Platform Architect
15 33 (3.26%) Data Analyst
15 33 (3.26%) Data Scientist
16 28 (2.76%) Machine Learning Engineer
17 27 (2.67%) Data Analytics Engineer
18 25 (2.47%) Head of Engineering
Libraries, Frameworks & Software Standards
1 161 (15.89%) Kafka
2 83 (8.19%) Spark Streaming
3 79 (7.80%) React
4 78 (7.70%) REST
5 69 (6.81%) Node.js
6 65 (6.42%) PySpark
7 37 (3.65%) Pandas
8 36 (3.55%) AngularJS
8 36 (3.55%) TensorFlow
9 35 (3.46%) Apache Beam
10 34 (3.36%) NumPy
11 33 (3.26%) GraphQL
12 27 (2.67%) gRPC
13 26 (2.57%) HTML
13 26 (2.57%) Web Services
14 25 (2.47%) Redux
15 23 (2.27%) JSON
16 21 (2.07%) Vue.js
17 20 (1.97%) D3.js
17 20 (1.97%) MDX
Miscellaneous
1 84 (8.29%) Algorithms
2 57 (5.63%) Data Structures
3 56 (5.53%) Greenfield Project
4 42 (4.15%) User Experience
5 33 (3.26%) Management Information System
6 23 (2.27%) Social Media
7 22 (2.17%) Virtual Team
8 21 (2.07%) Cloud Native
8 21 (2.07%) Marketing Technology
9 19 (1.88%) Acoustics
10 17 (1.68%) Linux Command Line
10 17 (1.68%) Renewable Energy
11 14 (1.38%) Mobile App
12 11 (1.09%) Blog
12 11 (1.09%) Data Centre
12 11 (1.09%) Self-Motivation
13 9 (0.89%) Hedge funds
14 8 (0.79%) FMCG
14 8 (0.79%) SCADA
15 7 (0.69%) Enterprise Software
Operating Systems
1 78 (7.70%) Linux
2 28 (2.76%) Unix
3 13 (1.28%) Windows
4 12 (1.18%) Apple iOS
5 9 (0.89%) SUSE Linux Enterprise Server
6 8 (0.79%) Android
7 6 (0.59%) Mesosphere
8 4 (0.39%) watchOS
9 1 (0.099%) OS/2
9 1 (0.099%) Windows Server
9 1 (0.099%) Windows Server 2012
Processes & Methodologies
1 543 (53.60%) Analytics
2 456 (45.01%) Data Science
3 388 (38.30%) ETL
4 342 (33.76%) Agile Software Development
5 337 (33.27%) Data Pipeline
6 293 (28.92%) Business Intelligence
7 248 (24.48%) Artificial Intelligence
8 242 (23.89%) Software Engineering
9 228 (22.51%) DevOps
10 209 (20.63%) Data Modelling
10 209 (20.63%) Machine Learning
11 182 (17.97%) Visualisation
12 141 (13.92%) Data Architecture
13 126 (12.44%) Data Management
13 126 (12.44%) Data Visualisation
14 123 (12.14%) Project Management
15 114 (11.25%) Configuration Management
16 104 (10.27%) Continuous Integration
17 100 (9.87%) Data Analytics
17 100 (9.87%) Microservices
Programming Languages
1 668 (65.94%) Python
2 513 (50.64%) SQL
3 219 (21.62%) Java
4 108 (10.66%) JavaScript
5 100 (9.87%) Scala
6 79 (7.80%) R
7 36 (3.55%) Go
8 34 (3.36%) Kotlin
9 33 (3.26%) Bash Shell
10 30 (2.96%) PowerShell
11 29 (2.86%) C#
12 26 (2.57%) T-SQL
13 21 (2.07%) Ruby
14 20 (1.97%) Data Analysis Expressions (DAX)
15 18 (1.78%) C++
16 17 (1.68%) TypeScript
17 12 (1.18%) Shell Script
18 10 (0.99%) Apple Swift
18 10 (0.99%) C
19 8 (0.79%) LookML
Qualifications
1 81 (8.00%) Degree
2 23 (2.27%) Computer Science Degree
2 23 (2.27%) Security Cleared
3 19 (1.88%) PhD
4 8 (0.79%) SC Cleared
5 6 (0.59%) Master's Degree
6 3 (0.30%) AWS Certification
6 3 (0.30%) DV Cleared
6 3 (0.30%) TOGAF Certification
7 2 (0.20%) BPSS Clearance
8 1 (0.099%) Microsoft Certification
8 1 (0.099%) Numerate Degree
8 1 (0.099%) SAS Certification
8 1 (0.099%) Tableau Certification
Quality Assurance & Compliance
1 61 (6.02%) Data Quality
2 35 (3.46%) GDPR
3 25 (2.47%) QA
4 17 (1.68%) GRC
5 11 (1.09%) SLA
6 7 (0.69%) HIPAA
7 6 (0.59%) Accessibility
8 3 (0.30%) AIFMD
8 3 (0.30%) MiFID
9 1 (0.099%) PMO
System Software
1 241 (23.79%) Docker
2 68 (6.71%) VirtualBox
3 11 (1.09%) HDFS
4 9 (0.89%) Virtual Machines
5 3 (0.30%) Apache ZooKeeper
6 1 (0.099%) Active Directory
Systems Management
1 223 (22.01%) Kubernetes
2 146 (14.41%) Terraform
3 107 (10.56%) Ansible
4 75 (7.40%) Docker Swarm
5 43 (4.24%) Puppet
6 35 (3.46%) Opscode Chef
7 12 (1.18%) Kubeflow
8 11 (1.09%) Prometheus
9 9 (0.89%) Hadoop YARN
10 8 (0.79%) Grafana
11 7 (0.69%) Consul
11 7 (0.69%) Packer
11 7 (0.69%) Salt
12 6 (0.59%) Automic
12 6 (0.59%) Graphite
12 6 (0.59%) Kibana
12 6 (0.59%) logstash
12 6 (0.59%) Nagios
12 6 (0.59%) Opsview
12 6 (0.59%) ZABBIX
Vendors
1 211 (20.83%) Google
2 105 (10.37%) Microsoft
3 91 (8.98%) Databricks
4 87 (8.59%) Cloudera
5 84 (8.29%) IBM
6 79 (7.80%) Informatica
7 78 (7.70%) Hortonworks
8 75 (7.40%) Talend
9 28 (2.76%) Salesforce.com
10 20 (1.97%) SAP
11 17 (1.68%) Adobe
12 16 (1.58%) Apteco
12 16 (1.58%) Salesforce Marketing Cloud
13 14 (1.38%) Oracle
13 14 (1.38%) Teradata
14 9 (0.89%) Dataiku
15 8 (0.79%) Alteryx
16 7 (0.69%) Splunk
16 7 (0.69%) StreamSets
17 4 (0.39%) Alibaba