Period
to

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Engineering skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Engineering over the 6 months to 27 June 2022 with a comparison to the same period in the previous 2 years.

Data Engineering
England > London
6 months to
27 Jun 2022
Same period 2021 Same period 2020
Rank 97 174 246
Rank change year-on-year +77 +72 +87
Permanent jobs citing Data Engineering 2,788 853 453
As % of all permanent jobs advertised in London 3.70% 2.09% 1.37%
As % of the Processes & Methodologies category 3.83% 2.19% 1.45%
Number of salaries quoted 837 627 355
10th Percentile £50,000 £46,250 £50,000
25th Percentile £61,250 £55,000 £59,375
Median annual salary (50th Percentile) £82,500 £77,500 £75,000
Median % change year-on-year +6.45% +3.33% -
75th Percentile £100,000 £87,750 £93,750
90th Percentile £112,500 £95,000 £107,500
England median annual salary £80,000 £70,000 £72,500
% change year-on-year +14.29% -3.45% +3.57%

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for process or methodology skills.

All Process and Methodology Skills
London
Permanent vacancies with a requirement for process or methodology skills 72,706 38,878 31,152
As % of all permanent IT jobs advertised in London 96.59% 95.22% 94.29%
Number of salaries quoted 34,840 26,681 25,456
10th Percentile £42,500 £42,500 £40,000
25th Percentile £53,750 £52,500 £51,250
Median annual salary (50th Percentile) £70,000 £70,000 £67,500
Median % change year-on-year - +3.70% +3.85%
75th Percentile £92,250 £87,500 £85,000
90th Percentile £110,000 £105,000 £102,500
England median annual salary £60,000 £56,000 £55,000
% change year-on-year +7.14% +1.82% +4.76%

Data Engineering
Job Vacancy Trend in London

Job postings citing Data Engineering as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Engineering in London

Data Engineering
Salary Trend in London

3-month moving average salary quoted in jobs citing Data Engineering in London.

Salary trend for Data Engineering in London

Data Engineering
Salary Histogram in London

Salary distribution for jobs citing Data Engineering in London over the 6 months to 27 June 2022.

Salary histogram for Data Engineering in London

Data Engineering
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineering within the London region over the 6 months to 27 June 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
Central London -22 184 £85,000 +6.25% 27
West London -23 34 £72,500 -4.92% 8
South London -44 19 £80,000 +33.33%
East London -39 18 - - 5
North London - 5 - - 1
Data Engineering
England

For the 6 months to 27 June 2022, IT jobs citing Data Engineering also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Data Engineering.

1 1,965 (70.48%) Python
2 1,492 (53.52%) SQL
3 1,447 (51.90%) AWS
4 1,400 (50.22%) Data Science
5 1,329 (47.67%) Analytics
6 1,191 (42.72%) GCP
7 1,181 (42.36%) Agile
8 1,031 (36.98%) Azure
9 875 (31.38%) CI/CD
10 861 (30.88%) Machine Learning
11 804 (28.84%) Data Warehouse
12 791 (28.37%) ETL
13 777 (27.87%) Social Skills
14 760 (27.26%) Java
15 738 (26.47%) Data Pipeline
16 708 (25.39%) Software Engineering
17 706 (25.32%) Big Data
18 680 (24.39%) Analytical Skills
19 679 (24.35%) Business Intelligence
19 679 (24.35%) Finance
20 673 (24.14%) Data Modelling
21 653 (23.42%) Apache Spark
22 628 (22.53%) DevOps
22 628 (22.53%) Kubernetes
23 605 (21.70%) Kafka
24 584 (20.95%) Artificial Intelligence
25 582 (20.88%) Visualisation
26 558 (20.01%) Degree
27 511 (18.33%) Google
28 504 (18.08%) Docker

Data Engineering
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 653 (23.42%) Apache Spark
2 493 (17.68%) Apache Airflow
3 181 (6.49%) Apache
4 65 (2.33%) Apache Pulsar
5 52 (1.87%) Jupyter
5 52 (1.87%) SAS
6 39 (1.40%) Confluence
7 35 (1.26%) Luigi
8 26 (0.93%) Headless CMS
9 20 (0.72%) nginx
9 20 (0.72%) SharePoint
10 19 (0.68%) CMS
11 17 (0.61%) Apache Solr
12 12 (0.43%) Tornado
13 5 (0.18%) Oracle SOA Suite
14 3 (0.11%) Apache Pig
15 1 (0.036%) Apache Synapse
15 1 (0.036%) Ethereum
15 1 (0.036%) IIS
15 1 (0.036%) Pachyderm
Applications
1 58 (2.08%) Microsoft Excel
2 27 (0.97%) Chatbot
3 20 (0.72%) Microsoft PowerPoint
3 20 (0.72%) Stata
4 12 (0.43%) Adobe Creative Suite
5 6 (0.22%) Microsoft Office
5 6 (0.22%) MS Visio
6 2 (0.072%) Microsoft Project
7 1 (0.036%) CPLEX
Business Applications
1 19 (0.68%) Oracle Payables
2 8 (0.29%) FastStats
3 5 (0.18%) JDE OneWorld
3 5 (0.18%) SAP Oil and Gas
4 2 (0.072%) Oracle ERP
4 2 (0.072%) Sparx Enterprise Architect
5 1 (0.036%) NetSuite
Cloud Services
1 1,447 (51.90%) AWS
2 1,191 (42.72%) GCP
3 1,031 (36.98%) Azure
4 418 (14.99%) Power Platform
5 374 (13.41%) Serverless
6 361 (12.95%) Snowflake
7 298 (10.69%) Amazon S3
8 213 (7.64%) Azure Data Factory
9 189 (6.78%) dbt
10 188 (6.74%) GitHub
11 158 (5.67%) Amazon Kinesis
12 155 (5.56%) AWS Lambda
13 131 (4.70%) Amazon EMR
14 126 (4.52%) Cloud Computing
15 121 (4.34%) SaaS
16 113 (4.05%) Azure Synapse Analytics
17 89 (3.19%) Azure DevOps
18 83 (2.98%) Fivetran
19 75 (2.69%) Amazon CloudWatch
20 74 (2.65%) Amazon EC2
Communications & Networking
1 14 (0.50%) Software-Defined Networking
2 13 (0.47%) Network Security
3 12 (0.43%) Broadband
3 12 (0.43%) VPN
4 11 (0.39%) Skype
5 10 (0.36%) HTTP
5 10 (0.36%) Internet
6 6 (0.22%) Firewall
7 4 (0.14%) SSL
8 3 (0.11%) DNS
Database & Business Intelligence
1 804 (28.84%) Data Warehouse
2 706 (25.32%) Big Data
3 463 (16.61%) NoSQL
4 452 (16.21%) Data Lake
5 414 (14.85%) Tableau
6 400 (14.35%) Power BI
7 377 (13.52%) BigQuery
8 331 (11.87%) Hadoop
9 323 (11.59%) Amazon Redshift
10 299 (10.72%) PostgreSQL
11 219 (7.86%) Looker
12 186 (6.67%) Flink
12 186 (6.67%) SQL Server
13 177 (6.35%) Amazon Athena
13 177 (6.35%) Elasticsearch
14 161 (5.77%) MongoDB
15 156 (5.60%) Relational Database
16 133 (4.77%) Apache Hive
17 124 (4.45%) Metadata
18 111 (3.98%) DynamoDB
Development Applications
1 327 (11.73%) Git (software)
2 287 (10.29%) Jenkins
3 164 (5.88%) JIRA
4 67 (2.40%) CircleCI
5 62 (2.22%) webpack
6 60 (2.15%) GitLab
7 56 (2.01%) JUnit
8 43 (1.54%) Atlassian Bamboo
9 42 (1.51%) Maven
10 27 (0.97%) TestNG
11 24 (0.86%) SonarQube
12 20 (0.72%) Gradle
12 20 (0.72%) Mockito
13 19 (0.68%) Mocha
14 15 (0.54%) Visual Studio
15 14 (0.50%) Selenium
16 12 (0.43%) Travis CI
17 11 (0.39%) Postman
17 11 (0.39%) RStudio
17 11 (0.39%) TestRail
General
1 777 (27.87%) Social Skills
2 680 (24.39%) Analytical Skills
3 679 (24.35%) Finance
4 395 (14.17%) Marketing
5 248 (8.90%) Games
6 210 (7.53%) Banking
7 195 (6.99%) Retail
8 181 (6.49%) Inclusion and Diversity
9 137 (4.91%) Advertising
10 106 (3.80%) Organisational Skills
10 106 (3.80%) Presentation Skills
11 75 (2.69%) Public Sector
12 60 (2.15%) Law
13 47 (1.69%) Influencing Skills
14 40 (1.43%) Legal
15 34 (1.22%) Telecoms
16 25 (0.90%) Esports
16 25 (0.90%) Manufacturing
17 16 (0.57%) Publishing
18 15 (0.54%) Documentation Skills
Job Titles
1 1,200 (43.04%) Data Engineer
2 400 (14.35%) Senior Data Engineer
3 216 (7.75%) Software Engineer
4 206 (7.39%) Developer
5 195 (6.99%) Architect
6 155 (5.56%) Principal Engineer
7 139 (4.99%) Data Architect
8 134 (4.81%) Analyst
9 106 (3.80%) Data Scientist
10 97 (3.48%) Data Manager
11 84 (3.01%) Python Developer
12 77 (2.76%) Azure Engineer
13 72 (2.58%) Azure Data Engineer
14 69 (2.47%) Solutions Architect
15 68 (2.44%) Engineering Manager
16 67 (2.40%) Consultant
17 66 (2.37%) Senior Developer
18 59 (2.12%) Python Engineer
19 58 (2.08%) Data Analyst
20 56 (2.01%) AWS Engineer
Libraries, Frameworks & Software Standards
1 605 (21.70%) Kafka
2 243 (8.72%) React
3 196 (7.03%) Pandas
4 179 (6.42%) PySpark
5 165 (5.92%) REST
6 146 (5.24%) AngularJS
7 144 (5.16%) CSS
8 133 (4.77%) Apache Beam
9 127 (4.56%) Node.js
10 123 (4.41%) scikit-learn
11 112 (4.02%) Spring
12 108 (3.87%) GraphQL
12 108 (3.87%) NumPy
13 107 (3.84%) Vue.js
14 103 (3.69%) Flask
15 100 (3.59%) Django
16 99 (3.55%) Apache NiFi
16 99 (3.55%) HTML
17 88 (3.16%) Spark Streaming
18 86 (3.08%) RESTful
Miscellaneous
1 369 (13.24%) Algorithms
2 207 (7.42%) Data Structures
3 149 (5.34%) Cloud Native
4 146 (5.24%) Greenfield Project
5 123 (4.41%) Self-Motivation
6 109 (3.91%) User Experience
7 105 (3.77%) Blog
8 83 (2.98%) FMCG
9 73 (2.62%) IoT
10 72 (2.58%) Public Cloud
11 56 (2.01%) Sports Betting
12 51 (1.83%) Digital Media
13 49 (1.76%) Linux Command Line
14 44 (1.58%) Management Information System
15 41 (1.47%) Marketing Technology
16 35 (1.26%) Online Games
17 33 (1.18%) Analytical Mindset
17 33 (1.18%) Renewable Energy
18 32 (1.15%) Robotics
19 28 (1.00%) NHS
Operating Systems
1 265 (9.51%) Linux
2 44 (1.58%) Unix
3 38 (1.36%) Android
3 38 (1.36%) Apple iOS
4 22 (0.79%) Windows
5 10 (0.36%) Ubuntu
6 8 (0.29%) Red Hat Enterprise Linux
7 4 (0.14%) Alpine Linux
7 4 (0.14%) Windows Server
8 2 (0.072%) Mac OS X
Processes & Methodologies
1 1,400 (50.22%) Data Science
2 1,329 (47.67%) Analytics
3 1,181 (42.36%) Agile
4 875 (31.38%) CI/CD
5 861 (30.88%) Machine Learning
6 791 (28.37%) ETL
7 738 (26.47%) Data Pipeline
8 708 (25.39%) Software Engineering
9 679 (24.35%) Business Intelligence
10 673 (24.14%) Data Modelling
11 628 (22.53%) DevOps
12 584 (20.95%) Artificial Intelligence
13 582 (20.88%) Visualisation
14 493 (17.68%) Problem-Solving
15 471 (16.89%) Computer Science
16 398 (14.28%) Mentoring
17 330 (11.84%) Data Architecture
18 327 (11.73%) Data Analysis
19 315 (11.30%) Data Analytics
20 305 (10.94%) Data Governance
Programming Languages
1 1,965 (70.48%) Python
2 1,492 (53.52%) SQL
3 760 (27.26%) Java
4 431 (15.46%) Scala
5 228 (8.18%) JavaScript
6 186 (6.67%) R
7 162 (5.81%) C#
8 140 (5.02%) TypeScript
9 114 (4.09%) C++
10 108 (3.87%) C
11 106 (3.80%) Bash
12 83 (2.98%) Objective-C
13 82 (2.94%) Ruby
14 63 (2.26%) T-SQL
15 62 (2.22%) Go
16 52 (1.87%) PowerShell
17 43 (1.54%) ES6
18 38 (1.36%) Kotlin
19 21 (0.75%) PHP
20 16 (0.57%) Shell Script
Qualifications
1 558 (20.01%) Degree
2 248 (8.90%) Computer Science Degree
3 114 (4.09%) Master's Degree
4 52 (1.87%) AWS Certification
5 33 (1.18%) PhD
6 25 (0.90%) Microsoft Certification
6 25 (0.90%) Numerate Degree
7 21 (0.75%) TOGAF Certification
8 14 (0.50%) BPSS Clearance
9 13 (0.47%) Sun Certification
10 9 (0.32%) Security Cleared
11 8 (0.29%) SC Cleared
12 7 (0.25%) DBS Check
13 6 (0.22%) PMP
14 4 (0.14%) DV Cleared
15 3 (0.11%) ISTQB
15 3 (0.11%) ISTQB Foundation Certification
16 1 (0.036%) (ISC)2 CCSP
16 1 (0.036%) IISP
16 1 (0.036%) Tableau Certification
Quality Assurance & Compliance
1 279 (10.01%) Data Quality
2 185 (6.64%) QA
3 104 (3.73%) Accessibility
4 50 (1.79%) GDPR
5 25 (0.90%) CDISC
5 25 (0.90%) HL7
6 12 (0.43%) GMP
7 7 (0.25%) ISO/IEC 27001
8 5 (0.18%) NIST
9 4 (0.14%) SLA
10 2 (0.072%) GxP
System Software
1 504 (18.08%) Docker
2 80 (2.87%) Apache Flume
3 13 (0.47%) HDFS
4 12 (0.43%) ISA Server
4 12 (0.43%) Virtual Machines
5 8 (0.29%) Apache ZooKeeper
6 4 (0.14%) VirtualBox
Systems Management
1 628 (22.53%) Kubernetes
2 413 (14.81%) Terraform
3 95 (3.41%) Ansible
4 88 (3.16%) Oozie
5 65 (2.33%) Prometheus
6 34 (1.22%) Grafana
7 29 (1.04%) Opscode Chef
8 23 (0.82%) Puppet
9 13 (0.47%) Rancher
10 10 (0.36%) Istio
11 9 (0.32%) Argo
11 9 (0.32%) Kubeflow
12 7 (0.25%) Docker Swarm
12 7 (0.25%) Kibana
13 1 (0.036%) Control-M
13 1 (0.036%) Rundeck
Vendors
1 511 (18.33%) Google
2 330 (11.84%) Microsoft
3 307 (11.01%) Databricks
4 121 (4.34%) Oracle
5 99 (3.55%) Cloudera
6 71 (2.55%) Alteryx
7 66 (2.37%) Teradata
8 64 (2.30%) Salesforce.com
9 48 (1.72%) Adobe
10 43 (1.54%) Netlify
11 39 (1.40%) Informatica
12 36 (1.29%) Splunk
13 31 (1.11%) Talend
14 29 (1.04%) AppDynamics
14 29 (1.04%) BT
15 28 (1.00%) Twitter
16 26 (0.93%) CA
17 23 (0.82%) DataRobot
18 21 (0.75%) IBM
19 19 (0.68%) SAP