Data Engineering
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Data Engineering skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Engineering over the 6 months to 5 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
5 May 2024
Same period 2023 Same period 2022
Rank 183 128 172
Rank change year-on-year -55 +44 +84
Permanent jobs citing Data Engineering 1,583 2,848 3,710
As % of all permanent jobs advertised in the UK 1.61% 2.75% 2.37%
As % of the Processes & Methodologies category 1.87% 2.88% 2.48%
Number of salaries quoted 900 1,241 1,510
10th Percentile £41,492 £46,875 £47,500
25th Percentile £55,000 £57,500 £55,225
Median annual salary (50th Percentile) £70,000 £75,000 £75,000
Median % change year-on-year -6.67% - +15.38%
75th Percentile £88,750 £97,500 £90,000
90th Percentile £107,460 £130,000 £108,750
UK excluding London median annual salary £65,000 £60,249 £65,000
% change year-on-year +7.89% -7.31% +13.04%

All Process and Methodology Skills
UK

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 84,624 98,922 149,770
As % of all permanent jobs advertised in the UK 85.89% 95.62% 95.60%
Number of salaries quoted 59,744 58,119 83,346
10th Percentile £29,000 £34,000 £33,500
25th Percentile £40,000 £45,000 £43,750
Median annual salary (50th Percentile) £55,000 £61,500 £60,000
Median % change year-on-year -10.57% +2.50% +9.09%
75th Percentile £72,500 £81,500 £80,000
90th Percentile £92,500 £100,000 £96,250
UK excluding London median annual salary £50,000 £55,000 £52,500
% change year-on-year -9.09% +4.76% +9.38%

Data Engineering
Job Vacancy Trend

Job postings citing Data Engineering as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineering in the UK

Data Engineering
Salary Trend

3-month moving average salary quoted in jobs citing Data Engineering.

Salary trend for Data Engineering in the UK

Data Engineering
Salary Histogram

Salary distribution for jobs citing Data Engineering over the 6 months to 5 May 2024.

Salary histogram for Data Engineering in the UK

Data Engineering
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineering within the UK over the 6 months to 5 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England -54 1,393 £70,000 -6.67% 422
UK excluding London -35 1,049 £65,000 +7.89% 186
Work from Home -87 569 £70,000 - 226
London -71 467 £82,500 -5.71% 245
North of England -38 323 £60,000 - 43
South East +39 202 £67,500 -3.57% 49
North West -27 178 £55,000 +2.33% 30
Midlands -31 169 £57,500 +4.55% 36
South West -25 157 £75,000 +24.48% 23
Scotland -36 121 £70,000 +3.70% 11
West Midlands -50 106 £61,616 +10.03% 24
Yorkshire -38 91 £65,066 -0.44% 6
East Midlands +1 62 £41,996 -23.64% 12
North East +17 54 £75,000 +11.11% 7
East of England -36 48 £70,000 +21.74% 14
Wales +2 20 £97,500 +118.29% 6
Northern Ireland +26 9 £55,000 - 9

Data Engineering
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 178 (11.24%) Apache Spark
2 107 (6.76%) Apache
3 87 (5.50%) Apache Airflow
4 27 (1.71%) Confluence
5 21 (1.33%) SAS
6 20 (1.26%) Jupyter
7 17 (1.07%) nginx
8 2 (0.13%) Apache Pulsar
8 2 (0.13%) Luigi
8 2 (0.13%) SharePoint
Applications
1 28 (1.77%) Microsoft Excel
2 6 (0.38%) Spreadsheet
3 3 (0.19%) Microsoft Office
3 3 (0.19%) MS Visio
3 3 (0.19%) SPSS
Business Applications
1 4 (0.25%) Dynamics CRM
2 1 (0.063%) NetSuite
Cloud Services
1 711 (44.91%) Azure
2 571 (36.07%) GCP
3 565 (35.69%) AWS
4 253 (15.98%) Power Platform
5 176 (11.12%) Azure Data Factory
6 146 (9.22%) Azure DevOps
7 138 (8.72%) Snowflake
8 125 (7.90%) Azure Synapse Analytics
9 98 (6.19%) Amazon S3
10 80 (5.05%) dbt
11 58 (3.66%) Serverless
12 55 (3.47%) Azure Cosmos DB
13 52 (3.28%) GitHub
14 42 (2.65%) AWS Lambda
15 35 (2.21%) SaaS
16 32 (2.02%) Matillion
17 30 (1.90%) Amazon Kinesis
18 25 (1.58%) Amazon EC2
19 22 (1.39%) GitHub Actions
20 19 (1.20%) Cloud Computing
Communications & Networking
1 6 (0.38%) Network Security
2 5 (0.32%) Firewall
3 3 (0.19%) VoIP
3 3 (0.19%) Wi-Fi
4 2 (0.13%) Broadband
4 2 (0.13%) LAN
4 2 (0.13%) WAN
4 2 (0.13%) Wireless
5 1 (0.063%) 3GPP
5 1 (0.063%) 5G
5 1 (0.063%) PPP
5 1 (0.063%) SMS
5 1 (0.063%) VPN
Database & Business Intelligence
1 559 (35.31%) Data Warehouse
2 426 (26.91%) BigQuery
3 378 (23.88%) Looker
4 251 (15.86%) Power BI
5 238 (15.03%) Data Lake
6 150 (9.48%) SQL Server
7 126 (7.96%) Big Data
8 110 (6.95%) Tableau
9 85 (5.37%) Amazon Redshift
10 80 (5.05%) Hadoop
11 71 (4.49%) Relational Database
12 68 (4.30%) SQL Server Integration Services
13 61 (3.85%) NoSQL
14 49 (3.10%) Azure SQL Database
15 48 (3.03%) Metadata
16 44 (2.78%) PostgreSQL
17 43 (2.72%) Star Schema
18 42 (2.65%) SQL Server Reporting Services
19 38 (2.40%) Elasticsearch
19 38 (2.40%) MySQL
Development Applications
1 74 (4.67%) Git
2 68 (4.30%) Jenkins
3 50 (3.16%) GitLab
4 35 (2.21%) JIRA
5 17 (1.07%) Atlassian Bamboo
6 14 (0.88%) CircleCI
7 12 (0.76%) MLflow
7 12 (0.76%) Spinnaker
8 9 (0.57%) ERwin
9 6 (0.38%) Oracle Forms
10 5 (0.32%) ER Studio
11 4 (0.25%) Bitbucket
11 4 (0.25%) Snakemake
12 3 (0.19%) Deequ
12 3 (0.19%) Octopus Deploy
12 3 (0.19%) Visual Studio
13 2 (0.13%) SQL Server Management Studio (SSMS)
14 1 (0.063%) Artifactory
14 1 (0.063%) Mockito
14 1 (0.063%) Postman
General
1 499 (31.52%) Analytical Skills
2 296 (18.70%) Finance
3 268 (16.93%) Social Skills
4 136 (8.59%) Inclusion and Diversity
5 93 (5.87%) Law
6 86 (5.43%) Banking
7 75 (4.74%) Marketing
8 72 (4.55%) Billing
9 67 (4.23%) Retail
10 43 (2.72%) Legal
11 41 (2.59%) Presentation Skills
12 39 (2.46%) Games
13 38 (2.40%) Public Sector
14 22 (1.39%) Influencing Skills
15 13 (0.82%) Telecoms
16 12 (0.76%) Front Office
16 12 (0.76%) Investment Banking
16 12 (0.76%) Retail Banking
17 10 (0.63%) Electronics
17 10 (0.63%) Manufacturing
Job Titles
1 724 (45.74%) Data Engineer
2 258 (16.30%) Senior
3 199 (12.57%) Data Manager
4 193 (12.19%) Principal Engineer
5 183 (11.56%) Lead
6 181 (11.43%) Principal Data Engineer
7 175 (11.05%) Platform Engineer
8 172 (10.87%) Architect
9 155 (9.79%) Data Architect
10 154 (9.73%) Engineering Manager
11 136 (8.59%) Senior Data Engineer
12 83 (5.24%) Lead Data Engineer
13 78 (4.93%) Software Engineer
14 75 (4.74%) Azure Engineer
15 58 (3.66%) Azure Data Engineer
16 57 (3.60%) Developer
17 48 (3.03%) Analyst
18 44 (2.78%) Python Engineer
19 40 (2.53%) Head of Engineering
19 40 (2.53%) Senior Software Engineer
Libraries, Frameworks & Software Standards
1 127 (8.02%) PySpark
2 67 (4.23%) Kafka
3 41 (2.59%) React
4 35 (2.21%) AngularJS
5 33 (2.08%) Apache Beam
5 33 (2.08%) Pandas
6 29 (1.83%) NumPy
7 28 (1.77%) TensorFlow
8 25 (1.58%) Spring
9 23 (1.45%) RESTful
10 21 (1.33%) YAML
11 20 (1.26%) Apache NiFi
12 19 (1.20%) ActiveMQ
12 19 (1.20%) PyTorch
12 19 (1.20%) RabbitMQ
13 18 (1.14%) Elastic Stack
14 17 (1.07%) .NET
14 17 (1.07%) Web Services
15 15 (0.95%) Keras
16 14 (0.88%) REST
Miscellaneous
1 315 (19.90%) Self-Motivation
2 117 (7.39%) Product Ownership
3 81 (5.12%) Data Structures
4 79 (4.99%) Algorithms
5 76 (4.80%) Cloud Native
6 44 (2.78%) Management Information System
7 30 (1.90%) Onboarding
8 24 (1.52%) Greenfield Project
8 24 (1.52%) Hybrid Cloud
9 20 (1.26%) Reference Data
10 18 (1.14%) Distributed Systems
11 17 (1.07%) Public Cloud
12 16 (1.01%) IoT
12 16 (1.01%) Taxonomies
13 15 (0.95%) Client/Server
14 13 (0.82%) NHS
15 10 (0.63%) Mainframe
16 9 (0.57%) Data Protection Act
16 9 (0.57%) Online Games
17 8 (0.51%) Distributed Applications
Operating Systems
1 39 (2.46%) Linux
2 11 (0.69%) Windows
3 5 (0.32%) Windows Server
4 3 (0.19%) Unix
5 1 (0.063%) Red Hat Enterprise Linux
Processes & Methodologies
1 641 (40.49%) ETL
2 625 (39.48%) Agile
3 605 (38.22%) Problem-Solving
4 595 (37.59%) Data Modelling
5 546 (34.49%) Analytics
6 517 (32.66%) Data Pipeline
7 495 (31.27%) Data Science
8 455 (28.74%) Mentoring
9 449 (28.36%) DevOps
10 399 (25.21%) Platform Engineering
11 331 (20.91%) Business Intelligence
12 309 (19.52%) CI/CD
13 302 (19.08%) Data Governance
14 301 (19.01%) Machine Learning
15 271 (17.12%) Data Architecture
16 255 (16.11%) Data Integration
17 254 (16.05%) Visualisation
18 201 (12.70%) DataOps
19 190 (12.00%) Change Management
20 184 (11.62%) Artificial Intelligence
Programming Languages
1 668 (42.20%) SQL
2 630 (39.80%) Python
3 175 (11.05%) Java
4 82 (5.18%) Scala
5 63 (3.98%) T-SQL
6 45 (2.84%) R
7 33 (2.08%) C#
8 27 (1.71%) MATLAB
9 25 (1.58%) Bash
10 23 (1.45%) Go
10 23 (1.45%) Shell Script
11 19 (1.20%) PowerShell
12 18 (1.14%) Data Analysis Expressions
13 12 (0.76%) TypeScript
14 11 (0.69%) C
15 10 (0.63%) Kusto Query Language
15 10 (0.63%) VBA
16 9 (0.57%) Perl
16 9 (0.57%) Ruby
17 8 (0.51%) PL/SQL
Qualifications
1 166 (10.49%) Degree
2 73 (4.61%) Security Cleared
3 67 (4.23%) Computer Science Degree
4 44 (2.78%) DV Cleared
5 38 (2.40%) DBS Check
6 36 (2.27%) Master's Degree
7 32 (2.02%) Azure Certification
8 31 (1.96%) SC Cleared
9 22 (1.39%) Microsoft Certification
10 16 (1.01%) PhD
11 8 (0.51%) PMI Certification
12 6 (0.38%) MBA
12 6 (0.38%) OCP
12 6 (0.38%) Oracle Certification
13 4 (0.25%) AWS Certification
13 4 (0.25%) ISTQB
14 3 (0.19%) AWS Certified Solutions Architect
14 3 (0.19%) PMP
15 2 (0.13%) MCP
16 1 (0.063%) MCSE
Quality Assurance & Compliance
1 357 (22.55%) Data Quality
2 296 (18.70%) GDPR
3 109 (6.89%) QA
4 22 (1.39%) Accessibility
5 10 (0.63%) California Consumer Privacy Act
6 4 (0.25%) ISO/IEC 27001
6 4 (0.25%) Solvency II
7 3 (0.19%) SLA
8 2 (0.13%) COBIT
8 2 (0.13%) Cyber Essentials
8 2 (0.13%) PCI DSS
9 1 (0.063%) Actionable Recommendations
9 1 (0.063%) NCSC
9 1 (0.063%) SNOMED CT
System Software
1 72 (4.55%) Docker
2 11 (0.69%) IAG
3 9 (0.57%) HDFS
4 2 (0.13%) Active Directory
4 2 (0.13%) Apache Flume
4 2 (0.13%) Apache ZooKeeper
4 2 (0.13%) Virtual Machines
Systems Management
1 104 (6.57%) Kubernetes
2 97 (6.13%) Terraform
3 34 (2.15%) Ansible
4 17 (1.07%) Grafana
4 17 (1.07%) HAProxy
4 17 (1.07%) Prometheus
5 7 (0.44%) SysTrack
6 5 (0.32%) logstash
7 3 (0.19%) Argo
7 3 (0.19%) Kubeflow
8 2 (0.13%) Oozie
9 1 (0.063%) Podman
9 1 (0.063%) Progress Chef
9 1 (0.063%) Puppet
9 1 (0.063%) Rancher
Vendors
1 442 (27.92%) Google
2 229 (14.47%) Databricks
3 171 (10.80%) Microsoft
4 64 (4.04%) Oracle
5 27 (1.71%) Informatica
6 24 (1.52%) Teradata
7 19 (1.20%) Cloudera
8 13 (0.82%) SAP
9 10 (0.63%) Alteryx
10 8 (0.51%) Samsung
11 7 (0.44%) Dataiku
11 7 (0.44%) IBM
11 7 (0.44%) ServiceNow
11 7 (0.44%) Snow
12 6 (0.38%) F5
12 6 (0.38%) SnapLogic
13 5 (0.32%) Dell
13 5 (0.32%) OpenAI
13 5 (0.32%) Talend
14 3 (0.19%) Embarcadero