Data Engineering
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Data Engineering skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Engineering over the 6 months to 29 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
29 May 2024
Same period 2023 Same period 2022
Rank 183 132 167
Rank change year-on-year -51 +35 +89
Permanent jobs citing Data Engineering 1,600 2,633 4,246
As % of all permanent jobs advertised in the UK 1.55% 2.71% 2.55%
As % of the Processes & Methodologies category 1.84% 2.84% 2.66%
Number of salaries quoted 921 1,137 1,514
10th Percentile £42,439 £46,250 £47,500
25th Percentile £55,000 £57,500 £55,000
Median annual salary (50th Percentile) £70,000 £75,000 £75,000
Median % change year-on-year -6.67% - +11.11%
75th Percentile £90,000 £96,750 £90,000
90th Percentile £107,456 £130,000 £107,500
UK excluding London median annual salary £65,000 £60,249 £65,000
% change year-on-year +7.89% -7.31% +13.04%

All Process and Methodology Skills
UK

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 86,886 92,843 159,778
As % of all permanent jobs advertised in the UK 84.13% 95.56% 95.90%
Number of salaries quoted 60,763 54,795 82,800
10th Percentile £29,250 £34,000 £33,500
25th Percentile £40,000 £45,000 £43,750
Median annual salary (50th Percentile) £55,000 £60,899 £60,000
Median % change year-on-year -9.69% +1.50% +9.09%
75th Percentile £72,500 £81,250 £80,000
90th Percentile £92,500 £100,000 £96,250
UK excluding London median annual salary £50,000 £55,000 £52,500
% change year-on-year -9.09% +4.76% +9.38%

Data Engineering
Job Vacancy Trend

Job postings citing Data Engineering as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineering in the UK

Data Engineering
Salary Trend

3-month moving average salary quoted in jobs citing Data Engineering.

Salary trend for Data Engineering in the UK

Data Engineering
Salary Histogram

Salary distribution for jobs citing Data Engineering over the 6 months to 29 May 2024.

Salary histogram for Data Engineering in the UK

Data Engineering
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineering within the UK over the 6 months to 29 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England -51 1,415 £70,000 -9.68% 361
UK excluding London -38 1,030 £65,000 +7.89% 150
Work from Home -82 568 £70,000 - 160
London -67 505 £82,500 -2.94% 216
North of England -41 306 £60,000 -7.69% 46
South East +26 202 £67,500 -3.57% 35
Midlands -36 189 £57,500 +4.55% 31
North West -33 169 £55,000 - 29
South West -26 145 £75,000 +17.65% 16
West Midlands -39 120 £59,300 +7.82% 22
Scotland -32 117 £70,000 +16.67% 9
Yorkshire -25 83 £65,066 -2.99% 10
East Midlands -10 67 £45,000 -21.74% 9
North East +24 54 £75,000 +15.38% 7
East of England -51 44 £72,500 +26.09% 9
Wales -6 18 £97,500 +118.29% 4
Northern Ireland +26 9 £55,000 - 2

Data Engineering
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 175 (10.94%) Apache Spark
2 103 (6.44%) Apache
3 92 (5.75%) Apache Airflow
4 26 (1.63%) Confluence
5 25 (1.56%) SAS
6 19 (1.19%) Jupyter
7 16 (1.00%) nginx
8 5 (0.31%) Apache Pulsar
9 3 (0.19%) Luigi
10 2 (0.13%) SharePoint
Applications
1 27 (1.69%) Microsoft Excel
2 6 (0.38%) Spreadsheet
3 5 (0.31%) Microsoft Office
4 3 (0.19%) MS Visio
4 3 (0.19%) SPSS
5 2 (0.13%) Chatbot
Business Applications
1 3 (0.19%) Dynamics CRM
2 1 (0.063%) NetSuite
2 1 (0.063%) SAP ERP
Cloud Services
1 730 (45.63%) Azure
2 561 (35.06%) GCP
3 559 (34.94%) AWS
4 266 (16.63%) Power Platform
5 173 (10.81%) Azure Data Factory
6 146 (9.13%) Azure DevOps
7 141 (8.81%) Snowflake
8 139 (8.69%) Azure Synapse Analytics
9 96 (6.00%) Amazon S3
10 86 (5.38%) dbt
11 57 (3.56%) Azure Cosmos DB
12 53 (3.31%) Serverless
13 42 (2.63%) GitHub
14 37 (2.31%) AWS Lambda
14 37 (2.31%) SaaS
15 33 (2.06%) Matillion
16 29 (1.81%) Amazon EC2
17 27 (1.69%) Amazon Kinesis
18 20 (1.25%) Cloud Computing
19 17 (1.06%) AWS CloudFormation
Communications & Networking
1 6 (0.38%) Network Security
2 5 (0.31%) Firewall
3 3 (0.19%) VoIP
3 3 (0.19%) Wi-Fi
4 2 (0.13%) Broadband
4 2 (0.13%) LAN
4 2 (0.13%) WAN
4 2 (0.13%) Wireless
5 1 (0.063%) 3GPP
5 1 (0.063%) 5G
5 1 (0.063%) PPP
5 1 (0.063%) VPN
Database & Business Intelligence
1 571 (35.69%) Data Warehouse
2 422 (26.38%) BigQuery
3 377 (23.56%) Looker
4 264 (16.50%) Power BI
5 249 (15.56%) Data Lake
6 153 (9.56%) SQL Server
7 129 (8.06%) Big Data
8 116 (7.25%) Tableau
9 88 (5.50%) Amazon Redshift
10 73 (4.56%) Hadoop
11 67 (4.19%) SQL Server Integration Services
12 66 (4.13%) Relational Database
13 62 (3.88%) NoSQL
14 55 (3.44%) Azure SQL Database
15 48 (3.00%) Metadata
16 42 (2.63%) SQL Server Reporting Services
17 40 (2.50%) Amazon Athena
18 39 (2.44%) PostgreSQL
18 39 (2.44%) Star Schema
19 38 (2.38%) Elasticsearch
Development Applications
1 77 (4.81%) Git
2 58 (3.63%) Jenkins
3 50 (3.13%) GitLab
4 33 (2.06%) JIRA
5 16 (1.00%) Atlassian Bamboo
6 15 (0.94%) MLflow
7 13 (0.81%) CircleCI
8 12 (0.75%) Spinnaker
9 8 (0.50%) ERwin
10 6 (0.38%) Oracle Forms
11 5 (0.31%) ER Studio
12 4 (0.25%) Bitbucket
12 4 (0.25%) Snakemake
13 3 (0.19%) Deequ
13 3 (0.19%) Octopus Deploy
14 1 (0.063%) Artifactory
14 1 (0.063%) JMeter
14 1 (0.063%) Postman
14 1 (0.063%) Subversion
14 1 (0.063%) Toad
General
1 512 (32.00%) Analytical Skills
2 289 (18.06%) Finance
3 262 (16.38%) Social Skills
4 139 (8.69%) Inclusion and Diversity
5 94 (5.88%) Law
6 75 (4.69%) Banking
7 72 (4.50%) Billing
8 70 (4.38%) Marketing
9 68 (4.25%) Retail
10 48 (3.00%) Legal
11 41 (2.56%) Presentation Skills
12 39 (2.44%) Games
13 29 (1.81%) Public Sector
14 22 (1.38%) Influencing Skills
15 18 (1.13%) Front Office
16 12 (0.75%) Investment Banking
17 10 (0.63%) Manufacturing
17 10 (0.63%) Pharmaceutical
18 9 (0.56%) Publishing
18 9 (0.56%) Telecoms
Job Titles
1 726 (45.38%) Data Engineer
2 272 (17.00%) Senior
3 198 (12.38%) Data Manager
4 196 (12.25%) Principal Engineer
5 184 (11.50%) Principal Data Engineer
6 178 (11.13%) Lead
7 176 (11.00%) Platform Engineer
8 171 (10.69%) Architect
9 153 (9.56%) Data Architect
9 153 (9.56%) Engineering Manager
10 145 (9.06%) Senior Data Engineer
11 81 (5.06%) Azure Engineer
12 80 (5.00%) Lead Data Engineer
13 79 (4.94%) Software Engineer
14 67 (4.19%) Developer
15 63 (3.94%) Azure Data Engineer
16 50 (3.13%) Analyst
17 49 (3.06%) Python Engineer
18 38 (2.38%) Senior Software Engineer
19 37 (2.31%) Lead Software Engineer
Libraries, Frameworks & Software Standards
1 143 (8.94%) PySpark
2 65 (4.06%) Kafka
3 42 (2.63%) React
4 36 (2.25%) Pandas
5 35 (2.19%) AngularJS
6 34 (2.13%) NumPy
7 29 (1.81%) Apache Beam
7 29 (1.81%) TensorFlow
8 25 (1.56%) Spring
9 23 (1.44%) RabbitMQ
10 22 (1.38%) .NET
11 20 (1.25%) ActiveMQ
11 20 (1.25%) RESTful
11 20 (1.25%) YAML
12 19 (1.19%) PyTorch
13 18 (1.13%) Apache NiFi
14 17 (1.06%) Web Services
15 16 (1.00%) Elastic Stack
15 16 (1.00%) Keras
16 14 (0.88%) REST
Miscellaneous
1 315 (19.69%) Self-Motivation
2 109 (6.81%) Product Ownership
3 87 (5.44%) Data Structures
4 83 (5.19%) Algorithms
5 74 (4.63%) Cloud Native
6 46 (2.88%) Management Information System
7 37 (2.31%) Onboarding
8 23 (1.44%) Hybrid Cloud
9 21 (1.31%) Greenfield Project
9 21 (1.31%) Reference Data
10 15 (0.94%) Client/Server
10 15 (0.94%) Distributed Systems
10 15 (0.94%) NHS
11 14 (0.88%) IoT
12 13 (0.81%) Taxonomies
13 12 (0.75%) Public Cloud
14 10 (0.63%) Mainframe
15 9 (0.56%) Data Protection Act
15 9 (0.56%) Online Games
16 8 (0.50%) Renewable Energy
Operating Systems
1 42 (2.63%) Linux
2 10 (0.63%) Windows
3 5 (0.31%) Windows Server
4 4 (0.25%) Unix
5 1 (0.063%) Red Hat Enterprise Linux
Processes & Methodologies
1 627 (39.19%) ETL
2 616 (38.50%) Agile
3 613 (38.31%) Data Modelling
3 613 (38.31%) Problem-Solving
4 556 (34.75%) Analytics
5 522 (32.63%) Data Pipeline
6 498 (31.13%) Data Science
7 462 (28.88%) Mentoring
8 438 (27.38%) DevOps
9 399 (24.94%) Platform Engineering
10 350 (21.88%) Business Intelligence
11 313 (19.56%) Data Governance
12 312 (19.50%) CI/CD
13 304 (19.00%) Machine Learning
14 271 (16.94%) Data Architecture
15 254 (15.88%) Data Integration
15 254 (15.88%) Visualisation
16 206 (12.88%) DataOps
17 191 (11.94%) Change Management
18 185 (11.56%) Artificial Intelligence
Programming Languages
1 688 (43.00%) SQL
2 642 (40.13%) Python
3 190 (11.88%) Java
4 78 (4.88%) Scala
5 64 (4.00%) T-SQL
6 52 (3.25%) R
7 38 (2.38%) C#
8 30 (1.88%) MATLAB
9 23 (1.44%) Go
9 23 (1.44%) Shell Script
10 22 (1.38%) Bash
10 22 (1.38%) Data Analysis Expressions
11 16 (1.00%) PowerShell
12 11 (0.69%) C
12 11 (0.69%) JavaScript
13 10 (0.63%) Ruby
13 10 (0.63%) VBA
14 9 (0.56%) TypeScript
15 8 (0.50%) Kusto Query Language
15 8 (0.50%) Perl
Qualifications
1 177 (11.06%) Degree
2 67 (4.19%) Computer Science Degree
2 67 (4.19%) Security Cleared
3 42 (2.63%) DBS Check
3 42 (2.63%) DV Cleared
4 39 (2.44%) Master's Degree
5 29 (1.81%) SC Cleared
6 28 (1.75%) Azure Certification
7 24 (1.50%) Microsoft Certification
8 15 (0.94%) PhD
9 8 (0.50%) PMI Certification
10 7 (0.44%) ISTQB
11 6 (0.38%) MBA
12 4 (0.25%) AWS Certification
13 3 (0.19%) AWS Certified Solutions Architect
13 3 (0.19%) PMP
14 2 (0.13%) MCP
15 1 (0.063%) MCSE
15 1 (0.063%) TOGAF Certification
Quality Assurance & Compliance
1 376 (23.50%) Data Quality
2 299 (18.69%) GDPR
3 108 (6.75%) QA
4 26 (1.63%) Accessibility
5 10 (0.63%) California Consumer Privacy Act
6 4 (0.25%) ISO/IEC 27001
6 4 (0.25%) Solvency II
7 3 (0.19%) Actionable Recommendations
7 3 (0.19%) SLA
8 2 (0.13%) COBIT
8 2 (0.13%) Cyber Essentials
8 2 (0.13%) PCI DSS
9 1 (0.063%) NCSC
9 1 (0.063%) SNOMED CT
System Software
1 75 (4.69%) Docker
2 11 (0.69%) IAG
3 8 (0.50%) HDFS
4 4 (0.25%) Active Directory
4 4 (0.25%) Virtual Machines
5 2 (0.13%) Apache ZooKeeper
Systems Management
1 110 (6.88%) Kubernetes
2 100 (6.25%) Terraform
3 36 (2.25%) Ansible
4 16 (1.00%) Grafana
4 16 (1.00%) HAProxy
4 16 (1.00%) Prometheus
5 7 (0.44%) SysTrack
6 5 (0.31%) logstash
7 3 (0.19%) Argo
7 3 (0.19%) Kubeflow
8 2 (0.13%) Oozie
9 1 (0.063%) Podman
9 1 (0.063%) Progress Chef
9 1 (0.063%) Puppet
Vendors
1 438 (27.38%) Google
2 242 (15.13%) Databricks
3 175 (10.94%) Microsoft
4 73 (4.56%) Oracle
5 27 (1.69%) Informatica
6 24 (1.50%) Teradata
7 20 (1.25%) Cloudera
8 10 (0.63%) Alteryx
9 8 (0.50%) Samsung
9 8 (0.50%) SAP
10 7 (0.44%) Dataiku
10 7 (0.44%) ServiceNow
10 7 (0.44%) Snow
11 6 (0.38%) F5
11 6 (0.38%) SnapLogic
12 5 (0.31%) OpenAI
12 5 (0.31%) Salesforce
13 4 (0.25%) Ab Initio
13 4 (0.25%) Dell
13 4 (0.25%) Talend