Data Engineering
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Data Engineering skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Engineering over the 6 months to 23 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
23 Apr 2024
Same period 2023 Same period 2022
Rank 180 120 176
Rank change year-on-year -60 +56 +75
Permanent jobs citing Data Engineering 1,576 3,074 3,514
As % of all permanent jobs advertised in the UK 1.61% 2.91% 2.28%
As % of the Processes & Methodologies category 1.87% 3.04% 2.39%
Number of salaries quoted 882 1,241 1,503
10th Percentile £41,492 £47,500 £47,100
25th Percentile £55,000 £57,500 £55,000
Median annual salary (50th Percentile) £70,000 £75,000 £75,000
Median % change year-on-year -6.67% - +15.38%
75th Percentile £88,750 £97,500 £90,000
90th Percentile £107,500 £130,000 £107,500
UK excluding London median annual salary £65,000 £61,180 £65,000
% change year-on-year +6.24% -5.88% +13.04%

All Process and Methodology Skills
UK

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 84,165 101,093 147,090
As % of all permanent jobs advertised in the UK 86.12% 95.64% 95.55%
Number of salaries quoted 59,702 59,212 83,288
10th Percentile £29,000 £34,000 £33,496
25th Percentile £40,000 £45,000 £43,750
Median annual salary (50th Percentile) £55,000 £61,600 £60,000
Median % change year-on-year -10.71% +2.67% +9.09%
75th Percentile £72,500 £82,500 £80,000
90th Percentile £92,500 £100,000 £96,250
UK excluding London median annual salary £50,000 £55,000 £52,500
% change year-on-year -9.09% +4.76% +9.38%

Data Engineering
Job Vacancy Trend

Job postings citing Data Engineering as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineering in the UK

Data Engineering
Salary Trend

3-month moving average salary quoted in jobs citing Data Engineering.

Salary trend for Data Engineering in the UK

Data Engineering
Salary Histogram

Salary distribution for jobs citing Data Engineering over the 6 months to 23 April 2024.

Salary histogram for Data Engineering in the UK

Data Engineering
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineering within the UK over the 6 months to 23 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England -61 1,386 £70,000 -9.68% 321
UK excluding London -59 1,040 £65,000 +6.24% 137
Work from Home -83 563 £70,000 - 150
London -71 471 £81,500 -9.44% 185
North of England -52 320 £60,000 - 47
South East +32 202 £67,500 -3.57% 30
North West -51 173 £55,000 +4.76% 35
South West -12 160 £75,000 +14.50% 10
Midlands -59 157 £57,500 - 24
Scotland -47 119 £70,000 +3.70% 10
West Midlands -58 99 £59,300 +3.13% 13
Yorkshire -39 95 £65,066 +0.10% 8
East Midlands -9 57 £41,492 -24.56% 11
North East +26 52 £75,000 +11.11% 4
East of England -32 51 £70,000 +21.74% 12
Wales -8 22 £97,500 +118.29% 6
Northern Ireland +22 9 £55,000 - 3

Data Engineering
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 183 (11.61%) Apache Spark
2 119 (7.55%) Apache
3 89 (5.65%) Apache Airflow
4 26 (1.65%) Confluence
5 22 (1.40%) SAS
6 21 (1.33%) Jupyter
7 18 (1.14%) nginx
8 4 (0.25%) SharePoint
9 2 (0.13%) Luigi
9 2 (0.13%) Microsoft Exchange
Applications
1 30 (1.90%) Microsoft Excel
2 6 (0.38%) Spreadsheet
3 5 (0.32%) Microsoft Office
3 5 (0.32%) MS Visio
4 3 (0.19%) SPSS
Business Applications
1 4 (0.25%) Dynamics CRM
2 1 (0.063%) NetSuite
Cloud Services
1 704 (44.67%) Azure
2 571 (36.23%) GCP
3 570 (36.17%) AWS
4 266 (16.88%) Power Platform
5 174 (11.04%) Azure Data Factory
6 139 (8.82%) Snowflake
7 137 (8.69%) Azure DevOps
8 119 (7.55%) Azure Synapse Analytics
9 104 (6.60%) Amazon S3
10 80 (5.08%) dbt
11 59 (3.74%) Serverless
12 58 (3.68%) GitHub
13 53 (3.36%) Azure Cosmos DB
14 46 (2.92%) AWS Lambda
15 34 (2.16%) SaaS
16 32 (2.03%) Matillion
17 31 (1.97%) Amazon Kinesis
18 28 (1.78%) GitHub Actions
19 27 (1.71%) Amazon EC2
20 18 (1.14%) OpenShift
Communications & Networking
1 6 (0.38%) Network Security
2 5 (0.32%) Firewall
3 3 (0.19%) VoIP
3 3 (0.19%) Wi-Fi
4 2 (0.13%) Broadband
4 2 (0.13%) LAN
4 2 (0.13%) WAN
4 2 (0.13%) Wireless
5 1 (0.063%) 3GPP
5 1 (0.063%) 5G
5 1 (0.063%) PPP
5 1 (0.063%) SMS
5 1 (0.063%) VPN
Database & Business Intelligence
1 543 (34.45%) Data Warehouse
2 430 (27.28%) BigQuery
3 384 (24.37%) Looker
4 264 (16.75%) Power BI
5 242 (15.36%) Data Lake
6 145 (9.20%) SQL Server
7 135 (8.57%) Big Data
8 123 (7.80%) Tableau
9 84 (5.33%) Hadoop
10 82 (5.20%) Amazon Redshift
11 74 (4.70%) Relational Database
12 67 (4.25%) NoSQL
12 67 (4.25%) SQL Server Integration Services
13 49 (3.11%) PostgreSQL
14 48 (3.05%) Metadata
15 46 (2.92%) Azure SQL Database
16 45 (2.86%) SQL Server Reporting Services
17 44 (2.79%) MySQL
17 44 (2.79%) Star Schema
18 38 (2.41%) Elasticsearch
Development Applications
1 76 (4.82%) Jenkins
2 71 (4.51%) Git
3 46 (2.92%) GitLab
4 36 (2.28%) JIRA
5 18 (1.14%) Atlassian Bamboo
6 13 (0.82%) CircleCI
7 12 (0.76%) MLflow
8 11 (0.70%) Spinnaker
9 10 (0.63%) ERwin
10 6 (0.38%) Oracle Forms
11 5 (0.32%) ER Studio
12 4 (0.25%) Bitbucket
12 4 (0.25%) Snakemake
13 3 (0.19%) Deequ
13 3 (0.19%) Octopus Deploy
13 3 (0.19%) Visual Studio
14 2 (0.13%) SQL Server Management Studio (SSMS)
15 1 (0.063%) Artifactory
15 1 (0.063%) Postman
15 1 (0.063%) SoapUI
General
1 512 (32.49%) Analytical Skills
2 306 (19.42%) Finance
3 277 (17.58%) Social Skills
4 130 (8.25%) Inclusion and Diversity
5 92 (5.84%) Banking
6 89 (5.65%) Law
7 79 (5.01%) Marketing
8 75 (4.76%) Retail
9 72 (4.57%) Billing
10 44 (2.79%) Presentation Skills
11 41 (2.60%) Legal
12 40 (2.54%) Public Sector
13 39 (2.47%) Games
14 24 (1.52%) Influencing Skills
15 13 (0.82%) Telecoms
16 12 (0.76%) Retail Banking
17 10 (0.63%) Electronics
17 10 (0.63%) Front Office
17 10 (0.63%) Manufacturing
18 9 (0.57%) Investment Banking
Job Titles
1 719 (45.62%) Data Engineer
2 255 (16.18%) Senior
3 196 (12.44%) Data Manager
4 192 (12.18%) Principal Engineer
5 183 (11.61%) Lead
6 180 (11.42%) Principal Data Engineer
7 176 (11.17%) Platform Engineer
8 172 (10.91%) Architect
9 155 (9.84%) Data Architect
9 155 (9.84%) Engineering Manager
10 132 (8.38%) Senior Data Engineer
11 81 (5.14%) Lead Data Engineer
12 77 (4.89%) Software Engineer
13 67 (4.25%) Azure Engineer
14 56 (3.55%) Developer
15 54 (3.43%) Azure Data Engineer
16 47 (2.98%) Head of Engineering
17 46 (2.92%) Python Engineer
18 45 (2.86%) Analyst
19 41 (2.60%) Senior Software Engineer
Libraries, Frameworks & Software Standards
1 123 (7.80%) PySpark
2 80 (5.08%) Kafka
3 41 (2.60%) React
4 36 (2.28%) Pandas
5 35 (2.22%) AngularJS
5 35 (2.22%) Apache Beam
6 29 (1.84%) NumPy
7 27 (1.71%) TensorFlow
8 24 (1.52%) Spring
9 22 (1.40%) RESTful
10 21 (1.33%) Apache NiFi
10 21 (1.33%) YAML
11 20 (1.27%) ActiveMQ
12 19 (1.21%) Elastic Stack
13 18 (1.14%) PyTorch
13 18 (1.14%) RabbitMQ
14 17 (1.08%) .NET
15 15 (0.95%) Web Services
16 14 (0.89%) Keras
16 14 (0.89%) REST
Miscellaneous
1 317 (20.11%) Self-Motivation
2 118 (7.49%) Product Ownership
3 79 (5.01%) Algorithms
4 75 (4.76%) Data Structures
5 71 (4.51%) Cloud Native
6 42 (2.66%) Management Information System
7 28 (1.78%) Greenfield Project
8 26 (1.65%) Onboarding
9 24 (1.52%) Hybrid Cloud
10 20 (1.27%) Distributed Systems
11 17 (1.08%) Public Cloud
12 16 (1.02%) Reference Data
12 16 (1.02%) Taxonomies
13 15 (0.95%) Client/Server
13 15 (0.95%) IoT
14 14 (0.89%) NHS
15 10 (0.63%) Mainframe
16 9 (0.57%) Data Protection Act
16 9 (0.57%) Online Games
17 8 (0.51%) Distributed Applications
Operating Systems
1 37 (2.35%) Linux
2 11 (0.70%) Windows
3 5 (0.32%) Windows Server
4 3 (0.19%) Unix
5 1 (0.063%) Red Hat Enterprise Linux
Processes & Methodologies
1 640 (40.61%) ETL
2 635 (40.29%) Agile
3 609 (38.64%) Problem-Solving
4 577 (36.61%) Data Modelling
5 548 (34.77%) Analytics
6 519 (32.93%) Data Pipeline
7 493 (31.28%) Data Science
8 449 (28.49%) Mentoring
9 445 (28.24%) DevOps
10 399 (25.32%) Platform Engineering
11 334 (21.19%) Business Intelligence
12 309 (19.61%) CI/CD
13 308 (19.54%) Machine Learning
14 286 (18.15%) Data Governance
15 265 (16.81%) Data Integration
16 257 (16.31%) Data Architecture
16 257 (16.31%) Visualisation
17 200 (12.69%) DataOps
18 188 (11.93%) Artificial Intelligence
19 185 (11.74%) Change Management
Programming Languages
1 661 (41.94%) SQL
2 626 (39.72%) Python
3 170 (10.79%) Java
4 85 (5.39%) Scala
5 59 (3.74%) T-SQL
6 48 (3.05%) R
7 32 (2.03%) C#
8 26 (1.65%) Bash
8 26 (1.65%) MATLAB
9 24 (1.52%) Shell Script
10 22 (1.40%) Go
11 19 (1.21%) Data Analysis Expressions
12 18 (1.14%) PowerShell
13 12 (0.76%) TypeScript
14 11 (0.70%) C
15 10 (0.63%) VBA
16 9 (0.57%) Kusto Query Language
16 9 (0.57%) Perl
17 8 (0.51%) JavaScript
17 8 (0.51%) PL/SQL
Qualifications
1 175 (11.10%) Degree
2 75 (4.76%) Security Cleared
3 72 (4.57%) Computer Science Degree
4 45 (2.86%) DV Cleared
5 44 (2.79%) Master's Degree
6 34 (2.16%) DBS Check
7 32 (2.03%) SC Cleared
8 29 (1.84%) Azure Certification
9 22 (1.40%) Microsoft Certification
10 16 (1.02%) PhD
11 9 (0.57%) PMI Certification
12 7 (0.44%) MBA
13 6 (0.38%) OCP
13 6 (0.38%) Oracle Certification
14 4 (0.25%) AWS Certification
14 4 (0.25%) ISTQB
15 3 (0.19%) AWS Certified Solutions Architect
15 3 (0.19%) PMP
16 2 (0.13%) MCP
17 1 (0.063%) MCSE
Quality Assurance & Compliance
1 355 (22.53%) Data Quality
2 295 (18.72%) GDPR
3 109 (6.92%) QA
4 16 (1.02%) Accessibility
5 9 (0.57%) California Consumer Privacy Act
6 6 (0.38%) ISO/IEC 27001
7 4 (0.25%) Solvency II
8 3 (0.19%) SLA
9 2 (0.13%) COBIT
9 2 (0.13%) Cyber Essentials
9 2 (0.13%) PCI DSS
10 1 (0.063%) Actionable Recommendations
10 1 (0.063%) HIPAA
10 1 (0.063%) NCSC
10 1 (0.063%) SNOMED CT
System Software
1 70 (4.44%) Docker
2 11 (0.70%) IAG
3 10 (0.63%) HDFS
4 2 (0.13%) Apache Flume
4 2 (0.13%) Apache ZooKeeper
Systems Management
1 99 (6.28%) Terraform
2 95 (6.03%) Kubernetes
3 32 (2.03%) Ansible
4 18 (1.14%) Grafana
4 18 (1.14%) HAProxy
4 18 (1.14%) Prometheus
5 7 (0.44%) SysTrack
6 5 (0.32%) logstash
7 3 (0.19%) Argo
7 3 (0.19%) Kubeflow
8 2 (0.13%) Oozie
9 1 (0.063%) Podman
9 1 (0.063%) Progress Chef
9 1 (0.063%) Puppet
9 1 (0.063%) Rancher
Vendors
1 450 (28.55%) Google
2 227 (14.40%) Databricks
3 174 (11.04%) Microsoft
4 61 (3.87%) Oracle
5 30 (1.90%) Informatica
6 26 (1.65%) Teradata
7 20 (1.27%) Cloudera
8 13 (0.82%) SAP
9 11 (0.70%) Alteryx
10 9 (0.57%) IBM
11 8 (0.51%) Samsung
11 8 (0.51%) ServiceNow
12 7 (0.44%) Dataiku
12 7 (0.44%) Snow
13 6 (0.38%) F5
13 6 (0.38%) SnapLogic
14 5 (0.32%) Dell
14 5 (0.32%) OpenAI
14 5 (0.32%) Talend
15 3 (0.19%) Confluent