Data Engineering
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Data Engineering skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Engineering over the 6 months to 19 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
19 Apr 2024
Same period 2023 Same period 2022
Rank 186 113 184
Rank change year-on-year -73 +71 +72
Permanent jobs citing Data Engineering 1,577 3,278 3,440
As % of all permanent jobs advertised in the UK 1.62% 3.08% 2.25%
As % of the Processes & Methodologies category 1.88% 3.22% 2.35%
Number of salaries quoted 881 1,244 1,510
10th Percentile £41,492 £47,500 £45,975
25th Percentile £55,000 £57,500 £53,978
Median annual salary (50th Percentile) £70,000 £75,000 £75,000
Median % change year-on-year -6.67% - +15.38%
75th Percentile £88,250 £97,500 £90,000
90th Percentile £107,500 £130,000 £107,500
UK excluding London median annual salary £65,000 £61,833 £65,000
% change year-on-year +5.12% -4.87% +13.04%

All Process and Methodology Skills
UK

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 83,814 101,905 146,218
As % of all permanent jobs advertised in the UK 86.22% 95.67% 95.49%
Number of salaries quoted 59,590 59,680 83,719
10th Percentile £29,000 £34,000 £33,250
25th Percentile £40,000 £45,000 £43,750
Median annual salary (50th Percentile) £55,000 £61,500 £60,000
Median % change year-on-year -10.57% +2.50% +9.09%
75th Percentile £72,500 £82,500 £80,000
90th Percentile £92,500 £100,000 £96,250
UK excluding London median annual salary £50,000 £54,882 £52,500
% change year-on-year -8.90% +4.54% +9.38%

Data Engineering
Job Vacancy Trend

Job postings citing Data Engineering as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineering in the UK

Data Engineering
Salary Trend

3-month moving average salary quoted in jobs citing Data Engineering.

Salary trend for Data Engineering in the UK

Data Engineering
Salary Histogram

Salary distribution for jobs citing Data Engineering over the 6 months to 19 April 2024.

Salary histogram for Data Engineering in the UK

Data Engineering
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineering within the UK over the 6 months to 19 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England -66 1,388 £70,000 -9.68% 326
UK excluding London -69 1,044 £65,000 +5.12% 142
Work from Home -82 566 £70,000 - 150
London -68 468 £81,500 -9.44% 187
North of England -59 321 £60,000 - 44
South East +11 201 £67,500 -3.57% 26
North West -61 174 £55,000 +2.33% 35
South West -14 162 £75,000 +9.49% 14
Midlands -72 158 £57,500 - 32
Scotland -58 119 £70,000 +3.70% 10
West Midlands -65 100 £59,300 +0.94% 20
Yorkshire -42 95 £65,066 +0.10% 6
East Midlands -18 57 £41,492 -24.56% 12
North East +18 52 £75,000 +11.11% 3
East of England -41 52 £70,000 +21.74% 12
Wales -3 22 £97,500 +118.29% 7
Northern Ireland +26 9 £55,000 - 3

Data Engineering
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 183 (11.60%) Apache Spark
2 119 (7.55%) Apache
3 89 (5.64%) Apache Airflow
4 26 (1.65%) Confluence
5 21 (1.33%) SAS
6 19 (1.20%) Jupyter
7 17 (1.08%) nginx
8 4 (0.25%) SharePoint
9 2 (0.13%) Luigi
9 2 (0.13%) Microsoft Exchange
Applications
1 30 (1.90%) Microsoft Excel
2 6 (0.38%) Spreadsheet
3 5 (0.32%) Microsoft Office
4 4 (0.25%) MS Visio
5 3 (0.19%) SPSS
Business Applications
1 4 (0.25%) Dynamics CRM
2 1 (0.063%) NetSuite
Cloud Services
1 700 (44.39%) Azure
2 572 (36.27%) AWS
3 570 (36.14%) GCP
4 265 (16.80%) Power Platform
5 172 (10.91%) Azure Data Factory
6 138 (8.75%) Azure DevOps
6 138 (8.75%) Snowflake
7 117 (7.42%) Azure Synapse Analytics
8 103 (6.53%) Amazon S3
9 80 (5.07%) dbt
10 59 (3.74%) Serverless
11 58 (3.68%) GitHub
12 52 (3.30%) Azure Cosmos DB
13 46 (2.92%) AWS Lambda
14 34 (2.16%) SaaS
15 32 (2.03%) Amazon Kinesis
15 32 (2.03%) Matillion
16 28 (1.78%) GitHub Actions
17 27 (1.71%) Amazon EC2
18 20 (1.27%) OpenShift
Communications & Networking
1 6 (0.38%) Network Security
2 5 (0.32%) Firewall
3 3 (0.19%) VoIP
3 3 (0.19%) Wi-Fi
4 2 (0.13%) Broadband
4 2 (0.13%) LAN
4 2 (0.13%) WAN
4 2 (0.13%) Wireless
5 1 (0.063%) 3GPP
5 1 (0.063%) 5G
5 1 (0.063%) PPP
5 1 (0.063%) SMS
5 1 (0.063%) VPN
Database & Business Intelligence
1 543 (34.43%) Data Warehouse
2 430 (27.27%) BigQuery
3 384 (24.35%) Looker
4 263 (16.68%) Power BI
5 242 (15.35%) Data Lake
6 146 (9.26%) SQL Server
7 137 (8.69%) Big Data
8 123 (7.80%) Tableau
9 84 (5.33%) Hadoop
10 83 (5.26%) Amazon Redshift
11 76 (4.82%) Relational Database
12 67 (4.25%) NoSQL
13 66 (4.19%) SQL Server Integration Services
14 49 (3.11%) PostgreSQL
15 48 (3.04%) Metadata
16 45 (2.85%) SQL Server Reporting Services
17 44 (2.79%) MySQL
17 44 (2.79%) Star Schema
18 43 (2.73%) Azure SQL Database
19 38 (2.41%) Elasticsearch
Development Applications
1 75 (4.76%) Jenkins
2 71 (4.50%) Git
3 46 (2.92%) GitLab
4 36 (2.28%) JIRA
5 17 (1.08%) Atlassian Bamboo
6 13 (0.82%) CircleCI
7 11 (0.70%) MLflow
7 11 (0.70%) Spinnaker
8 9 (0.57%) ERwin
9 6 (0.38%) Oracle Forms
10 4 (0.25%) Bitbucket
10 4 (0.25%) ER Studio
10 4 (0.25%) Snakemake
11 3 (0.19%) Deequ
11 3 (0.19%) Octopus Deploy
11 3 (0.19%) Visual Studio
12 2 (0.13%) SQL Server Management Studio (SSMS)
13 1 (0.063%) JMeter
13 1 (0.063%) Selenium
13 1 (0.063%) Toad
General
1 512 (32.47%) Analytical Skills
2 311 (19.72%) Finance
3 277 (17.56%) Social Skills
4 133 (8.43%) Inclusion and Diversity
5 93 (5.90%) Banking
6 89 (5.64%) Law
7 80 (5.07%) Marketing
8 75 (4.76%) Retail
9 72 (4.57%) Billing
10 43 (2.73%) Presentation Skills
11 41 (2.60%) Legal
11 41 (2.60%) Public Sector
12 39 (2.47%) Games
13 24 (1.52%) Influencing Skills
14 13 (0.82%) Telecoms
15 12 (0.76%) Retail Banking
16 10 (0.63%) Electronics
16 10 (0.63%) Front Office
16 10 (0.63%) Manufacturing
17 9 (0.57%) Investment Banking
Job Titles
1 723 (45.85%) Data Engineer
2 254 (16.11%) Senior
3 193 (12.24%) Data Manager
3 193 (12.24%) Principal Engineer
4 187 (11.86%) Lead
5 181 (11.48%) Principal Data Engineer
6 176 (11.16%) Platform Engineer
7 171 (10.84%) Architect
8 154 (9.77%) Data Architect
8 154 (9.77%) Engineering Manager
9 130 (8.24%) Senior Data Engineer
10 84 (5.33%) Lead Data Engineer
11 78 (4.95%) Software Engineer
12 66 (4.19%) Azure Engineer
13 56 (3.55%) Developer
14 53 (3.36%) Azure Data Engineer
15 47 (2.98%) Head of Engineering
15 47 (2.98%) Python Engineer
16 44 (2.79%) Analyst
17 42 (2.66%) Senior Software Engineer
Libraries, Frameworks & Software Standards
1 123 (7.80%) PySpark
2 81 (5.14%) Kafka
3 41 (2.60%) React
4 36 (2.28%) Pandas
5 35 (2.22%) Apache Beam
6 34 (2.16%) AngularJS
7 29 (1.84%) NumPy
8 27 (1.71%) TensorFlow
9 24 (1.52%) Spring
10 22 (1.40%) RESTful
11 20 (1.27%) Apache NiFi
11 20 (1.27%) YAML
12 19 (1.20%) ActiveMQ
13 18 (1.14%) Elastic Stack
13 18 (1.14%) PyTorch
14 17 (1.08%) RabbitMQ
15 16 (1.01%) .NET
16 15 (0.95%) Web Services
17 14 (0.89%) Keras
17 14 (0.89%) REST
Miscellaneous
1 319 (20.23%) Self-Motivation
2 119 (7.55%) Product Ownership
3 82 (5.20%) Algorithms
4 76 (4.82%) Data Structures
5 70 (4.44%) Cloud Native
6 40 (2.54%) Management Information System
7 28 (1.78%) Greenfield Project
8 27 (1.71%) Onboarding
9 23 (1.46%) Hybrid Cloud
10 21 (1.33%) Distributed Systems
11 18 (1.14%) Public Cloud
12 16 (1.01%) Reference Data
12 16 (1.01%) Taxonomies
13 15 (0.95%) Client/Server
13 15 (0.95%) IoT
14 14 (0.89%) NHS
15 10 (0.63%) Mainframe
16 9 (0.57%) Data Protection Act
16 9 (0.57%) Online Games
17 8 (0.51%) Distributed Applications
Operating Systems
1 36 (2.28%) Linux
2 11 (0.70%) Windows
3 5 (0.32%) Windows Server
4 3 (0.19%) Unix
5 1 (0.063%) Red Hat Enterprise Linux
Processes & Methodologies
1 643 (40.77%) ETL
2 637 (40.39%) Agile
3 608 (38.55%) Problem-Solving
4 576 (36.53%) Data Modelling
5 547 (34.69%) Analytics
6 520 (32.97%) Data Pipeline
7 497 (31.52%) Data Science
8 450 (28.54%) Mentoring
9 448 (28.41%) DevOps
10 399 (25.30%) Platform Engineering
11 332 (21.05%) Business Intelligence
12 308 (19.53%) CI/CD
12 308 (19.53%) Machine Learning
13 284 (18.01%) Data Governance
14 264 (16.74%) Data Integration
15 259 (16.42%) Visualisation
16 256 (16.23%) Data Architecture
17 198 (12.56%) DataOps
18 189 (11.98%) Artificial Intelligence
19 185 (11.73%) Change Management
Programming Languages
1 660 (41.85%) SQL
2 625 (39.63%) Python
3 173 (10.97%) Java
4 86 (5.45%) Scala
5 58 (3.68%) T-SQL
6 50 (3.17%) R
7 32 (2.03%) C#
8 26 (1.65%) MATLAB
9 25 (1.59%) Bash
10 23 (1.46%) Shell Script
11 22 (1.40%) Go
12 19 (1.20%) Data Analysis Expressions
13 18 (1.14%) PowerShell
14 12 (0.76%) TypeScript
15 11 (0.70%) C
15 11 (0.70%) JavaScript
16 10 (0.63%) VBA
17 9 (0.57%) Kusto Query Language
17 9 (0.57%) Perl
18 8 (0.51%) Ruby
Qualifications
1 179 (11.35%) Degree
2 78 (4.95%) Security Cleared
3 75 (4.76%) Computer Science Degree
4 47 (2.98%) DV Cleared
5 44 (2.79%) Master's Degree
6 34 (2.16%) DBS Check
7 33 (2.09%) SC Cleared
8 29 (1.84%) Azure Certification
9 22 (1.40%) Microsoft Certification
10 16 (1.01%) PhD
11 9 (0.57%) PMI Certification
12 7 (0.44%) MBA
13 6 (0.38%) OCP
13 6 (0.38%) Oracle Certification
14 4 (0.25%) ISTQB
15 3 (0.19%) AWS Certification
15 3 (0.19%) PMP
16 2 (0.13%) AWS Certified Solutions Architect
16 2 (0.13%) MCP
17 1 (0.063%) TOGAF Certification
Quality Assurance & Compliance
1 354 (22.45%) Data Quality
2 295 (18.71%) GDPR
3 109 (6.91%) QA
4 16 (1.01%) Accessibility
5 9 (0.57%) California Consumer Privacy Act
6 6 (0.38%) ISO/IEC 27001
7 4 (0.25%) Solvency II
8 3 (0.19%) SLA
9 2 (0.13%) COBIT
9 2 (0.13%) Cyber Essentials
9 2 (0.13%) PCI DSS
10 1 (0.063%) Actionable Recommendations
10 1 (0.063%) HIPAA
10 1 (0.063%) NCSC
10 1 (0.063%) SNOMED CT
System Software
1 72 (4.57%) Docker
2 11 (0.70%) IAG
3 10 (0.63%) HDFS
4 2 (0.13%) Apache Flume
4 2 (0.13%) Apache ZooKeeper
Systems Management
1 98 (6.21%) Terraform
2 96 (6.09%) Kubernetes
3 31 (1.97%) Ansible
4 17 (1.08%) Grafana
4 17 (1.08%) HAProxy
4 17 (1.08%) Prometheus
5 7 (0.44%) SysTrack
6 5 (0.32%) logstash
7 3 (0.19%) Argo
7 3 (0.19%) Kubeflow
8 2 (0.13%) Oozie
9 1 (0.063%) Podman
9 1 (0.063%) Progress Chef
9 1 (0.063%) Puppet
9 1 (0.063%) Rancher
Vendors
1 448 (28.41%) Google
2 226 (14.33%) Databricks
3 175 (11.10%) Microsoft
4 61 (3.87%) Oracle
5 30 (1.90%) Informatica
6 26 (1.65%) Teradata
7 20 (1.27%) Cloudera
8 13 (0.82%) SAP
9 10 (0.63%) Alteryx
9 10 (0.63%) IBM
10 8 (0.51%) Samsung
10 8 (0.51%) ServiceNow
11 7 (0.44%) Dataiku
11 7 (0.44%) Snow
12 6 (0.38%) F5
12 6 (0.38%) SnapLogic
13 5 (0.32%) Dell
13 5 (0.32%) OpenAI
13 5 (0.32%) Talend
14 4 (0.25%) Confluent