Data Engineering
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Data Engineering skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Engineering over the 6 months to 28 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
28 May 2024
Same period 2023 Same period 2022
Rank 183 129 165
Rank change year-on-year -54 +36 +93
Permanent jobs citing Data Engineering 1,594 2,668 4,243
As % of all permanent jobs advertised in the UK 1.55% 2.74% 2.54%
As % of the Processes & Methodologies category 1.84% 2.87% 2.65%
Number of salaries quoted 915 1,146 1,518
10th Percentile £42,439 £46,375 £47,500
25th Percentile £55,000 £57,500 £55,000
Median annual salary (50th Percentile) £70,000 £75,000 £75,000
Median % change year-on-year -6.67% - +11.11%
75th Percentile £90,000 £96,750 £90,000
90th Percentile £106,474 £130,000 £107,500
UK excluding London median annual salary £65,000 £60,249 £65,000
% change year-on-year +7.89% -7.31% +13.04%

All Process and Methodology Skills
UK

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 86,445 93,025 160,114
As % of all permanent jobs advertised in the UK 84.24% 95.56% 95.90%
Number of salaries quoted 60,550 54,985 83,280
10th Percentile £29,250 £34,000 £33,500
25th Percentile £40,000 £45,000 £43,750
Median annual salary (50th Percentile) £55,000 £61,000 £60,000
Median % change year-on-year -9.84% +1.67% +9.09%
75th Percentile £72,500 £81,250 £80,000
90th Percentile £92,500 £100,000 £96,250
UK excluding London median annual salary £50,000 £55,000 £52,500
% change year-on-year -9.09% +4.76% +9.38%

Data Engineering
Job Vacancy Trend

Job postings citing Data Engineering as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineering in the UK

Data Engineering
Salary Trend

3-month moving average salary quoted in jobs citing Data Engineering.

Salary trend for Data Engineering in the UK

Data Engineering
Salary Histogram

Salary distribution for jobs citing Data Engineering over the 6 months to 28 May 2024.

Salary histogram for Data Engineering in the UK

Data Engineering
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineering within the UK over the 6 months to 28 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England -55 1,409 £70,000 -9.68% 361
UK excluding London -35 1,030 £65,000 +7.89% 146
Work from Home -79 566 £70,000 - 151
London -60 498 £82,500 -2.94% 220
North of England -41 308 £60,000 -7.69% 40
South East +29 200 £67,500 -3.57% 35
Midlands -27 188 £57,500 +4.55% 29
North West -32 171 £55,000 - 27
South West -27 146 £75,000 +17.65% 19
West Midlands -42 119 £59,300 +7.82% 20
Scotland -26 117 £70,000 +16.67% 9
Yorkshire -41 83 £65,066 -2.99% 8
East Midlands -1 67 £45,000 -21.74% 9
North East +20 54 £75,000 +15.38% 5
East of England -55 44 £72,500 +26.09% 9
Wales -9 18 £97,500 +118.29% 4
Northern Ireland +21 9 £55,000 - 3

Data Engineering
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 176 (11.04%) Apache Spark
2 104 (6.52%) Apache
3 92 (5.77%) Apache Airflow
4 27 (1.69%) Confluence
5 25 (1.57%) SAS
6 20 (1.25%) Jupyter
7 17 (1.07%) nginx
8 5 (0.31%) Apache Pulsar
9 3 (0.19%) Luigi
10 2 (0.13%) SharePoint
Applications
1 27 (1.69%) Microsoft Excel
2 6 (0.38%) Spreadsheet
3 5 (0.31%) Microsoft Office
4 3 (0.19%) MS Visio
4 3 (0.19%) SPSS
5 1 (0.063%) Chatbot
Business Applications
1 3 (0.19%) Dynamics CRM
2 1 (0.063%) NetSuite
2 1 (0.063%) SAP ERP
Cloud Services
1 729 (45.73%) Azure
2 563 (35.32%) GCP
3 558 (35.01%) AWS
4 264 (16.56%) Power Platform
5 174 (10.92%) Azure Data Factory
6 144 (9.03%) Azure DevOps
7 141 (8.85%) Snowflake
8 135 (8.47%) Azure Synapse Analytics
9 97 (6.09%) Amazon S3
10 86 (5.40%) dbt
11 57 (3.58%) Azure Cosmos DB
12 53 (3.32%) Serverless
13 43 (2.70%) GitHub
14 37 (2.32%) AWS Lambda
14 37 (2.32%) SaaS
15 33 (2.07%) Matillion
16 29 (1.82%) Amazon EC2
17 27 (1.69%) Amazon Kinesis
18 22 (1.38%) Cloud Computing
19 17 (1.07%) Amazon EMR
Communications & Networking
1 6 (0.38%) Network Security
2 5 (0.31%) Firewall
3 3 (0.19%) VoIP
3 3 (0.19%) Wi-Fi
4 2 (0.13%) Broadband
4 2 (0.13%) LAN
4 2 (0.13%) WAN
4 2 (0.13%) Wireless
5 1 (0.063%) 3GPP
5 1 (0.063%) 5G
5 1 (0.063%) PPP
5 1 (0.063%) VPN
Database & Business Intelligence
1 568 (35.63%) Data Warehouse
2 422 (26.47%) BigQuery
3 377 (23.65%) Looker
4 262 (16.44%) Power BI
5 248 (15.56%) Data Lake
6 153 (9.60%) SQL Server
7 130 (8.16%) Big Data
8 115 (7.21%) Tableau
9 87 (5.46%) Amazon Redshift
10 74 (4.64%) Hadoop
11 67 (4.20%) SQL Server Integration Services
12 66 (4.14%) Relational Database
13 62 (3.89%) NoSQL
14 53 (3.32%) Azure SQL Database
15 49 (3.07%) Metadata
16 42 (2.63%) SQL Server Reporting Services
17 40 (2.51%) Amazon Athena
18 39 (2.45%) PostgreSQL
18 39 (2.45%) Star Schema
19 38 (2.38%) Elasticsearch
Development Applications
1 75 (4.71%) Git
2 60 (3.76%) Jenkins
3 50 (3.14%) GitLab
4 34 (2.13%) JIRA
5 17 (1.07%) Atlassian Bamboo
6 15 (0.94%) MLflow
7 13 (0.82%) CircleCI
7 13 (0.82%) Spinnaker
8 8 (0.50%) ERwin
9 6 (0.38%) Oracle Forms
10 5 (0.31%) ER Studio
11 4 (0.25%) Bitbucket
11 4 (0.25%) Snakemake
12 3 (0.19%) Deequ
12 3 (0.19%) Octopus Deploy
13 1 (0.063%) Artifactory
13 1 (0.063%) Mockito
13 1 (0.063%) Postman
13 1 (0.063%) SoapUI
13 1 (0.063%) SpecFlow
General
1 511 (32.06%) Analytical Skills
2 289 (18.13%) Finance
3 263 (16.50%) Social Skills
4 138 (8.66%) Inclusion and Diversity
5 94 (5.90%) Law
6 76 (4.77%) Banking
7 72 (4.52%) Billing
7 72 (4.52%) Marketing
8 67 (4.20%) Retail
9 48 (3.01%) Legal
10 42 (2.63%) Presentation Skills
11 39 (2.45%) Games
12 31 (1.94%) Public Sector
13 22 (1.38%) Influencing Skills
14 18 (1.13%) Front Office
15 12 (0.75%) Investment Banking
15 12 (0.75%) Manufacturing
16 11 (0.69%) Telecoms
17 10 (0.63%) Pharmaceutical
18 9 (0.56%) Electronics
Job Titles
1 727 (45.61%) Data Engineer
2 269 (16.88%) Senior
3 197 (12.36%) Data Manager
4 195 (12.23%) Principal Engineer
5 184 (11.54%) Principal Data Engineer
6 177 (11.10%) Lead
7 176 (11.04%) Platform Engineer
8 171 (10.73%) Architect
9 153 (9.60%) Data Architect
9 153 (9.60%) Engineering Manager
10 143 (8.97%) Senior Data Engineer
11 80 (5.02%) Azure Engineer
11 80 (5.02%) Lead Data Engineer
12 79 (4.96%) Software Engineer
13 67 (4.20%) Developer
14 64 (4.02%) Azure Data Engineer
15 49 (3.07%) Python Engineer
16 48 (3.01%) Analyst
17 38 (2.38%) Senior Software Engineer
18 37 (2.32%) Lead Software Engineer
Libraries, Frameworks & Software Standards
1 143 (8.97%) PySpark
2 64 (4.02%) Kafka
3 42 (2.63%) React
4 36 (2.26%) Pandas
5 35 (2.20%) AngularJS
6 34 (2.13%) NumPy
7 29 (1.82%) Apache Beam
7 29 (1.82%) TensorFlow
8 25 (1.57%) Spring
9 24 (1.51%) RabbitMQ
10 22 (1.38%) .NET
10 22 (1.38%) RESTful
11 21 (1.32%) ActiveMQ
11 21 (1.32%) YAML
12 19 (1.19%) Apache NiFi
12 19 (1.19%) PyTorch
13 17 (1.07%) Elastic Stack
13 17 (1.07%) Web Services
14 16 (1.00%) Keras
15 14 (0.88%) REST
Miscellaneous
1 315 (19.76%) Self-Motivation
2 110 (6.90%) Product Ownership
3 87 (5.46%) Data Structures
4 82 (5.14%) Algorithms
5 75 (4.71%) Cloud Native
6 45 (2.82%) Management Information System
7 36 (2.26%) Onboarding
8 24 (1.51%) Hybrid Cloud
9 20 (1.25%) Greenfield Project
9 20 (1.25%) Reference Data
10 15 (0.94%) Client/Server
10 15 (0.94%) Distributed Systems
10 15 (0.94%) NHS
11 14 (0.88%) IoT
12 13 (0.82%) Taxonomies
13 12 (0.75%) Public Cloud
14 10 (0.63%) Mainframe
15 9 (0.56%) Data Protection Act
15 9 (0.56%) Online Games
16 8 (0.50%) Renewable Energy
Operating Systems
1 42 (2.63%) Linux
2 10 (0.63%) Windows
3 5 (0.31%) Windows Server
4 4 (0.25%) Unix
5 1 (0.063%) Red Hat Enterprise Linux
Processes & Methodologies
1 628 (39.40%) ETL
2 615 (38.58%) Agile
3 612 (38.39%) Problem-Solving
4 608 (38.14%) Data Modelling
5 556 (34.88%) Analytics
6 517 (32.43%) Data Pipeline
7 497 (31.18%) Data Science
8 459 (28.80%) Mentoring
9 438 (27.48%) DevOps
10 400 (25.09%) Platform Engineering
11 350 (21.96%) Business Intelligence
12 311 (19.51%) Data Governance
13 310 (19.45%) CI/CD
14 303 (19.01%) Machine Learning
15 267 (16.75%) Data Architecture
16 255 (16.00%) Visualisation
17 254 (15.93%) Data Integration
18 203 (12.74%) DataOps
19 191 (11.98%) Change Management
20 183 (11.48%) Artificial Intelligence
Programming Languages
1 682 (42.79%) SQL
2 640 (40.15%) Python
3 190 (11.92%) Java
4 78 (4.89%) Scala
5 64 (4.02%) T-SQL
6 52 (3.26%) R
7 38 (2.38%) C#
8 30 (1.88%) MATLAB
9 24 (1.51%) Shell Script
10 23 (1.44%) Bash
10 23 (1.44%) Go
11 22 (1.38%) Data Analysis Expressions
12 18 (1.13%) PowerShell
13 11 (0.69%) C
13 11 (0.69%) JavaScript
14 10 (0.63%) Kusto Query Language
14 10 (0.63%) Ruby
14 10 (0.63%) VBA
15 9 (0.56%) TypeScript
16 8 (0.50%) Perl
Qualifications
1 178 (11.17%) Degree
2 69 (4.33%) Computer Science Degree
3 68 (4.27%) Security Cleared
4 43 (2.70%) DV Cleared
5 42 (2.63%) DBS Check
6 39 (2.45%) Master's Degree
7 30 (1.88%) Azure Certification
8 29 (1.82%) SC Cleared
9 24 (1.51%) Microsoft Certification
10 15 (0.94%) PhD
11 8 (0.50%) PMI Certification
12 7 (0.44%) ISTQB
13 6 (0.38%) MBA
14 4 (0.25%) AWS Certification
15 3 (0.19%) AWS Certified Solutions Architect
15 3 (0.19%) PMP
16 2 (0.13%) MCP
17 1 (0.063%) MCSE
17 1 (0.063%) TOGAF Certification
Quality Assurance & Compliance
1 373 (23.40%) Data Quality
2 299 (18.76%) GDPR
3 108 (6.78%) QA
4 25 (1.57%) Accessibility
5 10 (0.63%) California Consumer Privacy Act
6 4 (0.25%) ISO/IEC 27001
6 4 (0.25%) Solvency II
7 3 (0.19%) Actionable Recommendations
7 3 (0.19%) SLA
8 2 (0.13%) COBIT
8 2 (0.13%) Cyber Essentials
8 2 (0.13%) PCI DSS
9 1 (0.063%) NCSC
9 1 (0.063%) SNOMED CT
System Software
1 75 (4.71%) Docker
2 11 (0.69%) IAG
3 8 (0.50%) HDFS
4 2 (0.13%) Active Directory
4 2 (0.13%) Apache ZooKeeper
4 2 (0.13%) Virtual Machines
Systems Management
1 110 (6.90%) Kubernetes
2 100 (6.27%) Terraform
3 37 (2.32%) Ansible
4 17 (1.07%) Grafana
4 17 (1.07%) HAProxy
4 17 (1.07%) Prometheus
5 7 (0.44%) SysTrack
6 5 (0.31%) logstash
7 3 (0.19%) Argo
7 3 (0.19%) Kubeflow
8 2 (0.13%) Oozie
9 1 (0.063%) Podman
9 1 (0.063%) Progress Chef
9 1 (0.063%) Puppet
Vendors
1 439 (27.54%) Google
2 241 (15.12%) Databricks
3 176 (11.04%) Microsoft
4 73 (4.58%) Oracle
5 27 (1.69%) Informatica
6 24 (1.51%) Teradata
7 20 (1.25%) Cloudera
8 10 (0.63%) Alteryx
8 10 (0.63%) SAP
9 8 (0.50%) Samsung
10 7 (0.44%) Dataiku
10 7 (0.44%) ServiceNow
10 7 (0.44%) Snow
11 6 (0.38%) F5
11 6 (0.38%) SnapLogic
12 5 (0.31%) OpenAI
13 4 (0.25%) Dell
13 4 (0.25%) Hortonworks
13 4 (0.25%) Salesforce
13 4 (0.25%) Talend