Data Engineering Jobs

Data Engineering
UK

The table below provides summary statistics for permanent job vacancies requiring Data Engineering skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited Data Engineering over the 6 months leading up to 26 October 2024, comparing them to the same period in the previous two years.

6 months to
26 Oct 2024
Same period 2023 Same period 2022
Rank 174 231 144
Rank change year-on-year +57 -87 +103
Permanent jobs citing Data Engineering 1,219 928 3,719
As % of all permanent jobs advertised in the UK 1.60% 1.58% 2.64%
As % of the Processes & Methodologies category 1.91% 1.68% 2.74%
Number of salaries quoted 605 681 1,453
10th Percentile £44,738 £46,250 £47,500
25th Percentile £56,250 £55,000 £57,822
Median annual salary (50th Percentile) £72,500 £70,576 £77,500
Median % change year-on-year +2.73% -8.93% +16.54%
75th Percentile £92,500 £92,500 £92,500
90th Percentile £111,250 £106,250 £108,650
UK excluding London median annual salary £60,000 £67,500 £70,000
% change year-on-year -11.11% -3.57% +27.27%

All Process and Methodology Skills
UK

Data Engineering falls under the Processes and Methodologies category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 63,908 55,391 135,614
As % of all permanent jobs advertised in the UK 84.07% 94.35% 96.13%
Number of salaries quoted 30,608 39,736 76,629
10th Percentile £34,000 £32,500 £34,000
25th Percentile £45,000 £44,497 £45,000
Median annual salary (50th Percentile) £60,000 £60,000 £60,000
Median % change year-on-year - - +4.35%
75th Percentile £77,500 £80,000 £81,000
90th Percentile £97,250 £97,500 £98,750
UK excluding London median annual salary £54,125 £52,500 £52,500
% change year-on-year +3.10% - +5.00%

Data Engineering
Job Vacancy Trend

Job postings citing Data Engineering as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineering in the UK

Data Engineering
Salary Trend

3-month moving average salary quoted in jobs citing Data Engineering.

Salary trend for Data Engineering in the UK

Data Engineering
Salary Histogram

Salary distribution for jobs citing Data Engineering over the 6 months to 26 October 2024.

Salary histogram for Data Engineering in the UK

Data Engineering
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineering within the UK over the 6 months to 26 October 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England +40 1,143 £74,500 +2.76% 310
UK excluding London +69 719 £60,000 -11.11% 145
London +18 451 £85,000 +6.25% 176
Work from Home -9 397 £75,000 +3.45% 211
North of England +135 380 £54,500 -16.15% 57
North West +119 281 £54,500 -3.11% 29
South East -6 107 £65,000 -7.14% 23
South West -9 89 £75,000 - 20
Midlands -12 85 £60,625 +6.36% 15
Yorkshire +36 59 £51,250 -31.67% 13
West Midlands -22 59 £57,500 +2.68% 10
Scotland +16 44 £52,500 -30.27% 12
North East +2 40 £65,232 +0.76% 15
East Midlands -10 25 £70,000 -26.32% 5
East of England -62 8 £90,000 +56.52% 10
Wales +27 5 £66,199 +43.72% 1
Northern Ireland +21 1 - - 8

Data Engineering
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 109 (8.94%) Apache Airflow
2 90 (7.38%) Apache Spark
3 68 (5.58%) Apache
4 40 (3.28%) SAS
5 12 (0.98%) Confluence
5 12 (0.98%) Jupyter
5 12 (0.98%) nginx
6 8 (0.66%) SharePoint
7 6 (0.49%) Apache Pulsar
8 2 (0.16%) ArcGIS
8 2 (0.16%) WildFly
9 1 (0.082%) Apache Pig
9 1 (0.082%) Luigi
Applications
1 15 (1.23%) Microsoft Excel
2 3 (0.25%) Microsoft Office
3 2 (0.16%) Chatbot
4 1 (0.082%) Microsoft Project
4 1 (0.082%) Spreadsheet
Business Applications
1 7 (0.57%) SystmOne
2 4 (0.33%) Dynamics CRM
3 3 (0.25%) IBM Planning Analytics
4 1 (0.082%) SAP ERP
Cloud Services
1 477 (39.13%) Azure
2 337 (27.65%) AWS
3 191 (15.67%) Power Platform
4 181 (14.85%) GCP
5 128 (10.50%) Azure Data Factory
6 127 (10.42%) Azure Synapse Analytics
7 100 (8.20%) Amazon S3
8 88 (7.22%) Snowflake
9 85 (6.97%) Azure DevOps
9 85 (6.97%) dbt
10 69 (5.66%) GitHub
11 55 (4.51%) Dagster
12 33 (2.71%) Serverless
13 28 (2.30%) Amazon EC2
14 21 (1.72%) AWS Lambda
15 17 (1.39%) Azure API Management
15 17 (1.39%) GitHub Actions
16 15 (1.23%) OpenShift
17 14 (1.15%) Azure Cosmos DB
17 14 (1.15%) Fivetran
Communications & Networking
1 18 (1.48%) Broadband
2 14 (1.15%) Firewall
3 2 (0.16%) Internet
4 1 (0.082%) FTP
4 1 (0.082%) HTTP
Database & Business Intelligence
1 290 (23.79%) Data Warehouse
2 182 (14.93%) Data Lake
3 181 (14.85%) Power BI
4 110 (9.02%) Big Data
5 99 (8.12%) SQL Server
6 98 (8.04%) Tableau
7 78 (6.40%) Amazon Athena
8 72 (5.91%) Azure SQL Database
9 67 (5.50%) Amazon Redshift
9 67 (5.50%) NoSQL
10 57 (4.68%) BigQuery
11 56 (4.59%) Dremio
12 46 (3.77%) Data Mining
13 43 (3.53%) DynamoDB
14 40 (3.28%) Amazon QuickSight
14 40 (3.28%) SQL Server Integration Services
15 39 (3.20%) Hadoop
16 35 (2.87%) Looker
17 33 (2.71%) Metadata
17 33 (2.71%) Relational Database
Development Applications
1 42 (3.45%) Git
2 35 (2.87%) Jenkins
3 18 (1.48%) JIRA
4 14 (1.15%) GitLab
5 13 (1.07%) Atlassian Bamboo
6 11 (0.90%) MLflow
7 8 (0.66%) RStudio
8 6 (0.49%) Spinnaker
8 6 (0.49%) Terragrunt
9 5 (0.41%) CircleCI
10 4 (0.33%) SQL Server Management Studio (SSMS)
11 3 (0.25%) Bitbucket
11 3 (0.25%) Subversion
12 1 (0.082%) Cucumber
12 1 (0.082%) ERwin
12 1 (0.082%) Mockito
12 1 (0.082%) Octopus Deploy
12 1 (0.082%) Selenium
12 1 (0.082%) Team Foundation Server
General
1 320 (26.25%) Inclusion and Diversity
2 273 (22.40%) Finance
3 207 (16.98%) Social Skills
4 137 (11.24%) Analytical Skills
5 73 (5.99%) Banking
6 58 (4.76%) Front Office
7 43 (3.53%) Law
8 39 (3.20%) Retail
9 35 (2.87%) Legal
10 28 (2.30%) Pharmaceutical
11 19 (1.56%) Financial Institution
11 19 (1.56%) Marketing
12 17 (1.39%) Manufacturing
13 16 (1.31%) Automotive
14 13 (1.07%) Publishing
15 12 (0.98%) Influencing Skills
16 8 (0.66%) Organisational Skills
17 7 (0.57%) Presentation Skills
17 7 (0.57%) Public Sector
18 6 (0.49%) Telecoms
Job Titles
1 436 (35.77%) Data Engineer
2 257 (21.08%) Senior
3 169 (13.86%) Lead
4 148 (12.14%) Architect
5 138 (11.32%) Senior Data Engineer
6 129 (10.58%) Software Engineer
7 83 (6.81%) Lead Software Engineer
7 83 (6.81%) Software Architect
8 82 (6.73%) Programmer
8 82 (6.73%) Software Programmer
9 79 (6.48%) Python Engineer
10 77 (6.32%) Python Data Engineer
11 64 (5.25%) Azure Engineer
12 51 (4.18%) Azure Data Engineer
13 48 (3.94%) Data Manager
14 46 (3.77%) Data Architect
15 44 (3.61%) Analyst
16 43 (3.53%) Developer
17 41 (3.36%) Senior Manager
18 37 (3.04%) Lead Data Engineer
Libraries, Frameworks & Software Standards
1 136 (11.16%) PySpark
2 72 (5.91%) NumPy
3 71 (5.82%) Pandas
4 61 (5.00%) SciPy
5 59 (4.84%) Kafka
6 31 (2.54%) .NET
7 25 (2.05%) RabbitMQ
8 14 (1.15%) ActiveMQ
9 13 (1.07%) Apache NiFi
9 13 (1.07%) TensorFlow
10 12 (0.98%) Elastic Stack
10 12 (0.98%) PyTorch
10 12 (0.98%) YAML
11 11 (0.90%) Middleware
12 10 (0.82%) JSON
13 9 (0.74%) HTML
14 8 (0.66%) React
15 7 (0.57%) CSS
15 7 (0.57%) REST
15 7 (0.57%) scikit-learn
Miscellaneous
1 283 (23.22%) Cyberattack
2 44 (3.61%) Data Structures
3 41 (3.36%) Cloud Native
4 39 (3.20%) Onboarding
5 31 (2.54%) Product Ownership
6 25 (2.05%) Algorithms
7 22 (1.80%) Management Information System
8 18 (1.48%) Distributed Systems
9 15 (1.23%) Life Science
10 14 (1.15%) Analytical Mindset
11 13 (1.07%) Distributed Computing
11 13 (1.07%) Greenfield Project
11 13 (1.07%) NHS
12 12 (0.98%) Cloud Security Posture
12 12 (0.98%) Renewable Energy
12 12 (0.98%) Security Posture
13 9 (0.74%) Self-Motivation
14 8 (0.66%) IoT
14 8 (0.66%) Legacy Systems
14 8 (0.66%) PropTech
Operating Systems
1 33 (2.71%) Linux
2 17 (1.39%) Unix
3 7 (0.57%) Windows
4 3 (0.25%) Apple iOS
5 2 (0.16%) Android
5 2 (0.16%) Ubuntu
5 2 (0.16%) VMS
5 2 (0.16%) Windows Server
Processes & Methodologies
1 562 (46.10%) Agile
2 456 (37.41%) Software Engineering
3 429 (35.19%) Problem-Solving
4 422 (34.62%) Machine Learning
5 421 (34.54%) Mentoring
6 390 (31.99%) Analytics
7 346 (28.38%) ETL
8 309 (25.35%) Site Reliability Engineering
9 293 (24.04%) User Experience
10 292 (23.95%) Creative Thinking
11 291 (23.87%) Data Modelling
12 262 (21.49%) Business Intelligence
13 259 (21.25%) Data Pipeline
14 202 (16.57%) Data Science
15 199 (16.32%) DevOps
16 190 (15.59%) CI/CD
17 156 (12.80%) Visualisation
18 150 (12.31%) Data Management
19 144 (11.81%) Computer Science
20 140 (11.48%) Data Architecture
Programming Languages
1 524 (42.99%) SQL
2 513 (42.08%) Python
3 140 (11.48%) Java
4 65 (5.33%) R
5 48 (3.94%) C#
6 41 (3.36%) Scala
7 40 (3.28%) T-SQL
8 26 (2.13%) MATLAB
9 24 (1.97%) Bash
9 24 (1.97%) Go
10 20 (1.64%) Shell Script
11 19 (1.56%) JavaScript
12 18 (1.48%) C++
12 18 (1.48%) Data Analysis Expressions
13 15 (1.23%) PowerShell
14 9 (0.74%) Rust
15 7 (0.57%) Kotlin
15 7 (0.57%) VB.NET
16 5 (0.41%) Bicep
17 3 (0.25%) Kusto Query Language
Qualifications
1 150 (12.31%) Degree
2 68 (5.58%) Computer Science Degree
3 48 (3.94%) Security Cleared
4 46 (3.77%) Master's Degree
5 32 (2.63%) Azure Certification
6 27 (2.21%) DBS Check
6 27 (2.21%) SC Cleared
7 26 (2.13%) AWS Certification
8 20 (1.64%) DV Cleared
9 15 (1.23%) AWS Certified Cloud Practitioner
10 6 (0.49%) SnowPro
11 5 (0.41%) AWS Certified Solutions Architect
11 5 (0.41%) Microsoft Certification
11 5 (0.41%) PhD
12 4 (0.33%) Tableau Certification
13 3 (0.25%) AWS Certified Developer
13 3 (0.25%) ISTQB
14 2 (0.16%) Numerate Degree
14 2 (0.16%) PMI Certification
15 1 (0.082%) ITIL Certification
Quality Assurance & Compliance
1 197 (16.16%) Data Quality
2 37 (3.04%) Accessibility
3 27 (2.21%) QA
4 9 (0.74%) GDPR
5 2 (0.16%) Actionable Recommendations
5 2 (0.16%) HL7
5 2 (0.16%) SLA
6 1 (0.082%) HIPAA
System Software
1 69 (5.66%) Docker
2 10 (0.82%) Active Directory
2 10 (0.82%) Virtual Machines
3 3 (0.25%) HDFS
4 1 (0.082%) Apache Flume
Systems Management
1 100 (8.20%) Kubernetes
2 85 (6.97%) Terraform
3 24 (1.97%) Ansible
4 21 (1.72%) Prometheus
5 20 (1.64%) Grafana
6 12 (0.98%) HAProxy
7 2 (0.16%) Argo
8 1 (0.082%) Progress Chef
Vendors
1 193 (15.83%) Databricks
2 155 (12.72%) Microsoft
3 71 (5.82%) Google
4 51 (4.18%) Oracle
5 27 (2.21%) Informatica
6 9 (0.74%) MuleSoft
7 8 (0.66%) Salesforce
8 7 (0.57%) MicroStrategy
9 6 (0.49%) Foundry
9 6 (0.49%) Palantir
10 5 (0.41%) Atlassian
10 5 (0.41%) Red Hat
10 5 (0.41%) SAP
11 4 (0.33%) Alteryx
11 4 (0.33%) IBM
12 3 (0.25%) Cloudera
12 3 (0.25%) Cognos
12 3 (0.25%) Hortonworks
12 3 (0.25%) SnapLogic
13 2 (0.16%) Bloomberg