Data Engineering Jobs

Data Engineering
UK

The table below provides summary statistics for permanent job vacancies requiring Data Engineering skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited Data Engineering over the 6 months leading up to 24 July 2024, comparing them to the same period in the previous two years.

6 months to
24 Jul 2024
Same period 2023 Same period 2022
Rank 146 155 150
Rank change year-on-year +9 -5 +105
Permanent jobs citing Data Engineering 1,637 1,844 4,895
As % of all permanent jobs advertised in the UK 1.78% 2.26% 2.78%
As % of the Processes & Methodologies category 2.17% 2.37% 2.88%
Number of salaries quoted 807 1,050 1,572
10th Percentile £42,500 £45,000 £47,500
25th Percentile £55,070 £57,000 £57,822
Median annual salary (50th Percentile) £70,000 £75,000 £78,250
Median % change year-on-year -6.67% -4.15% +15.93%
75th Percentile £90,000 £95,000 £91,250
90th Percentile £105,982 £130,000 £108,625
UK excluding London median annual salary £65,000 £62,000 £67,500
% change year-on-year +4.84% -8.15% +18.60%

All Process and Methodology Skills
UK

Data Engineering falls under the Processes and Methodologies category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 75,478 77,846 169,786
As % of all permanent jobs advertised in the UK 82.06% 95.36% 96.40%
Number of salaries quoted 49,870 50,645 86,192
10th Percentile £30,000 £33,750 £33,678
25th Percentile £40,000 £45,000 £44,186
Median annual salary (50th Percentile) £55,000 £60,000 £60,000
Median % change year-on-year -8.33% - +9.09%
75th Percentile £73,750 £80,000 £80,000
90th Percentile £93,750 £100,000 £96,250
UK excluding London median annual salary £50,000 £55,000 £52,500
% change year-on-year -9.09% +4.76% +6.06%

Data Engineering
Job Vacancy Trend

Job postings citing Data Engineering as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineering in the UK

Data Engineering
Salary Trend

3-month moving average salary quoted in jobs citing Data Engineering.

Salary trend for Data Engineering in the UK

Data Engineering
Salary Histogram

Salary distribution for jobs citing Data Engineering over the 6 months to 24 July 2024.

Salary histogram for Data Engineering in the UK

Data Engineering
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineering within the UK over the 6 months to 24 July 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England +10 1,496 £70,000 -6.67% 149
UK excluding London +25 1,067 £65,000 +4.84% 99
London -24 500 £85,000 - 56
North of England +63 471 £57,500 -11.54% 32
Work from Home -60 456 £70,000 -3.45% 69
North West +58 333 £55,000 +10.00% 11
Midlands -35 170 £62,500 +13.64% 11
South East +20 151 £67,500 -3.57% 21
South West +7 140 £80,000 +16.79% 22
West Midlands -59 101 £62,500 +13.64% 8
Scotland -26 84 £70,000 +16.67% 1
Yorkshire +14 82 £52,500 -21.72% 7
East Midlands -1 67 £46,250 -28.85% 3
North East +26 56 £72,500 +11.54% 14
East of England -32 36 £75,000 +30.43% 14
Wales +19 13 £73,099 +63.66% 1
Northern Ireland +21 2 £77,500 -

Data Engineering
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 119 (7.27%) Apache Spark
2 94 (5.74%) Apache Airflow
3 69 (4.22%) Apache
4 44 (2.69%) SAS
5 25 (1.53%) Confluence
6 19 (1.16%) Jupyter
7 16 (0.98%) nginx
8 5 (0.31%) Apache Pulsar
9 2 (0.12%) SharePoint
9 2 (0.12%) WildFly
10 1 (0.061%) Apache Pig
10 1 (0.061%) Luigi
Applications
1 24 (1.47%) Microsoft Excel
2 7 (0.43%) Spreadsheet
3 6 (0.37%) Microsoft Office
4 3 (0.18%) MS Visio
4 3 (0.18%) SPSS
5 2 (0.12%) Chatbot
Business Applications
1 3 (0.18%) Dynamics CRM
1 3 (0.18%) SystmOne
2 1 (0.061%) NetSuite
2 1 (0.061%) SAP ERP
Cloud Services
1 624 (38.12%) Azure
2 498 (30.42%) GCP
3 484 (29.57%) AWS
4 243 (14.84%) Power Platform
5 171 (10.45%) Azure Data Factory
6 156 (9.53%) Azure DevOps
7 145 (8.86%) Azure Synapse Analytics
8 103 (6.29%) Amazon S3
9 92 (5.62%) dbt
10 85 (5.19%) Snowflake
11 54 (3.30%) GitHub
12 47 (2.87%) Serverless
13 33 (2.02%) Dagster
14 32 (1.95%) AWS Lambda
15 30 (1.83%) Amazon EC2
16 26 (1.59%) Azure Cosmos DB
17 23 (1.41%) SaaS
18 19 (1.16%) Cloud Computing
19 16 (0.98%) Fivetran
19 16 (0.98%) MinIO
Communications & Networking
1 7 (0.43%) Firewall
2 3 (0.18%) VoIP
2 3 (0.18%) Wi-Fi
3 2 (0.12%) Broadband
3 2 (0.12%) LAN
3 2 (0.12%) Network Security
3 2 (0.12%) WAN
3 2 (0.12%) Wireless
4 1 (0.061%) 3GPP
4 1 (0.061%) 5G
4 1 (0.061%) VPN
Database & Business Intelligence
1 474 (28.96%) Data Warehouse
2 359 (21.93%) BigQuery
3 335 (20.46%) Looker
4 241 (14.72%) Power BI
5 196 (11.97%) Data Lake
6 120 (7.33%) Big Data
7 112 (6.84%) Tableau
8 94 (5.74%) SQL Server
9 77 (4.70%) Amazon Redshift
10 66 (4.03%) Amazon Athena
11 65 (3.97%) NoSQL
12 59 (3.60%) Azure SQL Database
13 54 (3.30%) Relational Database
14 51 (3.12%) SQL Server Integration Services
15 48 (2.93%) Hadoop
16 44 (2.69%) Data Mining
16 44 (2.69%) DynamoDB
17 42 (2.57%) Metadata
18 38 (2.32%) Dremio
19 36 (2.20%) Amazon QuickSight
Development Applications
1 67 (4.09%) Git
2 47 (2.87%) Jenkins
3 33 (2.02%) JIRA
4 19 (1.16%) GitLab
5 17 (1.04%) MLflow
6 16 (0.98%) Atlassian Bamboo
7 9 (0.55%) CircleCI
7 9 (0.55%) Spinnaker
8 8 (0.49%) ERwin
8 8 (0.49%) RStudio
9 5 (0.31%) ER Studio
10 4 (0.24%) Bitbucket
11 3 (0.18%) Deequ
11 3 (0.18%) Octopus Deploy
12 2 (0.12%) Selenium
12 2 (0.12%) Subversion
13 1 (0.061%) Artifactory
13 1 (0.061%) JMeter
13 1 (0.061%) SpecFlow
13 1 (0.061%) Toad
General
1 467 (28.53%) Analytical Skills
2 338 (20.65%) Inclusion and Diversity
3 289 (17.65%) Finance
4 241 (14.72%) Social Skills
5 73 (4.46%) Law
6 72 (4.40%) Billing
7 69 (4.22%) Banking
8 49 (2.99%) Retail
9 46 (2.81%) Legal
10 42 (2.57%) Front Office
10 42 (2.57%) Marketing
11 19 (1.16%) Games
11 19 (1.16%) Pharmaceutical
12 18 (1.10%) Influencing Skills
12 18 (1.10%) Presentation Skills
12 18 (1.10%) Public Sector
13 15 (0.92%) Financial Institution
14 12 (0.73%) Publishing
15 10 (0.61%) Investment Banking
15 10 (0.61%) Manufacturing
Job Titles
1 623 (38.06%) Data Engineer
2 269 (16.43%) Senior
3 210 (12.83%) Architect
4 196 (11.97%) Lead
5 193 (11.79%) Principal Engineer
6 186 (11.36%) Principal Data Engineer
7 179 (10.93%) Data Manager
8 173 (10.57%) Platform Engineer
9 151 (9.22%) Senior Data Engineer
10 145 (8.86%) Engineering Manager
10 145 (8.86%) Software Engineer
11 108 (6.60%) Data Architect
12 91 (5.56%) Lead Software Engineer
13 85 (5.19%) Azure Engineer
14 81 (4.95%) Software Architect
15 80 (4.89%) Programmer
15 80 (4.89%) Software Programmer
16 68 (4.15%) Analyst
17 66 (4.03%) Azure Data Engineer
17 66 (4.03%) Developer
Libraries, Frameworks & Software Standards
1 143 (8.74%) PySpark
2 56 (3.42%) Kafka
3 55 (3.36%) Pandas
4 52 (3.18%) NumPy
5 39 (2.38%) SciPy
6 32 (1.95%) React
7 27 (1.65%) AngularJS
8 23 (1.41%) RabbitMQ
9 22 (1.34%) .NET
10 20 (1.22%) TensorFlow
10 20 (1.22%) YAML
11 19 (1.16%) ActiveMQ
11 19 (1.16%) RESTful
11 19 (1.16%) Spring
12 17 (1.04%) Apache NiFi
12 17 (1.04%) Web Services
13 16 (0.98%) Elastic Stack
14 15 (0.92%) JSON
14 15 (0.92%) PyTorch
15 13 (0.79%) SOAP
Miscellaneous
1 256 (15.64%) Cyberattack
2 244 (14.91%) Self-Motivation
3 102 (6.23%) Product Ownership
4 66 (4.03%) Algorithms
5 58 (3.54%) Cloud Native
6 55 (3.36%) Data Structures
7 44 (2.69%) Onboarding
8 38 (2.32%) Management Information System
9 23 (1.41%) Hybrid Cloud
10 22 (1.34%) Distributed Systems
11 20 (1.22%) Reference Data
12 14 (0.86%) Greenfield Project
12 14 (0.86%) NHS
13 13 (0.79%) Distributed Computing
14 12 (0.73%) Analytical Mindset
14 12 (0.73%) IoT
15 9 (0.55%) Fixed Income
16 8 (0.49%) Data Protection Act
16 8 (0.49%) Hedge funds
16 8 (0.49%) Taxonomies
Operating Systems
1 33 (2.02%) Linux
2 11 (0.67%) Windows
3 7 (0.43%) Windows Server
4 5 (0.31%) Unix
5 2 (0.12%) VMS
6 1 (0.061%) Red Hat Enterprise Linux
Processes & Methodologies
1 822 (50.21%) Agile
2 731 (44.65%) Problem-Solving
3 641 (39.16%) Mentoring
4 521 (31.83%) ETL
5 490 (29.93%) Data Modelling
6 473 (28.89%) Analytics
7 460 (28.10%) Machine Learning
8 424 (25.90%) DevOps
9 422 (25.78%) Data Pipeline
10 409 (24.98%) Software Engineering
11 394 (24.07%) Data Science
12 353 (21.56%) Platform Engineering
13 309 (18.88%) Business Intelligence
14 280 (17.10%) Site Reliability Engineering
15 274 (16.74%) User Experience
16 267 (16.31%) Creative Thinking
17 264 (16.13%) CI/CD
18 262 (16.00%) Data Governance
19 238 (14.54%) Data Architecture
20 235 (14.36%) Visualisation
Programming Languages
1 603 (36.84%) SQL
2 534 (32.62%) Python
3 169 (10.32%) Java
4 72 (4.40%) R
5 69 (4.22%) Scala
6 55 (3.36%) T-SQL
7 31 (1.89%) Bash
8 30 (1.83%) C#
9 29 (1.77%) MATLAB
10 28 (1.71%) Shell Script
11 25 (1.53%) Data Analysis Expressions
12 22 (1.34%) Go
13 17 (1.04%) PowerShell
14 13 (0.79%) JavaScript
15 8 (0.49%) C++
15 8 (0.49%) Kusto Query Language
15 8 (0.49%) Perl
15 8 (0.49%) VBA
16 6 (0.37%) Kotlin
16 6 (0.37%) TypeScript
Qualifications
1 134 (8.19%) Degree
2 73 (4.46%) Computer Science Degree
3 59 (3.60%) Security Cleared
4 54 (3.30%) Master's Degree
5 42 (2.57%) DBS Check
6 34 (2.08%) SC Cleared
7 32 (1.95%) DV Cleared
8 28 (1.71%) Azure Certification
9 15 (0.92%) Microsoft Certification
9 15 (0.92%) PhD
10 12 (0.73%) AWS Certification
11 6 (0.37%) ISTQB
11 6 (0.37%) MBA
12 4 (0.24%) PMI Certification
13 3 (0.18%) AWS Certified Solutions Architect
14 2 (0.12%) MCP
15 1 (0.061%) ITIL Certification
15 1 (0.061%) SnowPro
Quality Assurance & Compliance
1 255 (15.58%) GDPR
2 242 (14.78%) Data Quality
3 103 (6.29%) QA
4 31 (1.89%) Accessibility
5 10 (0.61%) California Consumer Privacy Act
6 4 (0.24%) ISO/IEC 27001
7 2 (0.12%) Actionable Recommendations
7 2 (0.12%) COBIT
7 2 (0.12%) Cyber Essentials
7 2 (0.12%) PCI DSS
8 1 (0.061%) NCSC
8 1 (0.061%) SNOMED CT
System Software
1 72 (4.40%) Docker
2 11 (0.67%) IAG
3 5 (0.31%) Active Directory
3 5 (0.31%) Virtual Machines
4 3 (0.18%) HDFS
5 1 (0.061%) Apache ZooKeeper
Systems Management
1 109 (6.66%) Kubernetes
2 95 (5.80%) Terraform
3 30 (1.83%) Ansible
4 20 (1.22%) Grafana
4 20 (1.22%) Prometheus
5 16 (0.98%) HAProxy
6 7 (0.43%) SysTrack
7 5 (0.31%) logstash
8 2 (0.12%) Argo
8 2 (0.12%) Kubeflow
9 1 (0.061%) Oozie
9 1 (0.061%) Podman
9 1 (0.061%) Progress Chef
9 1 (0.061%) Puppet
Vendors
1 388 (23.70%) Google
2 214 (13.07%) Databricks
3 160 (9.77%) Microsoft
4 61 (3.73%) Oracle
5 38 (2.32%) Informatica
6 11 (0.67%) Teradata
7 10 (0.61%) Cloudera
7 10 (0.61%) SAP
8 9 (0.55%) Alteryx
8 9 (0.55%) MuleSoft
9 8 (0.49%) Salesforce
10 7 (0.43%) ServiceNow
10 7 (0.43%) Snow
11 6 (0.37%) SnapLogic
12 5 (0.31%) OpenAI
13 4 (0.24%) Ab Initio
13 4 (0.24%) Dell
13 4 (0.24%) Foundry
13 4 (0.24%) Palantir
13 4 (0.24%) Talend