Period
to 23 January 2021

The following table provides summary statistics for permanent job vacancies with a requirement for Data Engineering skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Engineering over the 6 months to 23 January 2021 with a comparison to the same period in the previous 2 years.

Data Engineering
UK
6 months to
23 Jan 2021
Same period 2020 Same period 2019
Rank 270 415 478
Rank change year-on-year +145 +63 +358
Permanent jobs citing Data Engineering 713 894 926
As % of all permanent jobs advertised in the UK 1.12% 0.71% 0.61%
As % of the Processes & Methodologies category 1.21% 0.77% 0.66%
Number of salaries quoted 741 741 649
Median annual salary £60,000 £70,000 £65,000
Median salary % change year-on-year -14.29% +7.69% -3.70%
10th Percentile £41,250 £42,500 £45,000
90th Percentile £95,000 £100,000 £93,750
UK excluding London median annual salary £57,500 £57,388 £62,138
% change year-on-year +0.20% -7.65% +24.28%

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for process or methodology skills.

All Process and Methodology Skills
UK
Permanent vacancies with a requirement for process or methodology skills 58,983 115,832 140,046
As % of all permanent IT jobs advertised in the UK 92.36% 92.10% 92.25%
Number of salaries quoted 47,558 92,842 111,829
Median annual salary £55,000 £52,500 £52,500
Median salary % change year-on-year +4.76% - +5.00%
10th Percentile £32,500 £30,000 £29,750
90th Percentile £90,000 £87,500 £85,000
UK excluding London median annual salary £49,000 £46,000 £45,000
% change year-on-year +6.52% +2.22% -

Data Engineering
Job Vacancy Trend

Job postings citing Data Engineering as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineering in the UK

Data Engineering
Salary Trend

3-month moving average salary quoted in jobs citing Data Engineering.

Salary trend for Data Engineering in the UK

Data Engineering
Salary Histogram

Salary distribution for jobs citing Data Engineering over the 6 months to 23 January 2021.

Salary histogram for Data Engineering in the UK

Data Engineering
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineering within the UK over the 6 months to 23 January 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +137 645 £60,000 -14.29% 117
London +53 345 £67,500 -10.00% 67
UK excluding London +239 340 £57,500 +0.20% 56
Work from Home +27 130 £60,000 -20.00% 26
North of England +107 94 £57,500 +4.55% 18
South East +178 79 £57,500 -4.17% 8
Midlands +101 69 £57,500 +4.55% 12
North West +100 46 £60,000 -11.11% 12
East Midlands +93 39 £55,500 +0.91% 5
Yorkshire +58 39 £55,000 - 5
South West +76 34 £55,000 +22.22% 1
Scotland +52 34 £55,000 +10.00% 7
West Midlands +68 30 £60,000 +9.09% 7
East of England +71 11 £95,000 +26.67% 9
Northern Ireland +20 10 £45,000 +28.57%
Wales +50 9 £40,253 -0.61% 1
North East +10 9 £57,500 +5.18% 1

For the 6 months to 23 January 2021, IT jobs citing Data Engineering also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Data Engineering.

1 417 (58.49%) Python
2 344 (48.25%) Azure
3 338 (47.41%) AWS
4 337 (47.27%) SQL
5 298 (41.80%) Analytics
6 252 (35.34%) ETL
7 244 (34.22%) Business Intelligence
8 230 (32.26%) Data Warehouse
9 211 (29.59%) Data Science
10 205 (28.75%) Agile Software Development
11 191 (26.79%) Big Data
12 189 (26.51%) GCP
13 146 (20.48%) DevOps
14 145 (20.34%) Kafka
15 144 (20.20%) Apache Spark
16 139 (19.50%) Data Modelling
17 134 (18.79%) Machine Learning
18 126 (17.67%) Java
19 124 (17.39%) Hadoop
20 119 (16.69%) Artificial Intelligence
20 119 (16.69%) Power BI
20 119 (16.69%) Power Platform
21 108 (15.15%) Amazon Redshift
22 106 (14.87%) Finance
23 103 (14.45%) Visualisation
24 100 (14.03%) Software Engineering
25 99 (13.88%) Analytical Skills
26 98 (13.74%) Data Lake
27 95 (13.32%) Data Analytics
28 94 (13.18%) NoSQL

Data Engineering
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 144 (20.20%) Apache Spark
2 31 (4.35%) SAS
3 29 (4.07%) Apache
4 25 (3.51%) Apache Airflow
5 16 (2.24%) Elasticsearch
6 10 (1.40%) Luigi
7 3 (0.42%) Cloud Foundry
8 2 (0.28%) Confluence
9 1 (0.14%) ArcGIS
9 1 (0.14%) Jupyter
9 1 (0.14%) SharePoint
9 1 (0.14%) WebSphere
9 1 (0.14%) WebSphere Application Server
Applications
1 6 (0.84%) Microsoft Excel
2 1 (0.14%) Spreadsheet
Business Applications
1 2 (0.28%) Markit EDM
2 1 (0.14%) SAP APO
2 1 (0.14%) Sparx Enterprise Architect
Cloud Services
1 344 (48.25%) Azure
2 338 (47.41%) AWS
3 189 (26.51%) GCP
4 119 (16.69%) Power Platform
5 56 (7.85%) Azure Data Factory
6 39 (5.47%) Amazon S3
7 19 (2.66%) Amazon EC2
8 18 (2.52%) SaaS
8 18 (2.52%) Serverless
9 17 (2.38%) Amazon EMR
10 13 (1.82%) PaaS
11 12 (1.68%) Amazon SageMaker
11 12 (1.68%) AWS Lambda
12 11 (1.54%) Cloud Computing
13 10 (1.40%) Amazon EKS
13 10 (1.40%) IaaS
13 10 (1.40%) Logic Apps
14 8 (1.12%) AWS CloudFormation
14 8 (1.12%) GitHub
14 8 (1.12%) Trello
Communications & Networking
1 7 (0.98%) Internet
2 3 (0.42%) Skype
3 2 (0.28%) Extranet
3 2 (0.28%) Network Security
4 1 (0.14%) DNS
4 1 (0.14%) Intranet
4 1 (0.14%) SSH
Database & Business Intelligence
1 230 (32.26%) Data Warehouse
2 191 (26.79%) Big Data
3 124 (17.39%) Hadoop
4 119 (16.69%) Power BI
5 108 (15.15%) Amazon Redshift
6 98 (13.74%) Data Lake
7 94 (13.18%) NoSQL
8 93 (13.04%) Tableau
9 79 (11.08%) BigQuery
9 79 (11.08%) SQL Server
10 77 (10.80%) Snowflake Schema
11 51 (7.15%) SQL Server Integration Services
12 44 (6.17%) Looker
13 42 (5.89%) Pentaho
14 41 (5.75%) Azure SQL Database
14 41 (5.75%) Relational Database
15 37 (5.19%) PostgreSQL
16 36 (5.05%) Apache Hive
17 33 (4.63%) Amazon Athena
18 31 (4.35%) Azure SQL Data Warehouse
Development Applications
1 69 (9.68%) Git (software)
2 65 (9.12%) Jenkins
3 28 (3.93%) Bitbucket
4 24 (3.37%) Artifactory
4 24 (3.37%) Maven
5 23 (3.23%) JIRA
6 8 (1.12%) Atlassian Bamboo
7 7 (0.98%) Oracle APEX
7 7 (0.98%) Visual Studio
8 6 (0.84%) Vagrant
9 5 (0.70%) CircleCI
10 3 (0.42%) Cucumber
10 3 (0.42%) JUnit
11 2 (0.28%) ER Studio
11 2 (0.28%) ERwin
11 2 (0.28%) Mockito
11 2 (0.28%) SQL Server Management Studio (SSMS)
11 2 (0.28%) TeamCity
12 1 (0.14%) GitLab
12 1 (0.14%) SonarQube
General
1 106 (14.87%) Finance
2 35 (4.91%) Marketing
3 30 (4.21%) Law
4 29 (4.07%) Public Sector
5 25 (3.51%) Retail
6 13 (1.82%) Banking
7 10 (1.40%) Digital Economy
7 10 (1.40%) Legal
7 10 (1.40%) Manufacturing
8 9 (1.26%) Games
9 8 (1.12%) Advertising
10 5 (0.70%) Pharmaceutical
11 2 (0.28%) Front Office
11 2 (0.28%) Local Government
11 2 (0.28%) Retail Banking
11 2 (0.28%) Social Housing
11 2 (0.28%) Telecoms
12 1 (0.14%) General Ledger
12 1 (0.14%) Investment Banking
12 1 (0.14%) Police
Job Titles
1 386 (54.14%) Data Engineer
2 76 (10.66%) Developer
3 63 (8.84%) Python Engineer
4 47 (6.59%) Senior Data Engineer
5 44 (6.17%) Architect
6 40 (5.61%) Azure Engineer
7 33 (4.63%) Data Scientist
8 30 (4.21%) Data Architect
9 28 (3.93%) DevOps Engineer
10 26 (3.65%) Data Manager
11 25 (3.51%) AWS Engineer
11 25 (3.51%) Java Engineer
12 22 (3.09%) Big Data Engineer
12 22 (3.09%) Head of Engineering
13 20 (2.81%) Data Analytics Engineer
14 17 (2.38%) Consultant
14 17 (2.38%) Engineering Manager
15 16 (2.24%) Software Engineer
16 15 (2.10%) Cloud Engineer
17 14 (1.96%) Senior Data Scientist
Libraries, Frameworks & Software Standards
1 145 (20.34%) Kafka
2 32 (4.49%) Natural Language Processing
3 20 (2.81%) Node.js
4 17 (2.38%) PySpark
4 17 (2.38%) Web Services
5 16 (2.24%) RabbitMQ
6 15 (2.10%) Spark Streaming
7 14 (1.96%) React
7 14 (1.96%) TensorFlow
8 10 (1.40%) REST
9 9 (1.26%) Pandas
10 7 (0.98%) Lambda Expressions
10 7 (0.98%) NumPy
10 7 (0.98%) scikit-learn
11 6 (0.84%) XML
12 5 (0.70%) .NET
12 5 (0.70%) Swagger
13 4 (0.56%) CSS
13 4 (0.56%) JSON
13 4 (0.56%) MXNet
Miscellaneous
1 99 (13.88%) Analytical Skills
2 32 (4.49%) Algorithms
3 22 (3.09%) Greenfield Project
4 18 (2.52%) Data Structures
5 17 (2.38%) Cloud Native
6 16 (2.24%) Life Science
7 14 (1.96%) Clustering
8 13 (1.82%) Social Media
9 12 (1.68%) Tandem
10 11 (1.54%) Data Centre
11 8 (1.12%) Cyberattack
12 7 (0.98%) Acoustics
12 7 (0.98%) Public Cloud
13 6 (0.84%) Blog
13 6 (0.84%) Management Information System
14 5 (0.70%) Mobile App
15 4 (0.56%) NHS
15 4 (0.56%) Self-Motivation
15 4 (0.56%) Virtual Team
16 3 (0.42%) Renewable Energy
Operating Systems
1 40 (5.61%) Linux
2 12 (1.68%) Unix
3 8 (1.12%) Windows
4 7 (0.98%) Red Hat Enterprise Linux
5 1 (0.14%) CentOS
5 1 (0.14%) Windows Server
Processes & Methodologies
1 298 (41.80%) Analytics
2 252 (35.34%) ETL
3 244 (34.22%) Business Intelligence
4 211 (29.59%) Data Science
5 205 (28.75%) Agile Software Development
6 146 (20.48%) DevOps
7 139 (19.50%) Data Modelling
8 134 (18.79%) Machine Learning
9 119 (16.69%) Artificial Intelligence
10 103 (14.45%) Visualisation
11 100 (14.03%) Software Engineering
12 95 (13.32%) Data Analytics
13 90 (12.62%) Data Architecture
14 87 (12.20%) Data Management
15 67 (9.40%) Mentoring
16 66 (9.26%) Data Visualisation
17 62 (8.70%) Microservices
18 59 (8.27%) Fintech
19 58 (8.13%) Data Integration
20 52 (7.29%) Data Analysis
Programming Languages
1 417 (58.49%) Python
2 337 (47.27%) SQL
3 126 (17.67%) Java
4 83 (11.64%) R
5 58 (8.13%) Scala
6 52 (7.29%) C#
7 31 (4.35%) JavaScript
8 30 (4.21%) PL/SQL
9 29 (4.07%) Bash Shell
10 26 (3.65%) Go
11 19 (2.66%) C++
11 19 (2.66%) T-SQL
12 17 (2.38%) C
13 8 (1.12%) MATLAB
13 8 (1.12%) Shell Script
14 7 (0.98%) VBA
15 6 (0.84%) PowerShell
16 4 (0.56%) Cython
16 4 (0.56%) HiveQL
16 4 (0.56%) TypeScript
Qualifications
1 60 (8.42%) Degree
2 37 (5.19%) Security Cleared
3 33 (4.63%) SC Cleared
4 27 (3.79%) Computer Science Degree
5 13 (1.82%) AWS Certification
5 13 (1.82%) PhD
6 9 (1.26%) Microsoft Certification
7 3 (0.42%) DV Cleared
7 3 (0.42%) Numerate Degree
8 2 (0.28%) Master's Degree
8 2 (0.28%) Tableau Certification
9 1 (0.14%) PMI Certification
9 1 (0.14%) PMP
Quality Assurance & Compliance
1 49 (6.87%) Data Quality
2 27 (3.79%) QA
3 3 (0.42%) GDPR
4 1 (0.14%) ISO/IEC 27001
System Software
1 73 (10.24%) Docker
2 22 (3.09%) HDFS
3 7 (0.98%) Apache ZooKeeper
4 6 (0.84%) VirtualBox
5 4 (0.56%) Apache Flume
6 1 (0.14%) Active Directory
Systems Management
1 93 (13.04%) Terraform
2 75 (10.52%) Kubernetes
3 62 (8.70%) Ansible
4 14 (1.96%) Hadoop YARN
5 12 (1.68%) Opscode Chef
5 12 (1.68%) Puppet
6 8 (1.12%) Grafana
7 7 (0.98%) Graphite
7 7 (0.98%) Nagios
7 7 (0.98%) Opsview
7 7 (0.98%) Prometheus
8 6 (0.84%) Docker Swarm
9 3 (0.42%) Oozie
10 2 (0.28%) Single Sign-On
10 2 (0.28%) WebSphere Cast Iron
Vendors
1 74 (10.38%) Databricks
2 70 (9.82%) Microsoft
3 69 (9.68%) Google
4 67 (9.40%) Oracle
5 56 (7.85%) Cloudera
6 53 (7.43%) Talend
7 25 (3.51%) Informatica
8 15 (2.10%) Sun
9 12 (1.68%) Alteryx
10 10 (1.40%) Cognos
11 8 (1.12%) IBM
11 8 (1.12%) StreamSets
12 6 (0.84%) Hortonworks
12 6 (0.84%) MicroStrategy
12 6 (0.84%) TIBCO
13 5 (0.70%) MuleSoft
13 5 (0.70%) Salesforce.com
14 4 (0.56%) Dataiku
14 4 (0.56%) Intel
14 4 (0.56%) NVIDIA