Period
to 11 April 2021

The following table provides summary statistics for permanent job vacancies with a requirement for Data Engineering skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Engineering over the 6 months to 11 April 2021 with a comparison to the same period in the previous 2 years.

Data Engineering
UK
6 months to
11 Apr 2021
Same period 2020 Same period 2019
Rank 244 393 437
Rank change year-on-year +149 +44 +260
Permanent jobs citing Data Engineering 1,129 850 1,028
As % of all permanent jobs advertised in the UK 1.36% 0.75% 0.69%
As % of the Processes & Methodologies category 1.47% 0.81% 0.75%
Number of salaries quoted 918 671 788
10th Percentile £42,500 £43,750 £45,000
25th Percentile £48,750 £52,500 £52,500
Median annual salary (50th Percentile) £65,000 £72,500 £67,500
Median % change year-on-year -10.34% +7.41% -
75th Percentile £85,000 £87,500 £85,000
90th Percentile £95,000 £101,250 £102,500
UK excluding London median annual salary £57,500 £59,000 £62,138
% change year-on-year -2.54% -5.05% +12.98%

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for process or methodology skills.

All Process and Methodology Skills
UK
Permanent vacancies with a requirement for process or methodology skills 76,569 104,649 137,390
As % of all permanent IT jobs advertised in the UK 92.45% 92.14% 92.31%
Number of salaries quoted 59,055 84,002 109,346
10th Percentile £32,500 £31,250 £30,000
25th Percentile £41,250 £40,000 £37,500
Median annual salary (50th Percentile) £55,000 £55,000 £52,500
Median % change year-on-year - +4.76% +5.00%
75th Percentile £75,000 £72,500 £70,000
90th Percentile £90,000 £90,000 £85,000
UK excluding London median annual salary £48,500 £47,500 £45,000
% change year-on-year +2.11% +5.56% -

Data Engineering
Job Vacancy Trend

Job postings citing Data Engineering as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineering in the UK

Data Engineering
Salary Trend

3-month moving average salary quoted in jobs citing Data Engineering.

Salary trend for Data Engineering in the UK

Data Engineering
Salary Histogram

Salary distribution for jobs citing Data Engineering over the 6 months to 11 April 2021.

Salary histogram for Data Engineering in the UK

Data Engineering
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineering within the UK over the 6 months to 11 April 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +151 1,036 £65,000 -10.34% 169
London +106 600 £72,500 -6.45% 101
UK excluding London +210 484 £57,500 -2.54% 78
Work from Home +21 217 £70,000 -6.67% 39
North of England +89 112 £57,500 +5.18% 24
South East +137 110 £60,000 -7.69% 15
Midlands +86 103 £58,750 -2.08% 12
Yorkshire +58 68 £57,500 +4.55% 4
South West +30 60 £48,750 +8.33% 12
West Midlands +59 58 £60,000 -4.00% 9
East Midlands +47 45 £56,500 -1.74% 3
Scotland +23 44 £57,750 +10.00% 6
North West +52 34 £60,000 +26.32% 16
East of England +35 31 £95,000 +26.67% 5
Northern Ireland +17 13 £45,000 +28.57% 1
Wales +33 11 £38,626 +20.71% 3
North East +12 10 £57,500 +2.52% 4

For the 6 months to 11 April 2021, IT jobs citing Data Engineering also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Data Engineering.

1 672 (59.52%) Python
2 557 (49.34%) SQL
3 512 (45.35%) AWS
4 484 (42.87%) Analytics
5 477 (42.25%) Azure
6 411 (36.40%) ETL
7 399 (35.34%) Data Science
8 393 (34.81%) Agile Software Development
9 369 (32.68%) Big Data
10 318 (28.17%) GCP
11 315 (27.90%) Data Warehouse
12 308 (27.28%) Business Intelligence
13 261 (23.12%) Apache Spark
14 259 (22.94%) DevOps
15 242 (21.43%) Artificial Intelligence
16 224 (19.84%) Machine Learning
17 221 (19.57%) Software Engineering
18 210 (18.60%) Hadoop
19 205 (18.16%) Java
20 187 (16.56%) Kafka
21 185 (16.39%) Data Modelling
22 177 (15.68%) Amazon Redshift
23 176 (15.59%) Google
24 173 (15.32%) Finance
25 172 (15.23%) Visualisation
26 160 (14.17%) Docker
27 159 (14.08%) Kubernetes
28 158 (13.99%) Tableau
28 158 (13.99%) NoSQL
29 155 (13.73%) Terraform

Data Engineering
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 261 (23.12%) Apache Spark
2 61 (5.40%) Apache Airflow
3 54 (4.78%) SAS
4 39 (3.45%) Apache
5 33 (2.92%) Luigi
6 24 (2.13%) Elasticsearch
7 10 (0.89%) Confluence
8 5 (0.44%) Apache Pig
8 5 (0.44%) Apache Synapse
9 3 (0.27%) Gunicorn
9 3 (0.27%) Jupyter
9 3 (0.27%) Tomcat
10 2 (0.18%) ArcGIS
11 1 (0.089%) IBM Domino
11 1 (0.089%) SharePoint
Applications
1 17 (1.51%) Microsoft Excel
2 1 (0.089%) Microsoft PowerPoint
2 1 (0.089%) Spreadsheet
Business Applications
1 4 (0.35%) FastStats
2 2 (0.18%) Sentinel
3 1 (0.089%) SAP APO
3 1 (0.089%) Sparx Enterprise Architect
Cloud Services
1 512 (45.35%) AWS
2 477 (42.25%) Azure
3 318 (28.17%) GCP
4 153 (13.55%) Power Platform
5 61 (5.40%) Serverless
6 59 (5.23%) Amazon EMR
7 58 (5.14%) Azure Data Factory
8 42 (3.72%) IBM Cloud
9 41 (3.63%) Amazon S3
9 41 (3.63%) SaaS
10 27 (2.39%) AWS Lambda
11 26 (2.30%) AWS CloudFormation
12 24 (2.13%) PaaS
13 22 (1.95%) Amazon Kinesis
13 22 (1.95%) Cloud Computing
14 20 (1.77%) Google Compute Engine
15 19 (1.68%) Cloud Functions
15 19 (1.68%) Google App Engine
15 19 (1.68%) IaaS
16 18 (1.59%) Amazon EC2
Communications & Networking
1 9 (0.80%) Internet
2 4 (0.35%) Network Security
3 3 (0.27%) Extranet
3 3 (0.27%) Skype
4 2 (0.18%) DSL
4 2 (0.18%) FTP
5 1 (0.089%) Broadband
5 1 (0.089%) HTTP
5 1 (0.089%) Intranet
5 1 (0.089%) Intrusion Detection
5 1 (0.089%) SSH
5 1 (0.089%) TCP/IP
Database & Business Intelligence
1 369 (32.68%) Big Data
2 315 (27.90%) Data Warehouse
3 210 (18.60%) Hadoop
4 177 (15.68%) Amazon Redshift
5 158 (13.99%) NoSQL
5 158 (13.99%) Tableau
6 151 (13.37%) Power BI
7 132 (11.69%) Data Lake
8 127 (11.25%) BigQuery
9 105 (9.30%) SQL Server
10 86 (7.62%) Snowflake Schema
11 74 (6.55%) Amazon Athena
12 73 (6.47%) SQL Server Integration Services
13 71 (6.29%) Relational Database
14 60 (5.31%) Looker
15 55 (4.87%) PostgreSQL
16 52 (4.61%) Neo4j
17 50 (4.43%) Apache Hive
18 47 (4.16%) Azure SQL Database
19 46 (4.07%) MongoDB
Development Applications
1 120 (10.63%) Jenkins
2 85 (7.53%) Git (software)
3 58 (5.14%) Atlassian Bamboo
4 49 (4.34%) Vagrant
5 28 (2.48%) Bitbucket
6 23 (2.04%) JIRA
7 20 (1.77%) Artifactory
8 16 (1.42%) Maven
9 14 (1.24%) GitLab
9 14 (1.24%) Oracle APEX
10 9 (0.80%) Visual Studio
11 6 (0.53%) CircleCI
11 6 (0.53%) Hudson
11 6 (0.53%) TeamCity
12 5 (0.44%) Sonatype Nexus
13 4 (0.35%) Arsenale Dataplane
13 4 (0.35%) Travis CI
14 3 (0.27%) JUnit
14 3 (0.27%) Spinnaker
15 2 (0.18%) ERwin
General
1 173 (15.32%) Finance
2 75 (6.64%) Marketing
3 47 (4.16%) Public Sector
3 47 (4.16%) Retail
4 46 (4.07%) Banking
5 41 (3.63%) Law
6 35 (3.10%) Manufacturing
7 24 (2.13%) Telecoms
8 23 (2.04%) Advertising
8 23 (2.04%) Electronics
9 21 (1.86%) Games
10 20 (1.77%) Legal
11 10 (0.89%) Digital Economy
12 7 (0.62%) Brand Awareness
13 6 (0.53%) Financial Institution
13 6 (0.53%) French Language
13 6 (0.53%) German Language
13 6 (0.53%) Italian Language
13 6 (0.53%) Spanish Language
14 4 (0.35%) Czech Language
Job Titles
1 545 (48.27%) Data Engineer
2 102 (9.03%) Developer
3 99 (8.77%) Senior Data Engineer
4 89 (7.88%) Architect
5 86 (7.62%) Python Engineer
6 64 (5.67%) Data Architect
7 56 (4.96%) AWS Engineer
8 54 (4.78%) Azure Engineer
9 53 (4.69%) Data Scientist
10 43 (3.81%) Data Analytics Engineer
10 43 (3.81%) Head of Engineering
11 39 (3.45%) Big Data Engineer
12 38 (3.37%) Analyst
12 38 (3.37%) Consultant
13 33 (2.92%) Software Engineer
14 32 (2.83%) DevOps Engineer
14 32 (2.83%) Java Engineer
15 30 (2.66%) Data Manager
15 30 (2.66%) Platform Engineer
16 26 (2.30%) Engineering Manager
Libraries, Frameworks & Software Standards
1 187 (16.56%) Kafka
2 62 (5.49%) Spark Streaming
3 44 (3.90%) PySpark
4 42 (3.72%) Natural Language Processing
4 42 (3.72%) REST
5 37 (3.28%) React
6 35 (3.10%) Node.js
7 26 (2.30%) RabbitMQ
8 25 (2.21%) Web Services
9 23 (2.04%) TensorFlow
10 21 (1.86%) Pandas
11 18 (1.59%) AngularJS
12 17 (1.51%) NumPy
13 16 (1.42%) JSON
14 15 (1.33%) OLE
15 14 (1.24%) Spring
16 13 (1.15%) .NET
16 13 (1.15%) scikit-learn
17 12 (1.06%) Spring Boot
17 12 (1.06%) XML
Miscellaneous
1 145 (12.84%) Analytical Skills
2 52 (4.61%) Algorithms
3 35 (3.10%) Data Structures
4 34 (3.01%) Greenfield Project
5 30 (2.66%) Cloud Native
6 27 (2.39%) Life Science
7 23 (2.04%) User Experience
8 15 (1.33%) Cyberattack
8 15 (1.33%) Management Information System
8 15 (1.33%) Virtual Team
9 13 (1.15%) Tandem
10 12 (1.06%) Acoustics
11 11 (0.97%) Social Media
12 10 (0.89%) Blog
12 10 (0.89%) Data Centre
12 10 (0.89%) NHS
12 10 (0.89%) Self-Motivation
13 9 (0.80%) iPad
14 7 (0.62%) Analytical Mindset
14 7 (0.62%) Mobile App
Operating Systems
1 88 (7.79%) Linux
2 29 (2.57%) Unix
3 14 (1.24%) Windows
4 8 (0.71%) SUSE Linux Enterprise Server
5 7 (0.62%) Red Hat Enterprise Linux
6 3 (0.27%) Android
6 3 (0.27%) Apple iOS
7 1 (0.089%) CentOS
Processes & Methodologies
1 484 (42.87%) Analytics
2 411 (36.40%) ETL
3 399 (35.34%) Data Science
4 393 (34.81%) Agile Software Development
5 308 (27.28%) Business Intelligence
6 259 (22.94%) DevOps
7 242 (21.43%) Artificial Intelligence
8 224 (19.84%) Machine Learning
9 221 (19.57%) Software Engineering
10 185 (16.39%) Data Modelling
11 172 (15.23%) Visualisation
12 150 (13.29%) Data Analytics
13 129 (11.43%) Data Architecture
13 129 (11.43%) Mentoring
14 121 (10.72%) Project Management
15 118 (10.45%) Data Management
16 109 (9.65%) Data Visualisation
17 104 (9.21%) Data Integration
18 101 (8.95%) Microservices
18 101 (8.95%) Scrum
Programming Languages
1 672 (59.52%) Python
2 557 (49.34%) SQL
3 205 (18.16%) Java
4 133 (11.78%) R
5 97 (8.59%) Scala
6 85 (7.53%) JavaScript
7 62 (5.49%) C#
8 45 (3.99%) Bash Shell
9 43 (3.81%) Go
10 35 (3.10%) PL/SQL
11 33 (2.92%) C++
12 32 (2.83%) T-SQL
13 27 (2.39%) TypeScript
14 25 (2.21%) C
15 17 (1.51%) PowerShell
15 17 (1.51%) Shell Script
16 12 (1.06%) MATLAB
17 10 (0.89%) Ruby
18 9 (0.80%) HiveQL
19 8 (0.71%) Data Analysis Expressions (DAX)
Qualifications
1 106 (9.39%) Degree
2 54 (4.78%) Security Cleared
3 47 (4.16%) SC Cleared
4 38 (3.37%) Computer Science Degree
5 21 (1.86%) PhD
6 11 (0.97%) DV Cleared
7 7 (0.62%) AWS Certification
8 5 (0.44%) Master's Degree
8 5 (0.44%) Tableau Certification
9 4 (0.35%) Microsoft Certification
9 4 (0.35%) TOGAF Certification
10 3 (0.27%) ISTQB
10 3 (0.27%) Numerate Degree
11 2 (0.18%) BPSS Clearance
11 2 (0.18%) ISTQB Foundation Certification
12 1 (0.089%) PMI Certification
12 1 (0.089%) PMP
12 1 (0.089%) SAS Certification
Quality Assurance & Compliance
1 68 (6.02%) Data Quality
2 43 (3.81%) QA
3 8 (0.71%) GDPR
4 3 (0.27%) GRC
5 2 (0.18%) HIPAA
6 1 (0.089%) Actionable Recommendations
6 1 (0.089%) ISO/IEC 27001
6 1 (0.089%) PMO
System Software
1 160 (14.17%) Docker
2 42 (3.72%) VirtualBox
3 28 (2.48%) HDFS
4 6 (0.53%) Apache ZooKeeper
5 3 (0.27%) Virtual Machines
Systems Management
1 159 (14.08%) Kubernetes
2 155 (13.73%) Terraform
3 114 (10.10%) Ansible
4 48 (4.25%) Docker Swarm
5 29 (2.57%) Puppet
6 27 (2.39%) Opscode Chef
7 17 (1.51%) Hadoop YARN
8 15 (1.33%) Grafana
9 13 (1.15%) Graphite
9 13 (1.15%) Nagios
9 13 (1.15%) Opsview
10 9 (0.80%) Packer
11 8 (0.71%) Prometheus
12 6 (0.53%) Consul
12 6 (0.53%) Salt
12 6 (0.53%) ZABBIX
13 4 (0.35%) Ambari
13 4 (0.35%) Istio
14 2 (0.18%) Kibana
15 1 (0.089%) WebSphere Cast Iron
Vendors
1 176 (15.59%) Google
2 130 (11.51%) Microsoft
3 108 (9.57%) Databricks
4 99 (8.77%) Cloudera
4 99 (8.77%) Talend
5 90 (7.97%) Oracle
6 76 (6.73%) Informatica
7 53 (4.69%) IBM
8 52 (4.61%) Hortonworks
9 25 (2.21%) Salesforce.com
10 21 (1.86%) SAP
11 18 (1.59%) Sun
12 16 (1.42%) Alteryx
13 14 (1.24%) Teradata
14 13 (1.15%) ESRI
15 12 (1.06%) Cognos
16 8 (0.71%) Dataiku
16 8 (0.71%) StreamSets
17 7 (0.62%) Adobe
17 7 (0.62%) MuleSoft