Period
to 11 April 2021

The following table provides summary statistics for contract job vacancies with a requirement for Data Engineering skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Engineering over the 6 months to 11 April 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineering
UK
6 months to
11 Apr 2021
Same period 2020 Same period 2019
Rank 194 346 460
Rank change year-on-year +152 +114 +172
Contract jobs citing Data Engineering 661 406 468
As % of all contract jobs advertised in the UK 1.26% 0.68% 0.48%
As % of the Processes & Methodologies category 1.45% 0.80% 0.55%
Number of daily rates quoted 421 289 327
10th Percentile £400 £400 £406
25th Percentile £450 £475 £461
Median daily rate (50th Percentile) £538 £550 £525
Median % change year-on-year -2.27% +4.76% -
75th Percentile £613 £650 £600
90th Percentile £688 £750 £667
UK excluding London median daily rate £475 £500 £500
% change year-on-year -5.00% - +8.11%
Number of hourly rates quoted 12 1 2
10th Percentile £21.30 " £22.36
25th Percentile £24.19 " £27.59
Median hourly rate £35.69 £19.18 £38.19
Median % change year-on-year +86.08% -49.77% +25.20%
75th Percentile £55.38 " £50.66
90th Percentile £65.50 " £57.01
UK excluding London median hourly rate £31.69 £19.18 £38.19
% change year-on-year +65.22% -49.77% +25.20%

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for process or methodology skills.

All Process and Methodology Skills
UK
Contract vacancies with a requirement for process or methodology skills 45,608 50,839 84,477
As % of all contract IT jobs advertised in the UK 86.76% 85.23% 87.51%
Number of daily rates quoted 31,207 33,837 57,059
10th Percentile £305 £281 £300
25th Percentile £400 £375 £375
Median daily rate (50th Percentile) £480 £475 £475
Median % change year-on-year +1.05% - +5.56%
75th Percentile £575 £575 £575
90th Percentile £669 £650 £650
UK excluding London median daily rate £433 £445 £430
% change year-on-year -2.81% +3.49% +3.61%
Number of hourly rates quoted 1,441 1,617 1,998
10th Percentile £12.25 £12.30 £11.62
25th Percentile £15.75 £15.75 £14.50
Median hourly rate £26.00 £21.50 £22.88
Median % change year-on-year +20.93% -6.01% +6.40%
75th Percentile £47.00 £45.75 £43.75
90th Percentile £58.75 £55.00 £50.00
UK excluding London median hourly rate £23.00 £20.03 £22.40
% change year-on-year +14.86% -10.60% +12.00%

Data Engineering
Job Vacancy Trend

Job postings citing Data Engineering as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineering in the UK

Data Engineering
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Engineering.

Daily rate trend for Data Engineering in the UK

Data Engineering
Daily Rate Histogram

Daily rate distribution for jobs citing Data Engineering over the 6 months to 11 April 2021.

Daily rate histogram for Data Engineering in the UK

Data Engineering
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Engineering.

Hourly rate trend for Data Engineering in the UK

Data Engineering
Hourly Rate Histogram

Hourly rate distribution of jobs citing Data Engineering over the 6 months to 11 April 2021.

Hourly rate histogram for Data Engineering in the UK

Data Engineering
Top 17 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineering within the UK over the 6 months to 11 April 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +125 530 £539 -2.05% 162
London +56 333 £550 -4.35% 95
Work from Home -62 215 £525 -11.58% 39
UK excluding London +124 169 £475 -5.00% 77
North of England +101 55 £450 -18.18% 24
South East +68 35 £500 -18.37% 15
Scotland +27 25 £425 -5.56% 6
North West +50 24 £463 -15.91% 16
South West +84 23 £675 +68.75% 12
Yorkshire +54 21 £438 -20.45% 4
North East +35 11 £438 -20.45% 4
East of England +32 11 £515 +8.42% 5
Midlands +5 10 £400 -20.00% 11
Wales +10 9 £450 -5.26% 3
East Midlands +27 6 £400 -15.79% 2
West Midlands -7 4 £425 -15.00% 9
Northern Ireland - 1 £400 - 1

For the 6 months to 11 April 2021, IT contractor jobs citing Data Engineering also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Engineering.

1 370 (55.98%) Python
2 314 (47.50%) SQL
3 262 (39.64%) Azure
4 249 (37.67%) Agile Software Development
5 194 (29.35%) Analytics
6 193 (29.20%) ETL
7 185 (27.99%) AWS
8 175 (26.48%) DevOps
9 164 (24.81%) Big Data
10 156 (23.60%) Data Modelling
11 144 (21.79%) Apache Spark
12 143 (21.63%) Java
13 142 (21.48%) Data Science
14 122 (18.46%) Finance
15 117 (17.70%) Databricks
16 111 (16.79%) Data Warehouse
17 109 (16.49%) Business Intelligence
18 104 (15.73%) Scala
19 102 (15.43%) Hadoop
20 101 (15.28%) GCP
21 97 (14.67%) Visualisation
22 92 (13.92%) NoSQL
22 92 (13.92%) Security Cleared
23 91 (13.77%) Data Lake
24 90 (13.62%) Serverless
25 89 (13.46%) Kafka
26 87 (13.16%) Data Management
27 86 (13.01%) Git (software)
27 86 (13.01%) Kubernetes
28 83 (12.56%) Analytical Skills

Data Engineering
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 144 (21.79%) Apache Spark
2 56 (8.47%) Apache Airflow
3 42 (6.35%) Apache
4 29 (4.39%) BizTalk Server
5 23 (3.48%) Jupyter
6 17 (2.57%) Confluence
7 16 (2.42%) Elasticsearch
8 15 (2.27%) SAS
9 14 (2.12%) Cloud Foundry
10 10 (1.51%) Apache Synapse
10 10 (1.51%) Mule
11 8 (1.21%) SharePoint
12 4 (0.61%) nginx
13 3 (0.45%) Apache Pulsar
13 3 (0.45%) ArcGIS
13 3 (0.45%) Luigi
14 2 (0.30%) Jetty
14 2 (0.30%) OpenWhisk
14 2 (0.30%) Tomcat
15 1 (0.15%) WebSphere
Applications
1 21 (3.18%) Microsoft Excel
2 7 (1.06%) Microsoft PowerPoint
3 3 (0.45%) SPSS
4 2 (0.30%) Spreadsheet
5 1 (0.15%) MS Visio
Business Applications
1 3 (0.45%) Sparx Enterprise Architect
2 2 (0.30%) Shopify
3 1 (0.15%) Dynamics CRM
3 1 (0.15%) NetSuite
3 1 (0.15%) Oracle EBS
3 1 (0.15%) Refinitiv Enterprise Platform
3 1 (0.15%) RMDS
3 1 (0.15%) SAP Oil and Gas
3 1 (0.15%) Unit4 Business World
Cloud Services
1 262 (39.64%) Azure
2 185 (27.99%) AWS
3 101 (15.28%) GCP
4 90 (13.62%) Serverless
5 73 (11.04%) Power Platform
6 68 (10.29%) Azure Data Factory
7 65 (9.83%) AWS Lambda
8 55 (8.32%) Amazon S3
9 54 (8.17%) Azure Functions
10 37 (5.60%) Amazon EMR
11 33 (4.99%) Logic Apps
12 30 (4.54%) GitHub
13 20 (3.03%) AWS CloudFormation
14 17 (2.57%) PaaS
15 12 (1.82%) IaaS
16 11 (1.66%) Amazon EC2
16 11 (1.66%) Amazon SageMaker
16 11 (1.66%) OpenShift
17 9 (1.36%) Amazon EKS
17 9 (1.36%) Slack
Communications & Networking
1 9 (1.36%) SSL
2 5 (0.76%) Kerberos
3 4 (0.61%) SSH
4 3 (0.45%) Unified Communications
5 2 (0.30%) Extranet
5 2 (0.30%) HTTP
5 2 (0.30%) Internet
5 2 (0.30%) Network Security
6 1 (0.15%) 4G
6 1 (0.15%) Cisco Firepower
6 1 (0.15%) Firewall
6 1 (0.15%) FTP
6 1 (0.15%) HTTPS
6 1 (0.15%) Intrusion Detection
6 1 (0.15%) MQTT
6 1 (0.15%) TACACS
6 1 (0.15%) Wi-Fi
Database & Business Intelligence
1 164 (24.81%) Big Data
2 111 (16.79%) Data Warehouse
3 102 (15.43%) Hadoop
4 92 (13.92%) NoSQL
5 91 (13.77%) Data Lake
6 75 (11.35%) Apache Hive
7 73 (11.04%) Power BI
8 60 (9.08%) Relational Database
9 58 (8.77%) MongoDB
10 52 (7.87%) Azure SQL Database
11 45 (6.81%) BigQuery
12 43 (6.51%) Tableau
13 42 (6.35%) Impala
14 31 (4.69%) SQL Server
15 28 (4.24%) Amazon Redshift
16 27 (4.08%) HBase
17 26 (3.93%) PostgreSQL
17 26 (3.93%) SQL Server Integration Services
18 24 (3.63%) Amazon Athena
18 24 (3.63%) Snowflake Schema
Development Applications
1 86 (13.01%) Git (software)
2 68 (10.29%) Jenkins
3 51 (7.72%) JIRA
4 23 (3.48%) Maven
5 17 (2.57%) Sonatype Nexus
6 12 (1.82%) IntelliJ
6 12 (1.82%) JUnit
6 12 (1.82%) Mockito
7 10 (1.51%) Selenium
8 9 (1.36%) Android Studio
8 9 (1.36%) CocoaPods
8 9 (1.36%) Xcode
9 7 (1.06%) CircleCI
10 6 (0.91%) Cucumber
10 6 (0.91%) ERwin
10 6 (0.91%) SonarQube
11 5 (0.76%) Atlassian Bamboo
12 4 (0.61%) Gradle
12 4 (0.61%) TeamCity
12 4 (0.61%) Vagrant
General
1 122 (18.46%) Finance
2 48 (7.26%) Public Sector
3 44 (6.66%) Banking
4 26 (3.93%) Marketing
5 25 (3.78%) Retail
6 13 (1.97%) Retail Banking
7 9 (1.36%) Games
8 8 (1.21%) Back Office
8 8 (1.21%) Telecoms
9 7 (1.06%) Front Office
9 7 (1.06%) Manufacturing
9 7 (1.06%) Pharmaceutical
10 6 (0.91%) Electronics
11 4 (0.61%) Law
11 4 (0.61%) Publishing
12 3 (0.45%) Financial Institution
12 3 (0.45%) Investment Banking
12 3 (0.45%) Legal
13 1 (0.15%) Advertising
13 1 (0.15%) Multimedia
Job Titles
1 307 (46.44%) Data Engineer
2 82 (12.41%) Developer
3 59 (8.93%) Azure Engineer
4 50 (7.56%) Architect
5 43 (6.51%) Analyst
6 42 (6.35%) Python Engineer
7 40 (6.05%) AWS Engineer
8 32 (4.84%) Data Scientist
9 31 (4.69%) DevOps Engineer
10 30 (4.54%) Python Developer
11 25 (3.78%) Senior Data Engineer
12 24 (3.63%) Data Analyst
12 24 (3.63%) Data Architect
13 23 (3.48%) Cloud Engineer
14 17 (2.57%) Data Manager
14 17 (2.57%) Java Engineer
15 16 (2.42%) Azure Developer
15 16 (2.42%) Senior Developer
16 15 (2.27%) Big Data Engineer
16 15 (2.27%) Consultant
Libraries, Frameworks & Software Standards
1 89 (13.46%) Kafka
2 59 (8.93%) PySpark
3 38 (5.75%) JSON
4 30 (4.54%) NumPy
5 29 (4.39%) Pandas
6 24 (3.63%) REST
6 24 (3.63%) Velocity
7 21 (3.18%) Node.js
7 21 (3.18%) Spring
8 20 (3.03%) Spark Streaming
9 18 (2.72%) React
10 17 (2.57%) .NET
11 16 (2.42%) Spring Boot
12 15 (2.27%) SciPy
13 14 (2.12%) scikit-learn
14 11 (1.66%) XML
15 9 (1.36%) WireMock
16 8 (1.21%) .NET Core
16 8 (1.21%) Web Services
16 8 (1.21%) YAML
Miscellaneous
1 83 (12.56%) Analytical Skills
2 53 (8.02%) Cloud Native
3 31 (4.69%) Greenfield Project
4 26 (3.93%) Algorithms
4 26 (3.93%) Data Structures
5 21 (3.18%) iPad
6 14 (2.12%) Mobile App
7 12 (1.82%) Virtual Team
8 10 (1.51%) Self-Motivation
9 9 (1.36%) Analytical Mindset
9 9 (1.36%) FMCG
9 9 (1.36%) User Experience
10 7 (1.06%) Linked Data
11 6 (0.91%) Hedge funds
11 6 (0.91%) Reinsurance
12 5 (0.76%) EPoS
12 5 (0.76%) Lidar
12 5 (0.76%) Management Information System
12 5 (0.76%) Replication
12 5 (0.76%) Tandem
Operating Systems
1 34 (5.14%) Unix
2 27 (4.08%) Linux
3 13 (1.97%) AIX
3 13 (1.97%) Android
4 12 (1.82%) Windows
5 11 (1.66%) Apple iOS
6 1 (0.15%) CentOS
6 1 (0.15%) Windows Server
Processes & Methodologies
1 249 (37.67%) Agile Software Development
2 194 (29.35%) Analytics
3 193 (29.20%) ETL
4 175 (26.48%) DevOps
5 156 (23.60%) Data Modelling
6 142 (21.48%) Data Science
7 109 (16.49%) Business Intelligence
8 97 (14.67%) Visualisation
9 87 (13.16%) Data Management
10 83 (12.56%) Machine Learning
11 81 (12.25%) Software Engineering
12 71 (10.74%) Scrum
13 63 (9.53%) Continuous Improvement
13 63 (9.53%) Data Architecture
14 62 (9.38%) Data Ingestion
15 59 (8.93%) Test Automation
16 58 (8.77%) Microservices
17 54 (8.17%) Data Analytics
17 54 (8.17%) Decision-Making
18 52 (7.87%) Data Visualisation
Programming Languages
1 370 (55.98%) Python
2 314 (47.50%) SQL
3 143 (21.63%) Java
4 104 (15.73%) Scala
5 56 (8.47%) R
6 44 (6.66%) T-SQL
7 40 (6.05%) C++
8 39 (5.90%) Go
9 37 (5.60%) PL/SQL
10 33 (4.99%) C#
11 24 (3.63%) VBA
12 20 (3.03%) JavaScript
13 16 (2.42%) MATLAB
14 15 (2.27%) Java 8
15 13 (1.97%) Bash Shell
16 12 (1.82%) Kotlin
17 10 (1.51%) Apple Swift
18 6 (0.91%) TypeScript
19 5 (0.76%) PowerShell
20 4 (0.61%) Shell Script
Qualifications
1 92 (13.92%) Security Cleared
2 80 (12.10%) SC Cleared
3 46 (6.96%) Degree
4 19 (2.87%) DV Cleared
5 10 (1.51%) AWS Certification
5 10 (1.51%) PhD
6 6 (0.91%) BPSS Clearance
6 6 (0.91%) ISEB
7 5 (0.76%) Computer Science Degree
7 5 (0.76%) HND
8 4 (0.61%) Numerate Degree
8 4 (0.61%) TOGAF Certification
9 3 (0.45%) Master's Degree
10 2 (0.30%) DBS Check
10 2 (0.30%) Microsoft Certification
10 2 (0.30%) PMP
11 1 (0.15%) CISM
11 1 (0.15%) CISSP
11 1 (0.15%) ISTQB
Quality Assurance & Compliance
1 55 (8.32%) Data Quality
2 41 (6.20%) QA
3 5 (0.76%) GDPR
3 5 (0.76%) MiFID
4 3 (0.45%) Disclosure Scotland
5 1 (0.15%) Actionable Recommendations
5 1 (0.15%) IFRS
5 1 (0.15%) PMO
5 1 (0.15%) SLA
System Software
1 47 (7.11%) Docker
2 33 (4.99%) HDFS
3 5 (0.76%) Virtual Machines
4 2 (0.30%) Apache Flume
5 1 (0.15%) Active Directory
5 1 (0.15%) KVM
5 1 (0.15%) Snort
Systems Management
1 86 (13.01%) Kubernetes
2 51 (7.72%) Terraform
3 15 (2.27%) Opscode Chef
4 14 (2.12%) Ansible
5 11 (1.66%) Oozie
6 8 (1.21%) Puppet
7 6 (0.91%) Argo
8 5 (0.76%) Grafana
8 5 (0.76%) Hadoop YARN
9 4 (0.61%) Docker Swarm
9 4 (0.61%) Packer
9 4 (0.61%) Prometheus
10 2 (0.30%) Salt
11 1 (0.15%) FreeIPA
11 1 (0.15%) Kibana
11 1 (0.15%) Kubeflow
11 1 (0.15%) Rancher
11 1 (0.15%) Thomson Reuters DACS
11 1 (0.15%) ZABBIX
Vendors
1 117 (17.70%) Databricks
2 68 (10.29%) Microsoft
3 65 (9.83%) Google
4 62 (9.38%) Oracle
5 37 (5.60%) Cloudera
6 32 (4.84%) SAP
7 31 (4.69%) MuleSoft
8 27 (4.08%) Informatica
9 25 (3.78%) Alteryx
10 19 (2.87%) Dataiku
11 14 (2.12%) IBM
12 12 (1.82%) Splunk
13 9 (1.36%) AppDynamics
13 9 (1.36%) Salesforce.com
14 7 (1.06%) Teradata
15 6 (0.91%) Confluent
16 5 (0.76%) Atlassian
16 5 (0.76%) Facebook
16 5 (0.76%) StreamSets
17 4 (0.61%) Talend