Period
to 24 September 2021

The median contractor rate for a Data Engineer was £525 per day in advertised job vacancies during the 6 months to 24 September 2021.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
UK
6 months to
24 Sep 2021
Same period 2020 Same period 2019
Rank 101 162 192
Rank change year-on-year +61 +30 +129
Contract jobs requiring a Data Engineer 1,994 504 1,315
As % of all contract jobs advertised in the UK 2.48% 1.70% 1.48%
As % of the Job Titles category 2.66% 1.84% 1.58%
Number of daily rates quoted 1,398 363 989
10th Percentile £413 £363 £407
25th Percentile £463 £414 £463
Median daily rate (50th Percentile) £525 £500 £550
Median % change year-on-year +5.00% -9.09% -
75th Percentile £616 £588 £613
90th Percentile £675 £661 £675
UK excluding London median daily rate £500 £475 £500
% change year-on-year +5.26% -5.00% -
Number of hourly rates quoted 15 10 12
10th Percentile £23.97 £15.08 "
25th Percentile £25.63 £19.75 £15.00
Median hourly rate £29.00 £22.50 £17.25
Median % change year-on-year +28.89% +30.43% -23.33%
75th Percentile £40.03 £26.89 £36.30
90th Percentile £53.05 £57.88 £52.18
UK excluding London median hourly rate £25.25 £22.44 £20.25
% change year-on-year +12.52% +10.81% +9.46%

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
UK
Contract vacancies in the UK with a recognized job title 74,872 27,464 83,466
% of contract IT jobs with a recognized job title 93.12% 92.37% 94.23%
Number of daily rates quoted 51,755 18,381 55,806
10th Percentile £300 £263 £263
25th Percentile £406 £363 £363
Median daily rate (50th Percentile) £500 £475 £463
Median % change year-on-year +5.26% +2.70% +2.78%
75th Percentile £600 £575 £573
90th Percentile £690 £663 £650
UK excluding London median daily rate £450 £430 £425
% change year-on-year +4.65% +1.18% +2.41%
Number of hourly rates quoted 2,073 898 2,757
10th Percentile £11.50 £11.17 £11.17
25th Percentile £13.50 £14.25 £13.51
Median hourly rate £20.00 £21.83 £19.00
Median % change year-on-year -8.36% +14.87% +8.57%
75th Percentile £45.00 £43.75 £43.75
90th Percentile £61.70 £53.75 £52.50
UK excluding London median hourly rate £17.50 £20.00 £17.50
% change year-on-year -12.50% +14.29% +0.03%

Data Engineer
Job Vacancy Trend

Job postings that featured Data Engineer in the job title as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineer in the UK

Data Engineer
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Engineer.

Daily rate trend for Data Engineer in the UK

Data Engineer
Daily Rate Histogram

Daily rate distribution for jobs citing Data Engineer over the 6 months to 24 September 2021.

Daily rate histogram for Data Engineer in the UK

Data Engineer
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Engineer.

Hourly rate trend for Data Engineer in the UK

Data Engineer
Hourly Rate Histogram

Hourly rate distribution of jobs citing Data Engineer over the 6 months to 24 September 2021.

Hourly rate histogram for Data Engineer in the UK

Data Engineer
Top 17 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the UK over the 6 months to 24 September 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +58 1,519 £540 +8.00% 309
London +44 1,001 £550 +4.76% 179
Work from Home +26 697 £525 - 48
UK excluding London +20 526 £500 +5.26% 139
South East -15 136 £525 +10.53% 29
North of England +12 131 £497 +17.00% 34
Scotland -22 78 £520 +30.00% 13
Midlands -15 63 £479 +19.63% 25
Yorkshire -1 58 £463 +15.63% 5
West Midlands -9 56 £488 +21.88% 20
South West -12 54 £500 +12.36% 19
North West -20 50 £500 +18.76% 26
East of England -46 28 £429 -25.43% 14
North East +8 23 £600 +29.73% 3
Wales -17 23 £475 -5.00% 3
Northern Ireland - 14 £470 - 2
East Midlands -43 5 £425 +13.33% 5

Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 24 September 2021, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads featuring Data Engineer in the job title.

1 1,128 (56.57%) Python
2 1,078 (54.06%) SQL
3 758 (38.01%) Azure
4 582 (29.19%) AWS
5 557 (27.93%) ETL
6 523 (26.23%) Analytics
7 519 (26.03%) Data Engineering
8 508 (25.48%) Apache Spark
9 480 (24.07%) Data Pipeline
10 477 (23.92%) Databricks
11 470 (23.57%) Agile Software Development
12 467 (23.42%) Data Modelling
13 453 (22.72%) Data Warehouse
14 428 (21.46%) Big Data
15 426 (21.36%) Java
16 407 (20.41%) DevOps
17 402 (20.16%) Data Lake
18 398 (19.96%) Scala
19 378 (18.96%) Business Intelligence
20 353 (17.70%) Finance
21 345 (17.30%) Kafka
22 336 (16.85%) Azure Data Factory
23 323 (16.20%) Social Skills
24 314 (15.75%) Hadoop
25 264 (13.24%) Power Platform
26 257 (12.89%) PySpark
27 254 (12.74%) Power BI
28 247 (12.39%) Data Science
28 247 (12.39%) GCP
29 214 (10.73%) Git (software)

Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 508 (25.48%) Apache Spark
2 187 (9.38%) Apache Airflow
3 124 (6.22%) Apache
4 60 (3.01%) Confluence
5 48 (2.41%) Elasticsearch
6 32 (1.60%) Luigi
7 28 (1.40%) Jupyter
8 27 (1.35%) SAS
9 18 (0.90%) SharePoint
10 14 (0.70%) Tomcat
11 8 (0.40%) BizTalk Server
12 5 (0.25%) nginx
13 4 (0.20%) Apache Pig
13 4 (0.20%) Oracle Workflow
14 3 (0.15%) Ethereum
15 2 (0.10%) Cloud Foundry
15 2 (0.10%) Hyperledger
15 2 (0.10%) Mule
16 1 (0.050%) Apache Solr
Applications
1 34 (1.71%) Microsoft Excel
2 10 (0.50%) Microsoft Office
3 4 (0.20%) MS Visio
4 3 (0.15%) Microsoft PowerPoint
5 2 (0.10%) CPLEX
5 2 (0.10%) Spreadsheet
5 2 (0.10%) SPSS
Business Applications
1 8 (0.40%) Dynamics CRM
2 5 (0.25%) Dynamics AX
2 5 (0.25%) Oracle EBS
2 5 (0.25%) SAP Oil and Gas
3 3 (0.15%) Endur
3 3 (0.15%) Refinitiv Enterprise Platform
3 3 (0.15%) Teamcenter
4 2 (0.10%) Eikon
4 2 (0.10%) ENOVIA
4 2 (0.10%) SAP R/3
5 1 (0.050%) Adobe Campaign
5 1 (0.050%) Aligne
5 1 (0.050%) NetSuite
5 1 (0.050%) Oracle Procure-to-Pay
5 1 (0.050%) Remedy ITSM
5 1 (0.050%) SAP IS-U
5 1 (0.050%) Sparx Enterprise Architect
Cloud Services
1 758 (38.01%) Azure
2 582 (29.19%) AWS
3 336 (16.85%) Azure Data Factory
4 264 (13.24%) Power Platform
5 247 (12.39%) GCP
6 192 (9.63%) Serverless
7 182 (9.13%) Amazon S3
8 177 (8.88%) Azure Synapse Analytics
9 97 (4.86%) Snowflake
10 96 (4.81%) AWS Lambda
11 93 (4.66%) GitHub
12 88 (4.41%) Azure Cosmos DB
13 78 (3.91%) Azure Functions
14 64 (3.21%) Amazon EMR
15 47 (2.36%) Amazon EC2
16 41 (2.06%) Azure Storage
17 36 (1.81%) AWS CloudFormation
18 32 (1.60%) Azure Logic Apps
19 26 (1.30%) Amazon Kinesis
19 26 (1.30%) Azure Stack
Communications & Networking
1 14 (0.70%) Kerberos
2 10 (0.50%) Firewall
2 10 (0.50%) WAN
3 8 (0.40%) Internet
4 7 (0.35%) Network Security
5 6 (0.30%) FTP
6 4 (0.20%) Z-Wave
7 3 (0.15%) Broadband
7 3 (0.15%) Intranet
7 3 (0.15%) PuTTY
8 2 (0.10%) HTTP
8 2 (0.10%) SSL
9 1 (0.050%) ADSL
9 1 (0.050%) Cisco ASA
9 1 (0.050%) DNS
9 1 (0.050%) HTTPS
9 1 (0.050%) SAN
9 1 (0.050%) TCP/IP
9 1 (0.050%) Wi-Fi
9 1 (0.050%) Wireless
Database & Business Intelligence
1 453 (22.72%) Data Warehouse
2 428 (21.46%) Big Data
3 402 (20.16%) Data Lake
4 314 (15.75%) Hadoop
5 254 (12.74%) Power BI
6 196 (9.83%) SQL Server
7 185 (9.28%) Apache Hive
8 177 (8.88%) Relational Database
9 143 (7.17%) Azure SQL Database
10 139 (6.97%) NoSQL
11 138 (6.92%) Amazon Redshift
12 134 (6.72%) PostgreSQL
13 128 (6.42%) Tableau
14 115 (5.77%) BigQuery
14 115 (5.77%) SQL Server Integration Services
15 108 (5.42%) HBase
16 103 (5.17%) Metadata
17 75 (3.76%) Azure SQL Data Warehouse
18 70 (3.51%) RDBMS
19 65 (3.26%) MongoDB
Development Applications
1 214 (10.73%) Git (software)
2 147 (7.37%) Jenkins
3 127 (6.37%) JIRA
4 50 (2.51%) GitLab
5 25 (1.25%) Bitbucket
6 24 (1.20%) Hudson
7 20 (1.00%) Maven
8 18 (0.90%) Subversion
8 18 (0.90%) Visual Studio
9 15 (0.75%) TeamCity
10 12 (0.60%) IntelliJ
11 11 (0.55%) Artifactory
11 11 (0.55%) ERwin
12 10 (0.50%) Sonatype Nexus
13 9 (0.45%) Oracle APEX
14 7 (0.35%) MLflow
15 6 (0.30%) CircleCI
15 6 (0.30%) ProC
15 6 (0.30%) SQL Server Management Studio (SSMS)
16 5 (0.25%) Octopus Deploy
General
1 353 (17.70%) Finance
2 323 (16.20%) Social Skills
3 194 (9.73%) Analytical Skills
4 95 (4.76%) Banking
5 94 (4.71%) Public Sector
6 46 (2.31%) Marketing
6 46 (2.31%) Presentation Skills
7 36 (1.81%) Retail
8 30 (1.50%) Publishing
9 27 (1.35%) Telecoms
10 26 (1.30%) Pharmaceutical
11 25 (1.25%) Investment Banking
12 16 (0.80%) Manufacturing
13 14 (0.70%) Documentation Skills
13 14 (0.70%) Law
14 13 (0.65%) Financial Institution
15 10 (0.50%) Legal
16 9 (0.45%) Aerospace
16 9 (0.45%) Games
17 8 (0.40%) Advertising
Libraries, Frameworks & Software Standards
1 345 (17.30%) Kafka
2 257 (12.89%) PySpark
3 93 (4.66%) Spark Streaming
4 67 (3.36%) JSON
5 59 (2.96%) Pandas
6 48 (2.41%) .NET
7 41 (2.06%) Apache NiFi
8 38 (1.91%) ARM Templates
9 36 (1.81%) NumPy
10 34 (1.71%) XML
11 29 (1.45%) scikit-learn
11 29 (1.45%) Spring
12 28 (1.40%) RabbitMQ
13 27 (1.35%) Node.js
13 27 (1.35%) REST
14 25 (1.25%) Apache Avro
14 25 (1.25%) Oracle GoldenGate
14 25 (1.25%) Velocity
14 25 (1.25%) Web Services
15 23 (1.15%) pytest
Miscellaneous
1 78 (3.91%) Data Structures
2 63 (3.16%) Data Protection Act
3 59 (2.96%) Algorithms
4 53 (2.66%) Greenfield Project
5 36 (1.81%) Cloud Native
6 34 (1.71%) Data Centre
7 32 (1.60%) Management Information System
8 25 (1.25%) iPad
9 23 (1.15%) NHS
9 23 (1.15%) Social Media
10 21 (1.05%) FMCG
10 21 (1.05%) Replication
11 18 (0.90%) Public Cloud
12 14 (0.70%) Self-Motivation
13 13 (0.65%) User Experience
14 12 (0.60%) Legacy Applications
15 10 (0.50%) Hedge funds
15 10 (0.50%) Hybrid Cloud
16 9 (0.45%) Enterprise Software
16 9 (0.45%) Reference Data
Operating Systems
1 114 (5.72%) Linux
2 111 (5.57%) Unix
3 27 (1.35%) Windows
4 14 (0.70%) VMS
5 8 (0.40%) Red Hat Enterprise Linux
6 3 (0.15%) Windows Server
7 2 (0.10%) Android
7 2 (0.10%) Apple iOS
7 2 (0.10%) CentOS
7 2 (0.10%) Ubuntu
8 1 (0.050%) AIX
8 1 (0.050%) Debian
8 1 (0.050%) Windows 7
8 1 (0.050%) Windows Server 2008
8 1 (0.050%) Windows Server 2012
Processes & Methodologies
1 557 (27.93%) ETL
2 523 (26.23%) Analytics
3 519 (26.03%) Data Engineering
4 480 (24.07%) Data Pipeline
5 470 (23.57%) Agile Software Development
6 467 (23.42%) Data Modelling
7 407 (20.41%) DevOps
8 378 (18.96%) Business Intelligence
9 247 (12.39%) Data Science
10 194 (9.73%) Migration
11 185 (9.28%) Scrum
12 177 (8.88%) Visualisation
13 142 (7.12%) Machine Learning
14 120 (6.02%) Data Ingestion
14 120 (6.02%) Data Transformation
15 115 (5.77%) Data Analysis
16 112 (5.62%) Problem-Solving
17 107 (5.37%) Computer Science
18 106 (5.32%) Data Integration
19 103 (5.17%) Data Migration
Programming Languages
1 1,128 (56.57%) Python
2 1,078 (54.06%) SQL
3 426 (21.36%) Java
4 398 (19.96%) Scala
5 85 (4.26%) R
6 84 (4.21%) T-SQL
7 61 (3.06%) C#
8 58 (2.91%) C++
9 57 (2.86%) PL/SQL
10 44 (2.21%) Go
11 43 (2.16%) JavaScript
11 43 (2.16%) PowerShell
12 42 (2.11%) Bash Shell
13 27 (1.35%) Shell Script
13 27 (1.35%) VBA
14 21 (1.05%) Groovy
15 16 (0.80%) Data Analysis Expressions (DAX)
16 15 (0.75%) Kotlin
17 14 (0.70%) CQL
17 14 (0.70%) TypeScript
Qualifications
1 188 (9.43%) Security Cleared
2 146 (7.32%) SC Cleared
3 134 (6.72%) Degree
4 55 (2.76%) Computer Science Degree
5 34 (1.71%) AWS Certification
6 25 (1.25%) BPSS Clearance
7 18 (0.90%) DV Cleared
8 12 (0.60%) Master's Degree
9 8 (0.40%) DBS Check
10 7 (0.35%) Microsoft Certification
11 4 (0.20%) ISEB
11 4 (0.20%) Numerate Degree
11 4 (0.20%) PhD
12 2 (0.10%) HND
13 1 (0.050%) HNC
13 1 (0.050%) ISTQB
Quality Assurance & Compliance
1 155 (7.77%) Data Quality
2 51 (2.56%) QA
3 23 (1.15%) GDPR
4 11 (0.55%) Disclosure Scotland
5 9 (0.45%) Accessibility
5 9 (0.45%) SLA
6 6 (0.30%) IFRS
7 1 (0.050%) Actionable Recommendations
7 1 (0.050%) ISO/IEC 27001
7 1 (0.050%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
7 1 (0.050%) NIST
7 1 (0.050%) PCI DSS
7 1 (0.050%) PMO
7 1 (0.050%) Sarbanes-Oxley
7 1 (0.050%) SNOMED CT
7 1 (0.050%) SOC 2
7 1 (0.050%) Solvency II
System Software
1 137 (6.87%) Docker
2 72 (3.61%) HDFS
3 13 (0.65%) Apache ZooKeeper
4 12 (0.60%) Apache Flume
5 7 (0.35%) BitLocker
6 4 (0.20%) Active Directory
7 2 (0.10%) Virtual Machines
8 1 (0.050%) Hyper-V
8 1 (0.050%) Oracle RAC
8 1 (0.050%) VMware Infrastructure
8 1 (0.050%) vSphere
Systems Management
1 189 (9.48%) Kubernetes
2 153 (7.67%) Terraform
3 73 (3.66%) Ansible
4 38 (1.91%) Oozie
5 32 (1.60%) Grafana
6 31 (1.55%) Kibana
7 17 (0.85%) Bosun
7 17 (0.85%) VictorOps
8 16 (0.80%) Hadoop YARN
9 14 (0.70%) logstash
10 13 (0.65%) Puppet
11 12 (0.60%) Single Sign-On
12 8 (0.40%) Docker Swarm
12 8 (0.40%) SCCM
13 6 (0.30%) Ambari
13 6 (0.30%) Prometheus
14 5 (0.25%) Kubeflow
14 5 (0.25%) Rancher
15 4 (0.20%) Opscode Chef
16 3 (0.15%) Mesos
Vendors
1 477 (23.92%) Databricks
2 201 (10.08%) Microsoft
3 162 (8.12%) Google
4 151 (7.57%) Oracle
5 123 (6.17%) Cloudera
6 79 (3.96%) Informatica
7 49 (2.46%) SAP
8 44 (2.21%) Alteryx
9 41 (2.06%) Talend
10 34 (1.71%) Hortonworks
11 25 (1.25%) StreamSets
12 23 (1.15%) Dataiku
13 22 (1.10%) ServiceNow
13 22 (1.10%) Teradata
14 17 (0.85%) IBM
15 16 (0.80%) Confluent
15 16 (0.80%) Splunk
16 13 (0.65%) Sybase
17 12 (0.60%) Salesforce.com
18 9 (0.45%) Symantec