Period
to 5 May 2021

The median contractor rate for a Data Engineer was £525 per day in advertised job vacancies during the 6 months to 5 May 2021.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
UK
6 months to
5 May 2021
Same period 2020 Same period 2019
Rank 112 165 205
Rank change year-on-year +53 +40 +130
Contract jobs requiring a Data Engineer 1,246 863 1,325
As % of all contract jobs advertised in the UK 2.23% 1.61% 1.42%
As % of the Job Titles category 2.40% 1.72% 1.50%
Number of daily rates quoted 917 605 925
10th Percentile £388 £384 £400
25th Percentile £450 £425 £463
Median daily rate (50th Percentile) £525 £505 £525
Median % change year-on-year +3.96% -3.81% -
75th Percentile £600 £588 £601
90th Percentile £663 £663 £675
UK excluding London median daily rate £475 £475 £493
% change year-on-year - -3.55% +9.44%
Number of hourly rates quoted 12 5 72
Median hourly rate £33.50 £26.50 £15.00
Median % change year-on-year +26.42% +76.67% -78.18%
UK excluding London median hourly rate £25.25 £26.50 £15.00
% change year-on-year -4.72% +76.67% -45.45%

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
UK
Contract vacancies in the UK with a recognized job title 51,810 50,086 88,217
% of contract IT jobs with a recognized job title 92.75% 93.71% 94.63%
Number of daily rates quoted 35,552 33,164 59,274
10th Percentile £288 £231 £275
25th Percentile £382 £363 £365
Median daily rate (50th Percentile) £475 £463 £470
Median % change year-on-year +2.70% -1.60% +4.44%
75th Percentile £575 £575 £575
90th Percentile £675 £650 £650
UK excluding London median daily rate £425 £425 £425
Number of hourly rates quoted 1,728 1,881 2,632
10th Percentile £11.36 £11.63 £11.00
25th Percentile £14.50 £14.25 £13.00
Median hourly rate £22.50 £19.00 £18.00
Median % change year-on-year +18.42% +5.56% +2.86%
75th Percentile £45.00 £39.00 £40.00
90th Percentile £57.50 £52.50 £50.00
UK excluding London median hourly rate £19.00 £18.00 £17.50
% change year-on-year +5.56% +2.86% +0.40%

Data Engineer
Job Vacancy Trend

Job postings that featured Data Engineer in the job title as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineer in the UK

Data Engineer
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Engineer.

Daily rate trend for Data Engineer in the UK

Data Engineer
Daily Rate Histogram

Daily rate distribution for jobs citing Data Engineer over the 6 months to 5 May 2021.

Daily rate histogram for Data Engineer in the UK

Data Engineer
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Engineer.

Hourly rate trend for Data Engineer in the UK

Data Engineer
Hourly Rate Histogram

Hourly rate distribution of jobs citing Data Engineer over the 6 months to 5 May 2021.

Hourly rate histogram for Data Engineer in the UK

Data Engineer
Top 17 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the UK over the 6 months to 5 May 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +43 953 £525 - 265
London +21 644 £550 +4.76% 157
Work from Home +10 465 £520 +4.00% 43
UK excluding London +29 281 £475 - 119
North of England +97 91 £465 +3.33% 30
North West +60 48 £475 +10.79% 20
South East -14 44 £525 +10.53% 21
Scotland +11 35 £425 -15.00% 10
Yorkshire +43 34 £456 +1.39% 8
Midlands +5 34 £444 -8.97% 19
South West +34 31 £475 -5.00% 15
East of England +23 29 £600 +41.18% 21
West Midlands +9 26 £450 -14.29% 17
Wales -4 16 £450 -
North East +37 10 £450 +5.88% 2
East Midlands +2 7 £419 +19.64% 2
Northern Ireland - 3 £413 - 2

Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 5 May 2021, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads featuring Data Engineer in the job title.

1 670 (53.77%) Python
2 651 (52.25%) SQL
3 476 (38.20%) Azure
4 385 (30.90%) ETL
5 366 (29.37%) AWS
6 355 (28.49%) Data Warehouse
7 350 (28.09%) Data Pipeline
8 330 (26.48%) Analytics
9 314 (25.20%) Data Engineering
10 309 (24.80%) Agile Software Development
11 294 (23.60%) Big Data
12 290 (23.27%) Business Intelligence
13 288 (23.11%) Apache Spark
14 263 (21.11%) Data Modelling
15 254 (20.39%) Databricks
16 244 (19.58%) Java
17 232 (18.62%) Data Lake
18 226 (18.14%) Scala
19 224 (17.98%) DevOps
20 209 (16.77%) Kafka
21 203 (16.29%) Finance
22 201 (16.13%) Azure Data Factory
23 188 (15.09%) Hadoop
24 181 (14.53%) GCP
25 169 (13.56%) Social Skills
26 166 (13.32%) Power Platform
27 162 (13.00%) Data Science
27 162 (13.00%) Power BI
28 149 (11.96%) Microsoft
29 137 (11.00%) Git (software)

Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 288 (23.11%) Apache Spark
2 119 (9.55%) Apache
3 106 (8.51%) Apache Airflow
4 44 (3.53%) Confluence
5 39 (3.13%) SAS
6 27 (2.17%) Elasticsearch
7 20 (1.61%) SharePoint
8 18 (1.44%) Jupyter
9 11 (0.88%) Luigi
10 5 (0.40%) BizTalk Server
11 4 (0.32%) Oracle Workflow
12 2 (0.16%) Apache Pig
12 2 (0.16%) Oracle Coherence
12 2 (0.16%) Oracle Spatial
12 2 (0.16%) WebLogic
13 1 (0.080%) Hyperledger
13 1 (0.080%) IIS
13 1 (0.080%) nginx
Applications
1 25 (2.01%) Microsoft Excel
2 6 (0.48%) Microsoft PowerPoint
3 5 (0.40%) Microsoft Office
3 5 (0.40%) Spreadsheet
4 2 (0.16%) SPSS
5 1 (0.080%) Microsoft Project
5 1 (0.080%) MS Visio
Business Applications
1 13 (1.04%) Dynamics CRM
2 7 (0.56%) Dynamics AX
3 6 (0.48%) Eikon
3 6 (0.48%) Refinitiv Enterprise Platform
4 3 (0.24%) Aligne
5 2 (0.16%) Oracle EBS
5 2 (0.16%) Sparx Enterprise Architect
5 2 (0.16%) Teamcenter
5 2 (0.16%) Unit4 Business World
6 1 (0.080%) ENOVIA
6 1 (0.080%) SAP IS-U
6 1 (0.080%) Temenos T24
Cloud Services
1 476 (38.20%) Azure
2 366 (29.37%) AWS
3 201 (16.13%) Azure Data Factory
4 181 (14.53%) GCP
5 166 (13.32%) Power Platform
6 111 (8.91%) Amazon S3
7 101 (8.11%) Serverless
8 96 (7.70%) Azure Synapse Analytics
9 64 (5.14%) AWS Lambda
10 61 (4.90%) Azure Cosmos DB
11 47 (3.77%) Amazon EMR
12 43 (3.45%) Amazon EC2
13 32 (2.57%) Azure Functions
14 29 (2.33%) Amazon Kinesis
15 26 (2.09%) GitHub
16 23 (1.85%) AWS CloudFormation
17 22 (1.77%) Azure Logic Apps
18 21 (1.69%) Azure Storage
18 21 (1.69%) Google Analytics
19 19 (1.52%) Amazon ElastiCache
Communications & Networking
1 12 (0.96%) Kerberos
2 11 (0.88%) HTTP
3 7 (0.56%) Firewall
4 5 (0.40%) SSL
5 3 (0.24%) Broadband
5 3 (0.24%) Internet
5 3 (0.24%) SMTP
6 2 (0.16%) Network Security
6 2 (0.16%) SAN
6 2 (0.16%) Wireless
7 1 (0.080%) 3G
7 1 (0.080%) 4G
7 1 (0.080%) 5G
7 1 (0.080%) ADSL
7 1 (0.080%) DNS
7 1 (0.080%) FTP
7 1 (0.080%) MQTT
7 1 (0.080%) PuTTY
7 1 (0.080%) Radio Access Network
7 1 (0.080%) TCP/IP
Database & Business Intelligence
1 355 (28.49%) Data Warehouse
2 294 (23.60%) Big Data
3 232 (18.62%) Data Lake
4 188 (15.09%) Hadoop
5 162 (13.00%) Power BI
6 135 (10.83%) SQL Server
7 118 (9.47%) Apache Hive
8 111 (8.91%) Relational Database
9 107 (8.59%) BigQuery
10 104 (8.35%) Azure SQL Database
11 102 (8.19%) Tableau
12 92 (7.38%) Amazon Redshift
12 92 (7.38%) SQL Server Integration Services
13 87 (6.98%) NoSQL
14 82 (6.58%) Snowflake Schema
15 80 (6.42%) PostgreSQL
16 65 (5.22%) Amazon RDS
17 58 (4.65%) SQL Server Reporting Services
18 53 (4.25%) Amazon Athena
19 52 (4.17%) Azure SQL Data Warehouse
Development Applications
1 137 (11.00%) Git (software)
2 76 (6.10%) Jenkins
3 71 (5.70%) JIRA
4 39 (3.13%) Maven
5 9 (0.72%) GitLab
5 9 (0.72%) Sonatype Nexus
6 8 (0.64%) Oracle APEX
7 7 (0.56%) Atlassian Bamboo
7 7 (0.56%) Cucumber
8 6 (0.48%) SQL Server Management Studio (SSMS)
8 6 (0.48%) TeamCity
8 6 (0.48%) Visual Studio
9 4 (0.32%) Octopus Deploy
9 4 (0.32%) PyCharm
10 3 (0.24%) Artifactory
10 3 (0.24%) ERwin
10 3 (0.24%) git-flow
10 3 (0.24%) Gradle
10 3 (0.24%) ProC
10 3 (0.24%) Visual Studio Team System
General
1 203 (16.29%) Finance
2 169 (13.56%) Social Skills
3 112 (8.99%) Analytical Skills
4 63 (5.06%) Public Sector
5 56 (4.49%) Banking
6 35 (2.81%) Retail
7 21 (1.69%) Telecoms
8 19 (1.52%) Marketing
9 16 (1.28%) Presentation Skills
10 13 (1.04%) Games
11 12 (0.96%) Manufacturing
12 11 (0.88%) Pharmaceutical
12 11 (0.88%) Retail Banking
13 9 (0.72%) Investment Banking
14 8 (0.64%) Publishing
15 7 (0.56%) Front Office
16 6 (0.48%) Electronics
17 4 (0.32%) Advertising
17 4 (0.32%) Automotive
17 4 (0.32%) German Language
Libraries, Frameworks & Software Standards
1 209 (16.77%) Kafka
2 124 (9.95%) PySpark
3 53 (4.25%) JSON
4 40 (3.21%) RESTful
5 35 (2.81%) Spark Streaming
6 31 (2.49%) NumPy
6 31 (2.49%) XML
7 30 (2.41%) Pandas
8 28 (2.25%) .NET
9 25 (2.01%) scikit-learn
10 23 (1.85%) Apache NiFi
11 20 (1.61%) Velocity
11 20 (1.61%) Web Services
12 19 (1.52%) Celery
13 17 (1.36%) HTML
14 16 (1.28%) J2EE
15 15 (1.20%) Apache Beam
16 13 (1.04%) Apache Avro
16 13 (1.04%) Oracle GoldenGate
16 13 (1.04%) SciPy
Miscellaneous
1 58 (4.65%) Data Structures
2 40 (3.21%) Greenfield Project
3 37 (2.97%) Algorithms
4 18 (1.44%) User Experience
5 16 (1.28%) Cloud Native
6 15 (1.20%) Self-Motivation
7 13 (1.04%) Analytical Mindset
7 13 (1.04%) Management Information System
7 13 (1.04%) NHS
8 11 (0.88%) Hedge funds
8 11 (0.88%) iPad
9 10 (0.80%) Linux Command Line
10 8 (0.64%) Reinsurance
11 7 (0.56%) Data Centre
11 7 (0.56%) Replication
12 6 (0.48%) Foreign Exchange (FX)
12 6 (0.48%) Public Cloud
12 6 (0.48%) Reference Data
12 6 (0.48%) Social Media
13 5 (0.40%) FMCG
Operating Systems
1 51 (4.09%) Linux
2 29 (2.33%) Unix
3 26 (2.09%) Windows
4 7 (0.56%) AIX
4 7 (0.56%) Windows Server
5 6 (0.48%) CentOS
5 6 (0.48%) Ubuntu
6 5 (0.40%) Red Hat Enterprise Linux
7 3 (0.24%) Windows Server 2008
8 2 (0.16%) Windows Server 2019
9 1 (0.080%) MVS
9 1 (0.080%) VMS
9 1 (0.080%) Windows 7
Processes & Methodologies
1 385 (30.90%) ETL
2 350 (28.09%) Data Pipeline
3 330 (26.48%) Analytics
4 314 (25.20%) Data Engineering
5 309 (24.80%) Agile Software Development
6 290 (23.27%) Business Intelligence
7 263 (21.11%) Data Modelling
8 224 (17.98%) DevOps
9 162 (13.00%) Data Science
10 124 (9.95%) Migration
11 110 (8.83%) Visualisation
12 102 (8.19%) Scrum
13 96 (7.70%) Data Integration
14 86 (6.90%) Data Ingestion
15 79 (6.34%) Data Analysis
16 76 (6.10%) Machine Learning
17 71 (5.70%) Data Transformation
17 71 (5.70%) TDD
18 70 (5.62%) Data Management
19 66 (5.30%) Data Analytics
Programming Languages
1 670 (53.77%) Python
2 651 (52.25%) SQL
3 244 (19.58%) Java
4 226 (18.14%) Scala
5 60 (4.82%) R
6 52 (4.17%) PL/SQL
7 46 (3.69%) T-SQL
8 33 (2.65%) PowerShell
9 29 (2.33%) C++
10 28 (2.25%) C#
11 27 (2.17%) C
12 24 (1.93%) JavaScript
13 17 (1.36%) Shell Script
13 17 (1.36%) VBA
14 16 (1.28%) Go
15 14 (1.12%) Bash Shell
16 5 (0.40%) Data Analysis Expressions (DAX)
17 4 (0.32%) Haskell
18 3 (0.24%) XPath
18 3 (0.24%) XQuery
Qualifications
1 133 (10.67%) Security Cleared
2 109 (8.75%) SC Cleared
3 54 (4.33%) Degree
4 23 (1.85%) DV Cleared
5 22 (1.77%) AWS Certification
6 14 (1.12%) Computer Science Degree
7 7 (0.56%) BPSS Clearance
8 6 (0.48%) HND
8 6 (0.48%) Master's Degree
9 4 (0.32%) DBS Check
10 2 (0.16%) ISEB
10 2 (0.16%) PhD
11 1 (0.080%) BC Cleared
11 1 (0.080%) CCNA
11 1 (0.080%) Chartered Engineer
11 1 (0.080%) Cisco Certification
11 1 (0.080%) CITP
11 1 (0.080%) HNC
11 1 (0.080%) Microsoft Certification
11 1 (0.080%) Numerate Degree
Quality Assurance & Compliance
1 71 (5.70%) QA
2 64 (5.14%) Data Quality
3 12 (0.96%) GDPR
4 6 (0.48%) SLA
5 3 (0.24%) Disclosure Scotland
6 1 (0.080%) FATCA
6 1 (0.080%) GxP
6 1 (0.080%) IFRS
6 1 (0.080%) PMO
6 1 (0.080%) SNOMED CT
System Software
1 82 (6.58%) Docker
2 40 (3.21%) HDFS
3 6 (0.48%) BitLocker
4 4 (0.32%) Apache Flume
5 3 (0.24%) Apache ZooKeeper
6 2 (0.16%) Active Directory
6 2 (0.16%) Virtual Machines
6 2 (0.16%) VMware Infrastructure
6 2 (0.16%) VMware Server
Systems Management
1 93 (7.46%) Kubernetes
2 75 (6.02%) Terraform
3 30 (2.41%) Ansible
4 27 (2.17%) Oozie
5 13 (1.04%) Hadoop YARN
5 13 (1.04%) Kibana
6 10 (0.80%) Puppet
7 9 (0.72%) SCCM
8 6 (0.48%) Opscode Chef
9 4 (0.32%) Grafana
10 3 (0.24%) Ambari
11 2 (0.16%) Oracle Flashback
11 2 (0.16%) SCOM
12 1 (0.080%) Control-M
12 1 (0.080%) Istio
12 1 (0.080%) Marathon
12 1 (0.080%) Mesos
12 1 (0.080%) Microsoft Clustering
12 1 (0.080%) Prometheus
12 1 (0.080%) Rancher
Vendors
1 254 (20.39%) Databricks
2 149 (11.96%) Microsoft
3 117 (9.39%) Google
4 103 (8.27%) Oracle
5 57 (4.57%) Cloudera
6 50 (4.01%) SAP
7 39 (3.13%) Informatica
8 33 (2.65%) Alteryx
9 29 (2.33%) Talend
10 24 (1.93%) Splunk
11 20 (1.61%) IBM
12 16 (1.28%) Dataiku
13 14 (1.12%) StreamSets
14 13 (1.04%) Teradata
15 11 (0.88%) Hortonworks
16 10 (0.80%) Confluent
17 8 (0.64%) NetApp
18 7 (0.56%) Salesforce.com
19 6 (0.48%) Bloomberg
19 6 (0.48%) Reuters