Period
to 28 May 2020

The median contractor rate for a Data Engineer was £503 per day in advertised job vacancies during the 6 months to 28 May 2020.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
UK
6 months to
28 May 2020
Same period 2019 Same period 2018
Rank 157 187 320
Rank change year-on-year +30 +133 +146
Contract jobs requiring a Data Engineer 762 1,371 800
As % of all contract jobs advertised in the UK 1.63% 1.51% 0.79%
As % of the Job Titles category 1.74% 1.60% 0.84%
Number of daily rates quoted 543 978 612
Median daily rate £503 £525 £530
Median daily rate % change year-on-year -4.29% -0.94% +6.00%
10th Percentile £388 £400 £391
90th Percentile £669 £675 £675
UK excluding London median daily rate £475 £475 £463
% change year-on-year - +2.70% +8.82%
Number of hourly rates quoted 14 72 7
Median hourly rate £35.00 £15.00 £22.50
Median hourly rate % change year-on-year +133.33% -33.33% +80.00%
UK excluding London median hourly rate £35.00 £15.00 £18.50
% change year-on-year +133.33% -18.92% +48.00%

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
UK
Contract vacancies in the UK with a recognized job title 43,849 85,788 95,631
% of contract IT jobs with a recognized job title 93.61% 94.53% 94.85%
Number of daily rates quoted 27,567 56,437 62,716
Median daily rate £466 £473 £450
Median daily rate % change year-on-year -1.37% +5.00% +5.88%
10th Percentile £250 £275 £265
90th Percentile £650 £650 £631
UK excluding London median daily rate £425 £425 £413
% change year-on-year - +3.03% +3.13%
Number of hourly rates quoted 1,821 2,758 3,009
Median hourly rate £21.50 £19.00 £18.00
Median hourly rate % change year-on-year +13.16% +5.56% -5.26%
10th Percentile £12.00 £11.17 £10.80
90th Percentile £52.50 £50.00 £47.83
Median hourly rate £19.50 £18.00 £17.50
% change year-on-year +8.33% +2.86% -2.78%

Data Engineer
Job Vacancy Trend

Job postings that featured Data Engineer in the job title as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineer in the UK

Data Engineer
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Engineer.

Daily rate trend for Data Engineer in the UK

Data Engineer
Daily Rate Histogram

Daily rate distribution for jobs citing Data Engineer over the 6 months to 28 May 2020.

Daily rate histogram for Data Engineer in the UK

Data Engineer
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Engineer.

Hourly rate trend for Data Engineer in the UK

Data Engineer
Hourly Rate Histogram

Hourly rate distribution of jobs citing Data Engineer over the 6 months to 28 May 2020.

Hourly rate histogram for Data Engineer in the UK

Data Engineer
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the UK over the 6 months to 28 May 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +24 709 £513 -2.38% 124
London +9 464 £525 -4.55% 82
UK excluding London +93 276 £475 - 49
South East +101 85 £475 -5.00% 10
South West +63 45 £506 +1.25% 1
North of England +36 37 £443 -11.50% 12
Midlands +65 36 £446 +3.01% 7
East of England +45 33 £450 -10.00% 12
Wales +56 31 £489 +8.61% 2
Work from Home +25 30 £500 -7.41% 10
East Midlands +60 22 £344 -19.12% 1
Yorkshire +41 19 £450 -4.76% 4
West Midlands +37 14 £475 +5.56% 6
North West +21 13 £442 -19.64% 8
Scotland +13 11 £563 +32.35% 5
North East +17 3 £425 -15.00%

Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 28 May 2020, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads featuring Data Engineer in the job title.

1 415 (54.46%) Python
2 407 (53.41%) SQL
3 279 (36.61%) Big Data
4 273 (35.83%) ETL
5 248 (32.55%) AWS
6 239 (31.36%) Apache Spark
7 221 (29.00%) Azure
8 196 (25.72%) Hadoop
9 180 (23.62%) Agile Software Development
10 174 (22.83%) Data Engineering
11 167 (21.92%) Data Modelling
12 166 (21.78%) Scala
13 155 (20.34%) Analytics
14 154 (20.21%) Business Intelligence
15 153 (20.08%) Data Warehouse
16 136 (17.85%) Java
17 133 (17.45%) DevOps
18 124 (16.27%) Finance
19 116 (15.22%) SQL Server
19 116 (15.22%) Microsoft
20 113 (14.83%) Kafka
21 111 (14.57%) GCP
21 111 (14.57%) Data Lake
22 106 (13.91%) Data Science
23 100 (13.12%) Kubernetes
23 100 (13.12%) Apache Hive
24 96 (12.60%) Machine Learning
25 95 (12.47%) Git (software)
26 94 (12.34%) NoSQL
27 85 (11.15%) Azure Data Factory

Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 239 (31.36%) Apache Spark
2 53 (6.96%) Apache
3 25 (3.28%) Apache Airflow
4 14 (1.84%) Elasticsearch
5 11 (1.44%) Jupyter
6 9 (1.18%) BizTalk Server
6 9 (1.18%) Confluence
6 9 (1.18%) SAS
7 6 (0.79%) Apache Pig
8 3 (0.39%) Apache Pulsar
8 3 (0.39%) Oracle Workflow
8 3 (0.39%) SharePoint
8 3 (0.39%) Tornado
9 2 (0.26%) ArcGIS
10 1 (0.13%) GeoServer
10 1 (0.13%) IBM Domino
10 1 (0.13%) nginx
10 1 (0.13%) WebSphere
10 1 (0.13%) WebSphere Application Server
Applications
1 18 (2.36%) Microsoft Excel
2 3 (0.39%) Microsoft Office
3 1 (0.13%) Chatbot
Business Applications
1 8 (1.05%) Adobe Campaign
2 4 (0.52%) Magento
2 4 (0.52%) Shopify
3 3 (0.39%) FINCAD Analytics
4 2 (0.26%) Oracle Procure-to-Pay
4 2 (0.26%) Refinitiv Enterprise Platform
5 1 (0.13%) Cognos Business Intelligence
5 1 (0.13%) Dynamics AX
5 1 (0.13%) NetSuite
5 1 (0.13%) Oracle EBS
5 1 (0.13%) SAP S/4HANA
5 1 (0.13%) Sparx Enterprise Architect
Cloud Services
1 248 (32.55%) AWS
2 221 (29.00%) Azure
3 111 (14.57%) GCP
4 85 (11.15%) Azure Data Factory
5 74 (9.71%) Power Platform
6 57 (7.48%) AWS Lambda
7 55 (7.22%) Serverless
8 51 (6.69%) Amazon S3
9 35 (4.59%) Amazon Kinesis
10 19 (2.49%) Amazon EC2
10 19 (2.49%) Amazon EMR
11 13 (1.71%) PaaS
12 11 (1.44%) Amazon SQS
12 11 (1.44%) Azure Stack
13 10 (1.31%) AWS CloudFormation
14 9 (1.18%) Amazon ECS
14 9 (1.18%) Apigee
14 9 (1.18%) AWS Step Functions
15 8 (1.05%) IaaS
15 8 (1.05%) SaaS
Communications & Networking
1 7 (0.92%) Firewall
1 7 (0.92%) Kerberos
2 6 (0.79%) DNS
2 6 (0.79%) LAN
3 5 (0.66%) Wireless
4 4 (0.52%) Cisco Wireless
4 4 (0.52%) SSL
4 4 (0.52%) WAN
5 3 (0.39%) DHCP
5 3 (0.39%) IKE
5 3 (0.39%) Internet
5 3 (0.39%) IPsec
5 3 (0.39%) Multicast
5 3 (0.39%) Spanning Tree
5 3 (0.39%) Structured Cabling
5 3 (0.39%) VLAN
5 3 (0.39%) VoIP
5 3 (0.39%) VPN
5 3 (0.39%) Wi-Fi
5 3 (0.39%) WLAN
Database & Business Intelligence
1 279 (36.61%) Big Data
2 196 (25.72%) Hadoop
3 153 (20.08%) Data Warehouse
4 116 (15.22%) SQL Server
5 111 (14.57%) Data Lake
6 100 (13.12%) Apache Hive
7 94 (12.34%) NoSQL
8 74 (9.71%) Power BI
9 71 (9.32%) Amazon Redshift
10 63 (8.27%) Relational Database
11 61 (8.01%) BigQuery
12 52 (6.82%) Amazon Athena
12 52 (6.82%) Azure SQL Database
12 52 (6.82%) Impala
13 47 (6.17%) SQL Server Integration Services
14 40 (5.25%) HBase
15 32 (4.20%) MongoDB
16 29 (3.81%) SQL Server Analysis Services
17 27 (3.54%) Azure SQL Data Warehouse
18 26 (3.41%) Apache Cassandra
Development Applications
1 95 (12.47%) Git (software)
2 67 (8.79%) Jenkins
3 30 (3.94%) JIRA
4 27 (3.54%) GitLab
5 24 (3.15%) Maven
6 22 (2.89%) Artifactory
7 21 (2.76%) Visual Studio Team System
8 17 (2.23%) Sonatype Nexus
9 14 (1.84%) IBM UrbanCode
10 12 (1.57%) Visual Studio
11 6 (0.79%) ERwin
11 6 (0.79%) Gerrit
12 4 (0.52%) ProC
13 3 (0.39%) ER Studio
13 3 (0.39%) Gradle
13 3 (0.39%) Hudson
13 3 (0.39%) JUnit
13 3 (0.39%) LSMW
13 3 (0.39%) SQL Server Management Studio (SSMS)
14 2 (0.26%) Octopus Deploy
General
1 124 (16.27%) Finance
2 52 (6.82%) Banking
3 34 (4.46%) Telecoms
4 24 (3.15%) Retail
5 23 (3.02%) Public Sector
6 15 (1.97%) Marketing
7 10 (1.31%) Legal
7 10 (1.31%) Manufacturing
8 7 (0.92%) Front Office
8 7 (0.92%) Pharmaceutical
9 5 (0.66%) Advertising
9 5 (0.66%) Electronics
9 5 (0.66%) Games
9 5 (0.66%) Investment Banking
9 5 (0.66%) Law
9 5 (0.66%) Publishing
10 3 (0.39%) Aerospace
10 3 (0.39%) Billing
Libraries, Frameworks & Software Standards
1 113 (14.83%) Kafka
2 77 (10.10%) PySpark
3 36 (4.72%) Web Services
4 34 (4.46%) TensorFlow
5 27 (3.54%) scikit-learn
6 19 (2.49%) .NET
7 17 (2.23%) H2O
8 15 (1.97%) Spark Streaming
9 14 (1.84%) Pandas
9 14 (1.84%) XML
10 12 (1.57%) Apache NiFi
11 11 (1.44%) Apache Beam
11 11 (1.44%) OAuth
11 11 (1.44%) REST
11 11 (1.44%) Swagger
12 10 (1.31%) Elastic Stack
13 9 (1.18%) gRPC
13 9 (1.18%) Keras
13 9 (1.18%) MLlib
13 9 (1.18%) Natural Language Processing
Miscellaneous
1 70 (9.19%) Analytical Skills
2 30 (3.94%) Data Structures
3 29 (3.81%) Greenfield Project
4 20 (2.62%) Algorithms
4 20 (2.62%) Management Information System
5 15 (1.97%) Hedge funds
6 12 (1.57%) Public Cloud
7 10 (1.31%) Enterprise Software
8 9 (1.18%) PMI
9 8 (1.05%) Acoustics
10 5 (0.66%) Cloud Native
10 5 (0.66%) Credit Risk
10 5 (0.66%) Data Centre
10 5 (0.66%) Fixed Income
10 5 (0.66%) Linux Command Line
10 5 (0.66%) Reference Data
10 5 (0.66%) Self-Motivation
11 4 (0.52%) Derivative
11 4 (0.52%) User Experience
12 3 (0.39%) Hybrid Cloud
Operating Systems
1 37 (4.86%) Linux
2 15 (1.97%) Windows
3 9 (1.18%) Unix
4 5 (0.66%) Windows 10
5 4 (0.52%) Windows Server
6 3 (0.39%) Windows 7
7 2 (0.26%) Mac OS
7 2 (0.26%) Solaris
8 1 (0.13%) Debian
8 1 (0.13%) Windows Server 2008
8 1 (0.13%) Windows Server 2012
8 1 (0.13%) Windows Server 2016
Processes & Methodologies
1 273 (35.83%) ETL
2 180 (23.62%) Agile Software Development
3 174 (22.83%) Data Engineering
4 167 (21.92%) Data Modelling
5 155 (20.34%) Analytics
6 154 (20.21%) Business Intelligence
7 133 (17.45%) DevOps
8 106 (13.91%) Data Science
9 96 (12.60%) Machine Learning
10 77 (10.10%) Continuous Integration
11 75 (9.84%) Visualisation
12 58 (7.61%) Data Analysis
13 56 (7.35%) Migration
14 55 (7.22%) Data Visualisation
14 55 (7.22%) Software Engineering
15 52 (6.82%) Data Management
16 47 (6.17%) Scrum
17 45 (5.91%) Data Integration
18 42 (5.51%) TDD
19 39 (5.12%) Data Analytics
Programming Languages
1 415 (54.46%) Python
2 407 (53.41%) SQL
3 166 (21.78%) Scala
4 136 (17.85%) Java
5 56 (7.35%) C#
6 31 (4.07%) R
7 28 (3.67%) T-SQL
8 25 (3.28%) PowerShell
9 19 (2.49%) Bash Shell
10 17 (2.23%) JavaScript
11 14 (1.84%) C
12 11 (1.44%) Go
13 10 (1.31%) Ruby
14 7 (0.92%) PL/SQL
14 7 (0.92%) VB
15 6 (0.79%) C++
16 5 (0.66%) ABAP
16 5 (0.66%) Groovy
17 4 (0.52%) MATLAB
17 4 (0.52%) SOQL
Qualifications
1 72 (9.45%) Security Cleared
2 66 (8.66%) SC Cleared
3 40 (5.25%) Degree
4 20 (2.62%) Computer Science Degree
5 9 (1.18%) PMI Certification
6 5 (0.66%) AWS Certification
7 4 (0.52%) Microsoft Certification
8 3 (0.39%) Numerate Degree
9 2 (0.26%) BICSI Certification
9 2 (0.26%) CCNA
9 2 (0.26%) Cisco Certification
9 2 (0.26%) DBS Check
9 2 (0.26%) PhD
9 2 (0.26%) Postgraduate
10 1 (0.13%) DV Cleared
10 1 (0.13%) ITIL Foundation Certificate
10 1 (0.13%) Master's Degree
10 1 (0.13%) Oracle Certification
Quality Assurance & Compliance
1 25 (3.28%) Data Quality
2 15 (1.97%) QA
3 9 (1.18%) GDPR
4 1 (0.13%) GxP
4 1 (0.13%) NCSC
4 1 (0.13%) WCAG
System Software
1 75 (9.84%) Docker
2 58 (7.61%) HDFS
3 14 (1.84%) Virtual Machines
4 7 (0.92%) Active Directory
5 4 (0.52%) Apache Flume
6 3 (0.39%) vSphere
7 2 (0.26%) Apache ZooKeeper
Systems Management
1 100 (13.12%) Kubernetes
2 57 (7.48%) Terraform
3 32 (4.20%) Hadoop YARN
4 24 (3.15%) Ansible
5 8 (1.05%) Oozie
6 7 (0.92%) Kibana
6 7 (0.92%) Kubeflow
7 5 (0.66%) Avamar
7 5 (0.66%) Backup Exec
7 5 (0.66%) HP Data Protector
8 4 (0.52%) Grafana
8 4 (0.52%) SCCM
9 3 (0.39%) Cisco Prime
9 3 (0.39%) logstash
10 2 (0.26%) Ambari
10 2 (0.26%) Prometheus
10 2 (0.26%) Single Sign-On
11 1 (0.13%) FortiGate
11 1 (0.13%) Istio
11 1 (0.13%) linkerd
Vendors
1 116 (15.22%) Microsoft
2 70 (9.19%) Databricks
3 64 (8.40%) Cloudera
4 63 (8.27%) Google
5 53 (6.96%) Tableau
6 50 (6.56%) Oracle
7 33 (4.33%) SAP
8 32 (4.20%) Informatica
9 30 (3.94%) Talend
10 29 (3.81%) Hortonworks
11 12 (1.57%) MapR
11 12 (1.57%) Salesforce.com
12 10 (1.31%) Alteryx
13 8 (1.05%) Adobe
13 8 (1.05%) Cognos
13 8 (1.05%) Salesforce Marketing Cloud
14 7 (0.92%) Confluent
14 7 (0.92%) StreamSets
14 7 (0.92%) Teradata
15 6 (0.79%) Zuora