Period
to 28 January 2020

The median contractor rate for a Data Engineer was £525 per day in advertised job vacancies during the 6 months to 28 January 2020.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
UK
6 months to
28 Jan 2020
Same period 2019 Same period 2018
Rank 180 271 380
Rank change year-on-year +91 +109 +52
Contract jobs requiring a Data Engineer 1,038 960 635
As % of all contract IT jobs advertised in the UK 1.44% 0.97% 0.64%
As % of the Job Titles category 1.54% 1.03% 0.67%
Number of daily rates quoted 751 713 506
UK median daily rate £525 £538 £500
Median daily rate % change year-on-year -2.33% +7.50% -4.76%
10th Percentile £400 £413 £350
90th Percentile £675 £713 £638
UK excluding London median daily rate £475 £500 £463
% change year-on-year -5.00% +8.11% +2.78%
Number of hourly rates quoted 7 5 6
UK median hourly rate £33.46 £33.00 £26.75
Median hourly rate % change year-on-year +1.38% +23.36% +105.77%
10th Percentile £25.45 £21.50 £16.23
90th Percentile £44.30 £120.05 £59.69
UK excluding London median hourly rate £26.50 £18.00 £39.38
% change year-on-year +47.22% -54.29% +208.82%

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
UK
Contract vacancies in the UK with a recognized job title 67,587 93,474 94,091
% of contract IT jobs with a recognized job title 93.84% 94.67% 94.94%
Number of daily rates quoted 43,935 61,911 62,510
UK median daily rate £450 £450 £450
10th Percentile £240 £270 £260
90th Percentile £644 £638 £625
UK excluding London median daily rate £425 £425 £400
% change year-on-year - +6.25% -
Number of hourly rates quoted 2,701 2,878 2,799
UK median hourly rate £19.00 £18.70 £18.50
Median hourly rate % change year-on-year +1.60% +1.08% +2.78%
10th Percentile £11.37 £11.00 £10.75
90th Percentile £51.75 £48.75 £48.00
UK excluding London median hourly rate £18.00 £17.50 £17.50
% change year-on-year +2.86% - -

Data Engineer
Job Vacancy Trend

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Data Engineer in the UK

Data Engineer
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Engineer.

Contractor daily rate trend for Data Engineer in the UK

Data Engineer
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Engineer over the 6 months to 28 January 2020.

Contractor daily rate histogram for Data Engineer in the UK

Data Engineer
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Engineer.

Contractor hourly rate trend for Data Engineer in the UK

Data Engineer
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Data Engineer over the 6 months to 28 January 2020.

Contractor hourly rate histogram for Data Engineer in the UK

Data Engineer
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the UK over the 6 months to 28 January 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +78 950 £525 -4.55% 415
London +58 605 £550 - 278
UK excluding London +151 417 £475 -5.00% 167
South East +77 115 £475 -9.52% 34
North of England +53 70 £475 +0.26% 43
Midlands +76 58 £450 -7.69% 19
East of England +76 56 £458 -20.43% 10
Scotland +46 48 £500 +17.65% 20
North West +29 45 £450 -5.26% 25
South West +14 43 £500 -4.76% 30
East Midlands +47 31 £363 -27.50% 7
West Midlands +51 27 £525 +16.67% 12
Wales +49 24 £450 - 9
Yorkshire +32 20 £519 +9.79% 14
North East +14 7 £425 -8.11% 4
Northern Ireland +13 3 £450 - 1

Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 28 January 2020, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads featuring Data Engineer in the job title.

1 567 (54.62%) Python
2 535 (51.54%) SQL
3 396 (38.15%) ETL
4 362 (34.87%) Big Data
5 358 (34.49%) AWS
6 325 (31.31%) Apache Spark
7 292 (28.13%) Azure
8 288 (27.75%) Hadoop
9 263 (25.34%) Agile Software Development
10 247 (23.80%) Analytics
11 228 (21.97%) Data Modelling
12 227 (21.87%) Data Engineering
13 218 (21.00%) Scala
14 195 (18.79%) Business Intelligence
15 191 (18.40%) Java
16 185 (17.82%) Data Warehouse
17 184 (17.73%) DevOps
18 181 (17.44%) Data Science
19 168 (16.18%) Kafka
20 163 (15.70%) Microsoft
21 153 (14.74%) SQL Server
22 150 (14.45%) GCP
23 142 (13.68%) Data Lake
23 142 (13.68%) Finance
24 125 (12.04%) Git (software)
25 123 (11.85%) NoSQL
26 122 (11.75%) Machine Learning
27 117 (11.27%) Docker
28 114 (10.98%) Power BI
28 114 (10.98%) Power Platform

Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 325 (31.31%) Apache Spark
2 88 (8.48%) Apache
3 66 (6.36%) Apache Airflow
4 21 (2.02%) Elasticsearch
5 16 (1.54%) Jupyter
6 15 (1.45%) SAS
7 8 (0.77%) Luigi
8 6 (0.58%) Apache Pig
8 6 (0.58%) Confluence
8 6 (0.58%) SharePoint
9 3 (0.29%) Mule
9 3 (0.29%) Oracle Workflow
10 2 (0.19%) ArcGIS
11 1 (0.096%) BizTalk Server
11 1 (0.096%) IBM Domino
11 1 (0.096%) Pachyderm
11 1 (0.096%) WebSphere
11 1 (0.096%) WebSphere Application Server
Applications
1 27 (2.60%) Microsoft Excel
2 4 (0.39%) Microsoft Office
3 1 (0.096%) Chatbot
3 1 (0.096%) InDesign
3 1 (0.096%) Microsoft PowerPoint
Business Applications
1 7 (0.67%) FINCAD Analytics
2 3 (0.29%) Distributed Ledger
3 2 (0.19%) Dynamics CRM
3 2 (0.19%) NetSuite
3 2 (0.19%) SAP ERP
4 1 (0.096%) PolarLake
4 1 (0.096%) SAP Oil and Gas
Cloud Services
1 358 (34.49%) AWS
2 292 (28.13%) Azure
3 150 (14.45%) GCP
4 114 (10.98%) Power Platform
5 87 (8.38%) Azure Data Factory
6 65 (6.26%) Serverless
7 63 (6.07%) AWS Lambda
8 62 (5.97%) Amazon S3
9 57 (5.49%) Amazon Kinesis
10 44 (4.24%) Amazon EMR
11 34 (3.28%) AWS CloudFormation
12 28 (2.70%) Amazon EC2
13 24 (2.31%) GitHub
14 22 (2.12%) Azure Machine Learning
15 18 (1.73%) Amazon SQS
16 16 (1.54%) Azure Stack
17 13 (1.25%) Cloud Computing
18 12 (1.16%) AWS Step Functions
19 11 (1.06%) PaaS
20 7 (0.67%) Virtual Private Cloud
Communications & Networking
1 18 (1.73%) Kerberos
2 14 (1.35%) DNS
3 12 (1.16%) Firewall
3 12 (1.16%) SSL
4 7 (0.67%) LAN
5 5 (0.48%) Internet
5 5 (0.48%) WAN
6 4 (0.39%) F5 BIG-IP GTM
6 4 (0.39%) F5 BIG-IP LTM
6 4 (0.39%) Multicast
6 4 (0.39%) VoIP
6 4 (0.39%) VPN
7 3 (0.29%) Cisco Wireless
7 3 (0.29%) DHCP
7 3 (0.29%) IKE
7 3 (0.29%) IPsec
7 3 (0.29%) Spanning Tree
7 3 (0.29%) Structured Cabling
7 3 (0.29%) Wireless
7 3 (0.29%) WLAN
Database & Business Intelligence
1 362 (34.87%) Big Data
2 288 (27.75%) Hadoop
3 185 (17.82%) Data Warehouse
4 153 (14.74%) SQL Server
5 142 (13.68%) Data Lake
6 123 (11.85%) NoSQL
7 114 (10.98%) Power BI
8 112 (10.79%) Apache Hive
9 102 (9.83%) Amazon Redshift
10 91 (8.77%) Relational Database
11 85 (8.19%) SQL Server Integration Services
12 69 (6.65%) BigQuery
13 67 (6.45%) Amazon Athena
14 51 (4.91%) Azure SQL Database
14 51 (4.91%) PostgreSQL
15 48 (4.62%) Impala
16 47 (4.53%) Apache Cassandra
16 47 (4.53%) HBase
17 45 (4.34%) MongoDB
18 41 (3.95%) SQL Server Analysis Services
Development Applications
1 125 (12.04%) Git (software)
2 99 (9.54%) Jenkins
3 34 (3.28%) Visual Studio Team System
4 33 (3.18%) JIRA
5 27 (2.60%) Maven
6 25 (2.41%) Visual Studio
7 20 (1.93%) Artifactory
8 17 (1.64%) Sonatype Nexus
9 14 (1.35%) IBM UrbanCode
10 11 (1.06%) Selenium
11 7 (0.67%) Bitbucket
11 7 (0.67%) ERwin
12 6 (0.58%) Gerrit
12 6 (0.58%) GitLab
12 6 (0.58%) IntelliJ
12 6 (0.58%) tSQLt
13 5 (0.48%) ER Studio
13 5 (0.48%) Octopus Deploy
13 5 (0.48%) ProC
13 5 (0.48%) TeamCity
General
1 142 (13.68%) Finance
2 71 (6.84%) Banking
3 37 (3.56%) Retail
4 27 (2.60%) Public Sector
5 22 (2.12%) Telecoms
6 18 (1.73%) Front Office
7 16 (1.54%) Manufacturing
7 16 (1.54%) Marketing
8 13 (1.25%) Legal
9 9 (0.87%) Investment Banking
10 8 (0.77%) Publishing
11 6 (0.58%) Electronics
11 6 (0.58%) Games
11 6 (0.58%) Pharmaceutical
12 4 (0.39%) International Banking
12 4 (0.39%) Law
13 3 (0.29%) Aerospace
13 3 (0.29%) Corporate Banking
13 3 (0.29%) Retail Banking
14 2 (0.19%) Back Office
Libraries, Frameworks & Software Standards
1 168 (16.18%) Kafka
2 88 (8.48%) PySpark
3 34 (3.28%) Web Services
4 31 (2.99%) Pandas
5 28 (2.70%) TensorFlow
6 26 (2.50%) Spark Streaming
7 25 (2.41%) Apache Beam
8 24 (2.31%) scikit-learn
9 22 (2.12%) Apache NiFi
9 22 (2.12%) NumPy
10 21 (2.02%) REST
11 20 (1.93%) .NET
12 19 (1.83%) RESTful
13 15 (1.45%) Spring
14 14 (1.35%) JSON
15 12 (1.16%) Node.js
16 10 (0.96%) Akka
16 10 (0.96%) Django
16 10 (0.96%) Keras
16 10 (0.96%) MLlib
Miscellaneous
1 81 (7.80%) Analytical Skills
2 58 (5.59%) Data Structures
3 44 (4.24%) Greenfield Project
4 37 (3.56%) Algorithms
5 23 (2.22%) Management Information System
6 19 (1.83%) Linked Data
7 16 (1.54%) User Experience
8 13 (1.25%) Public Cloud
9 10 (0.96%) Equities
10 9 (0.87%) Data Centre
10 9 (0.87%) Fixed Income
10 9 (0.87%) Hedge funds
11 8 (0.77%) Derivative
11 8 (0.77%) Self-Motivation
12 6 (0.58%) CMDB
13 5 (0.48%) Foreign Exchange (FX)
13 5 (0.48%) PKI
13 5 (0.48%) Reference Data
14 4 (0.39%) Clustering
14 4 (0.39%) Equity Derivative
Operating Systems
1 68 (6.55%) Linux
2 20 (1.93%) Windows
3 16 (1.54%) Unix
4 7 (0.67%) CentOS
5 5 (0.48%) Windows 10
6 4 (0.39%) VMS
6 4 (0.39%) Windows Server
7 3 (0.29%) Windows 7
8 2 (0.19%) Mac OS
8 2 (0.19%) Red Hat Enterprise Linux
9 1 (0.096%) Windows Server 2008
9 1 (0.096%) Windows Server 2012
Processes & Methodologies
1 396 (38.15%) ETL
2 263 (25.34%) Agile Software Development
3 247 (23.80%) Analytics
4 228 (21.97%) Data Modelling
5 227 (21.87%) Data Engineering
6 195 (18.79%) Business Intelligence
7 184 (17.73%) DevOps
8 181 (17.44%) Data Science
9 122 (11.75%) Machine Learning
10 104 (10.02%) Migration
11 94 (9.06%) Visualisation
12 93 (8.96%) Data Analysis
13 88 (8.48%) Continuous Integration
14 81 (7.80%) Software Engineering
15 76 (7.32%) Data Management
16 73 (7.03%) Data Visualisation
17 68 (6.55%) Data Architecture
17 68 (6.55%) Scrum
18 63 (6.07%) Artificial Intelligence
19 56 (5.39%) Data Analytics
Programming Languages
1 567 (54.62%) Python
2 535 (51.54%) SQL
3 218 (21.00%) Scala
4 191 (18.40%) Java
5 60 (5.78%) R
6 51 (4.91%) C#
7 38 (3.66%) T-SQL
8 35 (3.37%) Bash Shell
9 27 (2.60%) PowerShell
10 20 (1.93%) C++
11 19 (1.83%) C
11 19 (1.83%) SHACL
11 19 (1.83%) SPARQL
12 16 (1.54%) PL/SQL
13 15 (1.45%) JavaScript
14 10 (0.96%) Kotlin
15 8 (0.77%) Go
16 7 (0.67%) Ruby
16 7 (0.67%) VB
17 6 (0.58%) VBA
Qualifications
1 73 (7.03%) Degree
2 64 (6.17%) Security Cleared
3 52 (5.01%) SC Cleared
4 19 (1.83%) Computer Science Degree
5 14 (1.35%) Master's Degree
6 9 (0.87%) Cisco Certification
7 8 (0.77%) CCNP
8 6 (0.58%) DV Cleared
9 5 (0.48%) CCNA
9 5 (0.48%) DBS Check
10 4 (0.39%) CCIE
10 4 (0.39%) Postgraduate
11 3 (0.29%) BPSS Clearance
11 3 (0.29%) PhD
11 3 (0.29%) PMI Certification
11 3 (0.29%) PMP
12 2 (0.19%) BICSI Certification
12 2 (0.19%) ITIL Certification
12 2 (0.19%) Numerate Degree
12 2 (0.19%) Oracle Certification
Quality Assurance & Compliance
1 30 (2.89%) Data Quality
2 19 (1.83%) QA
3 13 (1.25%) GDPR
4 3 (0.29%) Disclosure Scotland
4 3 (0.29%) GxP
4 3 (0.29%) Sarbanes-Oxley
5 1 (0.096%) IFRS
5 1 (0.096%) IFRS 9
5 1 (0.096%) NCSC
5 1 (0.096%) SLA
5 1 (0.096%) Solvency II
5 1 (0.096%) WCAG
System Software
1 117 (11.27%) Docker
2 62 (5.97%) HDFS
3 19 (1.83%) Active Directory
4 9 (0.87%) Virtual Machines
5 6 (0.58%) Apache Flume
6 5 (0.48%) Apache ZooKeeper
7 3 (0.29%) Virtual Servers
7 3 (0.29%) vSphere
8 2 (0.19%) VirtualBox
9 1 (0.096%) VMware Infrastructure
Systems Management
1 99 (9.54%) Kubernetes
2 89 (8.57%) Terraform
3 49 (4.72%) Hadoop YARN
4 39 (3.76%) Ansible
5 14 (1.35%) Oozie
6 9 (0.87%) Avamar
7 8 (0.77%) Istio
7 8 (0.77%) linkerd
7 8 (0.77%) Puppet
8 7 (0.67%) Kubeflow
9 6 (0.58%) Backup Exec
9 6 (0.58%) HP Data Protector
10 4 (0.39%) FortiGate
10 4 (0.39%) Kibana
10 4 (0.39%) SCCM
11 3 (0.29%) Cisco Prime
11 3 (0.29%) Opscode Chef
12 2 (0.19%) Ambari
12 2 (0.19%) logstash
12 2 (0.19%) Single Sign-On
Vendors
1 163 (15.70%) Microsoft
2 94 (9.06%) Google
3 90 (8.67%) Tableau
4 79 (7.61%) Databricks
5 78 (7.51%) Cloudera
6 62 (5.97%) Oracle
7 50 (4.82%) Informatica
8 46 (4.43%) Hortonworks
9 40 (3.85%) SAP
10 36 (3.47%) Talend
11 18 (1.73%) Cognos
12 16 (1.54%) Alteryx
13 15 (1.45%) Sybase
13 15 (1.45%) Teradata
14 14 (1.35%) Cisco
15 13 (1.25%) MapR
16 12 (1.16%) Ab Initio
17 10 (0.96%) Palantir
18 9 (0.87%) StreamSets
19 8 (0.77%) Splunk