Period
to 18 July 2019

The median contractor rate for a Data Engineer was £538 per day in advertised job vacancies during the 6 months to 18 July 2019.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
UK
6 months to
18 Jul 2019
Same period 2018 Same period 2017
Rank 173 306 432
Rank change year-on-year +133 +126 +209
Contract jobs requiring a Data Engineer 1,436 865 477
As % of all contract IT jobs advertised in the UK 1.55% 0.84% 0.50%
As % of the Job Titles category 1.64% 0.88% 0.53%
Number of daily rates quoted 1,012 661 322
UK median daily rate £538 £550 £500
Median daily rate % change year-on-year -2.27% +10.00% -4.76%
10th Percentile £400 £385 £263
90th Percentile £675 £675 £638
UK excluding London median daily rate £490 £475 £413
% change year-on-year +3.16% +15.15% +21.32%
Number of hourly rates quoted 73 8 30
UK median hourly rate £15.00 £22.25 £12.50
Median hourly rate % change year-on-year -32.58% +78.00% -18.41%
UK excluding London median hourly rate £15.00 £18.50 £12.50
% change year-on-year -18.92% +48.00% -18.41%

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
UK
Contract vacancies in the UK with a recognized job title 87,535 98,160 90,229
% of contract IT jobs with a recognized job title 94.49% 94.85% 94.96%
Number of daily rates quoted 57,549 64,291 58,477
UK median daily rate £470 £450 £425
Median daily rate % change year-on-year +4.44% +5.88% -
10th Percentile £263 £269 £263
90th Percentile £650 £638 £619
UK excluding London median daily rate £425 £413 £400
% change year-on-year +3.03% +3.13% +3.23%
Number of hourly rates quoted 2,925 3,167 2,923
UK median hourly rate £19.81 £18.50 £18.70
Median hourly rate % change year-on-year +7.05% -1.07% -3.78%
10th Percentile £11.17 £11.00 £10.75
90th Percentile £52.17 £48.75 £50.00
UK excluding London median hourly rate £18.50 £17.50 £17.77
% change year-on-year +5.71% -1.52% -6.47%

Data Engineer
Job Vacancy Trend

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Data Engineer in the UK

Data Engineer
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Engineer.

Contractor daily rate trend for Data Engineer in the UK

Data Engineer
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Engineer over the 6 months to 18 July 2019.

Contractor daily rate histogram for Data Engineer in the UK

Data Engineer
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Engineer.

Contractor hourly rate trend for Data Engineer in the UK

Data Engineer
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Data Engineer over the 6 months to 18 July 2019.

Contractor hourly rate histogram for Data Engineer in the UK

Data Engineer
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the UK over the 6 months to 18 July 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +113 1,368 £550 - 336
London +93 1,011 £550 - 189
UK excluding London +163 403 £490 +3.16% 183
South East +82 120 £475 -5.00% 23
North of England +52 84 £500 +5.26% 41
East of England +27 60 £520 +9.47% 24
Scotland +55 50 £425 +4.29% 27
North West +32 48 £550 +15.79% 30
Midlands +35 44 £410 -4.65% 23
South West +18 40 £525 +5.00% 37
West Midlands +36 31 £408 +42.98% 15
Yorkshire +17 28 £450 -5.76% 7
East Midlands +14 13 £440 -4.61% 8
North East +26 8 £563 +18.42% 4
Wales +7 5 £348 -9.15% 7

Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 18 July 2019, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads featuring Data Engineer in the job title.

1 799 (55.64%) Python
2 697 (48.54%) Big Data
3 647 (45.06%) SQL
4 636 (44.29%) Apache Spark
5 523 (36.42%) Amazon AWS
6 509 (35.45%) Hadoop
7 405 (28.20%) Analytics
8 377 (26.25%) Data Science
9 361 (25.14%) Agile Software Development
10 355 (24.72%) Microsoft Azure
11 354 (24.65%) Kafka
12 341 (23.75%) ETL
13 321 (22.35%) Data Warehouse
14 320 (22.28%) Apache Hive
15 308 (21.45%) Scala
16 294 (20.47%) Java
17 291 (20.26%) Data Engineering
18 282 (19.64%) Finance
19 273 (19.01%) Data Modelling
20 248 (17.27%) Google Cloud Platform
21 247 (17.20%) Google
22 235 (16.36%) Machine Learning
23 201 (14.00%) NoSQL
24 191 (13.30%) Data Lake
25 190 (13.23%) Docker
26 188 (13.09%) Apache
27 183 (12.74%) Business Intelligence
28 179 (12.47%) DevOps
29 161 (11.21%) Amazon S3
30 142 (9.89%) Amazon Redshift

Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 636 (44.29%) Apache Spark
2 188 (13.09%) Apache
3 139 (9.68%) Apache Airflow
4 67 (4.67%) Elasticsearch
5 29 (2.02%) Apache Solr
5 29 (2.02%) SAS
6 28 (1.95%) Luigi
7 21 (1.46%) Confluence
8 16 (1.11%) Jupyter
9 14 (0.97%) Pachyderm
10 13 (0.91%) Apache Pig
11 8 (0.56%) SharePoint
12 6 (0.42%) Apache Qpid
13 5 (0.35%) BizTalk Server
14 3 (0.21%) Oracle Workflow
15 2 (0.14%) ArcGIS
15 2 (0.14%) IIS
16 1 (0.070%) JBoss
16 1 (0.070%) Oracle Coherence
16 1 (0.070%) Skype for Business
Applications
1 42 (2.92%) Microsoft Excel
2 9 (0.63%) SPSS
2 9 (0.63%) Stata
3 5 (0.35%) Microsoft PowerPoint
4 3 (0.21%) Spreadsheet
5 2 (0.14%) Chatbot
6 1 (0.070%) Microsoft Office
6 1 (0.070%) MS Visio
Business Applications
1 16 (1.11%) SAP Oil and Gas
2 7 (0.49%) assyst
3 4 (0.28%) SAP ERP
3 4 (0.28%) SAP S/4HANA
4 2 (0.14%) Cognos Business Intelligence
4 2 (0.14%) Markit EDM
5 1 (0.070%) Distributed Ledger
5 1 (0.070%) Dynamics AX
5 1 (0.070%) Dynamics CRM
5 1 (0.070%) Oracle Retail
5 1 (0.070%) Workday HCM
Cloud Services
1 523 (36.42%) Amazon AWS
2 355 (24.72%) Microsoft Azure
3 248 (17.27%) Google Cloud Platform
4 161 (11.21%) Amazon S3
5 138 (9.61%) Amazon EMR
6 102 (7.10%) Serverless
7 84 (5.85%) Power Platform
8 82 (5.71%) Azure Data Factory
9 80 (5.57%) AWS Lambda
10 73 (5.08%) Amazon Kinesis
11 51 (3.55%) Amazon EC2
12 50 (3.48%) Amazon SQS
13 35 (2.44%) Cloud Computing
14 34 (2.37%) GitHub
15 22 (1.53%) Amazon ECS
15 22 (1.53%) AWS CloudFormation
16 21 (1.46%) PaaS
17 20 (1.39%) AWS Fargate
18 18 (1.25%) Amazon SageMaker
18 18 (1.25%) Azure Functions
Communications & Networking
1 26 (1.81%) Kerberos
2 16 (1.11%) Internet
3 14 (0.97%) SSL
4 13 (0.91%) DNS
5 12 (0.84%) MQTT
6 8 (0.56%) Wireless
7 6 (0.42%) Firewall
7 6 (0.42%) Multicast
8 5 (0.35%) HTTP
8 5 (0.35%) LAN
8 5 (0.35%) WAN
9 3 (0.21%) BGP
9 3 (0.21%) Cisco ASA
9 3 (0.21%) DHCP
9 3 (0.21%) OSPF
9 3 (0.21%) VLAN
9 3 (0.21%) Wi-Fi
10 2 (0.14%) EIGRP
10 2 (0.14%) IPv4
10 2 (0.14%) SSH
Database & Business Intelligence
1 697 (48.54%) Big Data
2 509 (35.45%) Hadoop
3 321 (22.35%) Data Warehouse
4 320 (22.28%) Apache Hive
5 201 (14.00%) NoSQL
6 191 (13.30%) Data Lake
7 142 (9.89%) Amazon Redshift
8 133 (9.26%) PostgreSQL
9 124 (8.64%) SQL Server
10 105 (7.31%) MongoDB
11 95 (6.62%) HBase
12 84 (5.85%) Power BI
13 83 (5.78%) Amazon Athena
13 83 (5.78%) Apache Cassandra
14 80 (5.57%) Impala
15 73 (5.08%) BigQuery
15 73 (5.08%) MySQL
16 70 (4.87%) Relational Database
17 49 (3.41%) SQL Server Integration Services
18 45 (3.13%) OLAP
Development Applications
1 139 (9.68%) Jenkins
2 133 (9.26%) Git (software)
3 44 (3.06%) JIRA
4 42 (2.92%) Artifactory
5 37 (2.58%) GitLab
6 32 (2.23%) Visual Studio Team System
7 23 (1.60%) Sonatype Nexus
8 22 (1.53%) Maven
9 15 (1.04%) CircleCI
10 11 (0.77%) SpecFlow
10 11 (0.77%) TeamCity
10 11 (0.77%) Visual Studio
11 10 (0.70%) Atlassian Bamboo
11 10 (0.70%) Bitbucket
11 10 (0.70%) Cucumber
11 10 (0.70%) Octopus Deploy
11 10 (0.70%) tSQLt
12 9 (0.63%) Subversion
13 8 (0.56%) Gradle
13 8 (0.56%) Selenium
General
1 282 (19.64%) Finance
2 64 (4.46%) Banking
3 41 (2.86%) Retail
4 38 (2.65%) Front Office
4 38 (2.65%) Legal
5 20 (1.39%) Investment Banking
6 15 (1.04%) Marketing
7 14 (0.97%) Games
8 9 (0.63%) Telecoms
9 6 (0.42%) Automotive
9 6 (0.42%) Publishing
10 5 (0.35%) Retail Banking
11 4 (0.28%) Pharmaceutical
12 3 (0.21%) Advertising
12 3 (0.21%) Financial Institution
13 2 (0.14%) International Banking
13 2 (0.14%) Military
14 1 (0.070%) Manufacturing
14 1 (0.070%) Multimedia
Libraries, Frameworks & Software Standards
1 354 (24.65%) Kafka
2 139 (9.68%) PySpark
3 63 (4.39%) Pandas
4 58 (4.04%) Spark Streaming
5 55 (3.83%) Web Services
6 45 (3.13%) Apache NiFi
7 29 (2.02%) Velocity
8 28 (1.95%) J2EE
9 26 (1.81%) JSON
9 26 (1.81%) XML
10 25 (1.74%) Apache Beam
10 25 (1.74%) scikit-learn
11 24 (1.67%) REST
11 24 (1.67%) RESTful
11 24 (1.67%) TensorFlow
12 21 (1.46%) Natural Language Processing
13 19 (1.32%) pytest
14 18 (1.25%) Apache Avro
14 18 (1.25%) NumPy
15 17 (1.18%) Elastic Stack
Miscellaneous
1 120 (8.36%) Analytical Skills
2 88 (6.13%) Algorithms
3 65 (4.53%) Data Structures
4 57 (3.97%) Greenfield Project
5 26 (1.81%) Self-Motivation
6 16 (1.11%) Public Cloud
7 14 (0.97%) Data Protection Act
8 10 (0.70%) Data Centre
8 10 (0.70%) Life Science
8 10 (0.70%) Reference Data
8 10 (0.70%) User Experience
9 9 (0.63%) Robotics
10 8 (0.56%) Internet of Things
11 6 (0.42%) Linux Command Line
11 6 (0.42%) Management Information System
12 5 (0.35%) Cloud Native
13 4 (0.28%) Hedge funds
13 4 (0.28%) Market Risk
13 4 (0.28%) Mobile App
13 4 (0.28%) PKI
Operating Systems
1 128 (8.91%) Linux
2 74 (5.15%) Unix
3 20 (1.39%) Windows
4 8 (0.56%) Red Hat Enterprise Linux
5 4 (0.28%) Windows Server
6 2 (0.14%) CentOS
Processes & Methodologies
1 405 (28.20%) Analytics
2 377 (26.25%) Data Science
3 361 (25.14%) Agile Software Development
4 341 (23.75%) ETL
5 291 (20.26%) Data Engineering
6 273 (19.01%) Data Modelling
7 235 (16.36%) Machine Learning
8 183 (12.74%) Business Intelligence
9 179 (12.47%) DevOps
10 117 (8.15%) Visualisation
11 103 (7.17%) Migration
12 102 (7.10%) Scrum
13 99 (6.89%) Problem-Solving
14 95 (6.62%) Artificial Intelligence
15 94 (6.55%) Data Analytics
16 87 (6.06%) Data Analysis
16 87 (6.06%) Data Integration
17 85 (5.92%) TDD
18 84 (5.85%) Software Engineering
19 83 (5.78%) Open Source
Programming Languages
1 799 (55.64%) Python
2 647 (45.06%) SQL
3 308 (21.45%) Scala
4 294 (20.47%) Java
5 73 (5.08%) R
6 47 (3.27%) C#
7 40 (2.79%) T-SQL
8 37 (2.58%) JavaScript
9 35 (2.44%) Bash Shell
10 30 (2.09%) PL/SQL
11 21 (1.46%) Perl
12 18 (1.25%) Go
12 18 (1.25%) Shell Script
13 17 (1.18%) C++
13 17 (1.18%) SAS Macro
14 16 (1.11%) PowerShell
15 15 (1.04%) Julia
16 13 (0.91%) C
17 11 (0.77%) Clojure
18 10 (0.70%) Java 8
Qualifications
1 95 (6.62%) Degree
2 92 (6.41%) Security Cleared
3 80 (5.57%) SC Cleared
4 38 (2.65%) Computer Science Degree
5 37 (2.58%) Master's Degree
6 24 (1.67%) AWS Certification
7 18 (1.25%) PMI Certification
7 18 (1.25%) PMP
8 10 (0.70%) DV Cleared
9 9 (0.63%) PhD
10 5 (0.35%) Cisco Certification
11 3 (0.21%) DBS Check
12 2 (0.14%) CCENT
12 2 (0.14%) CCNA
12 2 (0.14%) CCNP
12 2 (0.14%) CCVP
12 2 (0.14%) CISSP
13 1 (0.070%) CCIE
13 1 (0.070%) Microsoft Certification
13 1 (0.070%) SAS Certification
Quality Assurance & Compliance
1 84 (5.85%) Data Quality
2 15 (1.04%) GDPR
3 11 (0.77%) QA
4 2 (0.14%) COBIT
4 2 (0.14%) GxP
5 1 (0.070%) ISO/IEC 27001
5 1 (0.070%) PCI DSS
5 1 (0.070%) Sarbanes-Oxley
System Software
1 190 (13.23%) Docker
2 63 (4.39%) Apache Flume
3 44 (3.06%) HDFS
4 15 (1.04%) Active Directory
5 6 (0.42%) VMware Infrastructure
6 4 (0.28%) Apache ZooKeeper
6 4 (0.28%) vCloud
7 2 (0.14%) Firmware
7 2 (0.14%) Oracle RAC
7 2 (0.14%) VMware ESXi
8 1 (0.070%) Virtual Machines
8 1 (0.070%) Virtual Servers
8 1 (0.070%) VMware NSX
8 1 (0.070%) vSphere
Systems Management
1 131 (9.12%) Kubernetes
2 77 (5.36%) Terraform
3 58 (4.04%) Ansible
3 58 (4.04%) Oozie
4 52 (3.62%) Hadoop YARN
5 19 (1.32%) Puppet
6 14 (0.97%) Kubeflow
7 12 (0.84%) Kibana
8 9 (0.63%) logstash
9 8 (0.56%) Opscode Chef
10 4 (0.28%) Nagios
10 4 (0.28%) Prometheus
10 4 (0.28%) ZABBIX
11 3 (0.21%) Ambari
11 3 (0.21%) Consul
11 3 (0.21%) Mesos
12 2 (0.14%) Cisco CUCM
12 2 (0.14%) Cisco UCCX
13 1 (0.070%) Cisco Prime
13 1 (0.070%) FortiGate
Vendors
1 247 (17.20%) Google
2 117 (8.15%) Microsoft
3 115 (8.01%) Cloudera
4 111 (7.73%) Databricks
5 89 (6.20%) Oracle
6 73 (5.08%) Tableau
7 68 (4.74%) Informatica
8 65 (4.53%) Talend
9 48 (3.34%) Hortonworks
10 34 (2.37%) SAP
11 28 (1.95%) Alteryx
12 21 (1.46%) Teradata
13 13 (0.91%) IBM
14 12 (0.84%) MapR
15 10 (0.70%) Cisco
15 10 (0.70%) Dell
16 9 (0.63%) Red Hat
16 9 (0.63%) Salesforce.com
16 9 (0.63%) Splunk
16 9 (0.63%) VMware