Period
to 16 July 2018

The median contractor rate for a Data Engineer was £550 per day in advertised job vacancies during the 6 months to 16 July 2018.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
UK
6 months to
16 Jul 2018
Same period 2017 Same period 2016
Rank 301 445 640
Rank change year-on-year +144 +195 +111
Contract jobs requiring a Data Engineer 867 473 269
As % of all contract IT jobs advertised in the UK 0.84% 0.50% 0.24%
As % of the Job Titles category 0.88% 0.52% 0.26%
Number of daily rates quoted 661 319 192
UK median daily rate £550 £500 £525
Median daily rate % change year-on-year +10.00% -4.76% +13.51%
10th Percentile £385 £263 £256
90th Percentile £675 £638 £725
UK excluding London median daily rate £475 £424 £345
% change year-on-year +12.09% +22.83% -5.48%
Number of hourly rates quoted 8 30 5
UK median hourly rate £22.25 £12.50 £15.32
Median hourly rate % change year-on-year +78.00% -18.41% -54.94%
10th Percentile £15.00 £12.00 £9.90
90th Percentile £73.75 £27.30 £42.45
UK excluding London median hourly rate £18.50 £12.50 £15.32
% change year-on-year +48.00% -18.41% -50.29%

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
UK
Contract vacancies in the UK with a recognized job title 98,386 90,114 104,687
% of contract IT jobs with a recognized job title 94.85% 94.95% 95.07%
Number of daily rates quoted 64,408 58,344 68,084
UK median daily rate £450 £425 £425
Median daily rate % change year-on-year +5.88% - +6.25%
10th Percentile £269 £263 £255
90th Percentile £638 £619 £600
UK excluding London median daily rate £413 £400 £388
% change year-on-year +3.13% +3.23% +3.33%
Number of hourly rates quoted 3,166 2,933 3,152
UK median hourly rate £18.09 £18.70 £19.50
Median hourly rate % change year-on-year -3.26% -4.13% +11.43%
10th Percentile £11.00 £10.75 £10.50
90th Percentile £48.75 £50.00 £47.50
UK excluding London median hourly rate £17.50 £17.77 £19.00
% change year-on-year -1.52% -6.47% +11.76%

Data Engineer
Job Vacancy Trend

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Data Engineer in the UK

Data Engineer
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Engineer.

Contractor daily rate trend for Data Engineer in the UK

Data Engineer
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Engineer over the 6 months to 16 July 2018.

Contractor daily rate histogram for Data Engineer in the UK

Data Engineer
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Engineer.

Contractor hourly rate trend for Data Engineer in the UK

Data Engineer
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Data Engineer over the 6 months to 16 July 2018.

Contractor hourly rate histogram for Data Engineer in the UK

Data Engineer
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the UK over the 6 months to 16 July 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +146 848 £550 +10.00% 233
London +105 635 £550 +10.00% 120
UK excluding London +62 231 £475 +12.09% 119
North of England +6 71 £475 +15.15% 37
South East -21 63 £500 +17.65% 32
East of England +36 44 £475 +5.56% 14
Yorkshire +1 37 £478 +3.24% 12
North West -18 30 £475 +35.71% 24
Midlands -7 25 £430 +31.30% 12
East Midlands +11 20 £461 +40.84% 8
Scotland -26 14 £390 - 5
South West +16 9 £500 +244.83% 18
Wales -15 5 £383 -33.48% 1
West Midlands -18 5 £285 -24.00% 4
North East +5 4 £475 +11.76% 1

Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 16 July 2018, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads featuring Data Engineer in the job title.

1 525 (60.55%) Big Data
2 488 (56.29%) Python
3 466 (53.75%) SQL
4 456 (52.60%) Apache Spark
5 444 (51.21%) Hadoop
6 341 (39.33%) Analytics
7 321 (37.02%) ETL
8 300 (34.60%) Amazon AWS
9 294 (33.91%) Java
10 280 (32.30%) Scala
11 268 (30.91%) Kafka
12 244 (28.14%) Apache Hive
13 243 (28.03%) Data Science
14 223 (25.72%) Agile Software Development
15 221 (25.49%) Data Warehouse
16 213 (24.57%) Finance
17 195 (22.49%) NoSQL
18 156 (17.99%) Microsoft Azure
19 149 (17.19%) Machine Learning
20 144 (16.61%) Amazon Redshift
21 143 (16.49%) Data Modelling
22 140 (16.15%) Data Engineering
23 125 (14.42%) Linux
24 122 (14.07%) SQL Server
25 120 (13.84%) Business Intelligence
26 112 (12.92%) PostgreSQL
27 111 (12.80%) Oracle
28 109 (12.57%) Relational Database
29 107 (12.34%) Data Quality
29 107 (12.34%) HBase

Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 456 (52.60%) Apache Spark
2 93 (10.73%) Apache
3 39 (4.50%) Apache Pig
3 39 (4.50%) Elasticsearch
4 36 (4.15%) SAS
5 29 (3.34%) Apache Airflow
6 22 (2.54%) Apache Solr
7 11 (1.27%) OpenStack
8 9 (1.04%) Luigi
8 9 (1.04%) nginx
9 8 (0.92%) Oracle Workflow
9 8 (0.92%) Tomcat
10 7 (0.81%) SharePoint
11 5 (0.58%) Confluence
12 3 (0.35%) BizTalk Server
12 3 (0.35%) Jupyter
13 1 (0.12%) Gunicorn
13 1 (0.12%) MS Exchange
Applications
1 16 (1.85%) Microsoft Excel
2 10 (1.15%) Stata
3 4 (0.46%) Spreadsheet
4 1 (0.12%) Chatbot
Business Applications
1 8 (0.92%) SAP Oil and Gas
2 4 (0.46%) Dynamics NAV
3 3 (0.35%) Dynamics AX
3 3 (0.35%) Dynamics CRM
4 2 (0.23%) Markit EDM
4 2 (0.23%) PolarLake
5 1 (0.12%) Dynamics GP
5 1 (0.12%) Finacle
5 1 (0.12%) FLEXCUBE
5 1 (0.12%) SAP MDG
Cloud Services
1 300 (34.60%) Amazon AWS
2 156 (17.99%) Microsoft Azure
3 68 (7.84%) Google Cloud Platform
4 61 (7.04%) Amazon S3
5 55 (6.34%) Amazon EC2
6 53 (6.11%) Amazon EMR
7 51 (5.88%) Amazon Kinesis
8 28 (3.23%) Serverless
9 26 (3.00%) Azure Data Factory
10 22 (2.54%) AWS Lambda
11 21 (2.42%) GitHub
11 21 (2.42%) Google Analytics
12 9 (1.04%) Cloud Computing
12 9 (1.04%) Virtual Private Cloud
13 7 (0.81%) Data Lake Analytics
13 7 (0.81%) PaaS
14 6 (0.69%) Amazon ELB
15 4 (0.46%) Amazon Glacier
15 4 (0.46%) OpenShift
16 3 (0.35%) AdWords
Communications & Networking
1 19 (2.19%) Kerberos
2 11 (1.27%) WAN
3 10 (1.15%) Firewall
4 9 (1.04%) LAN
5 8 (0.92%) SAN
6 7 (0.81%) Fibre Channel
6 7 (0.81%) iSCSI
6 7 (0.81%) NAS
6 7 (0.81%) VPN
6 7 (0.81%) Wireless
7 6 (0.69%) DSL
8 5 (0.58%) BGP
8 5 (0.58%) Cisco Nexus
8 5 (0.58%) DNS
8 5 (0.58%) Internet
8 5 (0.58%) OSPF
9 4 (0.46%) F5 BIG-IP LTM
9 4 (0.46%) TCP/IP
10 3 (0.35%) ICMP
10 3 (0.35%) Network Security
Database & Business Intelligence
1 525 (60.55%) Big Data
2 444 (51.21%) Hadoop
3 244 (28.14%) Apache Hive
4 221 (25.49%) Data Warehouse
5 195 (22.49%) NoSQL
6 144 (16.61%) Amazon Redshift
7 122 (14.07%) SQL Server
8 112 (12.92%) PostgreSQL
9 109 (12.57%) Relational Database
10 107 (12.34%) HBase
11 90 (10.38%) MongoDB
12 82 (9.46%) Data Lake
13 80 (9.23%) MySQL
14 65 (7.50%) Apache Cassandra
15 64 (7.38%) OLAP
16 63 (7.27%) Star Schema
17 56 (6.46%) Enterprise Data Warehouse
17 56 (6.46%) Impala
18 54 (6.23%) Power BI
19 53 (6.11%) OLAP Cube
Development Applications
1 75 (8.65%) Git (software)
2 58 (6.69%) Jenkins
3 35 (4.04%) Visual Studio Team System
4 24 (2.77%) JIRA
5 16 (1.85%) Bitbucket
6 14 (1.61%) Maven
6 14 (1.61%) RStudio
6 14 (1.61%) Subversion
7 12 (1.38%) Artifactory
8 11 (1.27%) Visual Studio
9 10 (1.15%) TeamCity
10 9 (1.04%) Team Foundation Server
11 8 (0.92%) Cucumber
11 8 (0.92%) GitLab
12 7 (0.81%) Eclipse
12 7 (0.81%) JUnit
12 7 (0.81%) SpecFlow
13 6 (0.69%) Octopus Deploy
13 6 (0.69%) tSQLt
14 5 (0.58%) IntelliJ
General
1 213 (24.57%) Finance
2 45 (5.19%) Retail
3 41 (4.73%) Banking
4 16 (1.85%) Games
4 16 (1.85%) Marketing
5 14 (1.61%) Advertising
6 12 (1.38%) Manufacturing
7 10 (1.15%) Telecoms
8 8 (0.92%) Legal
9 7 (0.81%) Investment Banking
10 4 (0.46%) Pharmaceutical
11 3 (0.35%) Back Office
12 2 (0.23%) Electronics
12 2 (0.23%) Financial Institution
12 2 (0.23%) Law
12 2 (0.23%) Retail Banking
12 2 (0.23%) Wholesale Banking
13 1 (0.12%) French Language
13 1 (0.12%) Front Office
13 1 (0.12%) International Banking
Libraries, Frameworks & Software Standards
1 268 (30.91%) Kafka
2 28 (3.23%) Spark Streaming
3 25 (2.88%) XML
4 24 (2.77%) MLlib
5 23 (2.65%) JSON
6 22 (2.54%) Pandas
7 21 (2.42%) OpenCV
8 20 (2.31%) Unity (Game Engine)
9 18 (2.08%) HTML
10 17 (1.96%) LDAP
10 17 (1.96%) RESTful
11 16 (1.85%) REST
12 15 (1.73%) .NET
12 15 (1.73%) HTML5
12 15 (1.73%) Node.js
12 15 (1.73%) TensorFlow
12 15 (1.73%) Web Services
13 14 (1.61%) Spring
14 13 (1.50%) PySpark
14 13 (1.50%) RabbitMQ
Miscellaneous
1 98 (11.30%) Analytical Skills
2 68 (7.84%) Algorithms
3 42 (4.84%) Data Structures
4 34 (3.92%) Fintech
5 31 (3.58%) Computer Science
6 29 (3.34%) Greenfield Project
7 21 (2.42%) Data Centre
8 20 (2.31%) HoloLens
9 10 (1.15%) Enterprise Storage
9 10 (1.15%) Hedge funds
9 10 (1.15%) Linux Command Line
10 9 (1.04%) Enterprise Software
10 9 (1.04%) Private Cloud
11 8 (0.92%) Derivative
11 8 (0.92%) Management Information System
12 6 (0.69%) Driving Licence
12 6 (0.69%) Self-Motivation
13 5 (0.58%) Clustering
13 5 (0.58%) NHS
14 4 (0.46%) Grid Computing
Operating Systems
1 125 (14.42%) Linux
2 69 (7.96%) Unix
3 15 (1.73%) Windows
4 14 (1.61%) Red Hat Enterprise Linux
5 9 (1.04%) Ubuntu
6 6 (0.69%) Windows Server
7 5 (0.58%) Windows Server 2008
8 1 (0.12%) CentOS
8 1 (0.12%) DC/OS
8 1 (0.12%) Windows Server 2012
Processes & Methodologies
1 341 (39.33%) Analytics
2 321 (37.02%) ETL
3 243 (28.03%) Data Science
4 223 (25.72%) Agile Software Development
5 149 (17.19%) Machine Learning
6 143 (16.49%) Data Modelling
7 140 (16.15%) Data Engineering
8 120 (13.84%) Business Intelligence
9 101 (11.65%) DevOps
10 90 (10.38%) Visualisation
11 83 (9.57%) Data Analytics
12 71 (8.19%) Software Engineering
13 69 (7.96%) Open Source
14 65 (7.50%) Continuous Integration
15 61 (7.04%) Problem-Solving
16 59 (6.81%) TDD
17 57 (6.57%) Scrum
18 52 (6.00%) Data Transformation
18 52 (6.00%) MapReduce
19 50 (5.77%) SQL Optimisation
Programming Languages
1 488 (56.29%) Python
2 466 (53.75%) SQL
3 294 (33.91%) Java
4 280 (32.30%) Scala
5 80 (9.23%) R
6 46 (5.31%) JavaScript
7 44 (5.07%) C#
8 37 (4.27%) C++
8 37 (4.27%) Shell Script
9 29 (3.34%) Bash Shell
9 29 (3.34%) PL/SQL
10 28 (3.23%) Perl
10 28 (3.23%) T-SQL
11 17 (1.96%) Ruby
12 16 (1.85%) Go
12 16 (1.85%) Java 8
13 15 (1.73%) PowerShell
14 14 (1.61%) MATLAB
15 11 (1.27%) C
15 11 (1.27%) HiveQL
Qualifications
1 60 (6.92%) Security Cleared
2 52 (6.00%) SC Cleared
3 46 (5.31%) Degree
4 19 (2.19%) Computer Science Degree
5 15 (1.73%) DV Cleared
6 9 (1.04%) PhD
7 8 (0.92%) Cisco Certification
8 6 (0.69%) Numerate Degree
8 6 (0.69%) Oracle Certification
9 4 (0.46%) CCNP
9 4 (0.46%) Master's Degree
10 3 (0.35%) CISM
10 3 (0.35%) CISSP
10 3 (0.35%) DBS Check
11 2 (0.23%) CCNA
11 2 (0.23%) ITIL Certification
12 1 (0.12%) CCENT
12 1 (0.12%) CEH
12 1 (0.12%) ITIL Foundation Certificate
12 1 (0.12%) OSCP
Quality Assurance & Compliance
1 107 (12.34%) Data Quality
2 22 (2.54%) GCP
3 21 (2.42%) GDPR
4 13 (1.50%) QA
5 5 (0.58%) PMO
6 2 (0.23%) FINRA
7 1 (0.12%) SLA
System Software
1 93 (10.73%) HDFS
2 80 (9.23%) Docker
3 56 (6.46%) Apache Flume
4 12 (1.38%) Apache ZooKeeper
5 10 (1.15%) Hyper-V
5 10 (1.15%) VMware Infrastructure
6 7 (0.81%) NFS
7 2 (0.23%) Active Directory
7 2 (0.23%) Ceph
8 1 (0.12%) Oracle RAC
Systems Management
1 92 (10.61%) Oozie
2 35 (4.04%) Ansible
3 32 (3.69%) Kubernetes
4 29 (3.34%) Hadoop YARN
5 15 (1.73%) Kibana
6 13 (1.50%) Terraform
7 11 (1.27%) Opscode Chef
7 11 (1.27%) Prometheus
8 9 (1.04%) Puppet
9 7 (0.81%) Ambari
10 5 (0.58%) Mesos
11 4 (0.46%) Salt
12 3 (0.35%) Consul
12 3 (0.35%) HAProxy
12 3 (0.35%) Host Intrusion Detection System
12 3 (0.35%) Network Intrusion Detection System
12 3 (0.35%) Packer
12 3 (0.35%) Sysdig
13 2 (0.23%) Grafana
13 2 (0.23%) Graphite
Vendors
1 111 (12.80%) Oracle
2 75 (8.65%) Cloudera
3 68 (7.84%) Google
3 68 (7.84%) Microsoft
4 66 (7.61%) Tableau
5 61 (7.04%) Talend
6 49 (5.65%) Informatica
7 48 (5.54%) Hortonworks
8 36 (4.15%) Alteryx
9 28 (3.23%) Splunk
10 24 (2.77%) SAP
11 22 (2.54%) Red Hat
11 22 (2.54%) Salesforce.com
12 21 (2.42%) MapR
13 15 (1.73%) IBM
14 12 (1.38%) Cisco
14 12 (1.38%) VMware
15 11 (1.27%) EMC
15 11 (1.27%) Teradata
16 10 (1.15%) NetApp