Period
to 22 September 2018

The median contractor rate for a Data Engineer was £550 per day in advertised job vacancies during the 6 months to 22 September 2018.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
UK
6 months to
22 Sep 2018
Same period 2017 Same period 2016
Rank 301 413 618
Rank change year-on-year +112 +205 +175
Contract jobs requiring a Data Engineer 858 549 307
As % of all contract IT jobs advertised in the UK 0.84% 0.56% 0.29%
As % of the Job Titles category 0.89% 0.59% 0.30%
Number of daily rates quoted 662 412 209
UK median daily rate £550 £500 £525
Median daily rate % change year-on-year +10.00% -4.76% +5.00%
10th Percentile £388 £263 £305
90th Percentile £675 £625 £725
UK excluding London median daily rate £500 £425 £375
% change year-on-year +17.65% +13.33% -6.13%
Number of hourly rates quoted 9 6 16
UK median hourly rate £22.50 £50.63 £13.00
Median hourly rate % change year-on-year -55.56% +289.42% -56.42%
10th Percentile £15.00 £17.91 £11.25
90th Percentile £74.00 £106.25 £26.66
UK excluding London median hourly rate £18.50 £50.63 £13.00
% change year-on-year -63.46% +289.42% -45.03%

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
UK
Contract vacancies in the UK with a recognized job title 96,600 93,694 102,007
% of contract IT jobs with a recognized job title 94.78% 94.92% 94.87%
Number of daily rates quoted 63,416 61,277 66,597
UK median daily rate £450 £438 £425
Median daily rate % change year-on-year +2.86% +2.94% +6.25%
10th Percentile £269 £263 £255
90th Percentile £638 £625 £600
UK excluding London median daily rate £415 £400 £390
% change year-on-year +3.75% +2.56% +4.00%
Number of hourly rates quoted 3,154 2,815 3,199
UK median hourly rate £17.73 £18.70 £19.00
Median hourly rate % change year-on-year -5.19% -1.58% +6.03%
10th Percentile £11.00 £10.75 £10.31
90th Percentile £48.75 £48.75 £46.54
UK excluding London median hourly rate £17.50 £18.00 £18.50
% change year-on-year -2.78% -2.70% +5.71%

Data Engineer
Job Vacancy Trend

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Data Engineer in the UK

Data Engineer
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Engineer.

Contractor daily rate trend for Data Engineer in the UK

Data Engineer
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Engineer over the 6 months to 22 September 2018.

Contractor daily rate histogram for Data Engineer in the UK

Data Engineer
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Engineer.

Contractor hourly rate trend for Data Engineer in the UK

Data Engineer
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Data Engineer over the 6 months to 22 September 2018.

Contractor hourly rate histogram for Data Engineer in the UK

Data Engineer
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the UK over the 6 months to 22 September 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +111 833 £550 +10.00% 200
London +86 613 £550 +10.00% 127
UK excluding London +32 238 £500 +17.65% 85
South East -18 66 £500 +5.26% 11
North of England 0 53 £500 +17.65% 27
East of England +7 41 £475 -1.30% 5
North West +8 35 £525 +275.00% 20
South West +15 30 £525 - 20
Midlands -12 26 £475 +52.00% 10
East Midlands +19 23 £473 +71.82% 6
Scotland -1 20 £400 -7.25% 8
Yorkshire -24 17 £475 +11.76% 4
West Midlands -34 3 £495 +9.89% 4
Wales -26 2 £475 - 3
North East -16 1 £475 +11.76% 3

Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 22 September 2018, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads featuring Data Engineer in the job title.

1 504 (58.74%) Big Data
2 467 (54.43%) Python
3 457 (53.26%) Apache Spark
4 435 (50.70%) Hadoop
5 426 (49.65%) SQL
6 342 (39.86%) Amazon AWS
7 310 (36.13%) Analytics
8 286 (33.33%) Java
9 283 (32.98%) Kafka
10 274 (31.93%) Scala
11 270 (31.47%) ETL
12 253 (29.49%) Data Science
13 235 (27.39%) Apache Hive
14 232 (27.04%) Agile Software Development
15 224 (26.11%) Finance
16 193 (22.49%) Data Warehouse
17 182 (21.21%) NoSQL
18 151 (17.60%) Machine Learning
19 150 (17.48%) Microsoft Azure
20 144 (16.78%) Amazon Redshift
21 137 (15.97%) Data Modelling
22 129 (15.03%) Business Intelligence
23 117 (13.64%) SQL Server
24 115 (13.40%) Linux
25 111 (12.94%) Data Engineering
26 107 (12.47%) Apache
27 102 (11.89%) HBase
28 100 (11.66%) Data Quality
28 100 (11.66%) Oracle
28 100 (11.66%) Relational Database

Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 457 (53.26%) Apache Spark
2 107 (12.47%) Apache
3 55 (6.41%) Elasticsearch
4 32 (3.73%) Apache Airflow
5 29 (3.38%) SAS
6 24 (2.80%) Apache Pig
7 17 (1.98%) Apache Solr
8 11 (1.28%) OpenStack
9 10 (1.17%) Luigi
10 8 (0.93%) Oracle Workflow
11 6 (0.70%) Confluence
12 4 (0.47%) SharePoint
13 3 (0.35%) BizTalk Server
13 3 (0.35%) CMS
13 3 (0.35%) Jupyter
13 3 (0.35%) Tomcat
14 2 (0.23%) Drupal
14 2 (0.23%) nginx
15 1 (0.12%) Gunicorn
15 1 (0.12%) Oracle SOA Suite
Applications
1 23 (2.68%) Microsoft Excel
2 3 (0.35%) Stata
3 1 (0.12%) SPSS
Business Applications
1 11 (1.28%) SAP Oil and Gas
2 4 (0.47%) Dynamics CRM
2 4 (0.47%) Dynamics NAV
2 4 (0.47%) Markit EDM
3 3 (0.35%) Dynamics AX
3 3 (0.35%) SAP MM
3 3 (0.35%) SAP R/3
4 2 (0.23%) PolarLake
4 2 (0.23%) SAP MDG
5 1 (0.12%) Finacle
5 1 (0.12%) FLEXCUBE
5 1 (0.12%) Oracle BPM
5 1 (0.12%) Salesforce.com CRM
5 1 (0.12%) SAP ERP
5 1 (0.12%) SAP MDM
Cloud Services
1 342 (39.86%) Amazon AWS
2 150 (17.48%) Microsoft Azure
3 95 (11.07%) Google Cloud Platform
4 93 (10.84%) Amazon S3
5 85 (9.91%) Amazon EMR
6 64 (7.46%) Amazon EC2
7 62 (7.23%) Amazon Kinesis
8 33 (3.85%) GitHub
8 33 (3.85%) Serverless
9 32 (3.73%) AWS Lambda
10 18 (2.10%) Azure Data Factory
11 15 (1.75%) Cloud Computing
12 14 (1.63%) Virtual Private Cloud
13 11 (1.28%) Google Analytics
14 9 (1.05%) Amazon Glacier
15 6 (0.70%) Amazon ELB
16 4 (0.47%) IBM Cloud
16 4 (0.47%) OpenShift
16 4 (0.47%) PaaS
17 3 (0.35%) AWS Elastic Beanstalk
Communications & Networking
1 20 (2.33%) Kerberos
2 14 (1.63%) Internet
3 13 (1.52%) Firewall
4 11 (1.28%) WAN
5 9 (1.05%) LAN
6 8 (0.93%) SAN
7 7 (0.82%) Fibre Channel
7 7 (0.82%) iSCSI
7 7 (0.82%) NAS
7 7 (0.82%) TCP/IP
8 6 (0.70%) Cisco Nexus
8 6 (0.70%) DNS
8 6 (0.70%) OSPF
8 6 (0.70%) Wireless
9 5 (0.58%) BGP
9 5 (0.58%) SSH
10 4 (0.47%) F5 BIG-IP LTM
10 4 (0.47%) Network Security
10 4 (0.47%) VPN
11 3 (0.35%) SSL
Database & Business Intelligence
1 504 (58.74%) Big Data
2 435 (50.70%) Hadoop
3 235 (27.39%) Apache Hive
4 193 (22.49%) Data Warehouse
5 182 (21.21%) NoSQL
6 144 (16.78%) Amazon Redshift
7 117 (13.64%) SQL Server
8 102 (11.89%) HBase
9 100 (11.66%) Relational Database
10 92 (10.72%) PostgreSQL
11 74 (8.62%) MongoDB
11 74 (8.62%) Power BI
12 71 (8.28%) Data Lake
12 71 (8.28%) OLAP
13 69 (8.04%) Star Schema
14 65 (7.58%) Enterprise Data Warehouse
15 64 (7.46%) Apache Cassandra
16 63 (7.34%) MySQL
17 62 (7.23%) OLAP Cube
18 44 (5.13%) SQL Server Integration Services
Development Applications
1 84 (9.79%) Git (software)
2 78 (9.09%) Jenkins
3 41 (4.78%) JIRA
4 30 (3.50%) Visual Studio Team System
5 21 (2.45%) Bitbucket
6 19 (2.21%) Maven
7 14 (1.63%) Artifactory
8 11 (1.28%) Visual Studio
9 10 (1.17%) Subversion
10 9 (1.05%) Cucumber
11 8 (0.93%) Eclipse
11 8 (0.93%) IntelliJ
12 7 (0.82%) RStudio
12 7 (0.82%) Team Foundation Server
13 6 (0.70%) JUnit
13 6 (0.70%) Octopus Deploy
13 6 (0.70%) Selenium
13 6 (0.70%) Sonatype Nexus
14 5 (0.58%) Ant
14 5 (0.58%) TeamCity
General
1 224 (26.11%) Finance
2 42 (4.90%) Banking
3 40 (4.66%) Retail
4 24 (2.80%) Telecoms
5 21 (2.45%) Legal
6 18 (2.10%) Marketing
7 16 (1.86%) Publishing
8 11 (1.28%) Advertising
8 11 (1.28%) Manufacturing
9 8 (0.93%) Games
10 6 (0.70%) Back Office
11 5 (0.58%) Front Office
11 5 (0.58%) Pharmaceutical
12 4 (0.47%) Financial Institution
13 3 (0.35%) Investment Banking
13 3 (0.35%) Retail Banking
14 2 (0.23%) Dutch Language
14 2 (0.23%) Electronics
14 2 (0.23%) Wholesale Banking
15 1 (0.12%) French Language
Libraries, Frameworks & Software Standards
1 283 (32.98%) Kafka
2 35 (4.08%) Spark Streaming
3 31 (3.61%) Web Services
4 26 (3.03%) Pandas
5 25 (2.91%) RESTful
6 20 (2.33%) .NET
6 20 (2.33%) PySpark
7 19 (2.21%) Elastic Stack
7 19 (2.21%) OpenCV
7 19 (2.21%) XML
8 18 (2.10%) Spring
9 17 (1.98%) LDAP
9 17 (1.98%) MLlib
10 16 (1.86%) JSON
10 16 (1.86%) RabbitMQ
10 16 (1.86%) Unity (Game Engine)
11 14 (1.63%) NumPy
12 12 (1.40%) HTML
12 12 (1.40%) Node.js
12 12 (1.40%) Spring Boot
Miscellaneous
1 90 (10.49%) Analytical Skills
2 62 (7.23%) Algorithms
3 36 (4.20%) Data Structures
3 36 (4.20%) Greenfield Project
4 32 (3.73%) Computer Science
5 31 (3.61%) Fintech
6 18 (2.10%) Data Centre
7 16 (1.86%) HoloLens
8 11 (1.28%) Self-Motivation
9 10 (1.17%) Enterprise Storage
9 10 (1.17%) Virtual Team
10 9 (1.05%) Linux Command Line
10 9 (1.05%) Private Cloud
11 8 (0.93%) Enterprise Software
11 8 (0.93%) Management Information System
12 6 (0.70%) Driving Licence
12 6 (0.70%) Internet of Things
13 5 (0.58%) Mobile App
14 4 (0.47%) Cyber Defence
14 4 (0.47%) Cyberthreat
Operating Systems
1 115 (13.40%) Linux
2 82 (9.56%) Unix
3 17 (1.98%) Red Hat Enterprise Linux
4 15 (1.75%) Windows
5 13 (1.52%) Ubuntu
6 5 (0.58%) CentOS
7 3 (0.35%) Windows Server
8 2 (0.23%) Apple iOS
8 2 (0.23%) Windows Server 2008
9 1 (0.12%) DC/OS
9 1 (0.12%) Solaris
9 1 (0.12%) Windows Server 2012
Processes & Methodologies
1 310 (36.13%) Analytics
2 270 (31.47%) ETL
3 253 (29.49%) Data Science
4 232 (27.04%) Agile Software Development
5 151 (17.60%) Machine Learning
6 137 (15.97%) Data Modelling
7 129 (15.03%) Business Intelligence
8 111 (12.94%) Data Engineering
9 98 (11.42%) DevOps
10 92 (10.72%) Data Analytics
11 91 (10.61%) Visualisation
12 81 (9.44%) TDD
13 77 (8.97%) Continuous Integration
14 75 (8.74%) Scrum
15 74 (8.62%) Open Source
16 69 (8.04%) Software Engineering
17 62 (7.23%) SQL Optimisation
18 54 (6.29%) MapReduce
19 48 (5.59%) OO
20 47 (5.48%) BDD
Programming Languages
1 467 (54.43%) Python
2 426 (49.65%) SQL
3 286 (33.33%) Java
4 274 (31.93%) Scala
5 68 (7.93%) R
6 43 (5.01%) C++
6 43 (5.01%) JavaScript
7 38 (4.43%) Bash Shell
8 32 (3.73%) C#
9 30 (3.50%) Perl
10 29 (3.38%) PL/SQL
11 22 (2.56%) MATLAB
11 22 (2.56%) Shell Script
12 21 (2.45%) Ruby
13 19 (2.21%) T-SQL
14 17 (1.98%) VBA
15 15 (1.75%) Java 8
16 11 (1.28%) C
17 10 (1.17%) Go
18 7 (0.82%) PowerShell
Qualifications
1 34 (3.96%) Security Cleared
2 32 (3.73%) Degree
2 32 (3.73%) SC Cleared
3 12 (1.40%) Computer Science Degree
4 10 (1.17%) Cisco Certification
5 6 (0.70%) CISSP
5 6 (0.70%) Oracle Certification
5 6 (0.70%) PhD
6 5 (0.58%) CISM
7 4 (0.47%) CCNA
7 4 (0.47%) CCNP
7 4 (0.47%) Master's Degree
8 3 (0.35%) DV Cleared
9 2 (0.23%) CCENT
9 2 (0.23%) ITIL Certification
9 2 (0.23%) ITIL Foundation Certificate
9 2 (0.23%) Numerate Degree
10 1 (0.12%) CEH
10 1 (0.12%) CISMP
10 1 (0.12%) OSCP
Quality Assurance & Compliance
1 100 (11.66%) Data Quality
2 18 (2.10%) GDPR
3 16 (1.86%) QA
4 4 (0.47%) FINRA
4 4 (0.47%) PMO
5 1 (0.12%) ISO/IEC 27001
5 1 (0.12%) SLA
System Software
1 75 (8.74%) Docker
2 60 (6.99%) HDFS
3 37 (4.31%) Apache Flume
4 10 (1.17%) Hyper-V
4 10 (1.17%) VMware Infrastructure
5 9 (1.05%) Apache ZooKeeper
6 7 (0.82%) NFS
7 4 (0.47%) Active Directory
8 2 (0.23%) Ceph
9 1 (0.12%) Oracle RAC
Systems Management
1 91 (10.61%) Oozie
2 58 (6.76%) Ansible
3 35 (4.08%) Kubernetes
4 33 (3.85%) Hadoop YARN
5 26 (3.03%) Terraform
6 21 (2.45%) Kibana
7 16 (1.86%) Opscode Chef
8 10 (1.17%) Prometheus
9 9 (1.05%) logstash
10 5 (0.58%) Ambari
10 5 (0.58%) Mesos
11 4 (0.47%) Puppet
12 3 (0.35%) Packer
13 2 (0.23%) Docker Swarm
13 2 (0.23%) Grafana
13 2 (0.23%) Graphite
13 2 (0.23%) Marathon
13 2 (0.23%) Salt
14 1 (0.12%) Cisco CUCM
14 1 (0.12%) Cisco Prime
Vendors
1 100 (11.66%) Oracle
2 78 (9.09%) Tableau
3 68 (7.93%) Google
4 59 (6.88%) Microsoft
5 53 (6.18%) Cloudera
6 42 (4.90%) Hortonworks
6 42 (4.90%) Talend
7 40 (4.66%) Informatica
8 39 (4.55%) Splunk
9 35 (4.08%) Alteryx
10 33 (3.85%) SAP
11 20 (2.33%) Red Hat
12 19 (2.21%) IBM
13 15 (1.75%) Cisco
13 15 (1.75%) MapR
13 15 (1.75%) MicroStrategy
14 12 (1.40%) Centrify
14 12 (1.40%) Cognos
15 11 (1.28%) EMC
15 11 (1.28%) VMware