Period
to 12 November 2018

The median contractor rate for a Data Engineer was £550 per day in advertised job vacancies during the 6 months to 12 November 2018.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
UK
6 months to
12 Nov 2018
Same period 2017 Same period 2016
Rank 314 391 537
Rank change year-on-year +77 +146 +263
Contract jobs requiring a Data Engineer 841 630 403
As % of all contract IT jobs advertised in the UK 0.82% 0.62% 0.38%
As % of the Job Titles category 0.86% 0.65% 0.40%
Number of daily rates quoted 626 487 268
UK median daily rate £550 £500 £525
Median daily rate % change year-on-year +10.00% -4.76% +5.00%
10th Percentile £383 £263 £344
90th Percentile £688 £638 £713
UK excluding London median daily rate £498 £450 £400
% change year-on-year +10.56% +12.50% -
Number of hourly rates quoted 10 9 23
UK median hourly rate £25.50 £26.00 £13.00
Median hourly rate % change year-on-year -1.92% +100.00% -45.03%
10th Percentile £15.00 £14.87 £11.25
90th Percentile £85.18 £80.00 £38.00
UK excluding London median hourly rate £18.50 £50.00 £12.50
% change year-on-year -63.00% +300.00% -42.24%

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
UK
Contract vacancies in the UK with a recognized job title 97,437 96,189 100,178
% of contract IT jobs with a recognized job title 94.75% 94.94% 94.83%
Number of daily rates quoted 64,264 63,352 65,245
UK median daily rate £450 £445 £425
Median daily rate % change year-on-year +1.12% +4.71% +6.25%
10th Percentile £269 £262 £250
90th Percentile £638 £625 £600
UK excluding London median daily rate £423 £400 £390
% change year-on-year +5.63% +2.56% +4.00%
Number of hourly rates quoted 3,064 2,871 3,300
UK median hourly rate £18.00 £18.70 £18.00
Median hourly rate % change year-on-year -3.74% +3.89% -
10th Percentile £11.00 £10.92 £10.50
90th Percentile £48.75 £47.83 £47.25
UK excluding London median hourly rate £17.50 £18.00 £17.50
% change year-on-year -2.78% +2.86% -

Data Engineer
Job Vacancy Trend

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Data Engineer in the UK

Data Engineer
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Engineer.

Contractor daily rate trend for Data Engineer in the UK

Data Engineer
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Engineer over the 6 months to 12 November 2018.

Contractor daily rate histogram for Data Engineer in the UK

Data Engineer
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Engineer.

Contractor hourly rate trend for Data Engineer in the UK

Data Engineer
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Data Engineer over the 6 months to 12 November 2018.

Contractor hourly rate histogram for Data Engineer in the UK

Data Engineer
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the UK over the 6 months to 12 November 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +78 811 £550 +10.00% 317
London +87 579 £550 +10.00% 203
UK excluding London +17 253 £498 +10.56% 132
South East -29 74 £500 +2.56% 22
North of England -2 63 £475 +11.76% 38
South West +7 37 £525 +56.72% 32
North West -1 32 £525 +275.00% 22
East of England +6 29 £538 +13.16% 12
Midlands -7 24 £495 +40.28% 10
Yorkshire -16 24 £469 +10.29% 11
Scotland +6 22 £425 +3.03% 13
East Midlands +20 15 £488 +77.27% 6
West Midlands -27 9 £495 +9.89% 4
North East 0 7 £475 +11.76% 5
Wales -19 4 £325 - 4
Northern Ireland +36 1 - - 1

Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 12 November 2018, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads featuring Data Engineer in the job title.

1 466 (55.41%) Python
2 460 (54.70%) Big Data
3 413 (49.11%) Hadoop
3 413 (49.11%) Apache Spark
4 388 (46.14%) SQL
5 302 (35.91%) Amazon AWS
6 269 (31.99%) Kafka
7 266 (31.63%) Java
8 254 (30.20%) Analytics
9 250 (29.73%) Scala
10 245 (29.13%) ETL
11 234 (27.82%) Agile Software Development
12 227 (26.99%) Apache Hive
13 215 (25.56%) Data Science
14 182 (21.64%) Finance
15 170 (20.21%) NoSQL
16 161 (19.14%) Data Warehouse
17 159 (18.91%) Microsoft Azure
18 139 (16.53%) Business Intelligence
19 127 (15.10%) Machine Learning
20 123 (14.63%) Data Modelling
21 115 (13.67%) HBase
22 113 (13.44%) SQL Server
23 111 (13.20%) Amazon Redshift
24 106 (12.60%) Data Engineering
25 103 (12.25%) Linux
26 101 (12.01%) Google Cloud Platform
27 100 (11.89%) DevOps
28 98 (11.65%) Apache
29 97 (11.53%) Relational Database

Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 413 (49.11%) Apache Spark
2 98 (11.65%) Apache
3 62 (7.37%) Elasticsearch
4 42 (4.99%) SAS
5 29 (3.45%) Apache Pig
6 26 (3.09%) Apache Airflow
7 20 (2.38%) Apache Solr
8 9 (1.07%) Jupyter
9 8 (0.95%) Confluence
10 6 (0.71%) Luigi
11 5 (0.59%) SharePoint
12 4 (0.48%) Apache Qpid
12 4 (0.48%) OpenStack
13 3 (0.36%) BizTalk Server
13 3 (0.36%) CMS
13 3 (0.36%) Oracle Workflow
14 2 (0.24%) Drupal
14 2 (0.24%) Tomcat
15 1 (0.12%) Gunicorn
15 1 (0.12%) nginx
Applications
1 17 (2.02%) Microsoft Excel
2 3 (0.36%) MS Visio
3 1 (0.12%) SPSS
Business Applications
1 12 (1.43%) SAP Oil and Gas
2 4 (0.48%) Dynamics CRM
2 4 (0.48%) Dynamics NAV
2 4 (0.48%) Markit EDM
3 3 (0.36%) Dynamics AX
3 3 (0.36%) SAP MM
3 3 (0.36%) SAP R/3
4 2 (0.24%) PolarLake
4 2 (0.24%) SAP MDG
5 1 (0.12%) Oracle BPM
5 1 (0.12%) Salesforce.com CRM
5 1 (0.12%) SAP ERP
5 1 (0.12%) SAP MDM
Cloud Services
1 302 (35.91%) Amazon AWS
2 159 (18.91%) Microsoft Azure
3 101 (12.01%) Google Cloud Platform
4 91 (10.82%) Amazon S3
5 78 (9.27%) Amazon EMR
6 52 (6.18%) Amazon EC2
7 50 (5.95%) Amazon Kinesis
8 39 (4.64%) GitHub
9 34 (4.04%) Serverless
10 33 (3.92%) AWS Lambda
11 25 (2.97%) Azure Data Factory
12 16 (1.90%) Cloud Computing
12 16 (1.90%) Virtual Private Cloud
13 10 (1.19%) Google Analytics
14 9 (1.07%) Amazon Glacier
15 7 (0.83%) Data Lake Analytics
16 6 (0.71%) IaaS
17 5 (0.59%) AWS Elastic Beanstalk
17 5 (0.59%) PaaS
18 4 (0.48%) Amazon ELB
Communications & Networking
1 19 (2.26%) Kerberos
2 13 (1.55%) Internet
3 12 (1.43%) LAN
3 12 (1.43%) WAN
4 11 (1.31%) Firewall
5 6 (0.71%) TCP/IP
6 5 (0.59%) DNS
6 5 (0.59%) SSH
7 4 (0.48%) HTTP
8 3 (0.36%) Cisco ICM
8 3 (0.36%) Cisco Nexus
8 3 (0.36%) Fibre Channel
8 3 (0.36%) iSCSI
8 3 (0.36%) NAS
8 3 (0.36%) SAN
8 3 (0.36%) SIGTRAN
8 3 (0.36%) SS7
8 3 (0.36%) VPN
8 3 (0.36%) Wireless
9 2 (0.24%) Wi-Fi
Database & Business Intelligence
1 460 (54.70%) Big Data
2 413 (49.11%) Hadoop
3 227 (26.99%) Apache Hive
4 170 (20.21%) NoSQL
5 161 (19.14%) Data Warehouse
6 115 (13.67%) HBase
7 113 (13.44%) SQL Server
8 111 (13.20%) Amazon Redshift
9 97 (11.53%) Relational Database
10 90 (10.70%) Power BI
11 75 (8.92%) Data Lake
11 75 (8.92%) MongoDB
12 74 (8.80%) Apache Cassandra
13 64 (7.61%) PostgreSQL
13 64 (7.61%) SQL Server Integration Services
14 58 (6.90%) MySQL
15 50 (5.95%) Impala
16 42 (4.99%) Sqoop
17 35 (4.16%) Amazon Athena
17 35 (4.16%) RDBMS
Development Applications
1 83 (9.87%) Jenkins
2 81 (9.63%) Git (software)
3 42 (4.99%) JIRA
4 24 (2.85%) Visual Studio Team System
5 18 (2.14%) Bitbucket
6 17 (2.02%) Maven
7 12 (1.43%) Visual Studio
8 11 (1.31%) Artifactory
8 11 (1.31%) Cucumber
9 9 (1.07%) Eclipse
9 9 (1.07%) Selenium
10 8 (0.95%) IntelliJ
10 8 (0.95%) Subversion
11 6 (0.71%) JUnit
11 6 (0.71%) Octopus Deploy
11 6 (0.71%) Sonatype Nexus
11 6 (0.71%) TeamCity
12 5 (0.59%) Ant
12 5 (0.59%) Gerrit
12 5 (0.59%) JBehave
General
1 182 (21.64%) Finance
2 43 (5.11%) Banking
3 35 (4.16%) Retail
4 28 (3.33%) Legal
4 28 (3.33%) Telecoms
5 24 (2.85%) Marketing
6 18 (2.14%) Publishing
7 8 (0.95%) Advertising
8 7 (0.83%) Back Office
8 7 (0.83%) Front Office
9 6 (0.71%) Pharmaceutical
10 4 (0.48%) Financial Institution
10 4 (0.48%) Manufacturing
11 3 (0.36%) Dutch Language
11 3 (0.36%) Investment Banking
12 2 (0.24%) Games
12 2 (0.24%) Retail Banking
13 1 (0.12%) Automotive
13 1 (0.12%) Corporate Banking
13 1 (0.12%) Electronics
Libraries, Frameworks & Software Standards
1 269 (31.99%) Kafka
2 42 (4.99%) Spark Streaming
3 39 (4.64%) Web Services
4 28 (3.33%) Pandas
5 24 (2.85%) RESTful
6 23 (2.73%) PySpark
6 23 (2.73%) XML
7 22 (2.62%) .NET
8 20 (2.38%) Elastic Stack
9 18 (2.14%) JSON
10 17 (2.02%) NumPy
10 17 (2.02%) Spring
11 15 (1.78%) scikit-learn
12 14 (1.66%) Node.js
12 14 (1.66%) OpenCV
13 12 (1.43%) Lambda Expressions
14 11 (1.31%) LDAP
14 11 (1.31%) REST
14 11 (1.31%) Unity (Game Engine)
15 10 (1.19%) HTML
Miscellaneous
1 85 (10.11%) Analytical Skills
2 65 (7.73%) Algorithms
3 41 (4.88%) Computer Science
4 38 (4.52%) Greenfield Project
5 33 (3.92%) Fintech
6 31 (3.69%) Data Structures
7 18 (2.14%) Self-Motivation
8 12 (1.43%) Data Centre
9 11 (1.31%) HoloLens
10 10 (1.19%) Virtual Team
11 9 (1.07%) Management Information System
12 6 (0.71%) Enterprise Software
12 6 (0.71%) Internet of Things
13 5 (0.59%) Mobile App
13 5 (0.59%) Replication
13 5 (0.59%) Taxonomies
14 4 (0.48%) Derivative
14 4 (0.48%) Equities
14 4 (0.48%) Foreign Exchange (FX)
14 4 (0.48%) RIA
Operating Systems
1 103 (12.25%) Linux
2 78 (9.27%) Unix
3 21 (2.50%) Windows
4 14 (1.66%) Red Hat Enterprise Linux
5 10 (1.19%) Ubuntu
6 5 (0.59%) CentOS
7 2 (0.24%) Apple iOS
7 2 (0.24%) Solaris
8 1 (0.12%) DC/OS
8 1 (0.12%) Windows Server
Processes & Methodologies
1 254 (30.20%) Analytics
2 245 (29.13%) ETL
3 234 (27.82%) Agile Software Development
4 215 (25.56%) Data Science
5 139 (16.53%) Business Intelligence
6 127 (15.10%) Machine Learning
7 123 (14.63%) Data Modelling
8 106 (12.60%) Data Engineering
9 100 (11.89%) DevOps
10 84 (9.99%) Visualisation
11 77 (9.16%) Scrum
12 76 (9.04%) Data Analytics
12 76 (9.04%) TDD
13 71 (8.44%) Software Engineering
14 70 (8.32%) MapReduce
15 69 (8.20%) Open Source
16 66 (7.85%) Continuous Integration
17 49 (5.83%) BDD
18 47 (5.59%) Data Analysis
19 45 (5.35%) Data Architecture
Programming Languages
1 466 (55.41%) Python
2 388 (46.14%) SQL
3 266 (31.63%) Java
4 250 (29.73%) Scala
5 71 (8.44%) R
6 47 (5.59%) JavaScript
7 38 (4.52%) C#
8 37 (4.40%) C++
9 35 (4.16%) Bash Shell
10 33 (3.92%) T-SQL
11 27 (3.21%) MATLAB
12 22 (2.62%) Ruby
13 21 (2.50%) Perl
14 15 (1.78%) C
14 15 (1.78%) PL/SQL
15 14 (1.66%) VBA
16 13 (1.55%) Data Analysis Expressions (DAX)
16 13 (1.55%) Java 8
16 13 (1.55%) Shell Script
17 10 (1.19%) PowerShell
Qualifications
1 41 (4.88%) Degree
2 28 (3.33%) Security Cleared
3 25 (2.97%) SC Cleared
4 21 (2.50%) Computer Science Degree
5 9 (1.07%) CISSP
6 8 (0.95%) CISM
7 7 (0.83%) Cisco Certification
8 5 (0.59%) CCNA
8 5 (0.59%) Master's Degree
8 5 (0.59%) Microsoft Certification
8 5 (0.59%) PhD
9 4 (0.48%) MCSA
10 3 (0.36%) CCENT
10 3 (0.36%) CCNP
10 3 (0.36%) CEH
10 3 (0.36%) DV Cleared
10 3 (0.36%) OSCP
11 2 (0.24%) MCSE
12 1 (0.12%) CISMP
12 1 (0.12%) SAS Certification
Quality Assurance & Compliance
1 65 (7.73%) Data Quality
2 21 (2.50%) QA
3 12 (1.43%) GDPR
4 7 (0.83%) SLA
5 5 (0.59%) FINRA
6 2 (0.24%) PMO
7 1 (0.12%) ISO/IEC 27001
System Software
1 71 (8.44%) Docker
2 64 (7.61%) HDFS
3 46 (5.47%) Apache Flume
4 16 (1.90%) Apache ZooKeeper
5 5 (0.59%) Oracle RAC
5 5 (0.59%) VMware Infrastructure
6 4 (0.48%) Active Directory
7 3 (0.36%) Hyper-V
7 3 (0.36%) NFS
8 2 (0.24%) Tivoli Workload Scheduler
9 1 (0.12%) Cronacle
Systems Management
1 71 (8.44%) Oozie
2 59 (7.02%) Ansible
3 49 (5.83%) Hadoop YARN
4 32 (3.80%) Terraform
5 30 (3.57%) Kubernetes
6 17 (2.02%) Kibana
7 15 (1.78%) Opscode Chef
8 9 (1.07%) Ambari
8 9 (1.07%) logstash
9 8 (0.95%) Prometheus
9 8 (0.95%) Puppet
10 3 (0.36%) Cisco UCCE
10 3 (0.36%) Mesos
11 2 (0.24%) Docker Swarm
11 2 (0.24%) Grafana
11 2 (0.24%) Graphite
11 2 (0.24%) Tivoli
12 1 (0.12%) Control-M
12 1 (0.12%) EMC NetWorker
12 1 (0.12%) Systems Management Server (SMS)
Vendors
1 96 (11.41%) Oracle
2 80 (9.51%) Google
3 78 (9.27%) Tableau
4 56 (6.66%) Cloudera
5 55 (6.54%) Hortonworks
6 54 (6.42%) Microsoft
7 52 (6.18%) Talend
8 45 (5.35%) Informatica
9 39 (4.64%) Alteryx
10 35 (4.16%) SAP
11 29 (3.45%) Splunk
12 19 (2.26%) Cisco
13 14 (1.66%) Databricks
13 14 (1.66%) Red Hat
14 12 (1.43%) MicroStrategy
15 11 (1.31%) MapR
16 10 (1.19%) IBM
17 9 (1.07%) Centrify
18 8 (0.95%) Cognos
18 8 (0.95%) Sybase