Period
to 15 February 2019

The median contractor rate for a Data Engineer was £538 per day in advertised job vacancies during the 6 months to 15 February 2019.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
UK
6 months to
15 Feb 2019
Same period 2018 Same period 2017
Rank 263 365 427
Rank change year-on-year +102 +62 +308
Contract jobs requiring a Data Engineer 995 677 528
As % of all contract IT jobs advertised in the UK 1.00% 0.67% 0.55%
As % of the Job Titles category 1.06% 0.70% 0.58%
Number of daily rates quoted 728 526 346
UK median daily rate £538 £500 £543
Median daily rate % change year-on-year +7.50% -7.83% +3.33%
10th Percentile £413 £363 £380
90th Percentile £713 £650 £675
UK excluding London median daily rate £495 £463 £481
% change year-on-year +7.03% -3.90% +6.94%
Number of hourly rates quoted 15 6 38
UK median hourly rate £15.50 £26.75 £12.50
Median hourly rate % change year-on-year -42.06% +114.00% -61.54%
10th Percentile £15.00 £16.23 £12.00
90th Percentile £34.40 £59.69 £34.00
UK excluding London median hourly rate £15.50 £39.38 £12.50
% change year-on-year -60.63% +215.00% -50.00%

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
UK
Contract vacancies in the UK with a recognized job title 93,797 96,202 91,166
% of contract IT jobs with a recognized job title 94.63% 94.88% 94.86%
Number of daily rates quoted 62,076 63,816 59,505
UK median daily rate £460 £450 £425
Median daily rate % change year-on-year +2.22% +5.88% +3.03%
10th Percentile £275 £263 £251
90th Percentile £644 £625 £606
UK excluding London median daily rate £425 £400 £400
% change year-on-year +6.25% - +4.58%
Number of hourly rates quoted 2,933 2,871 3,250
UK median hourly rate £18.70 £18.70 £18.00
Median hourly rate % change year-on-year - +3.89% -5.23%
10th Percentile £11.00 £10.88 £10.62
90th Percentile £48.75 £48.50 £47.50
UK excluding London median hourly rate £17.50 £17.50 £17.50

Data Engineer
Job Vacancy Trend

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised.

Job vacancy trend for Data Engineer in the UK

Data Engineer
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Engineer.

Contractor daily rate trend for Data Engineer in the UK

Data Engineer
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Engineer over the 6 months to 15 February 2019.

Contractor daily rate histogram for Data Engineer in the UK

Data Engineer
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Engineer.

Contractor hourly rate trend for Data Engineer in the UK

Data Engineer
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Data Engineer over the 6 months to 15 February 2019.

Contractor hourly rate histogram for Data Engineer in the UK

Data Engineer
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the UK over the 6 months to 15 February 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +87 960 £550 +10.00% 313
London +80 686 £550 +4.76% 184
UK excluding London +41 296 £495 +7.03% 145
South East +27 105 £525 +5.00% 27
North of England +6 81 £475 +5.56% 31
Yorkshire -3 35 £473 +11.18% 10
North West -3 33 £500 +2.56% 20
Midlands +2 32 £450 - 15
South West -15 25 £425 +52.47% 30
Scotland +16 24 £425 -10.53% 13
East of England +25 21 £500 +2.56% 26
West Midlands -8 21 £438 -2.78% 13
North East -11 13 £475 +8.57% 1
East Midlands -2 11 £488 +8.33% 2
Wales -1 8 £450 +17.65% 2
Northern Ireland +22 1 - - 1

Data Engineer Skill Set
Top 30 Co-occurring IT Skills

For the 6 months to 15 February 2019, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads featuring Data Engineer in the job title.

1 538 (54.07%) Python
2 531 (53.37%) Big Data
3 450 (45.23%) Apache Spark
4 441 (44.32%) Hadoop
5 391 (39.30%) SQL
6 360 (36.18%) Amazon AWS
7 300 (30.15%) Kafka
8 285 (28.64%) Analytics
9 284 (28.54%) Apache Hive
10 247 (24.82%) Data Science
11 240 (24.12%) ETL
12 237 (23.82%) Agile Software Development
13 229 (23.02%) Java
13 229 (23.02%) Scala
14 215 (21.61%) Finance
15 214 (21.51%) Microsoft Azure
16 206 (20.70%) Data Warehouse
17 181 (18.19%) Data Modelling
18 178 (17.89%) Machine Learning
19 154 (15.48%) NoSQL
20 149 (14.97%) Data Engineering
21 136 (13.67%) Business Intelligence
22 134 (13.47%) Google Cloud Platform
23 132 (13.27%) Data Lake
24 127 (12.76%) Cloudera
25 117 (11.76%) DevOps
26 112 (11.26%) HBase
27 111 (11.16%) Apache
27 111 (11.16%) Google
28 105 (10.55%) Oracle

Data Engineer Skill Set
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 450 (45.23%) Apache Spark
2 111 (11.16%) Apache
3 79 (7.94%) Elasticsearch
4 44 (4.42%) Apache Airflow
5 39 (3.92%) SAS
6 23 (2.31%) Apache Pig
7 22 (2.21%) Apache Solr
8 19 (1.91%) Confluence
9 15 (1.51%) Jupyter
10 12 (1.21%) Apache Qpid
11 11 (1.11%) Luigi
12 7 (0.70%) nginx
13 3 (0.30%) SharePoint
14 2 (0.20%) Oracle Workflow
15 1 (0.10%) CMS
15 1 (0.10%) Oracle SOA Suite
Applications
1 23 (2.31%) Microsoft Excel
2 4 (0.40%) Microsoft PowerPoint
3 3 (0.30%) MS Visio
3 3 (0.30%) SPSS
4 2 (0.20%) Stata
5 1 (0.10%) Spreadsheet
Business Applications
1 15 (1.51%) SAP Oil and Gas
2 4 (0.40%) Markit EDM
3 3 (0.30%) SAP MM
3 3 (0.30%) SAP R/3
4 1 (0.10%) Distributed Ledger
4 1 (0.10%) Oracle BPM
4 1 (0.10%) PolarLake
4 1 (0.10%) SAP MDG
4 1 (0.10%) SAP MDM
Cloud Services
1 360 (36.18%) Amazon AWS
2 214 (21.51%) Microsoft Azure
3 134 (13.47%) Google Cloud Platform
4 88 (8.84%) Amazon EMR
5 85 (8.54%) Amazon S3
6 48 (4.82%) Serverless
7 47 (4.72%) Amazon Kinesis
7 47 (4.72%) Azure Data Factory
8 42 (4.22%) AWS Lambda
9 37 (3.72%) Amazon EC2
10 27 (2.71%) GitHub
11 14 (1.41%) Cloud Computing
12 12 (1.21%) Data Lake Analytics
13 10 (1.01%) IaaS
13 10 (1.01%) PaaS
14 9 (0.90%) Virtual Private Cloud
15 8 (0.80%) Amazon SQS
16 5 (0.50%) AWS CloudFormation
17 4 (0.40%) Cortana Intelligence Suite
17 4 (0.40%) Datadog
Communications & Networking
1 14 (1.41%) Kerberos
2 11 (1.11%) LAN
2 11 (1.11%) WAN
3 9 (0.90%) DNS
4 8 (0.80%) TCP/IP
5 7 (0.70%) Firewall
5 7 (0.70%) VPN
6 6 (0.60%) HTTP
6 6 (0.60%) Internet
7 5 (0.50%) Cisco ICM
7 5 (0.50%) Network Security
7 5 (0.50%) SIGTRAN
7 5 (0.50%) SS7
7 5 (0.50%) SSH
8 4 (0.40%) Cisco Nexus
8 4 (0.40%) DHCP
8 4 (0.40%) DSL
9 3 (0.30%) Wi-Fi
10 2 (0.20%) ICMP
10 2 (0.20%) PuTTY
Database & Business Intelligence
1 531 (53.37%) Big Data
2 441 (44.32%) Hadoop
3 284 (28.54%) Apache Hive
4 206 (20.70%) Data Warehouse
5 154 (15.48%) NoSQL
6 132 (13.27%) Data Lake
7 112 (11.26%) HBase
8 101 (10.15%) SQL Server
9 91 (9.15%) Apache Cassandra
10 90 (9.05%) Power BI
11 88 (8.84%) Amazon Redshift
12 85 (8.54%) Relational Database
13 75 (7.54%) MongoDB
14 71 (7.14%) Impala
15 63 (6.33%) PostgreSQL
16 59 (5.93%) SQL Server Integration Services
17 43 (4.32%) Sqoop
18 42 (4.22%) MySQL
19 41 (4.12%) OLAP
19 41 (4.12%) Star Schema
Development Applications
1 96 (9.65%) Jenkins
2 95 (9.55%) Git (software)
3 35 (3.52%) JIRA
4 23 (2.31%) Visual Studio
5 21 (2.11%) Visual Studio Team System
6 15 (1.51%) Maven
7 14 (1.41%) Sonatype Nexus
8 7 (0.70%) Gradle
8 7 (0.70%) Team Foundation Server
9 6 (0.60%) git-flow
9 6 (0.60%) Selenium
9 6 (0.60%) Subversion
10 5 (0.50%) Cucumber
10 5 (0.50%) Gerrit
10 5 (0.50%) JBehave
10 5 (0.50%) Octopus Deploy
10 5 (0.50%) TeamCity
11 4 (0.40%) Artifactory
11 4 (0.40%) Eclipse
11 4 (0.40%) Hudson
General
1 215 (21.61%) Finance
2 51 (5.13%) Retail
3 46 (4.62%) Banking
4 37 (3.72%) Legal
5 32 (3.22%) Marketing
6 26 (2.61%) Telecoms
7 16 (1.61%) Front Office
8 10 (1.01%) Publishing
9 7 (0.70%) Advertising
10 6 (0.60%) Back Office
11 4 (0.40%) Financial Institution
11 4 (0.40%) Investment Banking
12 3 (0.30%) Manufacturing
12 3 (0.30%) Pharmaceutical
13 1 (0.10%) Automotive
13 1 (0.10%) Corporate Banking
13 1 (0.10%) Dutch Language
13 1 (0.10%) Games
13 1 (0.10%) Retail Banking
Libraries, Frameworks & Software Standards
1 300 (30.15%) Kafka
2 65 (6.53%) PySpark
3 44 (4.42%) Spark Streaming
4 39 (3.92%) Web Services
5 33 (3.32%) Apache NiFi
5 33 (3.32%) Pandas
6 32 (3.22%) Elastic Stack
7 26 (2.61%) NumPy
8 24 (2.41%) XML
9 23 (2.31%) Apache Avro
10 18 (1.81%) Apache Camel
11 17 (1.71%) Akka
12 16 (1.61%) scikit-learn
13 14 (1.41%) JSON
14 13 (1.31%) .NET
14 13 (1.31%) Lambda Expressions
15 12 (1.21%) TensorFlow
15 12 (1.21%) XSLT
16 10 (1.01%) RESTful
16 10 (1.01%) Spring
Miscellaneous
1 96 (9.65%) Analytical Skills
2 66 (6.63%) Algorithms
3 39 (3.92%) Greenfield Project
4 34 (3.42%) Fintech
5 33 (3.32%) Data Structures
6 30 (3.02%) Self-Motivation
7 14 (1.41%) Data Centre
8 7 (0.70%) Public Cloud
9 5 (0.50%) HoloLens
9 5 (0.50%) Management Information System
9 5 (0.50%) Replication
10 4 (0.40%) Digital Media
10 4 (0.40%) Enterprise Software
10 4 (0.40%) PKI
10 4 (0.40%) Virtual Team
11 3 (0.30%) Cyber Defence
11 3 (0.30%) Fixed Income
11 3 (0.30%) Foreign Exchange (FX)
11 3 (0.30%) Mobile App
11 3 (0.30%) RIA
Operating Systems
1 86 (8.64%) Linux
2 55 (5.53%) Unix
3 21 (2.11%) Windows
4 8 (0.80%) Red Hat Enterprise Linux
5 3 (0.30%) Windows Server
6 2 (0.20%) Apple iOS
6 2 (0.20%) Windows Server 2012
7 1 (0.10%) CentOS
7 1 (0.10%) Solaris
Processes & Methodologies
1 285 (28.64%) Analytics
2 247 (24.82%) Data Science
3 240 (24.12%) ETL
4 237 (23.82%) Agile Software Development
5 181 (18.19%) Data Modelling
6 178 (17.89%) Machine Learning
7 149 (14.97%) Data Engineering
8 136 (13.67%) Business Intelligence
9 117 (11.76%) DevOps
10 78 (7.84%) Data Analytics
11 74 (7.44%) Continuous Integration
12 69 (6.93%) Software Engineering
12 69 (6.93%) Visualisation
13 65 (6.53%) Data Analysis
13 65 (6.53%) MapReduce
13 65 (6.53%) Open Source
14 59 (5.93%) Mentoring
15 58 (5.83%) TDD
16 52 (5.23%) Scrum
17 51 (5.13%) Artificial Intelligence
Programming Languages
1 538 (54.07%) Python
2 391 (39.30%) SQL
3 229 (23.02%) Java
3 229 (23.02%) Scala
4 61 (6.13%) R
5 45 (4.52%) Bash Shell
6 43 (4.32%) C#
7 42 (4.22%) T-SQL
8 32 (3.22%) C++
9 31 (3.12%) JavaScript
10 20 (2.01%) Data Analysis Expressions (DAX)
11 19 (1.91%) Ruby
12 17 (1.71%) PL/SQL
12 17 (1.71%) VBA
13 16 (1.61%) C
14 15 (1.51%) MATLAB
15 14 (1.41%) PowerShell
16 11 (1.11%) Groovy
16 11 (1.11%) Java 8
17 9 (0.90%) Perl
Qualifications
1 72 (7.24%) Security Cleared
2 65 (6.53%) SC Cleared
3 62 (6.23%) Degree
4 28 (2.81%) Master's Degree
5 24 (2.41%) Computer Science Degree
6 7 (0.70%) Cisco Certification
7 6 (0.60%) PhD
8 5 (0.50%) DV Cleared
8 5 (0.50%) ITIL Foundation Certificate
8 5 (0.50%) RHCE
9 4 (0.40%) BPSS Clearance
9 4 (0.40%) CCNA
9 4 (0.40%) CCNP
9 4 (0.40%) Microsoft Certification
10 3 (0.30%) CCENT
10 3 (0.30%) CISM
10 3 (0.30%) CISSP
10 3 (0.30%) MCSA
11 2 (0.20%) AWS Certification
11 2 (0.20%) OSCP
Quality Assurance & Compliance
1 71 (7.14%) Data Quality
2 32 (3.22%) QA
3 7 (0.70%) GDPR
4 6 (0.60%) SLA
5 3 (0.30%) ISO/IEC 27001
6 1 (0.10%) FINRA
System Software
1 90 (9.05%) Docker
2 65 (6.53%) Apache Flume
3 61 (6.13%) HDFS
4 26 (2.61%) Apache ZooKeeper
5 8 (0.80%) VMware Infrastructure
6 6 (0.60%) Virtual Machines
7 5 (0.50%) Oracle RAC
8 4 (0.40%) vCloud
9 3 (0.30%) Active Directory
10 2 (0.20%) Firmware
10 2 (0.20%) Tivoli Workload Scheduler
10 2 (0.20%) VMware ESXi
11 1 (0.10%) Cronacle
Systems Management
1 79 (7.94%) Oozie
2 63 (6.33%) Ansible
3 61 (6.13%) Hadoop YARN
4 58 (5.83%) Kubernetes
5 43 (4.32%) Terraform
6 27 (2.71%) Puppet
7 17 (1.71%) Kibana
7 17 (1.71%) logstash
8 15 (1.51%) Opscode Chef
9 11 (1.11%) Ambari
10 6 (0.60%) Nagios
10 6 (0.60%) ZABBIX
11 5 (0.50%) Cisco UCCE
12 4 (0.40%) Grafana
12 4 (0.40%) Salt
13 2 (0.20%) Consul
13 2 (0.20%) Host Intrusion Detection System
13 2 (0.20%) Network Intrusion Detection System
13 2 (0.20%) Prometheus
13 2 (0.20%) Sysdig
Vendors
1 127 (12.76%) Cloudera
2 111 (11.16%) Google
3 105 (10.55%) Oracle
4 91 (9.15%) Hortonworks
5 77 (7.74%) Talend
6 67 (6.73%) Microsoft
7 48 (4.82%) Tableau
8 40 (4.02%) Informatica
9 34 (3.42%) SAP
10 30 (3.02%) Databricks
11 22 (2.21%) Cisco
11 22 (2.21%) Splunk
12 19 (1.91%) Alteryx
13 12 (1.21%) MicroStrategy
14 10 (1.01%) IBM
15 9 (0.90%) MapR
16 8 (0.80%) Ab Initio
16 8 (0.80%) VMware
17 7 (0.70%) ATG
17 7 (0.70%) Teradata