Period
to 18 December 2017

The median contractor rate for a Data Engineer was £550 per day in advertised job vacancies in the City of London during the 6 months to 18 December 2017.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
Central London > City of London
6 months to
18 Dec 2017
Same period 2016 Same period 2015
Rank 199 183 242
Rank change year-on-year -16 +59 +52
Contract jobs requiring a Data Engineer 55 57 17
As % of all contract IT jobs advertised in the City of London 0.76% 0.88% 0.21%
As % of the Job Titles category 0.81% 0.92% 0.22%
Number of daily rates quoted 48 39 12
City of London median daily rate £550 £550 £525
Median daily rate % change year-on-year - +4.76% +20.00%
10th Percentile £367 £438 £321
90th Percentile £638 £655 £650
Central London median daily rate £525 £550 £500
% change year-on-year -4.55% +10.00% +11.11%
Number of hourly rates quoted 0 1 1
City of London median hourly rate - £13.00 £37.50
Median hourly rate % change year-on-year - -65.33% -
Central London median hourly rate - £13.00 £37.50
% change year-on-year - -65.33% -

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in the City of London. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
City of London
Contract vacancies in the City of London with a recognized job title 6798 6183 7864
% of contract IT jobs with a recognized job title 94.47% 95.27% 95.36%
Number of daily rates quoted 5396 4890 6202
City of London median daily rate £500 £475 £450
Median daily rate % change year-on-year +5.26% +5.56% +2.86%
10th Percentile £313 £313 £275
90th Percentile £688 £663 £650
Central London median daily rate £500 £475 £450
% change year-on-year +5.26% +5.56% +5.88%
Number of hourly rates quoted 93 69 108
City of London median hourly rate £17.00 £17.50 £18.25
Median hourly rate % change year-on-year -2.86% -4.11% +7.35%
10th Percentile £11.25 £12.50 £11.23
90th Percentile £30.75 £51.11 £36.13
Central London median hourly rate £18.10 £17.17 £18.00
% change year-on-year +5.45% -4.64% +9.09%

Data Engineer
Job Vacancy Trend in the City of London

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Data Engineer in the City of London

Data Engineer
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Engineer in the City of London.

Contractor daily rate trend for Data Engineer in the City of London

Data Engineer
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Data Engineer in the City of London over the 6 months to 18 December 2017.

Contractor daily rate histogram for Data Engineer in the City of London

Data Engineer
Contractor Hourly Rate Trend in the City of London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Engineer in the City of London.

Contractor hourly rate trend for Data Engineer in the City of London

Data Engineer
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the City of London region over the 6 months to 18 December 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Moorgate - 1 £575 -
Data Engineer
Central London

Data Engineer Skill Set
Top 30 Co-occurring IT Skills in the City of London

For the 6 months to 18 December 2017, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the City of London region featuring Data Engineer in the job title.

1 39 (70.91%) Python
2 36 (65.45%) Apache Spark
3 31 (56.36%) Big Data
4 27 (49.09%) SQL
5 25 (45.45%) Hadoop
6 21 (38.18%) Scala
7 20 (36.36%) ETL
8 19 (34.55%) Amazon AWS
9 16 (29.09%) Analytics
10 15 (27.27%) Agile Software Development
11 14 (25.45%) Kafka
12 13 (23.64%) Java
13 12 (21.82%) Data Warehouse
13 12 (21.82%) Apache Hive
14 11 (20.00%) Data Engineering
15 9 (16.36%) Business Intelligence
16 8 (14.55%) MongoDB
16 8 (14.55%) HBase
17 7 (12.73%) Jenkins
17 7 (12.73%) DevOps
17 7 (12.73%) NoSQL
17 7 (12.73%) R
17 7 (12.73%) Tableau
17 7 (12.73%) Microsoft Azure
17 7 (12.73%) Open Source
17 7 (12.73%) Software Engineering
18 6 (10.91%) Linux
18 6 (10.91%) Continuous Integration
18 6 (10.91%) HDFS
18 6 (10.91%) Impala

Data Engineer Skill Set
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 36 (65.45%) Apache Spark
2 4 (7.27%) Apache
2 4 (7.27%) nginx
3 3 (5.45%) Tomcat
4 2 (3.64%) Apache Pig
4 2 (3.64%) SAS
5 1 (1.82%) Apache Airflow
5 1 (1.82%) Apache Solr
5 1 (1.82%) Confluence
5 1 (1.82%) Jetty
5 1 (1.82%) MS Exchange
5 1 (1.82%) SharePoint
Business Applications
1 1 (1.82%) Dynamics CRM
1 1 (1.82%) RMDS
Cloud Services
1 19 (34.55%) Amazon AWS
2 7 (12.73%) Microsoft Azure
3 6 (10.91%) GitHub
4 4 (7.27%) Amazon S3
5 3 (5.45%) Amazon EMR
5 3 (5.45%) Google Cloud Platform
5 3 (5.45%) PaaS
6 2 (3.64%) Amazon Kinesis
6 2 (3.64%) AWS Data Pipeline
6 2 (3.64%) Cloud Computing
6 2 (3.64%) SaaS
7 1 (1.82%) Amazon EC2
7 1 (1.82%) AWS CloudTrail
7 1 (1.82%) AWS Lambda
7 1 (1.82%) Azure Active Directory
7 1 (1.82%) CloudFront
7 1 (1.82%) Office 365
7 1 (1.82%) Route 53
7 1 (1.82%) Serverless
7 1 (1.82%) Virtual Private Cloud
Communications & Networking
1 3 (5.45%) Kerberos
1 3 (5.45%) LDAP
2 1 (1.82%) 802.11
2 1 (1.82%) Cisco ISE
2 1 (1.82%) Cisco Wireless
2 1 (1.82%) FTP
2 1 (1.82%) LAN
2 1 (1.82%) SAN
2 1 (1.82%) Wi-Fi
2 1 (1.82%) Wireless
2 1 (1.82%) WLAN
Database & Business Intelligence
1 31 (56.36%) Big Data
2 25 (45.45%) Hadoop
3 12 (21.82%) Apache Hive
3 12 (21.82%) Data Warehouse
4 8 (14.55%) HBase
4 8 (14.55%) MongoDB
5 7 (12.73%) NoSQL
6 6 (10.91%) Impala
7 5 (9.09%) Apache Cassandra
8 4 (7.27%) Amazon Redshift
8 4 (7.27%) BigQuery
8 4 (7.27%) Data Lake
9 3 (5.45%) Amazon RDS
9 3 (5.45%) HDInsight
9 3 (5.45%) MySQL
9 3 (5.45%) Power BI
9 3 (5.45%) Relational Database
10 2 (3.64%) Bigtable
10 2 (3.64%) Pentaho
10 2 (3.64%) Sqoop
Development Applications
1 7 (12.73%) Jenkins
2 3 (5.45%) Git (software)
2 3 (5.45%) Subversion
3 2 (3.64%) Talend Open Studio
4 1 (1.82%) Babel
4 1 (1.82%) Bower
4 1 (1.82%) GoCD
4 1 (1.82%) Gradle
4 1 (1.82%) Grunt
4 1 (1.82%) Travis CI
4 1 (1.82%) Visual Studio
4 1 (1.82%) Visual Studio Team System
General
1 2 (3.64%) Banking
1 2 (3.64%) Finance
1 2 (3.64%) Investment Banking
1 2 (3.64%) Marketing
2 1 (1.82%) Pharmaceutical
2 1 (1.82%) Publishing
Libraries, Frameworks & Software Standards
1 14 (25.45%) Kafka
2 4 (7.27%) JSON
2 4 (7.27%) PySpark
3 3 (5.45%) Sensu
3 3 (5.45%) XML
4 2 (3.64%) Akka
4 2 (3.64%) Node.js
4 2 (3.64%) XSD
5 1 (1.82%) .NET
5 1 (1.82%) CNTK
5 1 (1.82%) Dropwizard
5 1 (1.82%) HTML
5 1 (1.82%) HTML5
5 1 (1.82%) LEMP Stack
5 1 (1.82%) MXNet
5 1 (1.82%) Pandas
5 1 (1.82%) RabbitMQ
5 1 (1.82%) Sass
5 1 (1.82%) Spring
5 1 (1.82%) Theano
Miscellaneous
1 5 (9.09%) Analytical Skills
1 5 (9.09%) Computer Science
2 2 (3.64%) Algorithms
3 1 (1.82%) Data Centre
3 1 (1.82%) Foreign Exchange (FX)
3 1 (1.82%) Greenfield Project
3 1 (1.82%) Grid Computing
3 1 (1.82%) Smart Home
3 1 (1.82%) Wiki
Operating Systems
1 6 (10.91%) Linux
2 4 (7.27%) Red Hat Enterprise Linux
2 4 (7.27%) Unix
3 2 (3.64%) Windows
4 1 (1.82%) Windows Server
4 1 (1.82%) Windows Server 2008
Processes & Methodologies
1 20 (36.36%) ETL
2 16 (29.09%) Analytics
3 15 (27.27%) Agile Software Development
4 11 (20.00%) Data Engineering
5 9 (16.36%) Business Intelligence
6 7 (12.73%) DevOps
6 7 (12.73%) Open Source
6 7 (12.73%) Software Engineering
7 6 (10.91%) Continuous Integration
7 6 (10.91%) Machine Learning
8 5 (9.09%) CRM
9 4 (7.27%) TDD
9 4 (7.27%) Validation
10 3 (5.45%) Data Migration
10 3 (5.45%) Data Modelling
10 3 (5.45%) MapReduce
10 3 (5.45%) Migration
10 3 (5.45%) Parallel Processing
10 3 (5.45%) Refactoring
10 3 (5.45%) Stakeholder Management
Programming Languages
1 39 (70.91%) Python
2 27 (49.09%) SQL
3 21 (38.18%) Scala
4 13 (23.64%) Java
5 7 (12.73%) R
6 3 (5.45%) Shell Script
7 2 (3.64%) Bash Shell
8 1 (1.82%) JavaScript
8 1 (1.82%) MATLAB
8 1 (1.82%) Perl
8 1 (1.82%) PowerShell
Qualifications
1 5 (9.09%) Degree
2 3 (5.45%) Computer Science Degree
3 1 (1.82%) CCNA
3 1 (1.82%) Cisco Certification
3 1 (1.82%) CWNA
3 1 (1.82%) Numerate Degree
3 1 (1.82%) Security Cleared
Quality Assurance & Compliance
1 4 (7.27%) QA
2 2 (3.64%) Data Quality
System Software
1 6 (10.91%) HDFS
2 5 (9.09%) Apache Flume
2 5 (9.09%) Docker
3 1 (1.82%) Virtual Machines
Systems Management
1 6 (10.91%) Ansible
1 6 (10.91%) Oozie
2 3 (5.45%) Salt
3 2 (3.64%) Mesos
3 2 (3.64%) Rundeck
3 2 (3.64%) Terraform
4 1 (1.82%) Cisco Prime
4 1 (1.82%) Kubernetes
4 1 (1.82%) Simpana
Vendors
1 7 (12.73%) Tableau
2 5 (9.09%) Cloudera
3 4 (7.27%) Salesforce.com
4 3 (5.45%) Google
4 3 (5.45%) SaltStack
5 2 (3.64%) Cisco
5 2 (3.64%) Microsoft
5 2 (3.64%) Omniture
5 2 (3.64%) Talend
5 2 (3.64%) Vertica
6 1 (1.82%) CommVault
6 1 (1.82%) EMC
6 1 (1.82%) Facebook
6 1 (1.82%) Hortonworks
6 1 (1.82%) Informatica
6 1 (1.82%) MicroStrategy
6 1 (1.82%) NetApp
6 1 (1.82%) Netezza
6 1 (1.82%) Oracle
6 1 (1.82%) Sybase