Period
to 17 December 2017

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Data Engineering skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Engineering over the 6 months to 17 December 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineering
Central London > City of London
6 months to
17 Dec 2017
Same period 2016 Same period 2015
Rank 212 229 -
Rank change year-on-year +17 - +301
Contract jobs citing Data Engineering 38 9 0
As % of all contract IT jobs advertised in the City of London 0.53% 0.14% -
As % of the Processes & Methodologies category 0.60% 0.16% -
Number of daily rates quoted 38 7 0
City of London median daily rate £550 £593 -
Median daily rate % change year-on-year -7.17% - -
Central London median daily rate £550 £575 -
% change year-on-year -4.35% - -
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for process or methodology skills.

All Process and Methodology Skills
City of London
Contract vacancies with a requirement for process or methodology skills 6318 5694 7036
As % of all contract IT jobs advertised in the City of London 88.41% 87.73% 84.85%
Number of daily rates quoted 5043 4513 5612
City of London median daily rate £513 £475 £475
Median daily rate % change year-on-year +7.89% - +5.56%
10th Percentile £325 £319 £288
90th Percentile £688 £675 £650
Central London median daily rate £500 £475 £463
% change year-on-year +5.26% +2.70% +2.78%
Number of hourly rates quoted 61 53 65
City of London median hourly rate £18.70 £20.00 £21.00
Median hourly rate % change year-on-year -6.50% -4.76% +10.53%
10th Percentile £13.30 £13.75 £12.35
90th Percentile £31.00 £55.00 £43.90
Central London median hourly rate £20.00 £19.00 £20.75
% change year-on-year +5.26% -8.43% +16.52%

Data Engineering
Job Vacancy Trend in the City of London

Job postings citing Data Engineering as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Data Engineering in the City of London

Data Engineering
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Engineering in the City of London.

Contractor daily rate trend for Data Engineering in the City of London

Data Engineering
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Data Engineering in the City of London over the 6 months to 17 December 2017.

Contractor daily rate histogram for Data Engineering in the City of London

Data Engineering
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineering within the City of London region over the 6 months to 17 December 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Moorgate - 1 £575 -
Data Engineering
Central London

For the 6 months to 17 December 2017, IT contractor jobs citing Data Engineering also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads across the City of London region with a requirement for Data Engineering.

1 37 (97.37%) Python
2 34 (89.47%) Apache Spark
3 33 (86.84%) Big Data
4 29 (76.32%) Hadoop
4 29 (76.32%) Open Source
5 28 (73.68%) Kafka
6 27 (71.05%) Java
7 26 (68.42%) Apache Hive
8 25 (65.79%) Apache Flume
8 25 (65.79%) Oozie
8 25 (65.79%) Oracle
8 25 (65.79%) HDFS
8 25 (65.79%) PySpark
9 24 (63.16%) DevOps
9 24 (63.16%) PostgreSQL
9 24 (63.16%) Ambari
10 17 (44.74%) SQL
11 14 (36.84%) IBM
11 14 (36.84%) Oracle ODI
11 14 (36.84%) Sqoop
11 14 (36.84%) Jenkins
11 14 (36.84%) GitHub
11 14 (36.84%) Amazon AWS
11 14 (36.84%) MapReduce
11 14 (36.84%) Tableau
11 14 (36.84%) Hadoop YARN
11 14 (36.84%) Docker
11 14 (36.84%) Kubernetes
11 14 (36.84%) Bluemix
11 14 (36.84%) IBM Cloud

Data Engineering
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 34 (89.47%) Apache Spark
2 2 (5.26%) Apache
3 1 (2.63%) Apache Solr
3 1 (2.63%) Confluence
Cloud Services
1 14 (36.84%) Amazon AWS
1 14 (36.84%) Bluemix
1 14 (36.84%) GitHub
1 14 (36.84%) IBM Cloud
Communications & Networking
1 1 (2.63%) FTP
Database & Business Intelligence
1 33 (86.84%) Big Data
2 29 (76.32%) Hadoop
3 26 (68.42%) Apache Hive
4 24 (63.16%) PostgreSQL
5 14 (36.84%) Oracle ODI
5 14 (36.84%) Sqoop
6 13 (34.21%) Data Warehouse
7 11 (28.95%) Relational Database
8 10 (26.32%) Oracle Database
8 10 (26.32%) RDBMS
9 4 (10.53%) HBase
10 3 (7.89%) NoSQL
11 2 (5.26%) BigQuery
11 2 (5.26%) Bigtable
11 2 (5.26%) Impala
12 1 (2.63%) Apache Cassandra
12 1 (2.63%) Data Lake
12 1 (2.63%) DB2
Development Applications
1 14 (36.84%) Jenkins
2 2 (5.26%) Git (software)
General
1 1 (2.63%) Marketing
Job Titles
1 11 (28.95%) Data Engineer
2 7 (18.42%) Big Data Engineer
3 2 (5.26%) Hadoop Engineer
3 2 (5.26%) Java Engineer
4 1 (2.63%) Data Manager
4 1 (2.63%) Developer
4 1 (2.63%) Engineering Manager
4 1 (2.63%) iOS Developer
4 1 (2.63%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 28 (73.68%) Kafka
2 25 (65.79%) PySpark
3 1 (2.63%) iOS SDK
3 1 (2.63%) JSON
3 1 (2.63%) Node.js
3 1 (2.63%) RxSwift
3 1 (2.63%) XML
Miscellaneous
1 1 (2.63%) Analytical Skills
1 1 (2.63%) Data Centre
1 1 (2.63%) Wiki
Operating Systems
1 1 (2.63%) Apple iOS
1 1 (2.63%) Linux
1 1 (2.63%) Unix
Processes & Methodologies
1 29 (76.32%) Open Source
2 24 (63.16%) DevOps
3 14 (36.84%) MapReduce
4 12 (31.58%) Business Intelligence
5 9 (23.68%) Analytics
6 4 (10.53%) ETL
7 2 (5.26%) Big Data Analytics
7 2 (5.26%) Data Analytics
7 2 (5.26%) Machine Learning
7 2 (5.26%) Parallel Processing
7 2 (5.26%) Software Engineering
7 2 (5.26%) Virtual Environments
8 1 (2.63%) BDD
8 1 (2.63%) ETL Development
8 1 (2.63%) iOS Development
8 1 (2.63%) Logistic Regression
8 1 (2.63%) Online Marketing
8 1 (2.63%) Technical Analysis
8 1 (2.63%) Unit Testing
8 1 (2.63%) Use Case
Programming Languages
1 37 (97.37%) Python
2 27 (71.05%) Java
3 17 (44.74%) SQL
4 11 (28.95%) Shell Script
5 10 (26.32%) PL/SQL
6 7 (18.42%) Scala
7 1 (2.63%) Apple Swift
7 1 (2.63%) MATLAB
7 1 (2.63%) R
System Software
1 25 (65.79%) Apache Flume
1 25 (65.79%) HDFS
2 14 (36.84%) Docker
Systems Management
1 25 (65.79%) Oozie
2 24 (63.16%) Ambari
3 14 (36.84%) Hadoop YARN
3 14 (36.84%) Kubernetes
Vendors
1 25 (65.79%) Oracle
2 14 (36.84%) IBM
2 14 (36.84%) Tableau
3 1 (2.63%) Facebook
3 1 (2.63%) Google
3 1 (2.63%) Hortonworks
3 1 (2.63%) Netezza
3 1 (2.63%) Sybase