Period
to 27 May 2020

The median contractor rate for a Data Engineer was £506 per day in advertised job vacancies in the City of London during the 6 months to 27 May 2020.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
Central London > City of London
6 months to
27 May 2020
Same period 2019 Same period 2018
Rank 81 72 155
Rank change year-on-year -9 +83 +32
Contract jobs requiring a Data Engineer 75 208 91
As % of all contract jobs advertised in the City of London 2.41% 3.24% 1.31%
As % of the Job Titles category 2.57% 3.46% 1.39%
Number of daily rates quoted 62 176 84
Median daily rate £506 £550 £550
Median daily rate % change year-on-year -7.95% - +10.00%
10th Percentile £401 £465 £463
90th Percentile £637 £625 £675
Central London median daily rate £513 £550 £550
% change year-on-year -6.82% - +10.00%
Number of hourly rates quoted 0 1 0
Median hourly rate - £19.50 -
Central London median hourly rate - £19.50 -

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in the City of London. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
City of London
Contract vacancies in the City of London with a recognized job title 2,914 6,006 6,560
% of contract IT jobs with a recognized job title 93.67% 93.68% 94.77%
Number of daily rates quoted 2,100 4,611 5,158
Median daily rate £500 £523 £500
Median daily rate % change year-on-year -4.31% +4.50% +5.26%
10th Percentile £300 £313 £313
90th Percentile £675 £675 £688
Central London median daily rate £500 £513 £500
% change year-on-year -2.44% +2.50% +5.26%
Number of hourly rates quoted 65 67 113
Median hourly rate £32.25 £21.00 £18.70
Median hourly rate % change year-on-year +53.57% +12.30% +8.59%
10th Percentile £12.50 £11.25 £11.81
90th Percentile £52.25 £56.50 £34.95
Median hourly rate £33.01 £20.65 £19.00
% change year-on-year +59.91% +8.66% +12.33%

Data Engineer
Job Vacancy Trend in the City of London

Job postings that featured Data Engineer in the job title as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Data Engineer in the City of London

Data Engineer
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing Data Engineer in the City of London.

Daily rate trend for Data Engineer in the City of London

Data Engineer
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing Data Engineer in the City of London over the 6 months to 27 May 2020.

Daily rate histogram for Data Engineer in the City of London

Data Engineer
Contractor Hourly Rate Trend in the City of London

3-month moving average hourly rates quoted in jobs citing Data Engineer in the City of London.

Hourly rate trend for Data Engineer in the City of London

Data Engineer
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the City of London region over the 6 months to 27 May 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge +2 1 £450 -18.18%
Data Engineer
Central London

Data Engineer Skill Set
Top 30 Co-occurring IT Skills in the City of London

For the 6 months to 27 May 2020, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region featuring Data Engineer in the job title.

1 49 (65.33%) Python
2 27 (36.00%) SQL
3 25 (33.33%) Big Data
4 23 (30.67%) AWS
5 20 (26.67%) Data Modelling
5 20 (26.67%) ETL
6 19 (25.33%) GCP
7 18 (24.00%) Machine Learning
7 18 (24.00%) Azure
8 17 (22.67%) Analytics
9 16 (21.33%) Apache Spark
10 15 (20.00%) DevOps
11 14 (18.67%) Data Engineering
12 13 (17.33%) Scala
12 13 (17.33%) Finance
13 12 (16.00%) Kafka
13 12 (16.00%) Kubernetes
13 12 (16.00%) Data Lake
13 12 (16.00%) Data Science
14 10 (13.33%) Hadoop
15 9 (12.00%) Google
15 9 (12.00%) NoSQL
15 9 (12.00%) Data Analysis
15 9 (12.00%) Java
15 9 (12.00%) Azure Data Factory
16 8 (10.67%) Artificial Intelligence
17 7 (9.33%) Agile Software Development
17 7 (9.33%) Business Intelligence
17 7 (9.33%) Apache Hive
17 7 (9.33%) PySpark

Data Engineer Skill Set
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 16 (21.33%) Apache Spark
2 5 (6.67%) Apache
2 5 (6.67%) Apache Airflow
3 3 (4.00%) Elasticsearch
4 2 (2.67%) Confluence
4 2 (2.67%) Tornado
5 1 (1.33%) Apache Pig
5 1 (1.33%) Apache Pulsar
5 1 (1.33%) BizTalk Server
5 1 (1.33%) Oracle Workflow
Applications
1 2 (2.67%) Microsoft Excel
Business Applications
1 3 (4.00%) Magento
1 3 (4.00%) Shopify
2 1 (1.33%) Refinitiv Enterprise Platform
Cloud Services
1 23 (30.67%) AWS
2 19 (25.33%) GCP
3 18 (24.00%) Azure
4 9 (12.00%) Azure Data Factory
5 5 (6.67%) Amazon S3
6 4 (5.33%) Azure Machine Learning
6 4 (5.33%) Azure Stack
7 3 (4.00%) AWS Lambda
7 3 (4.00%) SaaS
7 3 (4.00%) Serverless
8 2 (2.67%) Amazon Kinesis
9 1 (1.33%) Amazon EC2
9 1 (1.33%) Amazon SQS
9 1 (1.33%) AWS CloudFormation
9 1 (1.33%) Power Platform
Communications & Networking
1 1 (1.33%) Internet
1 1 (1.33%) WebEx
Database & Business Intelligence
1 25 (33.33%) Big Data
2 12 (16.00%) Data Lake
3 10 (13.33%) Hadoop
4 9 (12.00%) NoSQL
5 7 (9.33%) Apache Hive
6 6 (8.00%) Amazon Athena
6 6 (8.00%) Data Warehouse
7 4 (5.33%) Amazon DynamoDB
7 4 (5.33%) BigQuery
7 4 (5.33%) HBase
7 4 (5.33%) Impala
8 3 (4.00%) Amazon Redshift
8 3 (4.00%) Apache Cassandra
8 3 (4.00%) Azure SQL Database
8 3 (4.00%) SQL Server
9 2 (2.67%) Amazon RDS
9 2 (2.67%) Relational Database
9 2 (2.67%) Snowflake Schema
9 2 (2.67%) Sqoop
10 1 (1.33%) MemSQL
Development Applications
1 4 (5.33%) Jenkins
2 2 (2.67%) Git (software)
2 2 (2.67%) GitLab
2 2 (2.67%) Hudson
2 2 (2.67%) JIRA
2 2 (2.67%) ProC
3 1 (1.33%) JUnit
3 1 (1.33%) Maven
3 1 (1.33%) Sonatype Nexus
General
1 13 (17.33%) Finance
2 3 (4.00%) Banking
2 3 (4.00%) Billing
2 3 (4.00%) Investment Banking
2 3 (4.00%) Telecoms
3 2 (2.67%) Advertising
3 2 (2.67%) Retail
4 1 (1.33%) Law
4 1 (1.33%) Pharmaceutical
Libraries, Frameworks & Software Standards
1 12 (16.00%) Kafka
2 7 (9.33%) PySpark
3 4 (5.33%) TensorFlow
4 3 (4.00%) Apache Beam
4 3 (4.00%) Elastic Stack
4 3 (4.00%) H2O
4 3 (4.00%) REST
4 3 (4.00%) scikit-learn
4 3 (4.00%) Spark Streaming
5 2 (2.67%) Akka
5 2 (2.67%) Anaconda
5 2 (2.67%) CSS
5 2 (2.67%) CSS3
5 2 (2.67%) Flask
5 2 (2.67%) HTML
5 2 (2.67%) HTML5
5 2 (2.67%) JSON
5 2 (2.67%) RESTful
5 2 (2.67%) Twisted
5 2 (2.67%) Web Services
Miscellaneous
1 4 (5.33%) Algorithms
2 3 (4.00%) Analytical Skills
2 3 (4.00%) Self-Motivation
3 2 (2.67%) Credit Risk
3 2 (2.67%) Data Structures
3 2 (2.67%) Greenfield Project
3 2 (2.67%) Life Science
3 2 (2.67%) Public Cloud
3 2 (2.67%) Reinsurance
3 2 (2.67%) Semantic Web
3 2 (2.67%) User Experience
4 1 (1.33%) Equities
4 1 (1.33%) Internet of Things
4 1 (1.33%) Mobile App
Operating Systems
1 5 (6.67%) Linux
2 1 (1.33%) Debian
2 1 (1.33%) Solaris
Processes & Methodologies
1 20 (26.67%) Data Modelling
1 20 (26.67%) ETL
2 18 (24.00%) Machine Learning
3 17 (22.67%) Analytics
4 15 (20.00%) DevOps
5 14 (18.67%) Data Engineering
6 12 (16.00%) Data Science
7 9 (12.00%) Data Analysis
8 8 (10.67%) Artificial Intelligence
9 7 (9.33%) Agile Software Development
9 7 (9.33%) Business Intelligence
9 7 (9.33%) Data Transformation
10 6 (8.00%) Continuous Integration
10 6 (8.00%) Data Integration
11 5 (6.67%) Data Architecture
11 5 (6.67%) Migration
11 5 (6.67%) Software Engineering
11 5 (6.67%) Statistics
11 5 (6.67%) Validation
12 4 (5.33%) E-Commerce
Programming Languages
1 49 (65.33%) Python
2 27 (36.00%) SQL
3 13 (17.33%) Scala
4 9 (12.00%) Java
5 4 (5.33%) C#
6 3 (4.00%) R
6 3 (4.00%) SOQL
7 2 (2.67%) JavaScript
8 1 (1.33%) Groovy
Qualifications
1 3 (4.00%) SC Cleared
1 3 (4.00%) Security Cleared
Quality Assurance & Compliance
1 5 (6.67%) GDPR
2 1 (1.33%) QA
System Software
1 7 (9.33%) Docker
2 4 (5.33%) HDFS
3 1 (1.33%) Apache Flume
3 1 (1.33%) Virtual Machines
Systems Management
1 12 (16.00%) Kubernetes
2 5 (6.67%) Hadoop YARN
3 4 (5.33%) Kubeflow
4 3 (4.00%) Kibana
5 2 (2.67%) Ansible
5 2 (2.67%) Grafana
5 2 (2.67%) Oozie
5 2 (2.67%) Prometheus
5 2 (2.67%) Terraform
Vendors
1 9 (12.00%) Google
2 6 (8.00%) Microsoft
3 3 (4.00%) Cloudera
3 3 (4.00%) Databricks
3 3 (4.00%) Demandware
3 3 (4.00%) Zuora
4 2 (2.67%) Hortonworks
4 2 (2.67%) Oracle
5 1 (1.33%) Alteryx
5 1 (1.33%) BMC
5 1 (1.33%) MapR
5 1 (1.33%) Refinitiv
5 1 (1.33%) Salesforce.com
5 1 (1.33%) SAP
5 1 (1.33%) Snowplow
5 1 (1.33%) Sybase
5 1 (1.33%) Tableau
5 1 (1.33%) Talend