Period
to 22 February 2020

The median contractor rate for a Data Engineer was £525 per day in advertised job vacancies in the City of London during the 6 months to 22 February 2020.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
Central London > City of London
6 months to
22 Feb 2020
Same period 2019 Same period 2018
Rank 96 116 169
Rank change year-on-year +20 +53 +2
Contract jobs requiring a Data Engineer 94 149 80
As % of all contract IT jobs advertised in the City of London 2.01% 2.19% 1.13%
As % of the Job Titles category 2.16% 2.31% 1.19%
Number of daily rates quoted 67 124 75
City of London median daily rate £525 £550 £550
Median daily rate % change year-on-year -4.55% - -
10th Percentile £406 £463 £425
90th Percentile £632 £688 £638
Central London median daily rate £525 £550 £550
% change year-on-year -4.55% - -
Number of hourly rates quoted 0 0 0
City of London median hourly rate - - -
Central London median hourly rate - - -

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in the City of London. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
City of London
Contract vacancies in the City of London with a recognized job title 4,350 6,455 6,705
% of contract IT jobs with a recognized job title 93.13% 94.75% 94.38%
Number of daily rates quoted 3,315 5,047 5,323
City of London median daily rate £500 £500 £500
10th Percentile £297 £305 £313
90th Percentile £675 £675 £688
Central London median daily rate £500 £500 £500
Number of hourly rates quoted 76 72 98
City of London median hourly rate £21.00 £18.70 £16.75
Median hourly rate % change year-on-year +12.30% +11.64% -10.43%
10th Percentile £12.50 £12.30 £11.25
90th Percentile £44.28 £35.00 £34.45
Central London median hourly rate £21.95 £18.70 £18.10
% change year-on-year +17.35% +3.31% +2.30%

Data Engineer
Job Vacancy Trend in the City of London

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised in the City of London.

Job vacancy trend for Data Engineer in the City of London

Data Engineer
Contractor Daily Rate Trend in the City of London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Engineer in the City of London.

Contractor daily rate trend for Data Engineer in the City of London

Data Engineer
Contractor Daily Rate Histogram in the City of London

The daily rate distribution of IT jobs citing Data Engineer in the City of London over the 6 months to 22 February 2020.

Contractor daily rate histogram for Data Engineer in the City of London

Data Engineer
Contractor Hourly Rate Trend in the City of London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Engineer in the City of London.

Contractor hourly rate trend for Data Engineer in the City of London

Data Engineer
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the City of London region over the 6 months to 22 February 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London Bridge +2 1 £450 -18.18%
Data Engineer
Central London

Data Engineer Skill Set
Top 30 Co-occurring IT Skills in the City of London

For the 6 months to 22 February 2020, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region featuring Data Engineer in the job title.

1 66 (70.21%) Python
2 40 (42.55%) SQL
3 33 (35.11%) AWS
3 33 (35.11%) Big Data
4 31 (32.98%) ETL
5 28 (29.79%) Apache Spark
6 26 (27.66%) Analytics
7 25 (26.60%) GCP
7 25 (26.60%) Hadoop
8 24 (25.53%) DevOps
9 23 (24.47%) Azure
10 22 (23.40%) Data Engineering
10 22 (23.40%) Data Science
11 20 (21.28%) Machine Learning
12 18 (19.15%) Scala
12 18 (19.15%) Data Modelling
12 18 (19.15%) Java
12 18 (19.15%) Agile Software Development
12 18 (19.15%) Kafka
13 15 (15.96%) Data Lake
14 13 (13.83%) NoSQL
15 12 (12.77%) Apache Hive
15 12 (12.77%) Apache Airflow
15 12 (12.77%) Azure Data Factory
16 11 (11.70%) Data Transformation
16 11 (11.70%) Google
16 11 (11.70%) Artificial Intelligence
16 11 (11.70%) Data Warehouse
16 11 (11.70%) Business Intelligence
17 10 (10.64%) Jenkins

Data Engineer Skill Set
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 28 (29.79%) Apache Spark
2 12 (12.77%) Apache Airflow
3 5 (5.32%) Apache
4 3 (3.19%) Jupyter
4 3 (3.19%) Luigi
5 1 (1.06%) Apache Pig
5 1 (1.06%) Elasticsearch
5 1 (1.06%) Oracle Workflow
Applications
1 4 (4.26%) Microsoft Excel
Cloud Services
1 33 (35.11%) AWS
2 25 (26.60%) GCP
3 23 (24.47%) Azure
4 12 (12.77%) Azure Data Factory
5 6 (6.38%) Amazon S3
5 6 (6.38%) Azure Stack
5 6 (6.38%) Power Platform
6 4 (4.26%) Amazon Kinesis
6 4 (4.26%) AWS Lambda
6 4 (4.26%) Azure Machine Learning
6 4 (4.26%) Serverless
7 3 (3.19%) Amazon EC2
7 3 (3.19%) Amazon EMR
7 3 (3.19%) AWS CloudFormation
8 2 (2.13%) Cloud Computing
9 1 (1.06%) Amazon SQS
9 1 (1.06%) Virtual Private Cloud
Communications & Networking
1 1 (1.06%) Internet
Database & Business Intelligence
1 33 (35.11%) Big Data
2 25 (26.60%) Hadoop
3 15 (15.96%) Data Lake
4 13 (13.83%) NoSQL
5 12 (12.77%) Apache Hive
6 11 (11.70%) Data Warehouse
7 7 (7.45%) HBase
8 6 (6.38%) Apache Cassandra
8 6 (6.38%) Azure SQL Database
8 6 (6.38%) Impala
8 6 (6.38%) PostgreSQL
8 6 (6.38%) Power BI
8 6 (6.38%) SQL Server
9 5 (5.32%) Amazon Athena
9 5 (5.32%) BigQuery
10 4 (4.26%) Amazon Redshift
11 3 (3.19%) Amazon RDS
11 3 (3.19%) Azkaban
11 3 (3.19%) Azure SQL Data Warehouse
11 3 (3.19%) Sqoop
Development Applications
1 10 (10.64%) Jenkins
2 5 (5.32%) Git (software)
3 3 (3.19%) Maven
3 3 (3.19%) Visual Studio Team System
4 1 (1.06%) GitLab
4 1 (1.06%) GoCD
4 1 (1.06%) Visual Studio
General
1 9 (9.57%) Finance
2 5 (5.32%) Marketing
3 2 (2.13%) Banking
3 2 (2.13%) Retail
3 2 (2.13%) Telecoms
4 1 (1.06%) Advertising
4 1 (1.06%) Billing
4 1 (1.06%) Games
4 1 (1.06%) Investment Banking
4 1 (1.06%) Law
Libraries, Frameworks & Software Standards
1 18 (19.15%) Kafka
2 8 (8.51%) Spark Streaming
3 4 (4.26%) PySpark
3 4 (4.26%) REST
4 3 (3.19%) RESTful
5 2 (2.13%) .NET
5 2 (2.13%) Akka
5 2 (2.13%) Apache Beam
5 2 (2.13%) JSON
5 2 (2.13%) Spring
5 2 (2.13%) TensorFlow
6 1 (1.06%) Apache NiFi
6 1 (1.06%) Elastic Stack
6 1 (1.06%) Pandas
6 1 (1.06%) RabbitMQ
6 1 (1.06%) scikit-learn
6 1 (1.06%) Web Services
Miscellaneous
1 9 (9.57%) Data Structures
2 7 (7.45%) Algorithms
3 5 (5.32%) Analytical Skills
3 5 (5.32%) Greenfield Project
4 4 (4.26%) Public Cloud
5 3 (3.19%) Equities
5 3 (3.19%) Self-Motivation
5 3 (3.19%) User Experience
6 2 (2.13%) Life Science
6 2 (2.13%) Reinsurance
6 2 (2.13%) Semantic Web
7 1 (1.06%) Internet of Things
7 1 (1.06%) Mobile App
7 1 (1.06%) Social Media
Operating Systems
1 3 (3.19%) Linux
2 2 (2.13%) Unix
Processes & Methodologies
1 31 (32.98%) ETL
2 26 (27.66%) Analytics
3 24 (25.53%) DevOps
4 22 (23.40%) Data Engineering
4 22 (23.40%) Data Science
5 20 (21.28%) Machine Learning
6 18 (19.15%) Agile Software Development
6 18 (19.15%) Data Modelling
7 11 (11.70%) Artificial Intelligence
7 11 (11.70%) Business Intelligence
7 11 (11.70%) Data Transformation
8 9 (9.57%) Visualisation
9 8 (8.51%) Continuous Integration
10 7 (7.45%) Data Analysis
10 7 (7.45%) TDD
11 6 (6.38%) Data Integration
11 6 (6.38%) Data Visualisation
11 6 (6.38%) Migration
11 6 (6.38%) Validation
12 5 (5.32%) OO
Programming Languages
1 66 (70.21%) Python
2 40 (42.55%) SQL
3 18 (19.15%) Java
3 18 (19.15%) Scala
4 5 (5.32%) C#
4 5 (5.32%) C++
5 4 (4.26%) R
6 3 (3.19%) AWK
6 3 (3.19%) sed
7 2 (2.13%) Bash Shell
8 1 (1.06%) Go
8 1 (1.06%) HiveQL
8 1 (1.06%) Java 8
8 1 (1.06%) PL/SQL
Qualifications
1 1 (1.06%) Degree
1 1 (1.06%) SC Cleared
1 1 (1.06%) Security Cleared
Quality Assurance & Compliance
1 4 (4.26%) GDPR
2 3 (3.19%) QA
System Software
1 7 (7.45%) Docker
2 5 (5.32%) HDFS
3 3 (3.19%) Active Directory
4 1 (1.06%) Apache Flume
4 1 (1.06%) Virtual Machines
Systems Management
1 10 (10.64%) Kubernetes
2 7 (7.45%) Hadoop YARN
3 3 (3.19%) Kubeflow
3 3 (3.19%) Oozie
4 1 (1.06%) Kibana
4 1 (1.06%) Terraform
Vendors
1 11 (11.70%) Google
2 9 (9.57%) Microsoft
3 8 (8.51%) Tableau
4 5 (5.32%) Databricks
5 3 (3.19%) Oracle
6 2 (2.13%) Cloudera
6 2 (2.13%) Teradata
7 1 (1.06%) Ab Initio
7 1 (1.06%) Alteryx
7 1 (1.06%) Bloomberg
7 1 (1.06%) Foundry
7 1 (1.06%) Hortonworks
7 1 (1.06%) Informatica
7 1 (1.06%) MapR
7 1 (1.06%) Palantir
7 1 (1.06%) Reuters
7 1 (1.06%) Salesforce.com
7 1 (1.06%) Snowplow
7 1 (1.06%) Sybase
7 1 (1.06%) Talend