Period
to 10 December 2019

The median contractor rate for a Data Engineer was £550 per day in advertised job vacancies in Central London during the 6 months to 10 December 2019.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
London > Central London
6 months to
10 Dec 2019
Same period 2018 Same period 2017
Rank 115 159 210
Rank change year-on-year +44 +51 -8
Contract jobs requiring a Data Engineer 147 154 71
As % of all contract IT jobs advertised in Central London 2.06% 1.65% 0.83%
As % of the Job Titles category 2.20% 1.73% 0.87%
Number of daily rates quoted 107 125 61
Central London median daily rate £550 £550 £525
Median daily rate % change year-on-year - +4.76% -4.55%
10th Percentile £425 £413 £385
90th Percentile £675 £700 £625
London median daily rate £550 £550 £500
% change year-on-year - +10.00% -9.09%
Number of hourly rates quoted 0 0 0
Central London median hourly rate - - -
London median hourly rate £52.50 £34.00 £20.50
% change year-on-year +54.41% +65.85% -30.51%

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in Central London. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
Central London
Contract vacancies in Central London with a recognized job title 6,673 8,918 8,147
% of contract IT jobs with a recognized job title 93.52% 95.51% 94.83%
Number of daily rates quoted 5,130 6,897 6,339
Central London median daily rate £500 £500 £500
10th Percentile £300 £300 £310
90th Percentile £675 £675 £675
London median daily rate £500 £500 £500
Number of hourly rates quoted 82 130 113
Central London median hourly rate £20.50 £18.70 £18.10
Median hourly rate % change year-on-year +9.63% +3.31% +5.19%
10th Percentile £12.53 £13.00 £11.25
90th Percentile £52.15 £30.20 £34.14
London median hourly rate £22.00 £20.00 £20.50
% change year-on-year +10.00% -2.44% +6.60%

Data Engineer
Job Vacancy Trend in Central London

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised in Central London.

Job vacancy trend for Data Engineer in Central London

Data Engineer
Contractor Daily Rate Trend in Central London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Engineer in Central London.

Contractor daily rate trend for Data Engineer in Central London

Data Engineer
Contractor Daily Rate Histogram in Central London

The daily rate distribution of IT jobs citing Data Engineer in Central London over the 6 months to 10 December 2019.

Contractor daily rate histogram for Data Engineer in Central London

Data Engineer
Contractor Hourly Rate Trend in Central London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Engineer in Central London.

Contractor hourly rate trend for Data Engineer in Central London

Data Engineer
Contract Job Locations in Central London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the Central London region over the 6 months to 10 December 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
City of London +34 104 £550 - 66
Southwark +20 6 £525 -4.55%
West End of London +24 4 £519 - 1
City of Westminster +5 4 £455 +30.00%
Camden +9 1 £550 -8.33%
Data Engineer
London

Data Engineer Skill Set
Top 30 Co-occurring IT Skills in Central London

For the 6 months to 10 December 2019, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the Central London region featuring Data Engineer in the job title.

1 106 (72.11%) Python
2 72 (48.98%) Apache Spark
3 67 (45.58%) SQL
4 64 (43.54%) AWS
5 58 (39.46%) Big Data
5 58 (39.46%) Hadoop
6 51 (34.69%) Analytics
7 50 (34.01%) ETL
8 49 (33.33%) Kafka
9 46 (31.29%) Scala
9 46 (31.29%) GCP
9 46 (31.29%) Data Modelling
10 44 (29.93%) Data Science
11 43 (29.25%) Agile Software Development
12 41 (27.89%) Java
13 38 (25.85%) Azure
14 37 (25.17%) Data Engineering
15 32 (21.77%) Google
16 29 (19.73%) DevOps
17 28 (19.05%) Data Warehouse
18 27 (18.37%) Apache Hive
19 26 (17.69%) Finance
20 25 (17.01%) Docker
21 24 (16.33%) Machine Learning
22 23 (15.65%) Data Structures
23 22 (14.97%) Kubernetes
24 20 (13.61%) Apache Airflow
25 19 (12.93%) Apache
26 18 (12.24%) Git (software)
26 18 (12.24%) Data Lake

Data Engineer Skill Set
Co-occurring IT Skills in Central London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 72 (48.98%) Apache Spark
2 20 (13.61%) Apache Airflow
3 19 (12.93%) Apache
4 8 (5.44%) Jupyter
5 6 (4.08%) Luigi
6 4 (2.72%) Elasticsearch
7 3 (2.04%) Confluence
7 3 (2.04%) SharePoint
8 2 (1.36%) Apache Pig
9 1 (0.68%) Pachyderm
Applications
1 5 (3.40%) Microsoft Excel
2 1 (0.68%) Spreadsheet
Business Applications
1 1 (0.68%) SAP Oil and Gas
Cloud Services
1 64 (43.54%) AWS
2 46 (31.29%) GCP
3 38 (25.85%) Azure
4 17 (11.56%) Amazon EMR
5 16 (10.88%) Amazon S3
6 13 (8.84%) Amazon EC2
7 10 (6.80%) AWS CloudFormation
8 9 (6.12%) Amazon Kinesis
8 9 (6.12%) AWS Lambda
8 9 (6.12%) Power Platform
8 9 (6.12%) Serverless
9 8 (5.44%) Azure Data Factory
10 5 (3.40%) GitHub
11 4 (2.72%) Cloud Computing
12 3 (2.04%) Azure Stack
12 3 (2.04%) Virtual Private Cloud
13 2 (1.36%) Amazon CloudWatch
13 2 (1.36%) Amazon Cognito
13 2 (1.36%) Amazon SageMaker
13 2 (1.36%) AWS Step Functions
Database & Business Intelligence
1 58 (39.46%) Big Data
1 58 (39.46%) Hadoop
2 28 (19.05%) Data Warehouse
3 27 (18.37%) Apache Hive
4 18 (12.24%) Data Lake
5 17 (11.56%) NoSQL
6 16 (10.88%) PostgreSQL
7 15 (10.20%) BigQuery
8 14 (9.52%) SQL Server
9 12 (8.16%) Apache Cassandra
10 11 (7.48%) Amazon Redshift
11 10 (6.80%) HBase
12 9 (6.12%) Amazon Athena
12 9 (6.12%) Power BI
13 8 (5.44%) Relational Database
13 8 (5.44%) SQL Server Integration Services
14 7 (4.76%) Impala
14 7 (4.76%) Presto
15 6 (4.08%) Azkaban
15 6 (4.08%) Spark SQL
Development Applications
1 18 (12.24%) Git (software)
2 17 (11.56%) Jenkins
3 6 (4.08%) Visual Studio Team System
4 5 (3.40%) JIRA
4 5 (3.40%) Maven
5 2 (1.36%) Atlassian Bamboo
5 2 (1.36%) Bitbucket
5 2 (1.36%) Visual Studio
6 1 (0.68%) CircleCI
6 1 (0.68%) GitLab
6 1 (0.68%) GoCD
6 1 (0.68%) Sonatype Nexus
General
1 26 (17.69%) Finance
2 15 (10.20%) Banking
3 6 (4.08%) Retail
4 5 (3.40%) Marketing
5 3 (2.04%) Front Office
5 3 (2.04%) Manufacturing
6 2 (1.36%) Advertising
6 2 (1.36%) Games
6 2 (1.36%) Publishing
7 1 (0.68%) Billing
7 1 (0.68%) Investment Banking
7 1 (0.68%) Public Sector
7 1 (0.68%) Telecoms
Libraries, Frameworks & Software Standards
1 49 (33.33%) Kafka
2 14 (9.52%) Spark Streaming
3 12 (8.16%) PySpark
4 10 (6.80%) Pandas
5 9 (6.12%) Apache Beam
6 8 (5.44%) RESTful
7 7 (4.76%) REST
8 3 (2.04%) Flask
8 3 (2.04%) NumPy
8 3 (2.04%) Web Services
8 3 (2.04%) XML
9 2 (1.36%) .NET
9 2 (1.36%) Akka
9 2 (1.36%) Django
9 2 (1.36%) JSON
9 2 (1.36%) MLlib
9 2 (1.36%) Play Framework
9 2 (1.36%) Protocol Buffers
9 2 (1.36%) scikit-learn
9 2 (1.36%) Spring
Miscellaneous
1 23 (15.65%) Data Structures
2 9 (6.12%) Greenfield Project
3 7 (4.76%) Algorithms
4 6 (4.08%) Analytical Skills
5 5 (3.40%) Public Cloud
6 2 (1.36%) Cloud Native
6 2 (1.36%) Equities
7 1 (0.68%) Market Risk
7 1 (0.68%) Self-Motivation
7 1 (0.68%) Social Media
7 1 (0.68%) Spread Betting
7 1 (0.68%) User Experience
Operating Systems
1 10 (6.80%) Linux
2 7 (4.76%) Unix
3 1 (0.68%) Red Hat Enterprise Linux
Processes & Methodologies
1 51 (34.69%) Analytics
2 50 (34.01%) ETL
3 46 (31.29%) Data Modelling
4 44 (29.93%) Data Science
5 43 (29.25%) Agile Software Development
6 37 (25.17%) Data Engineering
7 29 (19.73%) DevOps
8 24 (16.33%) Machine Learning
9 16 (10.88%) Business Intelligence
9 16 (10.88%) Data Analytics
10 15 (10.20%) Visualisation
11 14 (9.52%) Continuous Integration
12 12 (8.16%) Data Analysis
12 12 (8.16%) Data Transformation
12 12 (8.16%) Mentoring
12 12 (8.16%) Workload Management
13 11 (7.48%) Artificial Intelligence
13 11 (7.48%) Data Visualisation
13 11 (7.48%) OO
14 9 (6.12%) Use Case
Programming Languages
1 106 (72.11%) Python
2 67 (45.58%) SQL
3 46 (31.29%) Scala
4 41 (27.89%) Java
5 10 (6.80%) C++
6 7 (4.76%) Go
7 5 (3.40%) AWK
7 5 (3.40%) Bash Shell
7 5 (3.40%) sed
8 4 (2.72%) C#
8 4 (2.72%) R
9 2 (1.36%) Kotlin
10 1 (0.68%) HiveQL
10 1 (0.68%) Java 8
10 1 (0.68%) JavaScript
10 1 (0.68%) Julia
10 1 (0.68%) PL/SQL
10 1 (0.68%) VBA
Qualifications
1 5 (3.40%) Degree
2 2 (1.36%) PMI Certification
2 2 (1.36%) PMP
2 2 (1.36%) Security Cleared
3 1 (0.68%) DV Cleared
3 1 (0.68%) SC Cleared
Quality Assurance & Compliance
1 2 (1.36%) Data Quality
1 2 (1.36%) QA
2 1 (0.68%) GDPR
System Software
1 25 (17.01%) Docker
2 5 (3.40%) HDFS
3 3 (2.04%) Active Directory
3 3 (2.04%) Apache Flume
Systems Management
1 22 (14.97%) Kubernetes
2 8 (5.44%) Hadoop YARN
3 5 (3.40%) Terraform
4 4 (2.72%) Ansible
5 3 (2.04%) Oozie
6 2 (1.36%) Kubeflow
7 1 (0.68%) ITRS Geneos
7 1 (0.68%) Thomson Reuters DACS
Vendors
1 32 (21.77%) Google
2 12 (8.16%) Microsoft
3 10 (6.80%) Cloudera
3 10 (6.80%) Tableau
4 9 (6.12%) Talend
5 8 (5.44%) Databricks
5 8 (5.44%) Informatica
6 5 (3.40%) Alteryx
6 5 (3.40%) Teradata
7 4 (2.72%) Ab Initio
7 4 (2.72%) Oracle
7 4 (2.72%) SAP
8 3 (2.04%) Confluent
9 1 (0.68%) Atlassian
9 1 (0.68%) Bloomberg
9 1 (0.68%) Hortonworks
9 1 (0.68%) Palantir
9 1 (0.68%) Reuters
9 1 (0.68%) Salesforce.com
9 1 (0.68%) Splunk