Period
to 12 August 2020

The median contractor rate for a Data Engineer was £525 per day in advertised job vacancies in London during the 6 months to 12 August 2020.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
England > London
6 months to
12 Aug 2020
Same period 2019 Same period 2018
Rank 133 108 205
Rank change year-on-year -25 +97 +115
Contract jobs requiring a Data Engineer 306 975 623
As % of all contract jobs advertised in London 2.04% 2.44% 1.36%
As % of the Job Titles category 2.20% 2.60% 1.44%
Number of daily rates quoted 239 757 494
Median daily rate £525 £550 £550
Median daily rate % change year-on-year -4.55% - +10.00%
10th Percentile £400 £413 £413
90th Percentile £675 £675 £684
England median daily rate £500 £550 £550
% change year-on-year -9.09% - +11.68%
Number of hourly rates quoted 2 22 2
Median hourly rate £30.00 £15.00 £40.25
Median hourly rate % change year-on-year +100.00% -62.73% +222.00%
10th Percentile £23.75 £15.00 £20.23
90th Percentile £34.25 £15.00 £60.08
England median hourly rate £35.00 £15.00 £22.25
% change year-on-year +133.33% -32.58% +78.00%

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in London. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
London
Contract vacancies in London with a recognized job title 13,905 37,538 43,263
% of contract IT jobs with a recognized job title 92.55% 94.12% 94.71%
Number of daily rates quoted 9,406 26,890 31,286
Median daily rate £513 £500 £500
Median daily rate % change year-on-year +2.50% - +5.26%
10th Percentile £313 £313 £313
90th Percentile £713 £675 £675
England median daily rate £475 £475 £450
% change year-on-year - +5.56% -
Number of hourly rates quoted 235 499 621
Median hourly rate £35.00 £21.00 £20.00
Median hourly rate % change year-on-year +66.67% +5.00% -4.90%
10th Percentile £17.97 £12.45 £13.13
90th Percentile £54.60 £58.83 £51.25
Median hourly rate £27.20 £20.00 £18.70
% change year-on-year +35.98% +6.95% +1.08%

Data Engineer
Job Vacancy Trend in London

Job postings that featured Data Engineer in the job title as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Engineer in London

Data Engineer
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Data Engineer in London.

Daily rate trend for Data Engineer in London

Data Engineer
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Engineer in London over the 6 months to 12 August 2020.

Daily rate histogram for Data Engineer in London

Data Engineer
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Data Engineer in London.

Hourly rate trend for Data Engineer in London

Data Engineer
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the London region over the 6 months to 12 August 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -16 59 £500 -9.09% 19
West London +44 8 £560 +24.44% 1
South London +24 8 £599 +26.05% 5
East London +30 2 £515 -1.90% 4
Data Engineer
England

Data Engineer Skill Set
Top 30 Co-occurring IT Skills in London

For the 6 months to 12 August 2020, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region featuring Data Engineer in the job title.

1 200 (65.36%) Python
2 138 (45.10%) SQL
3 125 (40.85%) Big Data
4 114 (37.25%) Apache Spark
5 100 (32.68%) AWS
6 95 (31.05%) Azure
7 89 (29.08%) Hadoop
8 85 (27.78%) ETL
9 80 (26.14%) Agile Software Development
10 79 (25.82%) Analytics
11 75 (24.51%) Scala
12 70 (22.88%) Data Modelling
13 67 (21.90%) DevOps
14 64 (20.92%) Java
14 64 (20.92%) Finance
15 63 (20.59%) Business Intelligence
15 63 (20.59%) Data Engineering
16 62 (20.26%) PySpark
16 62 (20.26%) GCP
17 56 (18.30%) Kubernetes
18 52 (16.99%) Data Warehouse
19 48 (15.69%) Kafka
20 46 (15.03%) Docker
21 44 (14.38%) Git (software)
22 43 (14.05%) Databricks
23 41 (13.40%) Data Science
23 41 (13.40%) Security Cleared
24 40 (13.07%) Machine Learning
25 39 (12.75%) Apache Hive
26 37 (12.09%) Data Lake

Data Engineer Skill Set
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 114 (37.25%) Apache Spark
2 27 (8.82%) Apache
3 19 (6.21%) Apache Airflow
4 18 (5.88%) Elasticsearch
5 7 (2.29%) Confluence
6 6 (1.96%) SAS
6 6 (1.96%) Tornado
7 5 (1.63%) Jupyter
8 3 (0.98%) Apache Pig
9 2 (0.65%) SharePoint
10 1 (0.33%) BizTalk Server
10 1 (0.33%) nginx
10 1 (0.33%) Oracle Coherence
10 1 (0.33%) R Markdown
Applications
1 4 (1.31%) Microsoft Excel
2 1 (0.33%) Spreadsheet
Business Applications
1 4 (1.31%) Magento
1 4 (1.31%) Shopify
2 2 (0.65%) Northgate Housing
2 2 (0.65%) Refinitiv Enterprise Platform
3 1 (0.33%) FINCAD Analytics
Cloud Services
1 100 (32.68%) AWS
2 95 (31.05%) Azure
3 62 (20.26%) GCP
4 34 (11.11%) Azure Data Factory
5 26 (8.50%) Serverless
6 23 (7.52%) Power Platform
7 22 (7.19%) AWS Lambda
8 17 (5.56%) Amazon S3
9 9 (2.94%) Amazon ECS
9 9 (2.94%) Apigee
10 8 (2.61%) Amazon Kinesis
10 8 (2.61%) Logic Apps
11 7 (2.29%) Amazon SQS
12 6 (1.96%) PaaS
12 6 (1.96%) SaaS
13 5 (1.63%) Amazon EC2
13 5 (1.63%) Amazon EMR
13 5 (1.63%) AWS Step Functions
14 4 (1.31%) Azure Functions
14 4 (1.31%) Cloud Computing
Communications & Networking
1 2 (0.65%) SSL
1 2 (0.65%) Wireless
2 1 (0.33%) BGP
2 1 (0.33%) Cisco Nexus
2 1 (0.33%) Internet
2 1 (0.33%) Kerberos
2 1 (0.33%) MPLS
2 1 (0.33%) OSPF
2 1 (0.33%) Skype
2 1 (0.33%) WebEx
Database & Business Intelligence
1 125 (40.85%) Big Data
2 89 (29.08%) Hadoop
3 52 (16.99%) Data Warehouse
4 39 (12.75%) Apache Hive
5 37 (12.09%) Data Lake
6 34 (11.11%) SQL Server
7 32 (10.46%) BigQuery
7 32 (10.46%) NoSQL
8 31 (10.13%) Amazon Redshift
9 23 (7.52%) Power BI
10 18 (5.88%) Azure SQL Database
11 17 (5.56%) PostgreSQL
12 16 (5.23%) Impala
13 14 (4.58%) Amazon Athena
13 14 (4.58%) MongoDB
14 13 (4.25%) HBase
14 13 (4.25%) Relational Database
15 12 (3.92%) Apache Cassandra
15 12 (3.92%) MySQL
16 11 (3.59%) Presto
Development Applications
1 44 (14.38%) Git (software)
2 34 (11.11%) Jenkins
3 30 (9.80%) GitLab
4 18 (5.88%) Artifactory
5 11 (3.59%) JIRA
6 9 (2.94%) Visual Studio Team System
7 6 (1.96%) Hudson
7 6 (1.96%) Maven
7 6 (1.96%) ProC
8 3 (0.98%) JUnit
9 2 (0.65%) Cucumber
9 2 (0.65%) Visual Studio
10 1 (0.33%) Octopus Deploy
10 1 (0.33%) Sonatype Nexus
10 1 (0.33%) Team Foundation Server
10 1 (0.33%) TeamCity
General
1 64 (20.92%) Finance
2 25 (8.17%) Banking
3 20 (6.54%) Telecoms
4 11 (3.59%) Retail
5 9 (2.94%) Legal
6 7 (2.29%) Marketing
7 6 (1.96%) Front Office
7 6 (1.96%) Games
8 5 (1.63%) Advertising
8 5 (1.63%) Electronics
8 5 (1.63%) Public Sector
9 4 (1.31%) Investment Banking
9 4 (1.31%) Pharmaceutical
10 3 (0.98%) Billing
10 3 (0.98%) Manufacturing
11 2 (0.65%) Law
11 2 (0.65%) Local Government
11 2 (0.65%) Publishing
12 1 (0.33%) Retail Banking
Libraries, Frameworks & Software Standards
1 62 (20.26%) PySpark
2 48 (15.69%) Kafka
3 20 (6.54%) Web Services
4 19 (6.21%) TensorFlow
5 17 (5.56%) scikit-learn
6 13 (4.25%) H2O
7 11 (3.59%) Anaconda
8 9 (2.94%) gRPC
8 9 (2.94%) OAuth
8 9 (2.94%) Swagger
9 8 (2.61%) ADO
9 8 (2.61%) JSON
9 8 (2.61%) Spark Streaming
10 7 (2.29%) .NET
10 7 (2.29%) Elastic Stack
10 7 (2.29%) REST
11 6 (1.96%) Backbone.js
11 6 (1.96%) CSS3
11 6 (1.96%) HTML5
11 6 (1.96%) Twisted
Miscellaneous
1 24 (7.84%) Analytical Skills
2 18 (5.88%) Greenfield Project
3 12 (3.92%) Hedge funds
4 10 (3.27%) Algorithms
5 9 (2.94%) Credit Risk
5 9 (2.94%) Enterprise Software
6 8 (2.61%) PMI
7 7 (2.29%) Data Structures
7 7 (2.29%) Public Cloud
8 6 (1.96%) FMCG
9 4 (1.31%) Blog
9 4 (1.31%) Cloud Native
9 4 (1.31%) Derivative
9 4 (1.31%) Fixed Income
9 4 (1.31%) Linux Command Line
9 4 (1.31%) Management Information System
9 4 (1.31%) Private Cloud
10 3 (0.98%) Hybrid Cloud
10 3 (0.98%) Self-Motivation
11 2 (0.65%) Pricing Data
Operating Systems
1 16 (5.23%) Linux
2 5 (1.63%) Unix
3 2 (0.65%) Solaris
3 2 (0.65%) Windows
4 1 (0.33%) Debian
4 1 (0.33%) Windows Server
4 1 (0.33%) Windows Server 2008
4 1 (0.33%) Windows Server 2012
4 1 (0.33%) Windows Server 2016
Processes & Methodologies
1 85 (27.78%) ETL
2 80 (26.14%) Agile Software Development
3 79 (25.82%) Analytics
4 70 (22.88%) Data Modelling
5 67 (21.90%) DevOps
6 63 (20.59%) Business Intelligence
6 63 (20.59%) Data Engineering
7 41 (13.40%) Data Science
8 40 (13.07%) Machine Learning
9 35 (11.44%) Continuous Integration
10 33 (10.78%) Visualisation
11 32 (10.46%) Software Engineering
12 29 (9.48%) Data Analytics
13 26 (8.50%) Microservices
14 24 (7.84%) Data Visualisation
15 19 (6.21%) E-Commerce
15 19 (6.21%) Migration
16 18 (5.88%) Data Analysis
16 18 (5.88%) Open Source
16 18 (5.88%) Scrum
Programming Languages
1 200 (65.36%) Python
2 138 (45.10%) SQL
3 75 (24.51%) Scala
4 64 (20.92%) Java
5 18 (5.88%) C#
6 13 (4.25%) R
7 11 (3.59%) PowerShell
8 10 (3.27%) JavaScript
9 9 (2.94%) Ruby
10 8 (2.61%) Bash Shell
10 8 (2.61%) T-SQL
11 5 (1.63%) Go
12 4 (1.31%) Groovy
12 4 (1.31%) SOQL
13 2 (0.65%) C
13 2 (0.65%) C++
13 2 (0.65%) PL/SQL
14 1 (0.33%) Julia
14 1 (0.33%) MATLAB
14 1 (0.33%) Shell Script
Qualifications
1 41 (13.40%) Security Cleared
2 34 (11.11%) SC Cleared
3 9 (2.94%) Degree
4 8 (2.61%) PMI Certification
5 4 (1.31%) Microsoft Certification
6 3 (0.98%) AWS Certification
6 3 (0.98%) DV Cleared
7 2 (0.65%) CTC Cleared
7 2 (0.65%) DBS Check
8 1 (0.33%) CCNA
8 1 (0.33%) Cisco Certification
8 1 (0.33%) Computer Science Degree
8 1 (0.33%) PhD
Quality Assurance & Compliance
1 8 (2.61%) Data Quality
2 6 (1.96%) GDPR
3 4 (1.31%) QA
4 1 (0.33%) CDISC
4 1 (0.33%) SLA
System Software
1 46 (15.03%) Docker
2 9 (2.94%) HDFS
3 2 (0.65%) Active Directory
4 1 (0.33%) Virtual Machines
4 1 (0.33%) VMware Infrastructure
Systems Management
1 56 (18.30%) Kubernetes
2 21 (6.86%) Terraform
3 17 (5.56%) Ansible
4 8 (2.61%) Hadoop YARN
5 5 (1.63%) Kubeflow
6 4 (1.31%) Oozie
7 3 (0.98%) Kibana
8 2 (0.65%) Grafana
8 2 (0.65%) Prometheus
9 1 (0.33%) logstash
Vendors
1 43 (14.05%) Databricks
2 35 (11.44%) Microsoft
3 34 (11.11%) Google
4 30 (9.80%) Cloudera
5 21 (6.86%) Tableau
6 19 (6.21%) Oracle
7 13 (4.25%) Hortonworks
8 8 (2.61%) Informatica
8 8 (2.61%) Talend
9 7 (2.29%) Teradata
10 6 (1.96%) SAP
10 6 (1.96%) StreamSets
10 6 (1.96%) Zuora
11 5 (1.63%) MapR
12 4 (1.31%) Alteryx
13 3 (0.98%) Bloomberg
13 3 (0.98%) Demandware
14 2 (0.65%) Northgate
14 2 (0.65%) Refinitiv
15 1 (0.33%) Confluent