Period
to 7 May 2021

The median contractor rate for a Data Engineer was £550 per day in advertised job vacancies in London during the 6 months to 7 May 2021.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
England > London
6 months to
7 May 2021
Same period 2020 Same period 2019
Rank 93 112 126
Rank change year-on-year +19 +14 +105
Contract jobs requiring a Data Engineer 645 509 911
As % of all contract jobs advertised in London 2.74% 2.36% 2.23%
As % of the Job Titles category 2.96% 2.53% 2.36%
Number of daily rates quoted 481 373 678
10th Percentile £413 £413 £425
25th Percentile £475 £463 £500
Median daily rate (50th Percentile) £550 £525 £550
Median % change year-on-year +4.76% -4.55% -
75th Percentile £613 £625 £625
90th Percentile £660 £688 £688
England median daily rate £525 £520 £530
% change year-on-year +0.96% -1.89% +0.95%
Number of hourly rates quoted 4 1 26
Median hourly rate £60.75 £25.00 £15.00
Median % change year-on-year +143.00% +66.67% -76.92%
England median hourly rate £38.00 £41.25 £15.00
% change year-on-year -7.88% +175.00% -78.18%

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in London. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
London
Contract vacancies in London with a recognized job title 21,805 20,143 38,586
% of contract IT jobs with a recognized job title 92.72% 93.48% 94.39%
Number of daily rates quoted 15,730 14,585 27,970
10th Percentile £334 £300 £313
25th Percentile £421 £413 £413
Median daily rate (50th Percentile) £525 £500 £500
Median % change year-on-year +5.00% - -
75th Percentile £625 £600 £600
90th Percentile £700 £688 £675
England median daily rate £485 £475 £475
% change year-on-year +2.11% - +5.56%
Number of hourly rates quoted 213 273 453
10th Percentile £16.15 £13.75 £12.25
25th Percentile £21.25 £17.95 £15.00
Median hourly rate £32.85 £25.00 £21.00
Median % change year-on-year +31.40% +19.05% +5.00%
75th Percentile £54.50 £46.51 £36.00
90th Percentile £66.50 £60.80 £49.68
England median hourly rate £21.68 £18.90 £18.50
% change year-on-year +14.71% +2.16% +5.71%

Data Engineer
Job Vacancy Trend in London

Job postings that featured Data Engineer in the job title as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Engineer in London

Data Engineer
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Data Engineer in London.

Daily rate trend for Data Engineer in London

Data Engineer
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Engineer in London over the 6 months to 7 May 2021.

Daily rate histogram for Data Engineer in London

Data Engineer
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Data Engineer in London.

Hourly rate trend for Data Engineer in London

Data Engineer
Hourly Rate Histogram in London

Hourly rate distribution of jobs citing Data Engineer in London over the 6 months to 7 May 2021.

Hourly rate histogram for Data Engineer in London

Data Engineer
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the London region over the 6 months to 7 May 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +23 99 £563 +7.14% 40
South London +24 12 £575 +15.00% 3
East London +13 1 £517 -1.52% 10
West London +10 1 £555 +11.00% 10
Data Engineer
England

Data Engineer Skill Set
Top 30 Co-occurring IT Skills in London

For the 6 months to 7 May 2021, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region featuring Data Engineer in the job title.

1 354 (54.88%) Python
2 343 (53.18%) SQL
3 229 (35.50%) AWS
4 220 (34.11%) Azure
4 220 (34.11%) Data Pipeline
5 196 (30.39%) Analytics
6 195 (30.23%) ETL
7 190 (29.46%) Data Warehouse
8 182 (28.22%) Agile Software Development
9 173 (26.82%) Apache Spark
10 172 (26.67%) Big Data
11 165 (25.58%) Data Engineering
12 151 (23.41%) Business Intelligence
13 143 (22.17%) Data Modelling
14 142 (22.02%) Kafka
15 139 (21.55%) Finance
16 130 (20.16%) Java
17 126 (19.53%) Scala
18 116 (17.98%) DevOps
19 115 (17.83%) Data Lake
20 111 (17.21%) Databricks
21 108 (16.74%) GCP
22 106 (16.43%) Data Science
23 105 (16.28%) Hadoop
24 94 (14.57%) Social Skills
25 81 (12.56%) Power Platform
26 79 (12.25%) Power BI
26 79 (12.25%) Azure Data Factory
27 75 (11.63%) Apache Airflow
28 74 (11.47%) Microsoft

Data Engineer Skill Set
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 173 (26.82%) Apache Spark
2 75 (11.63%) Apache Airflow
3 73 (11.32%) Apache
4 28 (4.34%) SAS
5 27 (4.19%) Confluence
6 9 (1.40%) Jupyter
7 8 (1.24%) Elasticsearch
8 6 (0.93%) Luigi
9 5 (0.78%) SharePoint
10 3 (0.47%) Oracle Workflow
11 2 (0.31%) Apache Pig
11 2 (0.31%) Oracle Coherence
12 1 (0.16%) Hyperledger
Applications
1 8 (1.24%) Microsoft Excel
2 5 (0.78%) Microsoft Office
3 1 (0.16%) Microsoft Project
3 1 (0.16%) Spreadsheet
3 1 (0.16%) SPSS
Business Applications
1 6 (0.93%) Eikon
1 6 (0.93%) Refinitiv Enterprise Platform
2 3 (0.47%) Aligne
3 2 (0.31%) Dynamics AX
3 2 (0.31%) Dynamics CRM
4 1 (0.16%) Oracle EBS
4 1 (0.16%) Sparx Enterprise Architect
Cloud Services
1 229 (35.50%) AWS
2 220 (34.11%) Azure
3 108 (16.74%) GCP
4 81 (12.56%) Power Platform
5 79 (12.25%) Azure Data Factory
6 70 (10.85%) Amazon S3
7 56 (8.68%) Serverless
8 47 (7.29%) Azure Synapse Analytics
9 37 (5.74%) Amazon EC2
10 36 (5.58%) Amazon EMR
11 34 (5.27%) AWS Lambda
12 27 (4.19%) Azure Cosmos DB
13 23 (3.57%) Amazon Kinesis
14 19 (2.95%) Amazon ElastiCache
15 16 (2.48%) Amazon Glacier
15 16 (2.48%) Azure Functions
15 16 (2.48%) GitHub
16 14 (2.17%) AWS CloudFormation
16 14 (2.17%) Google Analytics
17 10 (1.55%) Cloud Functions
Communications & Networking
1 11 (1.71%) HTTP
2 5 (0.78%) Firewall
3 4 (0.62%) Kerberos
4 3 (0.47%) SMTP
4 3 (0.47%) SSL
5 2 (0.31%) Internet
6 1 (0.16%) 3G
6 1 (0.16%) 4G
6 1 (0.16%) 5G
6 1 (0.16%) Broadband
6 1 (0.16%) DNS
6 1 (0.16%) FTP
6 1 (0.16%) Network Security
6 1 (0.16%) PuTTY
6 1 (0.16%) Radio Access Network
6 1 (0.16%) TCP/IP
6 1 (0.16%) Wireless
Database & Business Intelligence
1 190 (29.46%) Data Warehouse
2 172 (26.67%) Big Data
3 115 (17.83%) Data Lake
4 105 (16.28%) Hadoop
5 79 (12.25%) Power BI
6 69 (10.70%) Amazon Redshift
7 64 (9.92%) BigQuery
8 63 (9.77%) Tableau
9 57 (8.84%) Apache Hive
9 57 (8.84%) Relational Database
10 56 (8.68%) SQL Server
11 54 (8.37%) Amazon RDS
12 48 (7.44%) Snowflake Schema
13 44 (6.82%) PostgreSQL
14 38 (5.89%) NoSQL
15 36 (5.58%) Amazon Athena
16 27 (4.19%) Azure SQL Database
17 25 (3.88%) Azure SQL Data Warehouse
17 25 (3.88%) SQL Server Integration Services
18 24 (3.72%) Oracle Database
Development Applications
1 68 (10.54%) Git (software)
2 48 (7.44%) JIRA
3 45 (6.98%) Jenkins
4 17 (2.64%) Maven
5 6 (0.93%) Atlassian Bamboo
5 6 (0.93%) Oracle APEX
6 4 (0.62%) Sonatype Nexus
6 4 (0.62%) TeamCity
6 4 (0.62%) Visual Studio
7 3 (0.47%) ProC
7 3 (0.47%) SQL Server Management Studio (SSMS)
7 3 (0.47%) Subversion
7 3 (0.47%) Visual Studio Team System
8 2 (0.31%) Artifactory
8 2 (0.31%) git-flow
8 2 (0.31%) Octopus Deploy
8 2 (0.31%) Zephyr
9 1 (0.16%) CircleCI
9 1 (0.16%) GitLab
9 1 (0.16%) GoCD
General
1 139 (21.55%) Finance
2 94 (14.57%) Social Skills
3 70 (10.85%) Analytical Skills
4 32 (4.96%) Banking
5 26 (4.03%) Public Sector
6 23 (3.57%) Retail
7 13 (2.02%) Games
7 13 (2.02%) Marketing
8 11 (1.71%) Presentation Skills
9 9 (1.40%) Investment Banking
10 7 (1.09%) Front Office
10 7 (1.09%) Publishing
10 7 (1.09%) Telecoms
11 6 (0.93%) Manufacturing
11 6 (0.93%) Retail Banking
12 5 (0.78%) Pharmaceutical
13 4 (0.62%) Automotive
13 4 (0.62%) Law
14 3 (0.47%) Financial Institution
15 2 (0.31%) Advertising
Libraries, Frameworks & Software Standards
1 142 (22.02%) Kafka
2 72 (11.16%) PySpark
3 26 (4.03%) JSON
4 25 (3.88%) XML
5 20 (3.10%) NumPy
6 19 (2.95%) Celery
6 19 (2.95%) RESTful
7 18 (2.79%) Pandas
8 17 (2.64%) HTML
8 17 (2.64%) Velocity
9 15 (2.33%) Spark Streaming
10 13 (2.02%) Web Services
11 11 (1.71%) PostGIS
12 10 (1.55%) .NET
12 10 (1.55%) Node.js
13 9 (1.40%) Apache Beam
13 9 (1.40%) Spring
14 8 (1.24%) Apache NiFi
14 8 (1.24%) Oracle GoldenGate
14 8 (1.24%) scikit-learn
Miscellaneous
1 40 (6.20%) Data Structures
2 25 (3.88%) Greenfield Project
3 22 (3.41%) Algorithms
4 14 (2.17%) Cloud Native
5 11 (1.71%) Hedge funds
5 11 (1.71%) Self-Motivation
6 7 (1.09%) Foreign Exchange (FX)
7 6 (0.93%) Management Information System
7 6 (0.93%) Reinsurance
8 5 (0.78%) Client/Server
8 5 (0.78%) FMCG
8 5 (0.78%) NHS
8 5 (0.78%) Replication
8 5 (0.78%) User Experience
9 4 (0.62%) Data Centre
9 4 (0.62%) Fixed Income
9 4 (0.62%) iPad
9 4 (0.62%) Reference Data
9 4 (0.62%) Social Media
10 3 (0.47%) Public Cloud
Operating Systems
1 25 (3.88%) Linux
2 12 (1.86%) Unix
3 10 (1.55%) Windows
4 6 (0.93%) CentOS
4 6 (0.93%) Ubuntu
5 5 (0.78%) Red Hat Enterprise Linux
5 5 (0.78%) Windows Server
6 1 (0.16%) MVS
6 1 (0.16%) Windows 7
6 1 (0.16%) Windows Server 2008
Processes & Methodologies
1 220 (34.11%) Data Pipeline
2 196 (30.39%) Analytics
3 195 (30.23%) ETL
4 182 (28.22%) Agile Software Development
5 165 (25.58%) Data Engineering
6 151 (23.41%) Business Intelligence
7 143 (22.17%) Data Modelling
8 116 (17.98%) DevOps
9 106 (16.43%) Data Science
10 64 (9.92%) Scrum
11 60 (9.30%) Migration
12 56 (8.68%) Visualisation
13 52 (8.06%) Data Ingestion
14 49 (7.60%) Data Analysis
15 44 (6.82%) Data Transformation
16 42 (6.51%) Machine Learning
17 41 (6.36%) Software Engineering
18 37 (5.74%) Data Integration
19 34 (5.27%) Data Architecture
20 33 (5.12%) Data Analytics
Programming Languages
1 354 (54.88%) Python
2 343 (53.18%) SQL
3 130 (20.16%) Java
4 126 (19.53%) Scala
5 33 (5.12%) PL/SQL
5 33 (5.12%) R
6 22 (3.41%) C
7 18 (2.79%) C++
8 15 (2.33%) T-SQL
9 14 (2.17%) JavaScript
10 11 (1.71%) C#
10 11 (1.71%) Go
10 11 (1.71%) Shell Script
11 10 (1.55%) PowerShell
12 6 (0.93%) VBA
13 5 (0.78%) Bash Shell
14 3 (0.47%) PHP
14 3 (0.47%) TypeScript
14 3 (0.47%) VB
15 2 (0.31%) Java 8
Qualifications
1 63 (9.77%) Security Cleared
2 52 (8.06%) SC Cleared
3 28 (4.34%) Degree
4 18 (2.79%) AWS Certification
5 12 (1.86%) Computer Science Degree
6 11 (1.71%) DV Cleared
7 3 (0.47%) Master's Degree
8 2 (0.31%) ISEB
8 2 (0.31%) PhD
Quality Assurance & Compliance
1 32 (4.96%) Data Quality
2 22 (3.41%) QA
3 6 (0.93%) GDPR
4 2 (0.31%) SLA
5 1 (0.16%) GxP
5 1 (0.16%) IFRS
5 1 (0.16%) PMO
5 1 (0.16%) SNOMED CT
System Software
1 46 (7.13%) Docker
2 18 (2.79%) HDFS
3 4 (0.62%) Apache Flume
4 2 (0.31%) Apache ZooKeeper
5 1 (0.16%) Virtual Machines
Systems Management
1 55 (8.53%) Kubernetes
2 46 (7.13%) Terraform
3 18 (2.79%) Ansible
4 13 (2.02%) Oozie
5 9 (1.40%) Hadoop YARN
6 7 (1.09%) Puppet
7 6 (0.93%) Opscode Chef
8 2 (0.31%) Ambari
8 2 (0.31%) Grafana
8 2 (0.31%) Istio
9 1 (0.16%) Argo
9 1 (0.16%) Control-M
9 1 (0.16%) Rancher
9 1 (0.16%) SCCM
Vendors
1 111 (17.21%) Databricks
2 74 (11.47%) Microsoft
3 68 (10.54%) Google
4 50 (7.75%) Oracle
5 27 (4.19%) Cloudera
6 25 (3.88%) Alteryx
7 17 (2.64%) Informatica
8 16 (2.48%) SAP
9 14 (2.17%) Talend
10 12 (1.86%) Dataiku
10 12 (1.86%) Splunk
11 8 (1.24%) Hortonworks
11 8 (1.24%) StreamSets
12 7 (1.09%) Teradata
13 6 (0.93%) Bloomberg
13 6 (0.93%) Red Hat
13 6 (0.93%) Reuters
14 5 (0.78%) Adobe
14 5 (0.78%) Citrix
14 5 (0.78%) IBM