Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Contract Data Engineer Skill Set in London
Period
to 24 September 2021

The median contractor rate for a Data Engineer was £550 per day in advertised job vacancies in London during the 6 months to 24 September 2021.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
England > London
6 months to
24 Sep 2021		 Same period 2020 Same period 2019
Rank 88 132 118
Rank change year-on-year +44 -14 +93
Contract jobs requiring a Data Engineer 1,001 280 906
As % of all contract jobs advertised in London 2.94% 2.09% 2.34%
As % of the Job Titles category 3.17% 2.28% 2.48%
Number of daily rates quoted 714 214 722
10th Percentile £425 £383 £419
25th Percentile £475 £441 £488
Median daily rate (50th Percentile) £550 £525 £550
Median % change year-on-year +4.76% -4.55% -
75th Percentile £638 £600 £625
90th Percentile £688 £675 £686
England median daily rate £540 £500 £550
% change year-on-year +8.00% -9.09% -
Number of hourly rates quoted 7 1 2
10th Percentile £34.75 " £15.45
25th Percentile £36.25 £22.50 £16.13
Median hourly rate £41.30 £25.00 £17.25
Median % change year-on-year +65.20% +44.93% -21.59%
75th Percentile £51.94 £27.50 £18.38
90th Percentile £58.90 " £19.05
England median hourly rate £36.25 £23.75 £15.00
% change year-on-year +52.63% +58.33% -32.58%

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in London. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
London
Contract vacancies in London with a recognized job title 31,570 12,302 36,485
% of contract IT jobs with a recognized job title 92.87% 91.83% 94.14%
Number of daily rates quoted 22,802 8,806 26,553
10th Percentile £356 £313 £313
25th Percentile £450 £413 £413
Median daily rate (50th Percentile) £550 £500 £500
Median % change year-on-year +10.00% - -
75th Percentile £650 £613 £600
90th Percentile £725 £713 £685
England median daily rate £500 £475 £475
% change year-on-year +5.26% - +5.56%
Number of hourly rates quoted 320 111 451
10th Percentile £13.61 £15.00 £12.04
25th Percentile £18.74 £19.99 £15.02
Median hourly rate £30.50 £35.00 £21.00
Median % change year-on-year -12.86% +66.67% +12.00%
75th Percentile £51.00 £47.25 £40.00
90th Percentile £65.08 £56.00 £53.75
England median hourly rate £19.75 £22.00 £19.00
% change year-on-year -10.25% +15.79% +8.57%

Data Engineer
Job Vacancy Trend in London

Job postings that featured Data Engineer in the job title as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Engineer in London

Data Engineer
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Data Engineer in London.

Daily rate trend for Data Engineer in London

Data Engineer
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Engineer in London over the 6 months to 24 September 2021.

Daily rate histogram for Data Engineer in London

Data Engineer
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Data Engineer in London.

Hourly rate trend for Data Engineer in London

Data Engineer
Hourly Rate Histogram in London

Hourly rate distribution of jobs citing Data Engineer in London over the 6 months to 24 September 2021.

Hourly rate histogram for Data Engineer in London

Data Engineer
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the London region over the 6 months to 24 September 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
Central London -14 99 £575 +10.05% 50
South London +2 8 £550 -6.06% 1
West London -22 7 £555 -11.20% 11
Data Engineer
England

Data Engineer Skill Set
Top 30 Co-occurring IT Skills in London

For the 6 months to 24 September 2021, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region featuring Data Engineer in the job title.

1 575 (57.44%) Python
2 543 (54.25%) SQL
3 383 (38.26%) Azure
4 299 (29.87%) Apache Spark
5 291 (29.07%) AWS
6 273 (27.27%) ETL
7 272 (27.17%) Analytics
8 271 (27.07%) Data Pipeline
9 268 (26.77%) Agile Software Development
10 264 (26.37%) Big Data
11 260 (25.97%) Data Engineering
12 227 (22.68%) Data Warehouse
13 223 (22.28%) Data Modelling
13 223 (22.28%) Java
14 222 (22.18%) Scala
15 220 (21.98%) Databricks
16 193 (19.28%) Kafka
16 193 (19.28%) Finance
17 186 (18.58%) Business Intelligence
18 181 (18.08%) Data Lake
19 176 (17.58%) DevOps
20 164 (16.38%) Social Skills
21 153 (15.28%) Azure Data Factory
22 152 (15.18%) Hadoop
23 151 (15.08%) Data Science
24 145 (14.49%) Power Platform
25 142 (14.19%) GCP
26 139 (13.89%) Power BI
26 139 (13.89%) PySpark
27 123 (12.29%) Apache Airflow

Data Engineer Skill Set
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 299 (29.87%) Apache Spark
2 123 (12.29%) Apache Airflow
3 83 (8.29%) Apache
4 27 (2.70%) Luigi
5 26 (2.60%) Elasticsearch
6 25 (2.50%) Confluence
7 14 (1.40%) Tomcat
8 12 (1.20%) SAS
9 6 (0.60%) BizTalk Server
9 6 (0.60%) SharePoint
10 4 (0.40%) Oracle Workflow
11 3 (0.30%) Apache Pig
11 3 (0.30%) Ethereum
12 2 (0.20%) Cloud Foundry
12 2 (0.20%) Hyperledger
12 2 (0.20%) Jupyter
12 2 (0.20%) Mule
Applications
1 8 (0.80%) Microsoft Excel
2 6 (0.60%) Microsoft Office
3 2 (0.20%) MS Visio
3 2 (0.20%) Spreadsheet
Business Applications
1 5 (0.50%) Dynamics CRM
1 5 (0.50%) SAP Oil and Gas
2 3 (0.30%) Dynamics AX
2 3 (0.30%) Endur
2 3 (0.30%) Refinitiv Enterprise Platform
3 2 (0.20%) Eikon
4 1 (0.100%) Aligne
4 1 (0.100%) Oracle EBS
4 1 (0.100%) SAP R/3
4 1 (0.100%) Sparx Enterprise Architect
Cloud Services
1 383 (38.26%) Azure
2 291 (29.07%) AWS
3 153 (15.28%) Azure Data Factory
4 145 (14.49%) Power Platform
5 142 (14.19%) GCP
6 102 (10.19%) Serverless
7 99 (9.89%) Amazon S3
8 79 (7.89%) Azure Synapse Analytics
9 52 (5.19%) GitHub
10 51 (5.09%) Azure Functions
11 49 (4.90%) Azure Cosmos DB
12 45 (4.50%) Snowflake
13 40 (4.00%) AWS Lambda
14 32 (3.20%) Amazon EC2
15 31 (3.10%) Amazon EMR
16 18 (1.80%) Amazon Kinesis
17 17 (1.70%) Azure Stack
18 16 (1.60%) AWS CloudFormation
19 15 (1.50%) Cloud Functions
20 14 (1.40%) Azure Storage
Communications & Networking
1 5 (0.50%) Internet
1 5 (0.50%) WAN
2 4 (0.40%) FTP
2 4 (0.40%) Kerberos
2 4 (0.40%) Z-Wave
3 3 (0.30%) Firewall
3 3 (0.30%) Intranet
4 1 (0.100%) Broadband
4 1 (0.100%) Cisco ASA
4 1 (0.100%) Network Security
4 1 (0.100%) SSL
4 1 (0.100%) TCP/IP
Database & Business Intelligence
1 264 (26.37%) Big Data
2 227 (22.68%) Data Warehouse
3 181 (18.08%) Data Lake
4 152 (15.18%) Hadoop
5 139 (13.89%) Power BI
6 95 (9.49%) SQL Server
7 93 (9.29%) Apache Hive
8 92 (9.19%) Relational Database
9 85 (8.49%) BigQuery
10 78 (7.79%) NoSQL
11 72 (7.19%) PostgreSQL
11 72 (7.19%) Tableau
12 64 (6.39%) Amazon Redshift
13 62 (6.19%) Azure SQL Database
14 50 (5.00%) Apache Cassandra
14 50 (5.00%) HBase
15 49 (4.90%) Metadata
16 47 (4.70%) SQL Server Integration Services
17 42 (4.20%) Azure SQL Data Warehouse
18 37 (3.70%) MongoDB
Development Applications
1 114 (11.39%) Git (software)
2 88 (8.79%) Jenkins
3 57 (5.69%) JIRA
4 24 (2.40%) GitLab
4 24 (2.40%) Hudson
5 18 (1.80%) Maven
6 17 (1.70%) Subversion
7 12 (1.20%) IntelliJ
8 8 (0.80%) TeamCity
8 8 (0.80%) Visual Studio
9 7 (0.70%) Oracle APEX
10 6 (0.60%) MLflow
11 5 (0.50%) Visual Studio Team System
12 4 (0.40%) CircleCI
12 4 (0.40%) GoCD
12 4 (0.40%) IBM UrbanCode
12 4 (0.40%) Octopus Deploy
12 4 (0.40%) Sonatype Nexus
13 3 (0.30%) Selenium
13 3 (0.30%) Team Foundation Server
General
1 193 (19.28%) Finance
2 164 (16.38%) Social Skills
3 98 (9.79%) Analytical Skills
4 72 (7.19%) Banking
5 39 (3.90%) Presentation Skills
6 38 (3.80%) Public Sector
7 30 (3.00%) Marketing
8 25 (2.50%) Investment Banking
9 20 (2.00%) Retail
10 15 (1.50%) Publishing
11 12 (1.20%) Telecoms
12 9 (0.90%) Manufacturing
13 8 (0.80%) Aerospace
13 8 (0.80%) Games
14 7 (0.70%) Law
15 6 (0.60%) Documentation Skills
15 6 (0.60%) Pharmaceutical
15 6 (0.60%) Retail Banking
16 5 (0.50%) Advertising
17 4 (0.40%) Financial Institution
Libraries, Frameworks & Software Standards
1 193 (19.28%) Kafka
2 139 (13.89%) PySpark
3 36 (3.60%) Spark Streaming
4 28 (2.80%) Spring
5 26 (2.60%) ARM Templates
5 26 (2.60%) JSON
6 22 (2.20%) Velocity
7 21 (2.10%) .NET
7 21 (2.10%) RabbitMQ
8 20 (2.00%) Pandas
8 20 (2.00%) XML
9 18 (1.80%) Apache Avro
10 15 (1.50%) CSS
10 15 (1.50%) HTML
10 15 (1.50%) Node.js
10 15 (1.50%) RESTful
10 15 (1.50%) Spring Boot
10 15 (1.50%) Web Services
11 14 (1.40%) Oracle GoldenGate
11 14 (1.40%) pytest
Miscellaneous
1 55 (5.49%) Data Structures
2 42 (4.20%) Algorithms
3 28 (2.80%) Data Protection Act
4 25 (2.50%) Management Information System
5 24 (2.40%) Cloud Native
6 21 (2.10%) Greenfield Project
7 19 (1.90%) Data Centre
8 13 (1.30%) Replication
9 12 (1.20%) Legacy Applications
10 10 (1.00%) Social Media
11 9 (0.90%) NHS
11 9 (0.90%) Reference Data
11 9 (0.90%) Self-Motivation
12 7 (0.70%) iPad
12 7 (0.70%) Public Cloud
13 6 (0.60%) Enterprise Software
14 5 (0.50%) Equities
14 5 (0.50%) Legacy Systems
15 4 (0.40%) Private Cloud
15 4 (0.40%) User Experience
Operating Systems
1 36 (3.60%) Unix
2 35 (3.50%) Linux
3 8 (0.80%) Windows
4 4 (0.40%) VMS
5 3 (0.30%) Red Hat Enterprise Linux
5 3 (0.30%) Windows Server
6 2 (0.20%) Android
6 2 (0.20%) Apple iOS
6 2 (0.20%) CentOS
6 2 (0.20%) Ubuntu
7 1 (0.100%) Windows 7
7 1 (0.100%) Windows Server 2008
7 1 (0.100%) Windows Server 2012
Processes & Methodologies
1 273 (27.27%) ETL
2 272 (27.17%) Analytics
3 271 (27.07%) Data Pipeline
4 268 (26.77%) Agile Software Development
5 260 (25.97%) Data Engineering
6 223 (22.28%) Data Modelling
7 186 (18.58%) Business Intelligence
8 176 (17.58%) DevOps
9 151 (15.08%) Data Science
10 102 (10.19%) Migration
11 100 (9.99%) Scrum
12 92 (9.19%) Visualisation
13 88 (8.79%) Machine Learning
14 78 (7.79%) Data Transformation
15 69 (6.89%) Data Ingestion
16 65 (6.49%) Software Engineering
17 64 (6.39%) Computer Science
18 58 (5.79%) Data Migration
19 56 (5.59%) Data Integration
20 53 (5.29%) Artificial Intelligence
Programming Languages
1 575 (57.44%) Python
2 543 (54.25%) SQL
3 223 (22.28%) Java
4 222 (22.18%) Scala
5 38 (3.80%) R
6 37 (3.70%) C++
7 32 (3.20%) Go
8 31 (3.10%) PL/SQL
9 30 (3.00%) JavaScript
10 29 (2.90%) T-SQL
11 25 (2.50%) C#
12 16 (1.60%) Shell Script
13 15 (1.50%) Bash Shell
14 13 (1.30%) Java 8
14 13 (1.30%) Kotlin
14 13 (1.30%) PowerShell
15 11 (1.10%) TypeScript
16 10 (1.00%) CQL
16 10 (1.00%) Perl
17 7 (0.70%) Groovy
Qualifications
1 71 (7.09%) Degree
2 65 (6.49%) Security Cleared
3 48 (4.80%) SC Cleared
4 35 (3.50%) Computer Science Degree
5 19 (1.90%) AWS Certification
6 10 (1.00%) Master's Degree
7 8 (0.80%) BPSS Clearance
7 8 (0.80%) DV Cleared
8 3 (0.30%) PhD
9 1 (0.100%) ISEB
9 1 (0.100%) Microsoft Certification
Quality Assurance & Compliance
1 82 (8.19%) Data Quality
2 29 (2.90%) QA
3 11 (1.10%) GDPR
4 6 (0.60%) IFRS
5 4 (0.40%) SLA
6 2 (0.20%) Accessibility
7 1 (0.100%) Actionable Recommendations
7 1 (0.100%) ISO/IEC 27001
7 1 (0.100%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
7 1 (0.100%) NIST
7 1 (0.100%) PCI DSS
7 1 (0.100%) Sarbanes-Oxley
7 1 (0.100%) SNOMED CT
7 1 (0.100%) SOC 2
7 1 (0.100%) Solvency II
System Software
1 72 (7.19%) Docker
2 17 (1.70%) HDFS
3 4 (0.40%) Apache Flume
4 3 (0.30%) Apache ZooKeeper
5 2 (0.20%) Active Directory
6 1 (0.100%) Hyper-V
6 1 (0.100%) Oracle RAC
6 1 (0.100%) Virtual Machines
6 1 (0.100%) VMware Infrastructure
6 1 (0.100%) vSphere
Systems Management
1 102 (10.19%) Kubernetes
2 72 (7.19%) Terraform
3 43 (4.30%) Ansible
4 23 (2.30%) Oozie
5 12 (1.20%) Grafana
5 12 (1.20%) Kibana
5 12 (1.20%) Single Sign-On
6 11 (1.10%) Hadoop YARN
7 8 (0.80%) Bosun
7 8 (0.80%) Docker Swarm
7 8 (0.80%) logstash
7 8 (0.80%) VictorOps
8 6 (0.60%) Puppet
9 4 (0.40%) Ambari
9 4 (0.40%) Kubeflow
9 4 (0.40%) Opscode Chef
10 3 (0.30%) Istio
11 2 (0.20%) Active Directory Federation Services
11 2 (0.20%) Control-M
12 1 (0.100%) Oracle Enterprise Manager
Vendors
1 220 (21.98%) Databricks
2 99 (9.89%) Google
3 98 (9.79%) Microsoft
4 64 (6.39%) Oracle
5 53 (5.29%) Cloudera
6 28 (2.80%) Hortonworks
7 27 (2.70%) Informatica
8 24 (2.40%) SAP
9 21 (2.10%) Alteryx
10 14 (1.40%) Teradata
11 11 (1.10%) StreamSets
12 9 (0.90%) Confluent
12 9 (0.90%) Splunk
12 9 (0.90%) Talend
13 7 (0.70%) Netezza
14 6 (0.60%) Dataiku
14 6 (0.60%) IBM
14 6 (0.60%) Salesforce.com
15 4 (0.40%) Salesforce Marketing Cloud
16 3 (0.30%) Reuters