Period
to 25 October 2021

The median contractor rate for a Data Engineer was £574 per day in advertised job vacancies in the City of London during the 6 months to 25 October 2021.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
Central London > City of London
6 months to
25 Oct 2021
Same period 2020 Same period 2019
Rank 83 75 96
Rank change year-on-year -8 +21 +58
Contract jobs requiring a Data Engineer 103 43 149
As % of all contract jobs advertised in the City of London 2.64% 2.40% 2.51%
As % of the Job Titles category 2.85% 2.61% 2.67%
Number of daily rates quoted 80 34 119
10th Percentile £422 £393 £435
25th Percentile £484 £413 £513
Median daily rate (50th Percentile) £574 £450 £550
Median % change year-on-year +27.50% -18.18% -4.35%
75th Percentile £641 £584 £588
90th Percentile £726 £646 £664
Central London median daily rate £574 £460 £550
% change year-on-year +24.73% -16.36% -
Number of hourly rates quoted 1 0 0
Median hourly rate £58.00 - -
Central London median hourly rate £58.00 - -

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in the City of London. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
City of London
Contract vacancies in the City of London with a recognized job title 3,617 1,646 5,571
% of contract IT jobs with a recognized job title 92.84% 91.75% 93.76%
Number of daily rates quoted 2,741 1,247 4,433
10th Percentile £350 £306 £313
25th Percentile £458 £413 £413
Median daily rate (50th Percentile) £550 £513 £513
Median % change year-on-year +7.32% - +2.50%
75th Percentile £650 £600 £600
90th Percentile £748 £678 £675
Central London median daily rate £550 £513 £500
% change year-on-year +7.32% +2.50% -
Number of hourly rates quoted 37 25 68
10th Percentile £13.88 £15.50 £11.93
25th Percentile £21.00 £20.00 £13.44
Median hourly rate £28.50 £35.50 £19.50
Median % change year-on-year -19.72% +82.05% +4.28%
75th Percentile £37.75 £46.00 £24.25
90th Percentile £62.15 £47.75 £49.18
Central London median hourly rate £32.00 £29.89 £20.50
% change year-on-year +7.06% +45.80% +9.63%

Data Engineer
Job Vacancy Trend in the City of London

Job postings that featured Data Engineer in the job title as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Data Engineer in the City of London

Data Engineer
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing Data Engineer in the City of London.

Daily rate trend for Data Engineer in the City of London

Data Engineer
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing Data Engineer in the City of London over the 6 months to 25 October 2021.

Daily rate histogram for Data Engineer in the City of London

Data Engineer
Contractor Hourly Rate Trend in the City of London

3-month moving average hourly rates quoted in jobs citing Data Engineer in the City of London.

Hourly rate trend for Data Engineer in the City of London

Data Engineer Skill Set
Top 30 Co-occurring IT Skills in the City of London

For the 6 months to 25 October 2021, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region featuring Data Engineer in the job title.

1 61 (59.22%) Python
2 53 (51.46%) SQL
3 38 (36.89%) Apache Spark
4 37 (35.92%) Finance
5 36 (34.95%) ETL
6 30 (29.13%) Scala
6 30 (29.13%) Big Data
6 30 (29.13%) Data Engineering
7 28 (27.18%) Analytics
7 28 (27.18%) AWS
7 28 (27.18%) Java
7 28 (27.18%) Data Pipeline
8 26 (25.24%) Azure
9 25 (24.27%) Data Modelling
10 24 (23.30%) DevOps
11 23 (22.33%) Agile Software Development
12 22 (21.36%) Business Intelligence
12 22 (21.36%) Data Science
13 21 (20.39%) Kafka
14 18 (17.48%) Data Lake
14 18 (17.48%) Databricks
14 18 (17.48%) Banking
14 18 (17.48%) Apache Hive
15 16 (15.53%) Hadoop
15 16 (15.53%) Data Warehouse
15 16 (15.53%) Social Skills
16 14 (13.59%) Power BI
16 14 (13.59%) Problem-Solving
16 14 (13.59%) Power Platform
16 14 (13.59%) Algorithms

Data Engineer Skill Set
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 38 (36.89%) Apache Spark
2 8 (7.77%) Apache Airflow
3 7 (6.80%) Apache
4 1 (0.97%) Jupyter
4 1 (0.97%) SharePoint
Applications
1 5 (4.85%) Microsoft Excel
2 1 (0.97%) Microsoft PowerPoint
Cloud Services
1 28 (27.18%) AWS
2 26 (25.24%) Azure
3 14 (13.59%) Power Platform
4 9 (8.74%) Azure Data Factory
5 8 (7.77%) Amazon S3
5 8 (7.77%) Snowflake
6 7 (6.80%) GCP
6 7 (6.80%) Serverless
7 6 (5.83%) Azure Synapse Analytics
7 6 (5.83%) GitHub
8 5 (4.85%) AWS Lambda
9 4 (3.88%) AWS Step Functions
10 3 (2.91%) Amazon EMR
10 3 (2.91%) Azure Cosmos DB
10 3 (2.91%) Matillion
11 2 (1.94%) Amazon EC2
11 2 (1.94%) Amazon SQS
11 2 (1.94%) AWS CloudFormation
11 2 (1.94%) Azure Stack
11 2 (1.94%) Cloud Computing
Database & Business Intelligence
1 30 (29.13%) Big Data
2 18 (17.48%) Apache Hive
2 18 (17.48%) Data Lake
3 16 (15.53%) Data Warehouse
3 16 (15.53%) Hadoop
4 14 (13.59%) Power BI
5 12 (11.65%) SQL Server
6 10 (9.71%) NoSQL
6 10 (9.71%) Tableau
7 9 (8.74%) Amazon Redshift
8 7 (6.80%) Azure SQL Database
8 7 (6.80%) Impala
8 7 (6.80%) Metadata
8 7 (6.80%) MongoDB
9 6 (5.83%) Relational Database
9 6 (5.83%) SQL Server Analysis Services
9 6 (5.83%) SQL Server Integration Services
10 5 (4.85%) SQL Server Reporting Services
11 4 (3.88%) Amazon DynamoDB
11 4 (3.88%) Presto
Development Applications
1 5 (4.85%) Jenkins
2 4 (3.88%) JIRA
3 3 (2.91%) Git (software)
3 3 (2.91%) IBM UrbanCode
3 3 (2.91%) TeamCity
4 1 (0.97%) ERwin
4 1 (0.97%) MLflow
4 1 (0.97%) Visual Studio
General
1 37 (35.92%) Finance
2 18 (17.48%) Banking
3 16 (15.53%) Social Skills
4 10 (9.71%) Analytical Skills
5 5 (4.85%) Marketing
6 2 (1.94%) Documentation Skills
6 2 (1.94%) Presentation Skills
7 1 (0.97%) Advertising
7 1 (0.97%) Financial Institution
7 1 (0.97%) General Ledger
7 1 (0.97%) Investment Banking
7 1 (0.97%) Pharmaceutical
7 1 (0.97%) Public Sector
7 1 (0.97%) Telecoms
Libraries, Frameworks & Software Standards
1 21 (20.39%) Kafka
2 12 (11.65%) PySpark
3 5 (4.85%) Spring
4 4 (3.88%) .NET
4 4 (3.88%) Spark Streaming
5 3 (2.91%) Pandas
5 3 (2.91%) Web Services
6 2 (1.94%) Apache Avro
6 2 (1.94%) XML
7 1 (0.97%) Apache NiFi
7 1 (0.97%) JSON
7 1 (0.97%) Next.js
7 1 (0.97%) NumPy
7 1 (0.97%) pytest
7 1 (0.97%) RabbitMQ
7 1 (0.97%) React
7 1 (0.97%) Redux
7 1 (0.97%) scikit-learn
7 1 (0.97%) SciPy
Miscellaneous
1 14 (13.59%) Algorithms
2 6 (5.83%) Legacy Applications
2 6 (5.83%) Self-Motivation
3 4 (3.88%) Management Information System
4 3 (2.91%) Data Structures
4 3 (2.91%) Equities
5 2 (1.94%) Social Media
5 2 (1.94%) Taxonomies
6 1 (0.97%) FMCG
6 1 (0.97%) Linked Data
6 1 (0.97%) Linux Command Line
6 1 (0.97%) Market Risk
6 1 (0.97%) NHS
6 1 (0.97%) Replication
Operating Systems
1 3 (2.91%) VMS
2 2 (1.94%) Linux
2 2 (1.94%) Unix
Processes & Methodologies
1 36 (34.95%) ETL
2 30 (29.13%) Data Engineering
3 28 (27.18%) Analytics
3 28 (27.18%) Data Pipeline
4 25 (24.27%) Data Modelling
5 24 (23.30%) DevOps
6 23 (22.33%) Agile Software Development
7 22 (21.36%) Business Intelligence
7 22 (21.36%) Data Science
8 14 (13.59%) Problem-Solving
9 13 (12.62%) Data Ingestion
9 13 (12.62%) Visualisation
10 11 (10.68%) Data Visualisation
10 11 (10.68%) Machine Learning
11 10 (9.71%) Data Management
12 8 (7.77%) Computer Science
13 7 (6.80%) Scrum
13 7 (6.80%) Software Engineering
14 6 (5.83%) Mathematics
14 6 (5.83%) TDD
Programming Languages
1 61 (59.22%) Python
2 53 (51.46%) SQL
3 30 (29.13%) Scala
4 28 (27.18%) Java
5 5 (4.85%) C#
5 5 (4.85%) R
5 5 (4.85%) T-SQL
6 4 (3.88%) C++
7 3 (2.91%) JavaScript
7 3 (2.91%) PHP
8 2 (1.94%) Bash Shell
8 2 (1.94%) Perl
8 2 (1.94%) Ruby
8 2 (1.94%) Rust
8 2 (1.94%) Shell Script
8 2 (1.94%) TypeScript
9 1 (0.97%) CQL
9 1 (0.97%) PL/SQL
9 1 (0.97%) SPARQL
9 1 (0.97%) VBA
Qualifications
1 7 (6.80%) Degree
2 4 (3.88%) Security Cleared
3 3 (2.91%) SC Cleared
4 2 (1.94%) Computer Science Degree
5 1 (0.97%) Master's Degree
Quality Assurance & Compliance
1 12 (11.65%) Data Quality
2 2 (1.94%) IFRS
3 1 (0.97%) GDPR
3 1 (0.97%) QA
3 1 (0.97%) Sarbanes-Oxley
3 1 (0.97%) SLA
3 1 (0.97%) Solvency II
System Software
1 8 (7.77%) Docker
Systems Management
1 8 (7.77%) Terraform
2 5 (4.85%) Kubernetes
3 2 (1.94%) Hadoop YARN
4 1 (0.97%) Kubeflow
4 1 (0.97%) Oozie
Vendors
1 18 (17.48%) Databricks
2 12 (11.65%) Microsoft
3 11 (10.68%) Cloudera
4 10 (9.71%) Hortonworks
5 7 (6.80%) Oracle
6 3 (2.91%) Google
6 3 (2.91%) IBM
7 2 (1.94%) Alteryx
7 2 (1.94%) Salesforce Marketing Cloud
7 2 (1.94%) Salesforce.com
8 1 (0.97%) Dataiku
8 1 (0.97%) Informatica
8 1 (0.97%) ServiceNow
8 1 (0.97%) StreamSets
8 1 (0.97%) Sybase