Period
to 27 January 2022

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Data Engineering skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Engineering over the 6 months to 27 January 2022 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineering
Central London > City of London
6 months to
27 Jan 2022
Same period 2021 Same period 2020
Rank 132 103 170
Rank change year-on-year -29 +67 +30
Contract jobs citing Data Engineering 54 29 29
As % of all contract jobs advertised in the City of London 1.34% 1.38% 0.60%
As % of the Processes & Methodologies category 1.48% 1.52% 0.67%
Number of daily rates quoted 43 20 24
10th Percentile £475 £305 £413
25th Percentile £531 £453 £498
Median daily rate (50th Percentile) £575 £581 £550
Median % change year-on-year -1.08% +5.68% -
75th Percentile £675 £676 £616
90th Percentile £722 £693 £675
Central London median daily rate £575 £581 £560
% change year-on-year -1.08% +3.79% +1.82%
Number of hourly rates quoted 0 1 0
Median hourly rate - £36.50 -
Central London median hourly rate - £36.50 -

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for process or methodology skills.

All Process and Methodology Skills
City of London
Contract vacancies with a requirement for process or methodology skills 3,652 1,911 4,335
As % of all contract IT jobs advertised in the City of London 90.96% 90.61% 89.03%
Number of daily rates quoted 2,840 1,443 3,383
10th Percentile £375 £313 £319
25th Percentile £475 £413 £413
Median daily rate (50th Percentile) £550 £525 £513
Median % change year-on-year +4.76% +2.44% -
75th Percentile £657 £602 £613
90th Percentile £750 £688 £688
Central London median daily rate £550 £515 £510
% change year-on-year +6.80% +0.98% -0.49%
Number of hourly rates quoted 36 21 47
10th Percentile £19.13 £13.54 £12.02
25th Percentile £33.19 £17.00 £14.63
Median hourly rate £43.50 £26.50 £20.00
Median % change year-on-year +64.15% +32.50% +5.26%
75th Percentile £61.75 £36.50 £25.76
90th Percentile £64.25 £46.00 £52.25
Central London median hourly rate £43.50 £27.00 £21.00
% change year-on-year +61.11% +28.57% +9.09%

Data Engineering
Job Vacancy Trend in the City of London

Job postings citing Data Engineering as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Data Engineering in the City of London

Data Engineering
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing Data Engineering in the City of London.

Daily rate trend for Data Engineering in the City of London

Data Engineering
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing Data Engineering in the City of London over the 6 months to 27 January 2022.

Daily rate histogram for Data Engineering in the City of London

Data Engineering
Contractor Hourly Rate Trend in the City of London

3-month moving average hourly rates quoted in jobs citing Data Engineering in the City of London.

Hourly rate trend for Data Engineering in the City of London

For the 6 months to 27 January 2022, IT contractor jobs citing Data Engineering also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the City of London region with a requirement for Data Engineering.

1 31 (57.41%) SQL
2 29 (53.70%) AWS
3 25 (46.30%) Big Data
3 25 (46.30%) Python
4 24 (44.44%) Agile Software Development
5 23 (42.59%) Apache Spark
6 22 (40.74%) CI/CD
7 20 (37.04%) ETL
8 19 (35.19%) Data Modelling
8 19 (35.19%) Kafka
9 15 (27.78%) Analytics
10 14 (25.93%) DevOps
10 14 (25.93%) Data Science
10 14 (25.93%) Java
11 13 (24.07%) TDD
12 11 (20.37%) Business Intelligence
12 11 (20.37%) RDBMS
12 11 (20.37%) Git (software)
12 11 (20.37%) Relational Database
13 10 (18.52%) Amazon EMR
13 10 (18.52%) Social Skills
13 10 (18.52%) Hadoop
13 10 (18.52%) Visualisation
13 10 (18.52%) JIRA
13 10 (18.52%) Data Integration
13 10 (18.52%) BDD
13 10 (18.52%) PostgreSQL
14 9 (16.67%) Software Engineering
14 9 (16.67%) C
14 9 (16.67%) NoSQL

Data Engineering
Co-occurring IT Skills in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 23 (42.59%) Apache Spark
2 7 (12.96%) Apache Airflow
3 6 (11.11%) Apache
4 2 (3.70%) Apache Pig
5 1 (1.85%) Confluence
5 1 (1.85%) Jupyter
Applications
1 1 (1.85%) Microsoft PowerPoint
Cloud Services
1 29 (53.70%) AWS
2 10 (18.52%) Amazon EMR
3 9 (16.67%) Azure
4 8 (14.81%) Amazon S3
5 7 (12.96%) GCP
6 5 (9.26%) dbt
7 4 (7.41%) Snowflake
8 3 (5.56%) Amazon ECS
8 3 (5.56%) Amazon Kinesis
8 3 (5.56%) Amazon SQS
8 3 (5.56%) AWS CodeBuild
8 3 (5.56%) AWS CodePipeline
8 3 (5.56%) AWS Fargate
8 3 (5.56%) AWS Lambda
8 3 (5.56%) Datadog
8 3 (5.56%) Matillion
8 3 (5.56%) Serverless
9 2 (3.70%) Google Data Studio
9 2 (3.70%) IaaS
9 2 (3.70%) PaaS
Communications & Networking
1 1 (1.85%) Firewall
1 1 (1.85%) VPN
Database & Business Intelligence
1 25 (46.30%) Big Data
2 11 (20.37%) RDBMS
2 11 (20.37%) Relational Database
3 10 (18.52%) Hadoop
3 10 (18.52%) PostgreSQL
4 9 (16.67%) NoSQL
5 8 (14.81%) Data Warehouse
5 8 (14.81%) MongoDB
6 7 (12.96%) Data Lake
6 7 (12.96%) Parquet
6 7 (12.96%) Tableau
7 6 (11.11%) Data Vault
8 5 (9.26%) BigQuery
9 4 (7.41%) Apache Cassandra
9 4 (7.41%) SQL Server
10 3 (5.56%) Amazon Redshift
10 3 (5.56%) DB2
10 3 (5.56%) Delta Lake
11 2 (3.70%) Amazon Athena
11 2 (3.70%) Presto
Development Applications
1 11 (20.37%) Git (software)
2 10 (18.52%) JIRA
3 7 (12.96%) Jenkins
4 4 (7.41%) GitLab
5 1 (1.85%) Atlassian Bamboo
General
1 10 (18.52%) Social Skills
2 8 (14.81%) Finance
3 7 (12.96%) Analytical Skills
4 5 (9.26%) Financial Institution
4 5 (9.26%) Legal
5 1 (1.85%) Marketing
5 1 (1.85%) Pharmaceutical
5 1 (1.85%) Presentation Skills
5 1 (1.85%) Public Sector
5 1 (1.85%) Publishing
5 1 (1.85%) Wearables
Job Titles
1 22 (40.74%) Data Engineer
2 11 (20.37%) Developer
3 8 (14.81%) Architect
3 8 (14.81%) Senior Data Engineer
4 6 (11.11%) Talend Developer
5 5 (9.26%) Python Developer
5 5 (9.26%) Python Engineer
6 4 (7.41%) Data Architect
6 4 (7.41%) Data Scientist
6 4 (7.41%) DevOps Engineer
6 4 (7.41%) Java Developer
6 4 (7.41%) Java Engineer
6 4 (7.41%) Senior Data Scientist
7 3 (5.56%) Business Intelligence Architect
7 3 (5.56%) Senior DevOps
7 3 (5.56%) Senior DevOps Engineer
8 2 (3.70%) Engineering Manager
8 2 (3.70%) Hadoop Engineer
8 2 (3.70%) Senior Architect
8 2 (3.70%) Technical Product Manager
Libraries, Frameworks & Software Standards
1 19 (35.19%) Kafka
2 6 (11.11%) Apache Avro
2 6 (11.11%) JSON
2 6 (11.11%) XML
3 4 (7.41%) Spark Streaming
3 4 (7.41%) Spring Boot
4 3 (5.56%) SQLAlchemy
5 2 (3.70%) Apache Beam
5 2 (3.70%) Apache Tez
5 2 (3.70%) XSD
6 1 (1.85%) .NET
6 1 (1.85%) MLlib
6 1 (1.85%) Pandas
6 1 (1.85%) pytest
6 1 (1.85%) scikit-learn
Miscellaneous
1 7 (12.96%) Legacy Systems
2 5 (9.26%) Hedge funds
3 4 (7.41%) Algorithms
3 4 (7.41%) Self-Motivation
4 2 (3.70%) Market Risk
5 1 (1.85%) Equities
5 1 (1.85%) Life Science
5 1 (1.85%) NHS
5 1 (1.85%) Taxonomies
Operating Systems
1 2 (3.70%) CentOS
1 2 (3.70%) Linux
1 2 (3.70%) Ubuntu
1 2 (3.70%) Windows
1 2 (3.70%) Windows Server
1 2 (3.70%) Windows Server 2012
Processes & Methodologies
1 24 (44.44%) Agile Software Development
2 22 (40.74%) CI/CD
3 20 (37.04%) ETL
4 19 (35.19%) Data Modelling
5 15 (27.78%) Analytics
6 14 (25.93%) Data Science
6 14 (25.93%) DevOps
7 13 (24.07%) TDD
8 11 (20.37%) Business Intelligence
9 10 (18.52%) BDD
9 10 (18.52%) Data Integration
9 10 (18.52%) Visualisation
10 9 (16.67%) Software Engineering
11 8 (14.81%) Data Pipeline
11 8 (14.81%) SDLC
12 7 (12.96%) Microservices
13 6 (11.11%) Architectural Design
13 6 (11.11%) Computer Science
13 6 (11.11%) Configuration Management
13 6 (11.11%) Scrum
Programming Languages
1 31 (57.41%) SQL
2 25 (46.30%) Python
3 14 (25.93%) Java
4 9 (16.67%) C
5 8 (14.81%) Scala
6 4 (7.41%) C++
7 1 (1.85%) C#
7 1 (1.85%) PowerShell
Qualifications
1 7 (12.96%) Degree
2 4 (7.41%) SC Cleared
2 4 (7.41%) Security Cleared
3 2 (3.70%) Computer Science Degree
4 1 (1.85%) Microsoft Certification
4 1 (1.85%) TOGAF Certification
Quality Assurance & Compliance
1 8 (14.81%) Data Quality
2 5 (9.26%) GDPR
3 2 (3.70%) SLA
System Software
1 5 (9.26%) Docker
2 2 (3.70%) Apache ZooKeeper
Systems Management
1 9 (16.67%) Terraform
2 5 (9.26%) Kubernetes
3 4 (7.41%) Ansible
4 2 (3.70%) Ambari
4 2 (3.70%) Hadoop YARN
4 2 (3.70%) Oozie
Vendors
1 8 (14.81%) Oracle
1 8 (14.81%) Talend
2 6 (11.11%) Cloudera
3 4 (7.41%) Google
4 3 (5.56%) AppDynamics
5 2 (3.70%) Hortonworks
5 2 (3.70%) Microsoft
5 2 (3.70%) Red Hat
5 2 (3.70%) Splunk
5 2 (3.70%) Virgin Media
6 1 (1.85%) Alteryx
6 1 (1.85%) Capita
6 1 (1.85%) Databricks
6 1 (1.85%) Salesforce Marketing Cloud
6 1 (1.85%) Salesforce.com