Period
to 27 October 2021

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Engineering skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Engineering over the 6 months to 27 October 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineering
England > London
6 months to
27 Oct 2021
Same period 2020 Same period 2019
Rank 172 206 236
Rank change year-on-year +34 +30 +229
Contract jobs citing Data Engineering 606 164 411
As % of all contract jobs advertised in London 1.68% 1.15% 1.13%
As % of the Processes & Methodologies category 1.84% 1.28% 1.27%
Number of daily rates quoted 417 124 342
10th Percentile £413 £400 £425
25th Percentile £500 £450 £496
Median daily rate (50th Percentile) £580 £550 £550
Median % change year-on-year +5.45% - -
75th Percentile £675 £626 £619
90th Percentile £750 £675 £719
England median daily rate £575 £525 £550
% change year-on-year +9.52% -4.55% +4.76%
Number of hourly rates quoted 5 0 0
Median hourly rate £8.00 - -
England median hourly rate £25.50 £21.50 £52.50
% change year-on-year +18.60% -59.05% -

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for process or methodology skills.

All Process and Methodology Skills
London
Contract vacancies with a requirement for process or methodology skills 33,012 12,770 32,403
As % of all contract IT jobs advertised in London 91.29% 89.21% 88.88%
Number of daily rates quoted 23,892 9,204 23,738
10th Percentile £369 £320 £325
25th Percentile £463 £413 £413
Median daily rate (50th Percentile) £550 £505 £513
Median % change year-on-year +8.91% -1.46% +2.50%
75th Percentile £650 £613 £600
90th Percentile £738 £713 £688
England median daily rate £525 £475 £475
% change year-on-year +10.53% - +1.50%
Number of hourly rates quoted 296 108 373
10th Percentile £15.37 £14.85 £12.04
25th Percentile £20.75 £20.00 £15.60
Median hourly rate £35.00 £34.13 £22.50
Median % change year-on-year +2.56% +51.67% +12.50%
75th Percentile £53.75 £42.25 £44.97
90th Percentile £68.25 £52.88 £52.90
England median hourly rate £24.18 £25.00 £22.50
% change year-on-year -3.30% +11.11% +12.50%

Data Engineering
Job Vacancy Trend in London

Job postings citing Data Engineering as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Engineering in London

Data Engineering
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Data Engineering in London.

Daily rate trend for Data Engineering in London

Data Engineering
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Engineering in London over the 6 months to 27 October 2021.

Daily rate histogram for Data Engineering in London

Data Engineering
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Data Engineering in London.

Hourly rate trend for Data Engineering in London

Data Engineering
Hourly Rate Histogram in London

Hourly rate distribution of jobs citing Data Engineering in London over the 6 months to 27 October 2021.

Hourly rate histogram for Data Engineering in London

Data Engineering
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineering within the London region over the 6 months to 27 October 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London -14 62 £575 +4.55% 35
South London +10 16 £573 +9.05% 3
West London -21 5 £570 -9.52% 8
Data Engineering
England

For the 6 months to 27 October 2021, IT contractor jobs citing Data Engineering also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Data Engineering.

1 362 (59.74%) Python
2 329 (54.29%) SQL
3 254 (41.91%) Azure
4 223 (36.80%) Agile Software Development
5 220 (36.30%) AWS
6 205 (33.83%) Analytics
7 174 (28.71%) ETL
8 166 (27.39%) Data Warehouse
9 154 (25.41%) Apache Spark
10 144 (23.76%) Social Skills
11 143 (23.60%) Business Intelligence
12 138 (22.77%) Finance
13 134 (22.11%) Big Data
14 132 (21.78%) Data Modelling
14 132 (21.78%) Data Pipeline
14 132 (21.78%) Data Science
15 131 (21.62%) DevOps
16 114 (18.81%) Java
17 113 (18.65%) Scala
18 112 (18.48%) GCP
19 109 (17.99%) Databricks
20 99 (16.34%) Data Lake
21 95 (15.68%) Machine Learning
22 93 (15.35%) Kafka
23 92 (15.18%) Kubernetes
24 91 (15.02%) Serverless
24 91 (15.02%) Visualisation
25 89 (14.69%) Software Engineering
26 88 (14.52%) Power Platform
27 86 (14.19%) Power BI

Data Engineering
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 154 (25.41%) Apache Spark
2 60 (9.90%) Apache Airflow
3 53 (8.75%) Apache
4 26 (4.29%) BizTalk Server
5 12 (1.98%) Confluence
6 10 (1.65%) Tomcat
7 9 (1.49%) Luigi
8 6 (0.99%) SharePoint
9 4 (0.66%) Apache Pig
10 3 (0.50%) ArcGIS
10 3 (0.50%) Cloud Foundry
10 3 (0.50%) Jetty
10 3 (0.50%) WebSphere
11 2 (0.33%) Hyperledger
11 2 (0.33%) Jupyter
11 2 (0.33%) R Markdown
11 2 (0.33%) SAS
12 1 (0.17%) Elasticsearch
12 1 (0.17%) TPMS
Applications
1 10 (1.65%) Microsoft Excel
2 1 (0.17%) Microsoft PowerPoint
Business Applications
1 4 (0.66%) SAP Oil and Gas
2 2 (0.33%) Refinitiv Enterprise Platform
3 1 (0.17%) Dynamics AX
3 1 (0.17%) Dynamics CRM
Cloud Services
1 254 (41.91%) Azure
2 220 (36.30%) AWS
3 112 (18.48%) GCP
4 91 (15.02%) Serverless
5 88 (14.52%) Power Platform
6 82 (13.53%) Azure Data Factory
7 66 (10.89%) Azure Functions
8 48 (7.92%) AWS Lambda
9 41 (6.77%) Azure Cosmos DB
10 40 (6.60%) Azure Synapse Analytics
11 38 (6.27%) Amazon S3
12 36 (5.94%) GitHub
13 31 (5.12%) Snowflake
14 27 (4.46%) Amazon EMR
14 27 (4.46%) Azure Logic Apps
14 27 (4.46%) Azure Storage
15 19 (3.14%) Azure Stack
16 17 (2.81%) Dialogflow
16 17 (2.81%) PaaS
17 15 (2.48%) Amazon EC2
Communications & Networking
1 3 (0.50%) OpenVPN
2 2 (0.33%) FTP
2 2 (0.33%) HTTP
2 2 (0.33%) SSH
2 2 (0.33%) TCP/IP
2 2 (0.33%) VPN
2 2 (0.33%) WAN
3 1 (0.17%) DHCP
3 1 (0.17%) DNS
3 1 (0.17%) HTTPS
3 1 (0.17%) IPv4
3 1 (0.17%) IPv6
3 1 (0.17%) LAN
3 1 (0.17%) Network Security
3 1 (0.17%) SMTP
3 1 (0.17%) SNMP
3 1 (0.17%) tcpdump
Database & Business Intelligence
1 166 (27.39%) Data Warehouse
2 134 (22.11%) Big Data
3 99 (16.34%) Data Lake
4 86 (14.19%) Power BI
5 76 (12.54%) NoSQL
6 73 (12.05%) Hadoop
7 61 (10.07%) Azure SQL Database
8 60 (9.90%) BigQuery
9 59 (9.74%) Tableau
10 52 (8.58%) SQL Server
11 48 (7.92%) MongoDB
12 43 (7.10%) Relational Database
13 37 (6.11%) PostgreSQL
14 35 (5.78%) Apache Hive
15 32 (5.28%) Metadata
16 28 (4.62%) RDBMS
16 28 (4.62%) SQL Server Integration Services
17 25 (4.13%) Amazon Redshift
18 22 (3.63%) Amazon DynamoDB
19 21 (3.47%) Amazon RDS
Development Applications
1 62 (10.23%) Git (software)
2 41 (6.77%) Jenkins
3 26 (4.29%) JIRA
4 11 (1.82%) GitLab
4 11 (1.82%) SpecFlow
5 10 (1.65%) Cucumber
6 7 (1.16%) Team Foundation Server
7 6 (0.99%) JUnit
8 5 (0.83%) Maven
9 4 (0.66%) Bitbucket
9 4 (0.66%) JMeter
9 4 (0.66%) MLflow
9 4 (0.66%) Selenium
9 4 (0.66%) Travis CI
9 4 (0.66%) Visual Studio Team System
9 4 (0.66%) WebDriver
10 3 (0.50%) Artifactory
10 3 (0.50%) Mockito
10 3 (0.50%) SonarQube
11 2 (0.33%) ProC
General
1 144 (23.76%) Social Skills
2 138 (22.77%) Finance
3 77 (12.71%) Analytical Skills
4 35 (5.78%) Presentation Skills
5 28 (4.62%) Banking
6 22 (3.63%) Public Sector
7 21 (3.47%) Marketing
8 19 (3.14%) Back Office
8 19 (3.14%) Retail
9 15 (2.48%) Front Office
10 12 (1.98%) Legal
10 12 (1.98%) Pharmaceutical
11 11 (1.82%) Publishing
12 9 (1.49%) Investment Banking
13 7 (1.16%) Influencing Skills
14 6 (0.99%) Law
15 5 (0.83%) Aerospace
15 5 (0.83%) Financial Institution
16 3 (0.50%) Electronics
16 3 (0.50%) Manufacturing
Job Titles
1 282 (46.53%) Data Engineer
2 84 (13.86%) Developer
3 69 (11.39%) Senior Data Engineer
4 62 (10.23%) Architect
5 52 (8.58%) Azure Engineer
6 42 (6.93%) Data Architect
7 40 (6.60%) AWS Engineer
8 38 (6.27%) Analyst
9 32 (5.28%) Python Engineer
10 24 (3.96%) Python Developer
11 23 (3.80%) Data Analyst
12 22 (3.63%) Azure Developer
13 20 (3.30%) C# Developer
14 19 (3.14%) Data Scientist
15 18 (2.97%) Business Intelligence Developer
15 18 (2.97%) Energy Trading Developer
16 16 (2.64%) Cloud Engineer
17 15 (2.48%) DevOps Engineer
18 12 (1.98%) Cloud Architect
19 11 (1.82%) Machine Learning Engineer
Libraries, Frameworks & Software Standards
1 93 (15.35%) Kafka
2 35 (5.78%) PySpark
3 31 (5.12%) .NET
4 20 (3.30%) .NET Core
5 18 (2.97%) Spring
6 15 (2.48%) Velocity
7 14 (2.31%) React
7 14 (2.31%) REST
8 12 (1.98%) Spark Streaming
8 12 (1.98%) Spring Boot
9 11 (1.82%) Pandas
10 10 (1.65%) Apache Beam
10 10 (1.65%) pytest
11 9 (1.49%) AngularJS
12 8 (1.32%) Node.js
12 8 (1.32%) RESTful
12 8 (1.32%) XML
13 7 (1.16%) GraphQL
13 7 (1.16%) TensorFlow
14 6 (0.99%) ARM Templates
Miscellaneous
1 40 (6.60%) Cloud Native
2 37 (6.11%) Legacy Systems
3 31 (5.12%) Algorithms
4 20 (3.30%) Data Structures
5 16 (2.64%) Tandem
6 12 (1.98%) Management Information System
6 12 (1.98%) Self-Motivation
7 10 (1.65%) iPad
7 10 (1.65%) Market Risk
8 9 (1.49%) Reference Data
8 9 (1.49%) Virtual Team
9 8 (1.32%) FMCG
9 8 (1.32%) Renewable Energy
10 7 (1.16%) Data Centre
10 7 (1.16%) Hedge funds
11 6 (0.99%) Enterprise Software
11 6 (0.99%) Greenfield Project
11 6 (0.99%) User Experience
12 5 (0.83%) Data Protection Act
13 4 (0.66%) Life Science
Operating Systems
1 26 (4.29%) Linux
2 22 (3.63%) Windows
3 12 (1.98%) Unix
4 3 (0.50%) zOS
5 1 (0.17%) Apple iOS
Processes & Methodologies
1 223 (36.80%) Agile Software Development
2 205 (33.83%) Analytics
3 174 (28.71%) ETL
4 143 (23.60%) Business Intelligence
5 132 (21.78%) Data Modelling
5 132 (21.78%) Data Pipeline
5 132 (21.78%) Data Science
6 131 (21.62%) DevOps
7 95 (15.68%) Machine Learning
8 91 (15.02%) Visualisation
9 89 (14.69%) Software Engineering
10 76 (12.54%) Scrum
11 65 (10.73%) Artificial Intelligence
12 63 (10.40%) Data Architecture
12 63 (10.40%) Microservices
13 55 (9.08%) Migration
14 53 (8.75%) Data Analytics
14 53 (8.75%) Test Automation
15 51 (8.42%) Data Visualisation
16 47 (7.76%) TDD
Programming Languages
1 362 (59.74%) Python
2 329 (54.29%) SQL
3 114 (18.81%) Java
4 113 (18.65%) Scala
5 41 (6.77%) C++
5 41 (6.77%) T-SQL
6 39 (6.44%) C#
6 39 (6.44%) PL/SQL
7 32 (5.28%) Go
8 27 (4.46%) R
9 16 (2.64%) Bash Shell
10 13 (2.15%) C
10 13 (2.15%) PowerShell
11 11 (1.82%) Data Analysis Expressions (DAX)
11 11 (1.82%) JavaScript
12 10 (1.65%) Ruby
13 7 (1.16%) TypeScript
13 7 (1.16%) VBA
14 5 (0.83%) Groovy
15 3 (0.50%) ANSI SQL
Qualifications
1 69 (11.39%) Degree
2 35 (5.78%) Security Cleared
3 26 (4.29%) SC Cleared
4 19 (3.14%) Computer Science Degree
5 17 (2.81%) PhD
6 14 (2.31%) AWS Certification
7 9 (1.49%) BPSS Clearance
7 9 (1.49%) Numerate Degree
8 7 (1.16%) ISTQB
8 7 (1.16%) Master's Degree
9 4 (0.66%) ISTQB Foundation Certification
10 2 (0.33%) DV Cleared
10 2 (0.33%) ISEB
10 2 (0.33%) TOGAF Certification
11 1 (0.17%) CCA
11 1 (0.17%) ITIL Certification
11 1 (0.17%) Microsoft Certification
11 1 (0.17%) Tableau Certification
Quality Assurance & Compliance
1 60 (9.90%) Data Quality
2 37 (6.11%) QA
3 11 (1.82%) IFRS
4 9 (1.49%) GDPR
5 4 (0.66%) Accessibility
6 2 (0.33%) MiFID
7 1 (0.17%) COBIT
7 1 (0.17%) NIST
7 1 (0.17%) PMO
System Software
1 38 (6.27%) Docker
2 3 (0.50%) HDFS
3 1 (0.17%) Active Directory
3 1 (0.17%) Apache ZooKeeper
Systems Management
1 92 (15.18%) Kubernetes
2 58 (9.57%) Terraform
3 11 (1.82%) Ansible
4 7 (1.16%) Kubeflow
5 5 (0.83%) Rancher
6 4 (0.66%) Hadoop YARN
6 4 (0.66%) Opscode Chef
6 4 (0.66%) Puppet
7 3 (0.50%) Oozie
7 3 (0.50%) Sysdig
8 2 (0.33%) ITRS Geneos
9 1 (0.17%) Control-M
9 1 (0.17%) Kibana
9 1 (0.17%) logstash
9 1 (0.17%) Prometheus
Vendors
1 109 (17.99%) Databricks
2 75 (12.38%) Google
3 72 (11.88%) Microsoft
4 60 (9.90%) Oracle
5 28 (4.62%) MuleSoft
6 21 (3.47%) Informatica
7 13 (2.15%) Alteryx
8 12 (1.98%) Cloudera
9 11 (1.82%) Salesforce.com
10 10 (1.65%) AppDynamics
10 10 (1.65%) Splunk
11 9 (1.49%) SAP
12 8 (1.32%) Talend
13 7 (1.16%) Dataiku
14 5 (0.83%) Atlassian
15 4 (0.66%) BiZZdesign
16 3 (0.50%) Confluent
16 3 (0.50%) Hortonworks
16 3 (0.50%) Salesforce Marketing Cloud
16 3 (0.50%) Twitter