Period
to 10 July 2020

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Engineering skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Engineering over the 6 months to 10 July 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineering
England > London
6 months to
10 Jul 2020
Same period 2019 Same period 2018
Rank 199 278 426
Rank change year-on-year +79 +148 +123
Contract jobs citing Data Engineering 214 390 219
As % of all contract jobs advertised in London 1.22% 0.94% 0.47%
As % of the Processes & Methodologies category 1.38% 1.06% 0.53%
Number of daily rates quoted 148 316 169
Median daily rate £550 £525 £550
Median daily rate % change year-on-year +4.76% -4.55% -
10th Percentile £394 £417 £419
90th Percentile £725 £675 £675
England median daily rate £525 £525 £525
Number of hourly rates quoted 2 0 0
Median hourly rate £35.00 - -
England median hourly rate £35.00 £52.50 -
% change year-on-year -33.33% - -

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for process or methodology skills.

All Process and Methodology Skills
London
Contract vacancies with a requirement for process or methodology skills 15,563 36,848 41,166
As % of all contract IT jobs advertised in London 88.75% 88.81% 88.54%
Number of daily rates quoted 10,631 26,356 29,808
Median daily rate £525 £520 £500
Median daily rate % change year-on-year +0.96% +4.00% +4.17%
10th Percentile £329 £340 £325
90th Percentile £713 £688 £675
England median daily rate £480 £475 £463
% change year-on-year +1.05% +2.70% +2.78%
Number of hourly rates quoted 263 434 562
Median hourly rate £35.00 £24.29 £24.09
Median hourly rate % change year-on-year +44.09% +0.83% -2.31%
10th Percentile £15.95 £12.75 £14.00
90th Percentile £54.80 £53.75 £52.50
Median hourly rate £31.94 £24.91 £22.00
% change year-on-year +28.22% +13.23% -12.00%

Data Engineering
Job Vacancy Trend in London

Job postings citing Data Engineering as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Engineering in London

Data Engineering
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Data Engineering in London.

Daily rate trend for Data Engineering in London

Data Engineering
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Engineering in London over the 6 months to 10 July 2020.

Daily rate histogram for Data Engineering in London

Data Engineering
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Data Engineering in London.

Hourly rate trend for Data Engineering in London

Data Engineering
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineering within the London region over the 6 months to 10 July 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +41 30 £550 +4.76% 12
West London +49 11 £628 +4.58% 1
South London +45 9 £500 -5.72% 1
East London +51 8 £555 -17.78%
Data Engineering
England

For the 6 months to 10 July 2020, IT contractor jobs citing Data Engineering also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region with a requirement for Data Engineering.

1 118 (55.14%) Python
2 96 (44.86%) Agile Software Development
3 88 (41.12%) SQL
4 86 (40.19%) DevOps
5 80 (37.38%) AWS
6 70 (32.71%) Big Data
7 69 (32.24%) ETL
8 66 (30.84%) Analytics
9 62 (28.97%) Azure
10 60 (28.04%) Finance
11 58 (27.10%) Data Science
12 51 (23.83%) Business Intelligence
12 51 (23.83%) Java
13 50 (23.36%) Git (software)
14 46 (21.50%) Software Engineering
14 46 (21.50%) Data Warehouse
14 46 (21.50%) Docker
15 44 (20.56%) NoSQL
16 41 (19.16%) GCP
17 39 (18.22%) Kubernetes
18 38 (17.76%) Continuous Integration
19 37 (17.29%) Linux
19 37 (17.29%) Apache Spark
19 37 (17.29%) Kafka
20 35 (16.36%) Jenkins
20 35 (16.36%) Microsoft
21 34 (15.89%) Scrum
21 34 (15.89%) Terraform
22 32 (14.95%) Serverless
23 31 (14.49%) Data Modelling

Data Engineering
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 37 (17.29%) Apache Spark
2 15 (7.01%) SAS
3 10 (4.67%) WebLogic
4 8 (3.74%) Confluence
4 8 (3.74%) Elasticsearch
5 7 (3.27%) Apache
5 7 (3.27%) Apache Airflow
6 6 (2.80%) SharePoint
7 3 (1.40%) Jupyter
8 2 (0.93%) IIS
9 1 (0.47%) IBM Domino
9 1 (0.47%) Luigi
9 1 (0.47%) OpenStack
9 1 (0.47%) WebSphere
9 1 (0.47%) WebSphere Application Server
Applications
1 2 (0.93%) Microsoft Excel
2 1 (0.47%) MS Visio
Business Applications
1 1 (0.47%) FINCAD Analytics
1 1 (0.47%) Magento
1 1 (0.47%) NetSuite
1 1 (0.47%) Shopify
Cloud Services
1 80 (37.38%) AWS
2 62 (28.97%) Azure
3 41 (19.16%) GCP
4 32 (14.95%) Serverless
5 29 (13.55%) Amazon S3
6 26 (12.15%) AWS Lambda
7 24 (11.21%) Azure Data Factory
8 23 (10.75%) Power Platform
9 17 (7.94%) Amazon EC2
10 12 (5.61%) Amazon EMR
11 10 (4.67%) Amazon Kinesis
11 10 (4.67%) Amazon SQS
12 8 (3.74%) AWS CloudFormation
12 8 (3.74%) AWS Step Functions
13 7 (3.27%) Amazon Glacier
14 6 (2.80%) PaaS
15 3 (1.40%) Virtual Private Cloud
16 2 (0.93%) Cloud Computing
16 2 (0.93%) IaaS
16 2 (0.93%) SaaS
Communications & Networking
1 9 (4.21%) HTTP
2 8 (3.74%) Firewall
3 5 (2.34%) HTTPS
3 5 (2.34%) Skype
3 5 (2.34%) SSL
4 4 (1.87%) Kerberos
5 3 (1.40%) DNS
5 3 (1.40%) Internet
5 3 (1.40%) VPN
Database & Business Intelligence
1 70 (32.71%) Big Data
2 46 (21.50%) Data Warehouse
3 44 (20.56%) NoSQL
4 26 (12.15%) Hadoop
5 24 (11.21%) SQL Server
6 23 (10.75%) Power BI
7 21 (9.81%) Data Lake
8 20 (9.35%) Pentaho
9 19 (8.88%) MongoDB
10 18 (8.41%) Azure SQL Database
11 17 (7.94%) Amazon Redshift
12 15 (7.01%) Amazon Athena
12 15 (7.01%) Amazon DynamoDB
13 14 (6.54%) Looker
14 13 (6.07%) Apache Hive
14 13 (6.07%) Azure SQL Data Warehouse
14 13 (6.07%) Relational Database
15 12 (5.61%) Amazon RDS
15 12 (5.61%) PostgreSQL
16 11 (5.14%) SAS Data Integration Studio
Development Applications
1 50 (23.36%) Git (software)
2 35 (16.36%) Jenkins
3 18 (8.41%) GitLab
4 12 (5.61%) JIRA
5 9 (4.21%) Subversion
6 5 (2.34%) Bitbucket
7 4 (1.87%) Selenium
8 3 (1.40%) Postman
9 2 (0.93%) Jasmine
9 2 (0.93%) Karma Test Runner
9 2 (0.93%) Maven
9 2 (0.93%) Mocha
9 2 (0.93%) TestLink
9 2 (0.93%) Visual Studio Team System
10 1 (0.47%) Atlassian Bamboo
10 1 (0.47%) JUnit
General
1 60 (28.04%) Finance
2 12 (5.61%) Retail
3 11 (5.14%) Banking
4 9 (4.21%) Front Office
5 8 (3.74%) Public Sector
6 4 (1.87%) Games
6 4 (1.87%) Legal
6 4 (1.87%) Marketing
7 2 (0.93%) Financial Institution
7 2 (0.93%) Manufacturing
7 2 (0.93%) Telecoms
8 1 (0.47%) Billing
8 1 (0.47%) Electronics
8 1 (0.47%) Investment Banking
8 1 (0.47%) Military
8 1 (0.47%) Publishing
Job Titles
1 95 (44.39%) Data Engineer
2 34 (15.89%) AWS Engineer
3 33 (15.42%) Developer
4 27 (12.62%) Azure Engineer
5 24 (11.21%) Python Engineer
6 23 (10.75%) DevOps Engineer
7 20 (9.35%) Architect
8 17 (7.94%) Senior DevOps
9 16 (7.48%) Cloud Engineer
10 15 (7.01%) Software Engineer
11 14 (6.54%) Python Developer
11 14 (6.54%) Senior DevOps Engineer
12 12 (5.61%) Big Data Engineer
13 10 (4.67%) Data Architect
13 10 (4.67%) Senior Data Engineer
14 8 (3.74%) AWS DevOps
14 8 (3.74%) AWS DevOps Engineer
14 8 (3.74%) Django Developer
14 8 (3.74%) Python/Django Developer
15 7 (3.27%) Head of Engineering
Libraries, Frameworks & Software Standards
1 37 (17.29%) Kafka
2 19 (8.88%) React
3 17 (7.94%) .NET
4 16 (7.48%) REST
5 14 (6.54%) Django
6 12 (5.61%) AngularJS
6 12 (5.61%) HTML
7 10 (4.67%) CSS
7 10 (4.67%) Web Services
8 9 (4.21%) Backbone.js
8 9 (4.21%) Pandas
8 9 (4.21%) PySpark
9 8 (3.74%) NumPy
9 8 (3.74%) SOAP
10 7 (3.27%) .NET Framework
10 7 (3.27%) scikit-learn
11 6 (2.80%) SAML
12 5 (2.34%) OAuth
12 5 (2.34%) RESTful
12 5 (2.34%) XML
Miscellaneous
1 18 (8.41%) Analytical Skills
2 14 (6.54%) Data Structures
3 13 (6.07%) Greenfield Project
4 11 (5.14%) User Experience
5 10 (4.67%) Algorithms
6 8 (3.74%) Linux Command Line
7 7 (3.27%) Blog
7 7 (3.27%) Fixed Income
8 6 (2.80%) Derivative
9 5 (2.34%) Cloud Native
9 5 (2.34%) FMCG
9 5 (2.34%) Management Information System
9 5 (2.34%) Self-Motivation
10 4 (1.87%) Data Centre
10 4 (1.87%) Enterprise Software
10 4 (1.87%) Hedge funds
10 4 (1.87%) Mobile App
10 4 (1.87%) Private Cloud
11 3 (1.40%) Hybrid Cloud
12 2 (0.93%) Public Cloud
Operating Systems
1 37 (17.29%) Linux
2 21 (9.81%) Unix
3 3 (1.40%) Windows
4 1 (0.47%) Apple iOS
Processes & Methodologies
1 96 (44.86%) Agile Software Development
2 86 (40.19%) DevOps
3 69 (32.24%) ETL
4 66 (30.84%) Analytics
5 58 (27.10%) Data Science
6 51 (23.83%) Business Intelligence
7 46 (21.50%) Software Engineering
8 38 (17.76%) Continuous Integration
9 34 (15.89%) Scrum
10 31 (14.49%) Data Modelling
10 31 (14.49%) Machine Learning
11 29 (13.55%) Open Source
12 26 (12.15%) Mentoring
13 24 (11.21%) Infrastructure as Code
14 22 (10.28%) Data Analytics
14 22 (10.28%) TDD
14 22 (10.28%) Visualisation
15 21 (9.81%) Artificial Intelligence
16 20 (9.35%) Test Automation
17 18 (8.41%) Data Architecture
Programming Languages
1 118 (55.14%) Python
2 88 (41.12%) SQL
3 51 (23.83%) Java
4 30 (14.02%) C#
5 27 (12.62%) Scala
6 22 (10.28%) JavaScript
7 12 (5.61%) PL/SQL
8 11 (5.14%) Go
8 11 (5.14%) R
9 10 (4.67%) Bash Shell
9 10 (4.67%) SAS Macro
9 10 (4.67%) Shell Script
10 9 (4.21%) Perl
11 8 (3.74%) T-SQL
11 8 (3.74%) TypeScript
12 7 (3.27%) C++
13 5 (2.34%) Ruby
14 4 (1.87%) PowerShell
15 3 (1.40%) CQL
16 2 (0.93%) C
Qualifications
1 17 (7.94%) Degree
2 12 (5.61%) Security Cleared
3 11 (5.14%) SC Cleared
4 3 (1.40%) AWS Certification
4 3 (1.40%) PhD
4 3 (1.40%) TOGAF Certification
5 1 (0.47%) APMP
5 1 (0.47%) BPSS Clearance
5 1 (0.47%) Computer Science Degree
5 1 (0.47%) DV Cleared
5 1 (0.47%) MBA
5 1 (0.47%) Numerate Degree
Quality Assurance & Compliance
1 12 (5.61%) QA
2 4 (1.87%) Data Quality
2 4 (1.87%) GDPR
3 2 (0.93%) ISO/IEC 27001
4 1 (0.47%) COBIT
4 1 (0.47%) SLA
System Software
1 46 (21.50%) Docker
2 7 (3.27%) Virtual Machines
3 4 (1.87%) HDFS
4 3 (1.40%) VMware Infrastructure
5 1 (0.47%) Apache Flume
Systems Management
1 39 (18.22%) Kubernetes
2 34 (15.89%) Terraform
3 17 (7.94%) Ansible
4 5 (2.34%) Opscode Chef
5 4 (1.87%) Hadoop YARN
5 4 (1.87%) Oozie
5 4 (1.87%) Single Sign-On
6 3 (1.40%) Ambari
6 3 (1.40%) Grafana
7 2 (0.93%) HP ALM
7 2 (0.93%) Kibana
7 2 (0.93%) Puppet
Vendors
1 35 (16.36%) Microsoft
2 24 (11.21%) Google
3 21 (9.81%) Databricks
3 21 (9.81%) Tableau
4 20 (9.35%) Oracle
5 19 (8.88%) Informatica
6 11 (5.14%) Talend
7 8 (3.74%) Cloudera
8 6 (2.80%) Alteryx
8 6 (2.80%) SAP
9 5 (2.34%) Teradata
10 4 (1.87%) Bloomberg
10 4 (1.87%) Hortonworks
11 3 (1.40%) Birst
11 3 (1.40%) Splunk
11 3 (1.40%) Sybase
11 3 (1.40%) VMware
12 2 (0.93%) HP
12 2 (0.93%) MicroStrategy
12 2 (0.93%) Salesforce.com