Period
to 9 December 2019

The median contractor rate for a Data Engineer was £550 per day in advertised job vacancies in London during the 6 months to 9 December 2019.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
England > London
6 months to
9 Dec 2019
Same period 2018 Same period 2017
Rank 137 209 285
Rank change year-on-year +72 +76 +48
Contract jobs requiring a Data Engineer 684 629 441
As % of all contract IT jobs advertised in London 1.99% 1.35% 0.94%
As % of the Job Titles category 2.13% 1.42% 0.99%
Number of daily rates quoted 547 472 345
London median daily rate £550 £550 £500
Median daily rate % change year-on-year - +10.00% -9.09%
10th Percentile £425 £413 £400
90th Percentile £699 £725 £650
England median daily rate £550 £550 £500
% change year-on-year - +10.00% -5.88%
Number of hourly rates quoted 1 4 2
London median hourly rate £52.50 £34.00 £20.50
Median hourly rate % change year-on-year +54.41% +65.85% -30.51%
10th Percentile £51.25 £28.48 £16.10
90th Percentile £53.75 £134.23 £24.90
England median hourly rate £36.00 £34.00 £27.50
% change year-on-year +5.88% +23.64% +111.54%

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in London. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
London
Contract vacancies in London with a recognized job title 32,160 44,226 44,765
% of contract IT jobs with a recognized job title 93.54% 94.83% 94.98%
Number of daily rates quoted 23,063 31,966 32,510
London median daily rate £500 £500 £500
10th Percentile £300 £313 £300
90th Percentile £675 £675 £665
England median daily rate £463 £458 £450
% change year-on-year +1.09% +1.67% +5.88%
Number of hourly rates quoted 476 608 549
London median hourly rate £21.51 £20.00 £20.50
Median hourly rate % change year-on-year +7.56% -2.44% +6.60%
10th Percentile £12.44 £12.75 £12.00
90th Percentile £53.75 £53.75 £47.83
England median hourly rate £19.00 £18.25 £18.70
% change year-on-year +4.11% -2.41% +3.89%

Data Engineer
Job Vacancy Trend in London

Job postings that featured Data Engineer in the job title as a percentage of all IT jobs advertised in London.

Job vacancy trend for Data Engineer in London

Data Engineer
Contractor Daily Rate Trend in London

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Engineer in London.

Contractor daily rate trend for Data Engineer in London

Data Engineer
Contractor Daily Rate Histogram in London

The daily rate distribution of IT jobs citing Data Engineer in London over the 6 months to 9 December 2019.

Contractor daily rate histogram for Data Engineer in London

Data Engineer
Contractor Hourly Rate Trend in London

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Engineer in London.

Contractor hourly rate trend for Data Engineer in London

Data Engineer
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the London region over the 6 months to 9 December 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +43 146 £550 - 82
West London +40 36 £525 +5.00% 21
South London +31 14 £525 - 9
East London +14 6 £525 - 6
Data Engineer
England

Data Engineer Skill Set
Top 30 Co-occurring IT Skills in London

For the 6 months to 9 December 2019, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the London region featuring Data Engineer in the job title.

1 459 (67.11%) Python
2 316 (46.20%) SQL
3 276 (40.35%) AWS
4 270 (39.47%) Apache Spark
5 260 (38.01%) ETL
6 258 (37.72%) Big Data
7 210 (30.70%) Hadoop
8 189 (27.63%) GCP
8 189 (27.63%) Agile Software Development
9 186 (27.19%) Analytics
10 184 (26.90%) Azure
11 183 (26.75%) Data Engineering
12 179 (26.17%) Scala
13 161 (23.54%) Java
14 156 (22.81%) Data Science
15 155 (22.66%) Data Modelling
16 139 (20.32%) Google
16 139 (20.32%) Kafka
17 135 (19.74%) DevOps
18 128 (18.71%) Data Warehouse
19 114 (16.67%) Machine Learning
20 113 (16.52%) Docker
21 108 (15.79%) Finance
22 105 (15.35%) Kubernetes
23 103 (15.06%) Data Lake
24 87 (12.72%) Apache
25 84 (12.28%) NoSQL
26 83 (12.13%) Business Intelligence
27 80 (11.70%) Apache Hive
28 74 (10.82%) BigQuery

Data Engineer Skill Set
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 270 (39.47%) Apache Spark
2 87 (12.72%) Apache
3 62 (9.06%) Apache Airflow
4 17 (2.49%) Jupyter
5 16 (2.34%) Elasticsearch
6 11 (1.61%) Luigi
7 7 (1.02%) SAS
8 6 (0.88%) Pachyderm
9 5 (0.73%) BizTalk Server
9 5 (0.73%) Confluence
10 3 (0.44%) Apache Pig
10 3 (0.44%) SharePoint
11 1 (0.15%) Apache Solr
11 1 (0.15%) Oracle Workflow
Applications
1 17 (2.49%) Microsoft Excel
2 1 (0.15%) InDesign
2 1 (0.15%) Microsoft Office
2 1 (0.15%) Microsoft PowerPoint
2 1 (0.15%) Spreadsheet
Business Applications
1 7 (1.02%) FINCAD Analytics
2 5 (0.73%) SAP Oil and Gas
3 3 (0.44%) Distributed Ledger
4 1 (0.15%) Dynamics CRM
4 1 (0.15%) NetSuite
4 1 (0.15%) PolarLake
Cloud Services
1 276 (40.35%) AWS
2 189 (27.63%) GCP
3 184 (26.90%) Azure
4 57 (8.33%) Amazon S3
5 54 (7.89%) Amazon EMR
6 49 (7.16%) Azure Data Factory
7 48 (7.02%) Power Platform
7 48 (7.02%) Serverless
8 43 (6.29%) Amazon Kinesis
9 40 (5.85%) AWS Lambda
10 30 (4.39%) Amazon EC2
11 29 (4.24%) AWS CloudFormation
12 25 (3.65%) GitHub
13 23 (3.36%) Amazon SQS
14 17 (2.49%) Azure Machine Learning
15 14 (2.05%) Cloud Computing
16 10 (1.46%) AWS Step Functions
16 10 (1.46%) Azure Stack
17 7 (1.02%) Azure Functions
17 7 (1.02%) Virtual Private Cloud
Communications & Networking
1 5 (0.73%) Internet
2 4 (0.58%) Firewall
3 3 (0.44%) LAN
3 3 (0.44%) WAN
4 2 (0.29%) DHCP
4 2 (0.29%) DNS
4 2 (0.29%) F5 BIG-IP GTM
4 2 (0.29%) F5 BIG-IP LTM
5 1 (0.15%) Cisco ASA
5 1 (0.15%) Cisco Firepower
5 1 (0.15%) Cisco IOS
5 1 (0.15%) Cisco Nexus
5 1 (0.15%) Network Security
5 1 (0.15%) Software-Defined Networking
5 1 (0.15%) TACACS
5 1 (0.15%) VoIP
5 1 (0.15%) VPN
Database & Business Intelligence
1 258 (37.72%) Big Data
2 210 (30.70%) Hadoop
3 128 (18.71%) Data Warehouse
4 103 (15.06%) Data Lake
5 84 (12.28%) NoSQL
6 80 (11.70%) Apache Hive
7 74 (10.82%) Amazon Redshift
7 74 (10.82%) BigQuery
8 67 (9.80%) SQL Server
9 61 (8.92%) Relational Database
10 53 (7.75%) PostgreSQL
11 48 (7.02%) Power BI
12 47 (6.87%) Apache Cassandra
13 46 (6.73%) Amazon Athena
14 34 (4.97%) RDBMS
15 30 (4.39%) MongoDB
16 27 (3.95%) Azure SQL Database
16 27 (3.95%) SQL Server Integration Services
17 26 (3.80%) Amazon DynamoDB
17 26 (3.80%) Spark SQL
Development Applications
1 68 (9.94%) Git (software)
2 56 (8.19%) Jenkins
3 19 (2.78%) JIRA
4 13 (1.90%) Visual Studio Team System
5 9 (1.32%) Maven
5 9 (1.32%) ProC
6 6 (0.88%) Selenium
7 5 (0.73%) GitLab
8 4 (0.58%) Artifactory
8 4 (0.58%) Atlassian Bamboo
8 4 (0.58%) Vagrant
8 4 (0.58%) Visual Studio
9 3 (0.44%) ERwin
10 2 (0.29%) Bitbucket
10 2 (0.29%) ER Studio
10 2 (0.29%) Octopus Deploy
11 1 (0.15%) CircleCI
11 1 (0.15%) GoCD
11 1 (0.15%) Sonatype Nexus
11 1 (0.15%) Team Foundation Server
General
1 108 (15.79%) Finance
2 47 (6.87%) Banking
3 29 (4.24%) Retail
4 26 (3.80%) Front Office
5 21 (3.07%) Legal
6 15 (2.19%) Marketing
6 15 (2.19%) Telecoms
7 11 (1.61%) Investment Banking
7 11 (1.61%) Public Sector
8 7 (1.02%) Manufacturing
8 7 (1.02%) Publishing
9 5 (0.73%) Games
10 4 (0.58%) Pharmaceutical
11 3 (0.44%) Corporate Banking
11 3 (0.44%) Electronics
11 3 (0.44%) Retail Banking
12 2 (0.29%) Advertising
12 2 (0.29%) Financial Institution
13 1 (0.15%) Automotive
13 1 (0.15%) Multimedia
Libraries, Frameworks & Software Standards
1 139 (20.32%) Kafka
2 67 (9.80%) PySpark
3 44 (6.43%) Apache Beam
4 39 (5.70%) Pandas
5 35 (5.12%) Spark Streaming
6 28 (4.09%) Web Services
7 22 (3.22%) RESTful
8 19 (2.78%) scikit-learn
9 17 (2.49%) NumPy
10 16 (2.34%) TensorFlow
11 15 (2.19%) REST
12 14 (2.05%) Akka
13 11 (1.61%) J2EE
13 11 (1.61%) JSON
13 11 (1.61%) XML
14 10 (1.46%) Natural Language Processing
14 10 (1.46%) Spring
14 10 (1.46%) Velocity
15 9 (1.32%) Memcached
16 8 (1.17%) Node.js
Miscellaneous
1 47 (6.87%) Data Structures
2 41 (5.99%) Greenfield Project
3 38 (5.56%) Analytical Skills
4 25 (3.65%) Algorithms
5 14 (2.05%) Public Cloud
6 11 (1.61%) User Experience
7 10 (1.46%) Self-Motivation
8 9 (1.32%) Derivative
8 9 (1.32%) Fixed Income
8 9 (1.32%) Linked Data
9 8 (1.17%) Equities
10 7 (1.02%) Hedge funds
11 6 (0.88%) Foreign Exchange (FX)
11 6 (0.88%) Reference Data
12 5 (0.73%) Market Risk
13 4 (0.58%) Equity Derivative
14 3 (0.44%) Blog
14 3 (0.44%) Pricing Data
14 3 (0.44%) Private Cloud
14 3 (0.44%) Semantic Web
Operating Systems
1 37 (5.41%) Linux
2 19 (2.78%) Unix
3 6 (0.88%) VMS
3 6 (0.88%) Windows
4 3 (0.44%) Windows Server
5 1 (0.15%) Red Hat Enterprise Linux
Processes & Methodologies
1 260 (38.01%) ETL
2 189 (27.63%) Agile Software Development
3 186 (27.19%) Analytics
4 183 (26.75%) Data Engineering
5 156 (22.81%) Data Science
6 155 (22.66%) Data Modelling
7 135 (19.74%) DevOps
8 114 (16.67%) Machine Learning
9 83 (12.13%) Business Intelligence
10 67 (9.80%) Migration
11 63 (9.21%) Artificial Intelligence
12 55 (8.04%) Visualisation
13 54 (7.89%) Data Analytics
13 54 (7.89%) Software Engineering
14 49 (7.16%) Data Analysis
14 49 (7.16%) Scrum
15 47 (6.87%) Continuous Integration
16 41 (5.99%) Computer Science
16 41 (5.99%) Data Visualisation
17 39 (5.70%) Fintech
Programming Languages
1 459 (67.11%) Python
2 316 (46.20%) SQL
3 179 (26.17%) Scala
4 161 (23.54%) Java
5 37 (5.41%) C#
6 33 (4.82%) R
7 17 (2.49%) C++
8 16 (2.34%) Go
9 13 (1.90%) JavaScript
10 12 (1.75%) Kotlin
11 11 (1.61%) Bash Shell
11 11 (1.61%) T-SQL
12 9 (1.32%) SHACL
12 9 (1.32%) SPARQL
13 8 (1.17%) PL/SQL
14 7 (1.02%) C
15 6 (0.88%) AWK
15 6 (0.88%) Julia
15 6 (0.88%) sed
16 5 (0.73%) PowerShell
Qualifications
1 52 (7.60%) Degree
2 25 (3.65%) Master's Degree
3 20 (2.92%) Computer Science Degree
4 16 (2.34%) Security Cleared
5 15 (2.19%) SC Cleared
6 5 (0.73%) PMI Certification
6 5 (0.73%) PMP
7 4 (0.58%) AWS Certification
7 4 (0.58%) Cisco Certification
8 3 (0.44%) Postgraduate
9 2 (0.29%) CCENT
9 2 (0.29%) CCIE
9 2 (0.29%) CCNA
9 2 (0.29%) CCNP
9 2 (0.29%) DBS Check
9 2 (0.29%) DV Cleared
10 1 (0.15%) ITIL Foundation Certificate
10 1 (0.15%) Microsoft Certification
10 1 (0.15%) Numerate Degree
Quality Assurance & Compliance
1 11 (1.61%) Data Quality
2 8 (1.17%) GDPR
3 5 (0.73%) QA
System Software
1 113 (16.52%) Docker
2 22 (3.22%) HDFS
3 3 (0.44%) Active Directory
3 3 (0.44%) Apache Flume
3 3 (0.44%) Virtual Servers
4 2 (0.29%) VirtualBox
5 1 (0.15%) Apache ZooKeeper
5 1 (0.15%) VMware Infrastructure
Systems Management
1 105 (15.35%) Kubernetes
2 53 (7.75%) Terraform
3 23 (3.36%) Ansible
4 22 (3.22%) Hadoop YARN
5 11 (1.61%) Kubeflow
6 9 (1.32%) Istio
6 9 (1.32%) linkerd
7 8 (1.17%) Oozie
8 4 (0.58%) Kibana
9 2 (0.29%) Docker Swarm
9 2 (0.29%) FortiGate
9 2 (0.29%) Packer
9 2 (0.29%) Prometheus
10 1 (0.15%) Ambari
10 1 (0.15%) Cisco CUCM
10 1 (0.15%) ITRS Geneos
10 1 (0.15%) logstash
10 1 (0.15%) Opscode Chef
10 1 (0.15%) Thomson Reuters DACS
Vendors
1 139 (20.32%) Google
2 59 (8.63%) Microsoft
3 55 (8.04%) Databricks
4 52 (7.60%) Oracle
5 41 (5.99%) Tableau
6 34 (4.97%) Cloudera
7 31 (4.53%) Informatica
8 28 (4.09%) Talend
9 24 (3.51%) SAP
10 19 (2.78%) Alteryx
11 18 (2.63%) Teradata
12 17 (2.49%) Hortonworks
13 11 (1.61%) Sybase
14 9 (1.32%) MapR
14 9 (1.32%) Palantir
14 9 (1.32%) StreamSets
15 7 (1.02%) Foundry
16 6 (0.88%) Ab Initio
17 5 (0.73%) Cisco
17 5 (0.73%) IBM