Period
to 18 May 2021

The median contractor rate for a Data Engineer was £525 per day in advertised job vacancies in England during the 6 months to 18 May 2021.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
UK > England
6 months to
18 May 2021
Same period 2020 Same period 2019
Rank 118 161 194
Rank change year-on-year +43 +33 +114
Contract jobs requiring a Data Engineer 994 743 1,289
As % of all contract jobs advertised in England 2.18% 1.68% 1.53%
As % of the Job Titles category 2.35% 1.79% 1.62%
Number of daily rates quoted 725 536 919
10th Percentile £400 £391 £413
25th Percentile £450 £425 £467
Median daily rate (50th Percentile) £525 £505 £525
Median % change year-on-year +3.96% -3.81% -3.00%
75th Percentile £600 £588 £600
90th Percentile £660 £669 £675
UK median daily rate £525 £500 £525
% change year-on-year +5.00% -4.76% -
Number of hourly rates quoted 11 2 66
Median hourly rate £38.00 £41.25 £15.00
Median % change year-on-year -7.88% +175.00% -79.31%
UK median hourly rate £37.50 £26.50 £15.00
% change year-on-year +41.51% +76.67% -79.31%

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in England. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
England
Contract vacancies in England with a recognized job title 42,261 41,596 79,538
% of contract IT jobs with a recognized job title 92.80% 93.88% 94.65%
Number of daily rates quoted 29,215 28,024 53,967
10th Percentile £288 £250 £275
25th Percentile £388 £363 £375
Median daily rate (50th Percentile) £488 £475 £475
Median % change year-on-year +2.63% - +5.56%
75th Percentile £588 £575 £575
90th Percentile £675 £659 £650
UK median daily rate £475 £463 £473
% change year-on-year +2.70% -2.22% +5.11%
Number of hourly rates quoted 1,431 1,497 2,333
10th Percentile £11.40 £11.63 £11.00
25th Percentile £14.26 £14.00 £13.25
Median hourly rate £21.50 £19.00 £18.50
Median % change year-on-year +13.16% +2.70% +5.68%
75th Percentile £43.75 £37.50 £40.75
90th Percentile £56.50 £51.75 £50.00
UK median hourly rate £22.42 £19.00 £18.00
% change year-on-year +18.00% +5.56% +2.86%

Data Engineer
Job Vacancy Trend in England

Job postings that featured Data Engineer in the job title as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Engineer in England

Data Engineer
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Data Engineer in England.

Daily rate trend for Data Engineer in England

Data Engineer
Daily Rate Histogram in England

Daily rate distribution for jobs citing Data Engineer in England over the 6 months to 18 May 2021.

Daily rate histogram for Data Engineer in England

Data Engineer
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Data Engineer in England.

Hourly rate trend for Data Engineer in England

Data Engineer
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Data Engineer in England over the 6 months to 18 May 2021.

Hourly rate histogram for Data Engineer in England

Data Engineer
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the England region over the 6 months to 18 May 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +15 675 £550 +4.76% 148
North of England +81 88 £456 +3.69% 38
South East -1 57 £525 +10.53% 21
North West +50 46 £475 +7.34% 19
South West +34 34 £484 -5.61% 11
Yorkshire +41 33 £440 -0.85% 16
Midlands -2 33 £444 -4.05% 17
West Midlands +15 25 £450 -5.26% 11
East of England +11 24 £555 +30.59% 19
North East +27 10 £450 +9.09% 3
East Midlands -8 7 £425 +21.43% 6
Data Engineer
UK

Data Engineer Skill Set
Top 30 Co-occurring IT Skills in England

For the 6 months to 18 May 2021, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region featuring Data Engineer in the job title.

1 529 (53.22%) SQL
2 528 (53.12%) Python
3 383 (38.53%) Azure
4 324 (32.60%) AWS
5 304 (30.58%) Data Pipeline
6 302 (30.38%) ETL
7 285 (28.67%) Analytics
8 278 (27.97%) Data Warehouse
9 264 (26.56%) Agile Software Development
10 262 (26.36%) Data Engineering
11 250 (25.15%) Apache Spark
12 243 (24.45%) Business Intelligence
13 236 (23.74%) Big Data
14 224 (22.54%) Data Modelling
15 204 (20.52%) Databricks
16 200 (20.12%) Data Lake
17 195 (19.62%) Scala
18 185 (18.61%) Kafka
19 184 (18.51%) Java
20 172 (17.30%) Finance
21 168 (16.90%) DevOps
22 159 (16.00%) Hadoop
23 147 (14.79%) Azure Data Factory
23 147 (14.79%) Data Science
24 140 (14.08%) Social Skills
25 138 (13.88%) Power Platform
26 136 (13.68%) GCP
27 133 (13.38%) Power BI
28 132 (13.28%) Microsoft
29 113 (11.37%) PySpark

Data Engineer Skill Set
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 250 (25.15%) Apache Spark
2 96 (9.66%) Apache Airflow
3 87 (8.75%) Apache
4 34 (3.42%) Confluence
5 30 (3.02%) SAS
6 18 (1.81%) Elasticsearch
7 14 (1.41%) SharePoint
8 10 (1.01%) Luigi
9 9 (0.91%) Jupyter
10 5 (0.50%) Oracle Workflow
11 2 (0.20%) Apache Pig
11 2 (0.20%) Oracle Coherence
11 2 (0.20%) WebLogic
12 1 (0.10%) Hyperledger
Applications
1 17 (1.71%) Microsoft Excel
2 5 (0.50%) Microsoft Office
3 4 (0.40%) Microsoft PowerPoint
4 2 (0.20%) MS Visio
4 2 (0.20%) Spreadsheet
5 1 (0.10%) SPSS
Business Applications
1 6 (0.60%) Eikon
1 6 (0.60%) Refinitiv Enterprise Platform
2 4 (0.40%) Dynamics CRM
3 3 (0.30%) Oracle EBS
3 3 (0.30%) Sparx Enterprise Architect
4 2 (0.20%) Aligne
4 2 (0.20%) Dynamics AX
5 1 (0.10%) SAP IS-U
5 1 (0.10%) Teamcenter
Cloud Services
1 383 (38.53%) Azure
2 324 (32.60%) AWS
3 147 (14.79%) Azure Data Factory
4 138 (13.88%) Power Platform
5 136 (13.68%) GCP
6 100 (10.06%) Amazon S3
7 85 (8.55%) Serverless
8 73 (7.34%) Azure Synapse Analytics
9 57 (5.73%) AWS Lambda
10 46 (4.63%) Amazon EC2
11 45 (4.53%) Amazon EMR
12 41 (4.12%) Azure Cosmos DB
13 30 (3.02%) Amazon Kinesis
14 22 (2.21%) GitHub
15 20 (2.01%) AWS CloudFormation
15 20 (2.01%) Azure Functions
15 20 (2.01%) Google Analytics
16 19 (1.91%) Amazon ElastiCache
17 16 (1.61%) Amazon Glacier
18 12 (1.21%) Azure Storage
Communications & Networking
1 11 (1.11%) HTTP
2 6 (0.60%) Firewall
3 5 (0.50%) Kerberos
4 3 (0.30%) SMTP
4 3 (0.30%) SSL
5 2 (0.20%) Internet
5 2 (0.20%) SAN
5 2 (0.20%) Wireless
6 1 (0.10%) 3G
6 1 (0.10%) 4G
6 1 (0.10%) 5G
6 1 (0.10%) Broadband
6 1 (0.10%) DNS
6 1 (0.10%) FTP
6 1 (0.10%) MQTT
6 1 (0.10%) Network Security
6 1 (0.10%) PuTTY
6 1 (0.10%) Radio Access Network
6 1 (0.10%) TCP/IP
Database & Business Intelligence
1 278 (27.97%) Data Warehouse
2 236 (23.74%) Big Data
3 200 (20.12%) Data Lake
4 159 (16.00%) Hadoop
5 133 (13.38%) Power BI
6 112 (11.27%) SQL Server
7 94 (9.46%) Apache Hive
8 91 (9.15%) Amazon Redshift
8 91 (9.15%) Tableau
9 88 (8.85%) Relational Database
10 85 (8.55%) Snowflake Schema
11 77 (7.75%) SQL Server Integration Services
12 76 (7.65%) BigQuery
12 76 (7.65%) PostgreSQL
13 73 (7.34%) NoSQL
14 66 (6.64%) Amazon RDS
15 65 (6.54%) Azure SQL Database
16 50 (5.03%) SQL Server Reporting Services
17 46 (4.63%) Amazon Athena
18 39 (3.92%) SQL Server Analysis Services
Development Applications
1 89 (8.95%) Git (software)
2 61 (6.14%) Jenkins
3 56 (5.63%) JIRA
4 15 (1.51%) Maven
5 9 (0.91%) Oracle APEX
6 8 (0.80%) GitLab
7 7 (0.70%) Atlassian Bamboo
8 6 (0.60%) Sonatype Nexus
9 5 (0.50%) SQL Server Management Studio (SSMS)
9 5 (0.50%) Visual Studio
10 4 (0.40%) TeamCity
11 3 (0.30%) MLflow
11 3 (0.30%) ProC
11 3 (0.30%) Subversion
11 3 (0.30%) Visual Studio Team System
12 2 (0.20%) git-flow
12 2 (0.20%) kappa
12 2 (0.20%) Octopus Deploy
12 2 (0.20%) Sourcetree
12 2 (0.20%) Zephyr
General
1 172 (17.30%) Finance
2 140 (14.08%) Social Skills
3 105 (10.56%) Analytical Skills
4 41 (4.12%) Banking
5 37 (3.72%) Public Sector
6 32 (3.22%) Retail
7 19 (1.91%) Marketing
8 15 (1.51%) Presentation Skills
9 13 (1.31%) Games
10 12 (1.21%) Telecoms
11 11 (1.11%) Manufacturing
12 9 (0.91%) Investment Banking
13 8 (0.80%) Pharmaceutical
14 7 (0.70%) Front Office
15 6 (0.60%) Publishing
15 6 (0.60%) Retail Banking
16 5 (0.50%) Electronics
17 4 (0.40%) Automotive
18 3 (0.30%) Financial Institution
18 3 (0.30%) Law
Libraries, Frameworks & Software Standards
1 185 (18.61%) Kafka
2 113 (11.37%) PySpark
3 39 (3.92%) JSON
4 29 (2.92%) Spark Streaming
4 29 (2.92%) XML
5 26 (2.62%) NumPy
6 22 (2.21%) Pandas
7 21 (2.11%) Velocity
8 19 (1.91%) Celery
9 17 (1.71%) RESTful
9 17 (1.71%) Web Services
10 16 (1.61%) HTML
11 15 (1.51%) .NET
12 13 (1.31%) Apache NiFi
12 13 (1.31%) scikit-learn
12 13 (1.31%) Spring
13 12 (1.21%) Oracle GoldenGate
13 12 (1.21%) Software Packaging
14 11 (1.11%) PostGIS
15 10 (1.01%) Node.js
Miscellaneous
1 56 (5.63%) Data Structures
2 36 (3.62%) Algorithms
3 30 (3.02%) Greenfield Project
4 17 (1.71%) Cloud Native
4 17 (1.71%) Management Information System
4 17 (1.71%) NHS
5 16 (1.61%) User Experience
6 12 (1.21%) iPad
6 12 (1.21%) Self-Motivation
7 11 (1.11%) Analytical Mindset
7 11 (1.11%) Hedge funds
8 8 (0.80%) Reinsurance
8 8 (0.80%) Replication
9 7 (0.70%) Data Centre
9 7 (0.70%) Foreign Exchange (FX)
9 7 (0.70%) Linux Command Line
9 7 (0.70%) Reference Data
9 7 (0.70%) Social Media
10 5 (0.50%) Client/Server
10 5 (0.50%) FMCG
Operating Systems
1 39 (3.92%) Linux
2 26 (2.62%) Unix
3 23 (2.31%) Windows
4 7 (0.70%) Windows Server
5 6 (0.60%) AIX
5 6 (0.60%) CentOS
5 6 (0.60%) Ubuntu
6 5 (0.50%) Red Hat Enterprise Linux
7 3 (0.30%) Windows Server 2008
8 2 (0.20%) Windows Server 2019
9 1 (0.10%) MVS
9 1 (0.10%) Windows 7
Processes & Methodologies
1 304 (30.58%) Data Pipeline
2 302 (30.38%) ETL
3 285 (28.67%) Analytics
4 264 (26.56%) Agile Software Development
5 262 (26.36%) Data Engineering
6 243 (24.45%) Business Intelligence
7 224 (22.54%) Data Modelling
8 168 (16.90%) DevOps
9 147 (14.79%) Data Science
10 108 (10.87%) Migration
11 92 (9.26%) Scrum
12 86 (8.65%) Visualisation
13 80 (8.05%) Data Ingestion
14 78 (7.85%) Data Integration
15 74 (7.44%) Data Transformation
16 69 (6.94%) Data Analysis
17 68 (6.84%) Machine Learning
18 55 (5.53%) Problem-Solving
19 53 (5.33%) Data Architecture
19 53 (5.33%) Software Engineering
Programming Languages
1 529 (53.22%) SQL
2 528 (53.12%) Python
3 195 (19.62%) Scala
4 184 (18.51%) Java
5 46 (4.63%) R
6 43 (4.33%) PL/SQL
7 34 (3.42%) T-SQL
8 30 (3.02%) C++
9 25 (2.52%) PowerShell
10 24 (2.41%) C#
11 23 (2.31%) C
12 19 (1.91%) JavaScript
13 16 (1.61%) Shell Script
14 15 (1.51%) Go
15 11 (1.11%) VBA
16 6 (0.60%) Bash Shell
17 5 (0.50%) SPARQL
18 4 (0.40%) Data Analysis Expressions (DAX)
18 4 (0.40%) SHACL
19 3 (0.30%) TypeScript
Qualifications
1 101 (10.16%) Security Cleared
2 85 (8.55%) SC Cleared
3 44 (4.43%) Degree
4 19 (1.91%) AWS Certification
5 18 (1.81%) DV Cleared
6 16 (1.61%) Computer Science Degree
7 6 (0.60%) Master's Degree
8 4 (0.40%) BPSS Clearance
9 3 (0.30%) DBS Check
10 2 (0.20%) ISEB
10 2 (0.20%) PhD
11 1 (0.10%) CCNA
11 1 (0.10%) Chartered Engineer
11 1 (0.10%) Cisco Certification
11 1 (0.10%) CITP
11 1 (0.10%) HNC
11 1 (0.10%) HND
11 1 (0.10%) Microsoft Certification
11 1 (0.10%) Numerate Degree
Quality Assurance & Compliance
1 60 (6.04%) Data Quality
2 33 (3.32%) QA
3 9 (0.91%) GDPR
4 5 (0.50%) SLA
5 4 (0.40%) IFRS
6 2 (0.20%) Disclosure Scotland
7 1 (0.10%) FATCA
7 1 (0.10%) GxP
7 1 (0.10%) PMO
7 1 (0.10%) SNOMED CT
System Software
1 62 (6.24%) Docker
2 31 (3.12%) HDFS
3 6 (0.60%) BitLocker
4 4 (0.40%) Apache Flume
5 3 (0.30%) Active Directory
5 3 (0.30%) Apache ZooKeeper
6 2 (0.20%) VMware Infrastructure
6 2 (0.20%) VMware Server
7 1 (0.10%) Virtual Machines
Systems Management
1 85 (8.55%) Kubernetes
2 57 (5.73%) Terraform
3 31 (3.12%) Ansible
4 22 (2.21%) Oozie
5 13 (1.31%) Hadoop YARN
6 10 (1.01%) SCCM
7 9 (0.91%) Puppet
8 6 (0.60%) Kibana
8 6 (0.60%) Opscode Chef
9 3 (0.30%) Ambari
10 2 (0.20%) Grafana
10 2 (0.20%) Istio
10 2 (0.20%) Kubeflow
10 2 (0.20%) SCOM
11 1 (0.10%) Argo
11 1 (0.10%) Rancher
Vendors
1 204 (20.52%) Databricks
2 132 (13.28%) Microsoft
3 84 (8.45%) Google
4 77 (7.75%) Oracle
5 49 (4.93%) Cloudera
6 38 (3.82%) SAP
7 31 (3.12%) Talend
8 30 (3.02%) Informatica
9 25 (2.52%) Alteryx
9 25 (2.52%) Splunk
10 13 (1.31%) IBM
10 13 (1.31%) Teradata
11 12 (1.21%) Dataiku
12 10 (1.01%) StreamSets
13 9 (0.91%) Hortonworks
13 9 (0.91%) Salesforce.com
14 8 (0.80%) Confluent
14 8 (0.80%) NetApp
15 7 (0.70%) Symantec
16 6 (0.60%) Reuters