Period
to 26 September 2021

The median contractor rate for a Data Engineer was £540 per day in advertised job vacancies in England during the 6 months to 26 September 2021.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
UK > England
6 months to
26 Sep 2021
Same period 2020 Same period 2019
Rank 111 168 184
Rank change year-on-year +57 +16 +120
Contract jobs requiring a Data Engineer 1,502 429 1,239
As % of all contract jobs advertised in England 2.36% 1.68% 1.54%
As % of the Job Titles category 2.53% 1.81% 1.63%
Number of daily rates quoted 1,061 316 955
10th Percentile £413 £366 £413
25th Percentile £463 £425 £463
Median daily rate (50th Percentile) £540 £500 £550
Median % change year-on-year +8.00% -9.09% -
75th Percentile £619 £588 £619
90th Percentile £675 £669 £687
UK median daily rate £525 £500 £550
% change year-on-year +5.00% -9.09% -
Number of hourly rates quoted 12 8 5
10th Percentile £25.33 £20.65 £21.47
25th Percentile £26.00 £21.25 £31.18
Median hourly rate £36.25 £23.75 £36.00
Median % change year-on-year +52.63% -34.03% +61.80%
75th Percentile £42.57 £35.00 £53.75
90th Percentile £56.39 £58.63 "
UK median hourly rate £29.00 £22.50 £34.73
% change year-on-year +28.89% -35.21% +54.34%

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in England. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
England
Contract vacancies in England with a recognized job title 59,471 23,703 75,821
% of contract IT jobs with a recognized job title 93.28% 92.59% 94.24%
Number of daily rates quoted 41,644 16,158 51,310
10th Percentile £300 £263 £263
25th Percentile £406 £375 £363
Median daily rate (50th Percentile) £500 £475 £475
Median % change year-on-year +5.26% - +5.56%
75th Percentile £603 £575 £575
90th Percentile £700 £675 £650
UK median daily rate £500 £475 £463
% change year-on-year +5.26% +2.70% +2.78%
Number of hourly rates quoted 1,828 755 2,406
10th Percentile £11.73 £11.17 £11.17
25th Percentile £13.60 £14.25 £13.75
Median hourly rate £19.85 £22.00 £19.02
Median % change year-on-year -9.77% +15.70% +8.66%
75th Percentile £45.00 £44.13 £43.75
90th Percentile £61.33 £53.75 £52.50
UK median hourly rate £20.00 £21.91 £19.00
% change year-on-year -8.72% +15.32% +8.57%

Data Engineer
Job Vacancy Trend in England

Job postings that featured Data Engineer in the job title as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Engineer in England

Data Engineer
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Data Engineer in England.

Daily rate trend for Data Engineer in England

Data Engineer
Daily Rate Histogram in England

Daily rate distribution for jobs citing Data Engineer in England over the 6 months to 26 September 2021.

Daily rate histogram for Data Engineer in England

Data Engineer
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Data Engineer in England.

Hourly rate trend for Data Engineer in England

Data Engineer
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Data Engineer in England over the 6 months to 26 September 2021.

Hourly rate histogram for Data Engineer in England

Data Engineer
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the England region over the 6 months to 26 September 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +35 990 £550 +4.76% 174
South East -15 134 £525 +10.53% 33
North of England +22 131 £497 +20.55% 31
Midlands -20 62 £483 +20.75% 24
Yorkshire +5 58 £463 +15.63% 4
West Midlands -18 55 £489 +22.19% 20
South West -9 52 £500 +12.36% 18
North West -25 50 £500 +25.00% 25
East of England -52 27 £400 -30.43% 16
North East +4 23 £600 +29.73% 2
East Midlands -38 5 £425 +13.33% 4
Data Engineer
UK

Data Engineer Skill Set
Top 30 Co-occurring IT Skills in England

For the 6 months to 26 September 2021, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region featuring Data Engineer in the job title.

1 823 (54.79%) Python
2 817 (54.39%) SQL
3 572 (38.08%) Azure
4 436 (29.03%) ETL
5 431 (28.70%) AWS
6 405 (26.96%) Apache Spark
7 400 (26.63%) Analytics
8 381 (25.37%) Data Pipeline
9 368 (24.50%) Agile Software Development
10 366 (24.37%) Data Engineering
11 354 (23.57%) Data Warehouse
12 351 (23.37%) Data Modelling
13 349 (23.24%) Big Data
14 344 (22.90%) Databricks
15 314 (20.91%) Scala
16 305 (20.31%) Java
17 294 (19.57%) Business Intelligence
18 288 (19.17%) Data Lake
19 268 (17.84%) DevOps
20 256 (17.04%) Kafka
20 256 (17.04%) Social Skills
21 244 (16.25%) Finance
22 238 (15.85%) Hadoop
23 230 (15.31%) Azure Data Factory
24 201 (13.38%) Power Platform
25 199 (13.25%) PySpark
26 194 (12.92%) GCP
27 193 (12.85%) Power BI
28 192 (12.78%) Data Science
29 164 (10.92%) Microsoft

Data Engineer Skill Set
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 405 (26.96%) Apache Spark
2 139 (9.25%) Apache Airflow
3 99 (6.59%) Apache
4 54 (3.60%) Confluence
5 44 (2.93%) Elasticsearch
6 29 (1.93%) Luigi
7 19 (1.26%) SAS
8 14 (0.93%) SharePoint
8 14 (0.93%) Tomcat
9 10 (0.67%) Jupyter
10 6 (0.40%) BizTalk Server
11 5 (0.33%) nginx
12 4 (0.27%) Apache Pig
12 4 (0.27%) Oracle Workflow
13 3 (0.20%) Ethereum
14 2 (0.13%) Cloud Foundry
14 2 (0.13%) Hyperledger
14 2 (0.13%) Mule
Applications
1 17 (1.13%) Microsoft Excel
2 10 (0.67%) Microsoft Office
3 4 (0.27%) MS Visio
4 3 (0.20%) Microsoft PowerPoint
5 2 (0.13%) Spreadsheet
5 2 (0.13%) SPSS
Business Applications
1 6 (0.40%) Dynamics CRM
2 5 (0.33%) Oracle EBS
2 5 (0.33%) SAP Oil and Gas
3 3 (0.20%) Dynamics AX
3 3 (0.20%) Endur
4 2 (0.13%) Refinitiv Enterprise Platform
4 2 (0.13%) SAP R/3
5 1 (0.067%) Aligne
5 1 (0.067%) Eikon
5 1 (0.067%) Oracle Procure-to-Pay
5 1 (0.067%) Remedy ITSM
5 1 (0.067%) SAP IS-U
5 1 (0.067%) Sparx Enterprise Architect
5 1 (0.067%) Teamcenter
Cloud Services
1 572 (38.08%) Azure
2 431 (28.70%) AWS
3 230 (15.31%) Azure Data Factory
4 201 (13.38%) Power Platform
5 194 (12.92%) GCP
6 134 (8.92%) Serverless
7 132 (8.79%) Amazon S3
8 131 (8.72%) Azure Synapse Analytics
9 71 (4.73%) Azure Cosmos DB
10 69 (4.59%) Snowflake
11 65 (4.33%) GitHub
12 62 (4.13%) Azure Functions
13 56 (3.73%) AWS Lambda
14 48 (3.20%) Amazon EMR
15 33 (2.20%) Azure Storage
16 32 (2.13%) Amazon EC2
17 29 (1.93%) Azure Logic Apps
18 23 (1.53%) AWS CloudFormation
18 23 (1.53%) Azure Stack
19 20 (1.33%) Amazon Kinesis
Communications & Networking
1 10 (0.67%) WAN
2 9 (0.60%) Firewall
2 9 (0.60%) Internet
3 8 (0.53%) Kerberos
4 6 (0.40%) Network Security
5 5 (0.33%) FTP
6 4 (0.27%) Z-Wave
7 3 (0.20%) Intranet
8 2 (0.13%) PuTTY
8 2 (0.13%) SSL
8 2 (0.13%) TCP/IP
9 1 (0.067%) Broadband
9 1 (0.067%) Cisco ASA
9 1 (0.067%) Cisco Wireless
9 1 (0.067%) Ethernet
9 1 (0.067%) HTTP
9 1 (0.067%) HTTPS
9 1 (0.067%) LAN
9 1 (0.067%) SAN
9 1 (0.067%) Wi-Fi
Database & Business Intelligence
1 354 (23.57%) Data Warehouse
2 349 (23.24%) Big Data
3 288 (19.17%) Data Lake
4 238 (15.85%) Hadoop
5 193 (12.85%) Power BI
6 160 (10.65%) SQL Server
7 156 (10.39%) Apache Hive
8 131 (8.72%) Relational Database
9 113 (7.52%) NoSQL
10 109 (7.26%) PostgreSQL
11 105 (6.99%) Azure SQL Database
12 97 (6.46%) Amazon Redshift
13 95 (6.32%) BigQuery
13 95 (6.32%) Tableau
14 91 (6.06%) SQL Server Integration Services
15 84 (5.59%) HBase
16 75 (4.99%) Metadata
17 60 (3.99%) Apache Cassandra
18 59 (3.93%) Azure SQL Data Warehouse
19 51 (3.40%) SQL Server Reporting Services
Development Applications
1 152 (10.12%) Git (software)
2 117 (7.79%) Jenkins
3 85 (5.66%) JIRA
4 43 (2.86%) GitLab
5 24 (1.60%) Hudson
6 20 (1.33%) Bitbucket
7 19 (1.26%) Maven
8 17 (1.13%) Subversion
9 12 (0.80%) IntelliJ
9 12 (0.80%) Visual Studio
10 9 (0.60%) Oracle APEX
10 9 (0.60%) Sonatype Nexus
11 8 (0.53%) ERwin
11 8 (0.53%) TeamCity
12 7 (0.47%) MLflow
13 5 (0.33%) Artifactory
13 5 (0.33%) Visual Studio Team System
14 4 (0.27%) CircleCI
14 4 (0.27%) GoCD
14 4 (0.27%) Octopus Deploy
General
1 256 (17.04%) Social Skills
2 244 (16.25%) Finance
3 146 (9.72%) Analytical Skills
4 78 (5.19%) Banking
5 70 (4.66%) Public Sector
6 46 (3.06%) Presentation Skills
7 41 (2.73%) Marketing
8 30 (2.00%) Retail
9 25 (1.66%) Investment Banking
10 22 (1.46%) Telecoms
11 19 (1.26%) Publishing
12 16 (1.07%) Manufacturing
13 12 (0.80%) Documentation Skills
13 12 (0.80%) Financial Institution
14 10 (0.67%) Legal
15 9 (0.60%) Aerospace
15 9 (0.60%) Games
15 9 (0.60%) Pharmaceutical
16 8 (0.53%) Law
17 6 (0.40%) Advertising
Libraries, Frameworks & Software Standards
1 256 (17.04%) Kafka
2 199 (13.25%) PySpark
3 59 (3.93%) Spark Streaming
4 52 (3.46%) JSON
5 40 (2.66%) .NET
6 36 (2.40%) Pandas
7 30 (2.00%) Apache NiFi
7 30 (2.00%) ARM Templates
8 29 (1.93%) Spring
9 26 (1.73%) XML
10 25 (1.66%) Velocity
11 22 (1.46%) Node.js
11 22 (1.46%) RabbitMQ
12 20 (1.33%) Oracle GoldenGate
12 20 (1.33%) Web Services
13 19 (1.26%) Apache Avro
13 19 (1.26%) REST
14 18 (1.20%) NumPy
15 17 (1.13%) pytest
15 17 (1.13%) RESTful
Miscellaneous
1 68 (4.53%) Data Structures
2 54 (3.60%) Algorithms
3 50 (3.33%) Data Protection Act
4 32 (2.13%) Management Information System
5 30 (2.00%) Cloud Native
6 26 (1.73%) Greenfield Project
7 23 (1.53%) Data Centre
8 22 (1.46%) iPad
9 20 (1.33%) NHS
9 20 (1.33%) Replication
10 16 (1.07%) Social Media
11 12 (0.80%) Legacy Applications
12 11 (0.73%) Public Cloud
12 11 (0.73%) Self-Motivation
12 11 (0.73%) User Experience
13 10 (0.67%) Hedge funds
14 9 (0.60%) Reference Data
15 8 (0.53%) Hybrid Cloud
16 6 (0.40%) Enterprise Software
16 6 (0.40%) Taxonomies
Operating Systems
1 85 (5.66%) Linux
2 80 (5.33%) Unix
3 24 (1.60%) Windows
4 7 (0.47%) Red Hat Enterprise Linux
5 6 (0.40%) VMS
6 2 (0.13%) Android
6 2 (0.13%) Apple iOS
6 2 (0.13%) CentOS
6 2 (0.13%) Ubuntu
6 2 (0.13%) Windows Server
7 1 (0.067%) AIX
7 1 (0.067%) Debian
7 1 (0.067%) Windows 7
7 1 (0.067%) Windows Server 2008
7 1 (0.067%) Windows Server 2012
Processes & Methodologies
1 436 (29.03%) ETL
2 400 (26.63%) Analytics
3 381 (25.37%) Data Pipeline
4 368 (24.50%) Agile Software Development
5 366 (24.37%) Data Engineering
6 351 (23.37%) Data Modelling
7 294 (19.57%) Business Intelligence
8 268 (17.84%) DevOps
9 192 (12.78%) Data Science
10 147 (9.79%) Migration
11 144 (9.59%) Scrum
12 137 (9.12%) Visualisation
13 126 (8.39%) Machine Learning
14 103 (6.86%) Data Transformation
15 100 (6.66%) Data Ingestion
16 87 (5.79%) Computer Science
17 86 (5.73%) Problem-Solving
18 85 (5.66%) Data Integration
18 85 (5.66%) Data Migration
19 83 (5.53%) Software Engineering
Programming Languages
1 823 (54.79%) Python
2 817 (54.39%) SQL
3 314 (20.91%) Scala
4 305 (20.31%) Java
5 65 (4.33%) R
6 59 (3.93%) T-SQL
7 51 (3.40%) C++
8 49 (3.26%) C#
9 45 (3.00%) PL/SQL
10 37 (2.46%) Go
11 35 (2.33%) JavaScript
12 33 (2.20%) PowerShell
13 32 (2.13%) Bash Shell
14 22 (1.46%) Shell Script
15 18 (1.20%) Groovy
16 13 (0.87%) Java 8
16 13 (0.87%) Kotlin
17 11 (0.73%) CQL
17 11 (0.73%) Perl
17 11 (0.73%) TypeScript
Qualifications
1 147 (9.79%) Security Cleared
2 113 (7.52%) SC Cleared
3 97 (6.46%) Degree
4 48 (3.20%) Computer Science Degree
5 26 (1.73%) AWS Certification
6 17 (1.13%) BPSS Clearance
6 17 (1.13%) DV Cleared
7 12 (0.80%) Master's Degree
8 8 (0.53%) Microsoft Certification
9 4 (0.27%) DBS Check
9 4 (0.27%) PhD
10 3 (0.20%) ISEB
11 2 (0.13%) Numerate Degree
12 1 (0.067%) HNC
12 1 (0.067%) HND
12 1 (0.067%) MCSE
Quality Assurance & Compliance
1 125 (8.32%) Data Quality
2 45 (3.00%) QA
3 23 (1.53%) GDPR
4 9 (0.60%) SLA
5 6 (0.40%) IFRS
6 5 (0.33%) Disclosure Scotland
7 4 (0.27%) Accessibility
8 1 (0.067%) Actionable Recommendations
8 1 (0.067%) ISO/IEC 27001
8 1 (0.067%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
8 1 (0.067%) NIST
8 1 (0.067%) PCI DSS
8 1 (0.067%) PMO
8 1 (0.067%) Sarbanes-Oxley
8 1 (0.067%) SNOMED CT
8 1 (0.067%) SOC 2
8 1 (0.067%) Solvency II
System Software
1 104 (6.92%) Docker
2 57 (3.79%) HDFS
3 13 (0.87%) Apache ZooKeeper
4 8 (0.53%) Apache Flume
5 7 (0.47%) BitLocker
6 4 (0.27%) Active Directory
7 2 (0.13%) Virtual Machines
8 1 (0.067%) Hyper-V
8 1 (0.067%) Oracle RAC
8 1 (0.067%) VMware Infrastructure
8 1 (0.067%) vSphere
Systems Management
1 143 (9.52%) Kubernetes
2 116 (7.72%) Terraform
3 57 (3.79%) Ansible
4 35 (2.33%) Oozie
5 25 (1.66%) Kibana
6 22 (1.46%) Grafana
7 13 (0.87%) Hadoop YARN
7 13 (0.87%) logstash
8 12 (0.80%) Single Sign-On
9 9 (0.60%) Puppet
10 8 (0.53%) Bosun
10 8 (0.53%) Docker Swarm
10 8 (0.53%) SCCM
10 8 (0.53%) VictorOps
11 6 (0.40%) Ambari
11 6 (0.40%) Prometheus
12 5 (0.33%) Kubeflow
12 5 (0.33%) Rancher
13 4 (0.27%) Opscode Chef
14 3 (0.20%) Istio
Vendors
1 344 (22.90%) Databricks
2 164 (10.92%) Microsoft
3 132 (8.79%) Google
4 103 (6.86%) Cloudera
5 102 (6.79%) Oracle
6 48 (3.20%) Informatica
7 39 (2.60%) Talend
8 38 (2.53%) SAP
9 33 (2.20%) Hortonworks
10 23 (1.53%) Alteryx
11 21 (1.40%) ServiceNow
12 18 (1.20%) Teradata
13 16 (1.07%) Splunk
14 12 (0.80%) Confluent
14 12 (0.80%) IBM
15 11 (0.73%) StreamSets
16 10 (0.67%) Salesforce.com
17 9 (0.60%) Netezza
17 9 (0.60%) Symantec
18 7 (0.47%) NetApp