Period
to 16 January 2021

The median contractor rate for a Data Engineer was £500 per day in advertised job vacancies in England during the 6 months to 16 January 2021.

The first table below provides contractor rate benchmarking and summary statistics including a comparison to same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineer
UK > England
6 months to
16 Jan 2021
Same period 2020 Same period 2019
Rank 131 183 279
Rank change year-on-year +52 +96 +74
Contract jobs requiring a Data Engineer 649 966 893
As % of all contract jobs advertised in England 1.93% 1.45% 0.98%
As % of the Job Titles category 2.09% 1.55% 1.03%
Number of daily rates quoted 587 722 668
Median daily rate £500 £538 £550
Median daily rate % change year-on-year -6.98% -2.27% +10.00%
10th Percentile £369 £400 £413
90th Percentile £650 £675 £700
UK median daily rate £500 £525 £530
% change year-on-year -4.76% -0.94% +6.00%
Number of hourly rates quoted 13 2 3
Median hourly rate £25.05 £34.73 £33.00
Median hourly rate % change year-on-year -27.88% +5.23% +23.36%
10th Percentile £21.25 £31.46 £27.90
90th Percentile £66.50 £37.77 £34.70
UK median hourly rate £25.00 £26.50 £34.00
% change year-on-year -5.66% -22.06% +27.10%

The following table is for comparison with the above and includes summary statistics for all contract IT job vacancies advertised in England. Most job vacancies include a discernible job title that can be normalized. As such, the figures in the second row provide an indication of the number of contract jobs in our overall sample.

All Contract IT Job Vacancies
England
Contract vacancies in England with a recognized job title 31,001 62,424 86,345
% of contract IT jobs with a recognized job title 92.38% 93.82% 94.73%
Number of daily rates quoted 21,254 42,272 58,721
Median daily rate £475 £463 £463
Median daily rate % change year-on-year +2.70% - +2.78%
10th Percentile £255 £250 £275
90th Percentile £656 £650 £645
UK median daily rate £470 £450 £450
% change year-on-year +4.44% - -
Number of hourly rates quoted 1,144 2,258 2,466
Median hourly rate £22.50 £18.00 £17.70
Median hourly rate % change year-on-year +25.00% +1.69% -1.67%
10th Percentile £11.17 £11.17 £11.00
90th Percentile £57.50 £50.00 £48.75
Median hourly rate £23.00 £18.00 £17.66
% change year-on-year +27.78% +1.93% -1.89%

Data Engineer
Job Vacancy Trend in England

Job postings that featured Data Engineer in the job title as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Engineer in England

Data Engineer
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Data Engineer in England.

Daily rate trend for Data Engineer in England

Data Engineer
Daily Rate Histogram in England

Daily rate distribution for jobs citing Data Engineer in England over the 6 months to 16 January 2021.

Daily rate histogram for Data Engineer in England

Data Engineer
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Data Engineer in England.

Hourly rate trend for Data Engineer in England

Data Engineer
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Data Engineer in England over the 6 months to 16 January 2021.

Hourly rate histogram for Data Engineer in England

Data Engineer
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineer within the England region over the 6 months to 16 January 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +30 433 £550 - 122
North of England +112 72 £450 - 35
North West +71 44 £450 - 23
East of England +47 31 £568 +19.47% 8
South East +42 26 £438 -11.62% 11
Midlands +27 25 £420 -6.67% 13
West Midlands +39 18 £438 -16.67% 6
South West +67 16 £450 -6.49% 7
North East +46 15 £440 +3.53% 1
Yorkshire +45 14 £450 -16.28% 11
East Midlands +19 7 £400 +10.34% 7
Data Engineer
UK

Data Engineer Skill Set
Top 30 Co-occurring IT Skills in England

For the 6 months to 16 January 2021, Data Engineer contract jobs required the following IT skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region featuring Data Engineer in the job title.

1 364 (56.09%) Python
2 354 (54.55%) SQL
3 222 (34.21%) Azure
4 218 (33.59%) ETL
5 180 (27.73%) Data Warehouse
6 171 (26.35%) Apache Spark
7 169 (26.04%) Data Engineering
8 166 (25.58%) AWS
9 163 (25.12%) Big Data
9 163 (25.12%) Business Intelligence
10 153 (23.57%) Agile Software Development
11 150 (23.11%) Data Modelling
12 127 (19.57%) Analytics
13 117 (18.03%) DevOps
14 116 (17.87%) Data Lake
15 111 (17.10%) Java
16 109 (16.80%) Hadoop
17 108 (16.64%) Scala
17 108 (16.64%) Databricks
18 98 (15.10%) Data Science
19 96 (14.79%) Security Cleared
20 93 (14.33%) Kafka
21 92 (14.18%) GCP
21 92 (14.18%) Finance
22 85 (13.10%) Power BI
22 85 (13.10%) Power Platform
23 80 (12.33%) Azure Data Factory
24 74 (11.40%) Analytical Skills
24 74 (11.40%) SQL Server
25 70 (10.79%) Microsoft

Data Engineer Skill Set
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 171 (26.35%) Apache Spark
2 54 (8.32%) Apache
3 40 (6.16%) Apache Airflow
4 29 (4.47%) Confluence
5 24 (3.70%) SAS
6 21 (3.24%) Elasticsearch
7 10 (1.54%) Jupyter
8 4 (0.62%) Luigi
9 2 (0.31%) Apache Pig
9 2 (0.31%) Tornado
9 2 (0.31%) WebLogic
10 1 (0.15%) Apache Synapse
10 1 (0.15%) Oracle Coherence
Applications
1 9 (1.39%) Microsoft Excel
2 6 (0.92%) Microsoft Office
3 5 (0.77%) Spreadsheet
4 2 (0.31%) Microsoft Project
5 1 (0.15%) MS Visio
Business Applications
1 2 (0.31%) Aligne
1 2 (0.31%) Sparx Enterprise Architect
2 1 (0.15%) Dynamics CRM
2 1 (0.15%) Oracle EBS
2 1 (0.15%) Refinitiv Enterprise Platform
2 1 (0.15%) RMDS
Cloud Services
1 222 (34.21%) Azure
2 166 (25.58%) AWS
3 92 (14.18%) GCP
4 85 (13.10%) Power Platform
5 80 (12.33%) Azure Data Factory
6 63 (9.71%) Amazon S3
7 41 (6.32%) Serverless
8 36 (5.55%) Amazon EMR
9 26 (4.01%) AWS Lambda
10 19 (2.93%) Amazon EC2
11 15 (2.31%) Amazon Kinesis
11 15 (2.31%) Logic Apps
12 14 (2.16%) GitHub
13 13 (2.00%) Amazon Glacier
13 13 (2.00%) Azure Functions
14 10 (1.54%) AWS CloudFormation
14 10 (1.54%) SaaS
15 9 (1.39%) Dynamics 365
16 8 (1.23%) Google Analytics
17 7 (1.08%) Cloud Computing
Communications & Networking
1 5 (0.77%) HTTP
2 3 (0.46%) 4G
2 3 (0.46%) Kerberos
3 2 (0.31%) Internet
3 2 (0.31%) SMTP
3 2 (0.31%) SSL
4 1 (0.15%) DNS
4 1 (0.15%) Firewall
4 1 (0.15%) Wireless
Database & Business Intelligence
1 180 (27.73%) Data Warehouse
2 163 (25.12%) Big Data
3 116 (17.87%) Data Lake
4 109 (16.80%) Hadoop
5 85 (13.10%) Power BI
6 74 (11.40%) SQL Server
7 67 (10.32%) Apache Hive
8 62 (9.55%) Tableau
9 58 (8.94%) Relational Database
10 57 (8.78%) BigQuery
11 55 (8.47%) NoSQL
12 54 (8.32%) Amazon Redshift
13 45 (6.93%) Azure SQL Database
14 41 (6.32%) Amazon Athena
14 41 (6.32%) SQL Server Integration Services
15 36 (5.55%) Impala
16 32 (4.93%) PostgreSQL
16 32 (4.93%) Snowflake Schema
17 30 (4.62%) Amazon RDS
18 26 (4.01%) SQL Server Analysis Services
Development Applications
1 54 (8.32%) Git (software)
2 49 (7.55%) JIRA
3 40 (6.16%) Jenkins
4 16 (2.47%) GitLab
5 15 (2.31%) Maven
6 11 (1.69%) Atlassian Bamboo
7 4 (0.62%) Bitbucket
7 4 (0.62%) JUnit
7 4 (0.62%) ProC
7 4 (0.62%) Visual Studio
8 3 (0.46%) ERwin
8 3 (0.46%) Hudson
8 3 (0.46%) SQL Server Management Studio (SSMS)
8 3 (0.46%) Terragrunt
9 2 (0.31%) CA Gen
9 2 (0.31%) ER Studio
9 2 (0.31%) Octopus Deploy
9 2 (0.31%) SonarQube
9 2 (0.31%) Sourcetree
9 2 (0.31%) Spinnaker
General
1 92 (14.18%) Finance
2 33 (5.08%) Public Sector
3 21 (3.24%) Marketing
4 19 (2.93%) Banking
4 19 (2.93%) Retail
5 12 (1.85%) Electronics
5 12 (1.85%) Manufacturing
6 11 (1.69%) Advertising
6 11 (1.69%) Telecoms
7 10 (1.54%) Pharmaceutical
8 6 (0.92%) Front Office
8 6 (0.92%) Games
9 5 (0.77%) Investment Banking
9 5 (0.77%) Legal
10 4 (0.62%) Aerospace
10 4 (0.62%) Financial Institution
11 3 (0.46%) Military
12 2 (0.31%) Automotive
12 2 (0.31%) Law
12 2 (0.31%) Publishing
Libraries, Frameworks & Software Standards
1 93 (14.33%) Kafka
2 57 (8.78%) PySpark
3 36 (5.55%) JSON
4 23 (3.54%) XML
5 17 (2.62%) Web Services
6 16 (2.47%) Apache NiFi
6 16 (2.47%) NumPy
7 15 (2.31%) RESTful
7 15 (2.31%) scikit-learn
8 13 (2.00%) Spring
9 10 (1.54%) .NET
9 10 (1.54%) HTML
9 10 (1.54%) PyTorch
10 9 (1.39%) Elastic Stack
10 9 (1.39%) Keras
10 9 (1.39%) REST
10 9 (1.39%) TensorFlow
11 8 (1.23%) Pandas
11 8 (1.23%) Spark Streaming
12 7 (1.08%) MDX
Miscellaneous
1 74 (11.40%) Analytical Skills
2 30 (4.62%) Greenfield Project
3 25 (3.85%) Data Structures
4 16 (2.47%) Algorithms
5 15 (2.31%) FMCG
6 14 (2.16%) Cloud Native
7 10 (1.54%) EPoS
8 9 (1.39%) Management Information System
8 9 (1.39%) Self-Motivation
9 8 (1.23%) User Experience
10 6 (0.92%) iPad
11 5 (0.77%) Life Science
11 5 (0.77%) NHS
12 4 (0.62%) Hedge funds
12 4 (0.62%) Reference Data
13 3 (0.46%) Credit Risk
13 3 (0.46%) Fixed Income
13 3 (0.46%) Market Risk
13 3 (0.46%) Public Cloud
13 3 (0.46%) VSAM
Operating Systems
1 27 (4.16%) Unix
2 25 (3.85%) Linux
3 13 (2.00%) AIX
4 7 (1.08%) Windows
5 1 (0.15%) CentOS
5 1 (0.15%) Robot Operating System
5 1 (0.15%) Ubuntu
5 1 (0.15%) Windows Server
Processes & Methodologies
1 218 (33.59%) ETL
2 169 (26.04%) Data Engineering
3 163 (25.12%) Business Intelligence
4 153 (23.57%) Agile Software Development
5 150 (23.11%) Data Modelling
6 127 (19.57%) Analytics
7 117 (18.03%) DevOps
8 98 (15.10%) Data Science
9 67 (10.32%) Migration
10 55 (8.47%) Data Analysis
11 49 (7.55%) Machine Learning
12 42 (6.47%) Data Integration
13 40 (6.16%) Data Ingestion
13 40 (6.16%) Data Migration
14 38 (5.86%) Problem-Solving
14 38 (5.86%) Scrum
15 36 (5.55%) Data Architecture
15 36 (5.55%) ETL Development
16 35 (5.39%) Data Analytics
17 34 (5.24%) Visualisation
Programming Languages
1 364 (56.09%) Python
2 354 (54.55%) SQL
3 111 (17.10%) Java
4 108 (16.64%) Scala
5 38 (5.86%) R
6 27 (4.16%) PL/SQL
7 21 (3.24%) T-SQL
8 16 (2.47%) VBA
9 14 (2.16%) C#
10 12 (1.85%) PowerShell
11 10 (1.54%) Shell Script
12 9 (1.39%) C
13 8 (1.23%) Bash Shell
14 7 (1.08%) JavaScript
15 6 (0.92%) Go
15 6 (0.92%) Java 8
15 6 (0.92%) Perl
16 4 (0.62%) C++
17 2 (0.31%) COBOL
17 2 (0.31%) SPARQL
Qualifications
1 96 (14.79%) Security Cleared
2 66 (10.17%) SC Cleared
3 22 (3.39%) DV Cleared
4 18 (2.77%) AWS Certification
5 13 (2.00%) Degree
6 7 (1.08%) Computer Science Degree
7 3 (0.46%) CTC Cleared
8 2 (0.31%) PhD
9 1 (0.15%) BPSS Clearance
9 1 (0.15%) DBS Check
9 1 (0.15%) Numerate Degree
Quality Assurance & Compliance
1 47 (7.24%) QA
2 29 (4.47%) Data Quality
3 2 (0.31%) GDPR
3 2 (0.31%) SNOMED CT
4 1 (0.15%) SLA
System Software
1 54 (8.32%) Docker
2 41 (6.32%) HDFS
3 6 (0.92%) Apache ZooKeeper
4 5 (0.77%) Active Directory
5 4 (0.62%) Virtual Machines
6 2 (0.31%) Apache Flume
7 1 (0.15%) NFS
7 1 (0.15%) VMware Infrastructure
Systems Management
1 47 (7.24%) Kubernetes
2 46 (7.09%) Terraform
3 23 (3.54%) Ansible
4 13 (2.00%) Kibana
5 12 (1.85%) Puppet
6 9 (1.39%) Opscode Chef
7 7 (1.08%) Hadoop YARN
8 4 (0.62%) Oozie
9 2 (0.31%) Argo
10 1 (0.15%) Control-M
10 1 (0.15%) Grafana
Vendors
1 108 (16.64%) Databricks
2 70 (10.79%) Microsoft
3 65 (10.02%) Google
4 46 (7.09%) Oracle
5 36 (5.55%) Cloudera
6 31 (4.78%) SAP
7 26 (4.01%) Talend
8 22 (3.39%) Alteryx
9 18 (2.77%) Informatica
10 12 (1.85%) Teradata
11 8 (1.23%) Atlassian
11 8 (1.23%) Dataiku
11 8 (1.23%) Hortonworks
11 8 (1.23%) StreamSets
12 6 (0.92%) Splunk
13 5 (0.77%) Salesforce.com
14 4 (0.62%) Adobe
15 3 (0.46%) BEA
15 3 (0.46%) Draytek
15 3 (0.46%) Twitter