Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Hourly Rate Trend Hourly Rate Histogram Job Locations Skill Sets
Period
to 12 June 2021

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Data Engineering skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Engineering over the 6 months to 12 June 2021 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineering
UK > England
6 months to
12 Jun 2021		 Same period 2020 Same period 2019
Rank 205 291 378
Rank change year-on-year +86 +87 +199
Contract jobs citing Data Engineering 637 335 546
As % of all contract jobs advertised in England 1.31% 0.86% 0.66%
As % of the Processes & Methodologies category 1.48% 0.99% 0.75%
Number of daily rates quoted 374 227 402
10th Percentile £400 £393 £413
25th Percentile £463 £447 £463
Median daily rate (50th Percentile) £550 £550 £525
Median % change year-on-year - +4.76% -
75th Percentile £643 £638 £611
90th Percentile £738 £734 £700
UK median daily rate £550 £545 £525
% change year-on-year +0.92% +3.81% +2.44%
Number of hourly rates quoted 13 2 3
10th Percentile " £19.45 "
25th Percentile £8.00 £19.75 £51.25
Median hourly rate £36.50 £21.00 £52.50
Median % change year-on-year +73.81% -60.00% -
75th Percentile £55.00 £22.75 £57.50
90th Percentile £56.50 £23.35 £59.75
UK median hourly rate £27.73 £19.75 £52.50
% change year-on-year +40.41% -62.38% -

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for process or methodology skills.

All Process and Methodology Skills
England
Contract vacancies with a requirement for process or methodology skills 42,927 33,740 72,603
As % of all contract IT jobs advertised in England 88.13% 86.17% 87.70%
Number of daily rates quoted 29,494 22,880 49,070
10th Percentile £313 £300 £306
25th Percentile £400 £400 £388
Median daily rate (50th Percentile) £500 £475 £475
Median % change year-on-year +5.26% - +2.70%
75th Percentile £600 £588 £575
90th Percentile £688 £675 £650
UK median daily rate £500 £475 £475
% change year-on-year +5.26% - +5.56%
Number of hourly rates quoted 1,280 920 1,826
10th Percentile £11.74 £12.50 £11.85
25th Percentile £15.02 £15.90 £14.60
Median hourly rate £24.00 £22.00 £22.86
Median % change year-on-year +9.09% -3.76% +8.86%
75th Percentile £46.56 £45.00 £45.00
90th Percentile £58.75 £55.00 £52.50
UK median hourly rate £25.00 £22.50 £22.50
% change year-on-year +11.11% - +12.50%

Data Engineering
Job Vacancy Trend in England

Job postings citing Data Engineering as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Engineering in England

Data Engineering
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Data Engineering in England.

Daily rate trend for Data Engineering in England

Data Engineering
Daily Rate Histogram in England

Daily rate distribution for jobs citing Data Engineering in England over the 6 months to 12 June 2021.

Daily rate histogram for Data Engineering in England

Data Engineering
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Data Engineering in England.

Hourly rate trend for Data Engineering in England

Data Engineering
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Data Engineering in England over the 6 months to 12 June 2021.

Hourly rate histogram for Data Engineering in England

Data Engineering
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineering within the England region over the 6 months to 12 June 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
London +38 429 £550 - 111
South East +15 46 £525 +3.96% 12
North of England +47 42 £490 -10.91% 25
South West +47 29 £626 +45.04% 8
North West +11 19 £550 -6.38% 14
Yorkshire +28 18 £450 -8.86% 8
Midlands -30 16 £450 - 14
East of England -6 12 £515 +8.42% 5
West Midlands -27 9 £475 - 4
North East +18 6 £545 -5.22% 3
East Midlands +2 6 £400 -11.11% 10
Data Engineering
UK

For the 6 months to 12 June 2021, IT contractor jobs citing Data Engineering also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Data Engineering.

1 351 (55.10%) Python
2 326 (51.18%) SQL
3 295 (46.31%) Azure
4 264 (41.44%) Agile Software Development
5 210 (32.97%) Analytics
6 195 (30.61%) AWS
7 176 (27.63%) ETL
8 158 (24.80%) Databricks
9 155 (24.33%) Social Skills
10 154 (24.18%) Data Pipeline
11 149 (23.39%) Data Modelling
12 147 (23.08%) DevOps
13 146 (22.92%) Apache Spark
14 138 (21.66%) Data Warehouse
15 134 (21.04%) Finance
16 132 (20.72%) Big Data
17 127 (19.94%) Java
18 115 (18.05%) Business Intelligence
19 114 (17.90%) Kafka
19 114 (17.90%) Serverless
19 114 (17.90%) Data Science
20 102 (16.01%) Data Lake
21 99 (15.54%) Scala
21 99 (15.54%) Microsoft
22 98 (15.38%) NoSQL
23 97 (15.23%) Software Engineering
24 91 (14.29%) Hadoop
25 89 (13.97%) Kubernetes
26 88 (13.81%) Data Management
26 88 (13.81%) Scrum

Data Engineering
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 146 (22.92%) Apache Spark
2 84 (13.19%) Apache Airflow
3 62 (9.73%) Apache
4 32 (5.02%) BizTalk Server
5 16 (2.51%) Jupyter
6 14 (2.20%) SAS
6 14 (2.20%) SharePoint
7 8 (1.26%) Elasticsearch
8 7 (1.10%) Confluence
9 5 (0.78%) Apache Pig
10 4 (0.63%) Apache Pulsar
10 4 (0.63%) Luigi
11 2 (0.31%) Jetty
11 2 (0.31%) Tomcat
11 2 (0.31%) TPMS
12 1 (0.16%) Cloud Foundry
12 1 (0.16%) Hyperledger
12 1 (0.16%) MS Exchange
12 1 (0.16%) Mule
12 1 (0.16%) WebSphere
Applications
1 20 (3.14%) Microsoft Excel
2 6 (0.94%) Microsoft PowerPoint
3 1 (0.16%) MS Visio
3 1 (0.16%) SPSS
Business Applications
1 6 (0.94%) SAP Oil and Gas
2 3 (0.47%) Oracle EBS
2 3 (0.47%) Refinitiv Enterprise Platform
2 3 (0.47%) Sparx Enterprise Architect
3 2 (0.31%) Shopify
4 1 (0.16%) NetSuite
4 1 (0.16%) RMDS
4 1 (0.16%) SAP IS-U
Cloud Services
1 295 (46.31%) Azure
2 195 (30.61%) AWS
3 114 (17.90%) Serverless
4 84 (13.19%) GCP
5 78 (12.24%) Azure Functions
6 74 (11.62%) Power Platform
7 67 (10.52%) Azure Data Factory
8 66 (10.36%) AWS Lambda
9 60 (9.42%) Azure Synapse Analytics
10 49 (7.69%) Azure Cosmos DB
11 47 (7.38%) Amazon S3
12 41 (6.44%) Azure Storage
13 36 (5.65%) Azure Logic Apps
14 23 (3.61%) GitHub
15 22 (3.45%) Amazon EMR
16 19 (2.98%) Amazon EC2
17 17 (2.67%) AWS CloudFormation
17 17 (2.67%) Snowflake
18 10 (1.57%) Azure Stack
19 9 (1.41%) Cloud Functions
Communications & Networking
1 6 (0.94%) SSL
2 5 (0.78%) SSH
3 3 (0.47%) Kerberos
3 3 (0.47%) Unified Communications
4 2 (0.31%) Network Security
5 1 (0.16%) 4G
5 1 (0.16%) DHCP
5 1 (0.16%) DNS
5 1 (0.16%) FTP
5 1 (0.16%) HTTP
5 1 (0.16%) HTTPS
5 1 (0.16%) Intrusion Detection
5 1 (0.16%) IPv4
5 1 (0.16%) IPv6
5 1 (0.16%) LAN
5 1 (0.16%) SMTP
5 1 (0.16%) SNMP
5 1 (0.16%) TACACS
5 1 (0.16%) TCP/IP
5 1 (0.16%) WAN
Database & Business Intelligence
1 138 (21.66%) Data Warehouse
2 132 (20.72%) Big Data
3 102 (16.01%) Data Lake
4 98 (15.38%) NoSQL
5 91 (14.29%) Hadoop
6 74 (11.62%) Power BI
7 67 (10.52%) MongoDB
8 66 (10.36%) Apache Hive
9 61 (9.58%) Relational Database
10 58 (9.11%) Azure SQL Database
11 48 (7.54%) SQL Server
12 42 (6.59%) SQL Server Integration Services
12 42 (6.59%) Tableau
13 39 (6.12%) BigQuery
14 32 (5.02%) Impala
15 31 (4.87%) RDBMS
16 29 (4.55%) Data Mining
17 25 (3.92%) HBase
18 24 (3.77%) PostgreSQL
19 23 (3.61%) Amazon Redshift
Development Applications
1 79 (12.40%) Git (software)
2 56 (8.79%) Jenkins
3 45 (7.06%) JIRA
4 9 (1.41%) Visual Studio Team System
5 8 (1.26%) Visual Studio
6 6 (0.94%) Cucumber
6 6 (0.94%) Maven
7 5 (0.78%) GitLab
7 5 (0.78%) Sonatype Nexus
8 4 (0.63%) ERwin
8 4 (0.63%) IntelliJ
9 3 (0.47%) CircleCI
9 3 (0.47%) JUnit
9 3 (0.47%) Selenium
9 3 (0.47%) SpecFlow
9 3 (0.47%) TeamCity
10 2 (0.31%) GoCD
10 2 (0.31%) Liquibase
10 2 (0.31%) SQL Server Management Studio (SSMS)
10 2 (0.31%) Zephyr
General
1 155 (24.33%) Social Skills
2 134 (21.04%) Finance
3 83 (13.03%) Analytical Skills
4 29 (4.55%) Marketing
5 28 (4.40%) Public Sector
6 27 (4.24%) Banking
6 27 (4.24%) Presentation Skills
7 20 (3.14%) Retail
8 17 (2.67%) Front Office
9 12 (1.88%) Back Office
10 11 (1.73%) Pharmaceutical
11 9 (1.41%) Influencing Skills
12 8 (1.26%) Organisational Skills
13 7 (1.10%) Manufacturing
14 6 (0.94%) Publishing
14 6 (0.94%) Retail Banking
14 6 (0.94%) Telecoms
15 5 (0.78%) Electronics
15 5 (0.78%) Games
15 5 (0.78%) Legal
Job Titles
1 282 (44.27%) Data Engineer
2 86 (13.50%) Developer
3 56 (8.79%) Analyst
4 48 (7.54%) Architect
5 42 (6.59%) Azure Engineer
6 38 (5.97%) Senior Data Engineer
7 35 (5.49%) AWS Engineer
7 35 (5.49%) Data Architect
8 33 (5.18%) Python Engineer
9 30 (4.71%) Data Analyst
10 29 (4.55%) Python Developer
11 21 (3.30%) Data Scientist
12 19 (2.98%) Azure Developer
12 19 (2.98%) Cloud Engineer
13 18 (2.83%) Business Analyst
14 17 (2.67%) Energy Trading Developer
15 16 (2.51%) Consultant
16 15 (2.35%) Java Engineer
16 15 (2.35%) Senior Data Scientist
16 15 (2.35%) Senior Developer
Libraries, Frameworks & Software Standards
1 114 (17.90%) Kafka
2 73 (11.46%) PySpark
3 36 (5.65%) Velocity
4 30 (4.71%) .NET
5 29 (4.55%) Pandas
6 26 (4.08%) NumPy
7 23 (3.61%) Spring
8 21 (3.30%) Spark Streaming
9 19 (2.98%) REST
10 15 (2.35%) Spring Boot
11 13 (2.04%) .NET Core
12 12 (1.88%) React
12 12 (1.88%) scikit-learn
13 11 (1.73%) ADO
13 11 (1.73%) HTML
13 11 (1.73%) JSON
14 10 (1.57%) Apache NiFi
14 10 (1.57%) SciPy
14 10 (1.57%) XML
15 8 (1.26%) Apache Beam
Miscellaneous
1 52 (8.16%) Cloud Native
2 30 (4.71%) Data Structures
3 28 (4.40%) Algorithms
4 18 (2.83%) iPad
4 18 (2.83%) Management Information System
5 16 (2.51%) Virtual Team
6 15 (2.35%) Greenfield Project
6 15 (2.35%) Self-Motivation
7 12 (1.88%) FMCG
8 11 (1.73%) Analytical Mindset
9 10 (1.57%) User Experience
10 9 (1.41%) Hedge funds
11 8 (1.26%) Replication
12 6 (0.94%) Linux Command Line
12 6 (0.94%) NHS
12 6 (0.94%) Reinsurance
13 5 (0.78%) Foreign Exchange (FX)
13 5 (0.78%) Mobile App
13 5 (0.78%) Tandem
13 5 (0.78%) Video Conferencing
Operating Systems
1 28 (4.40%) Unix
2 25 (3.92%) Linux
3 19 (2.98%) Windows
4 4 (0.63%) Android
5 2 (0.31%) AIX
5 2 (0.31%) Apple iOS
6 1 (0.16%) CentOS
6 1 (0.16%) Windows 10
Processes & Methodologies
1 264 (41.44%) Agile Software Development
2 210 (32.97%) Analytics
3 176 (27.63%) ETL
4 154 (24.18%) Data Pipeline
5 149 (23.39%) Data Modelling
6 147 (23.08%) DevOps
7 115 (18.05%) Business Intelligence
8 114 (17.90%) Data Science
9 97 (15.23%) Software Engineering
10 88 (13.81%) Data Management
10 88 (13.81%) Scrum
11 87 (13.66%) Visualisation
12 76 (11.93%) Machine Learning
13 70 (10.99%) Data Architecture
14 67 (10.52%) Computer Science
15 65 (10.20%) Decision-Making
16 62 (9.73%) Microservices
17 53 (8.32%) Data Ingestion
18 51 (8.01%) Data Analytics
19 48 (7.54%) Data Visualisation
Programming Languages
1 351 (55.10%) Python
2 326 (51.18%) SQL
3 127 (19.94%) Java
4 99 (15.54%) Scala
5 55 (8.63%) T-SQL
6 51 (8.01%) C++
7 43 (6.75%) R
8 42 (6.59%) C#
9 40 (6.28%) Go
9 40 (6.28%) PL/SQL
10 23 (3.61%) JavaScript
11 15 (2.35%) VBA
12 12 (1.88%) MATLAB
13 11 (1.73%) Bash Shell
14 10 (1.57%) TypeScript
15 6 (0.94%) Data Analysis Expressions (DAX)
15 6 (0.94%) Groovy
16 5 (0.78%) PowerShell
16 5 (0.78%) Shell Script
17 4 (0.63%) Kotlin
Qualifications
1 78 (12.24%) Security Cleared
2 66 (10.36%) SC Cleared
3 61 (9.58%) Degree
4 19 (2.98%) DV Cleared
5 11 (1.73%) PhD
6 10 (1.57%) ISEB
7 9 (1.41%) AWS Certification
7 9 (1.41%) Computer Science Degree
8 7 (1.10%) Numerate Degree
9 6 (0.94%) Master's Degree
10 5 (0.78%) BPSS Clearance
11 3 (0.47%) TOGAF Certification
12 1 (0.16%) CCA
12 1 (0.16%) CISM
12 1 (0.16%) CISSP
12 1 (0.16%) ISTQB
12 1 (0.16%) PMP
Quality Assurance & Compliance
1 52 (8.16%) Data Quality
2 30 (4.71%) QA
3 8 (1.26%) MiFID
4 7 (1.10%) GDPR
5 4 (0.63%) IFRS
6 3 (0.47%) Disclosure Scotland
7 2 (0.31%) Accessibility
8 1 (0.16%) Actionable Recommendations
8 1 (0.16%) COBIT
8 1 (0.16%) NIST
8 1 (0.16%) PMO
8 1 (0.16%) SLA
System Software
1 30 (4.71%) Docker
2 16 (2.51%) HDFS
3 5 (0.78%) Apache Flume
4 1 (0.16%) Apache ZooKeeper
4 1 (0.16%) KVM
4 1 (0.16%) Snort
4 1 (0.16%) Virtual Machines
Systems Management
1 89 (13.97%) Kubernetes
2 45 (7.06%) Terraform
3 17 (2.67%) Ansible
4 16 (2.51%) Oozie
5 6 (0.94%) Rancher
6 4 (0.63%) Opscode Chef
6 4 (0.63%) Puppet
7 3 (0.47%) Hadoop YARN
8 2 (0.31%) ITRS Geneos
9 1 (0.16%) FreeIPA
9 1 (0.16%) Microsoft Intune
9 1 (0.16%) Prometheus
9 1 (0.16%) SCCM
9 1 (0.16%) Thomson Reuters DACS
9 1 (0.16%) ZABBIX
Vendors
1 158 (24.80%) Databricks
2 99 (15.54%) Microsoft
3 61 (9.58%) Oracle
4 56 (8.79%) Google
5 37 (5.81%) MuleSoft
6 29 (4.55%) Cloudera
7 22 (3.45%) Alteryx
8 21 (3.30%) SAP
9 19 (2.98%) Dataiku
10 18 (2.83%) Informatica
11 16 (2.51%) IBM
12 12 (1.88%) Salesforce.com
13 8 (1.26%) Confluent
14 6 (0.94%) Atlassian
14 6 (0.94%) BiZZdesign
15 5 (0.78%) Facebook
15 5 (0.78%) StreamSets
15 5 (0.78%) Talend
15 5 (0.78%) Teradata
16 3 (0.47%) Sparx