Period
to 23 November 2020

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Data Engineering skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Engineering over the 6 months to 23 November 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineering
UK > England
6 months to
23 Nov 2020
Same period 2019 Same period 2018
Rank 252 360 595
Rank change year-on-year +108 +235 +133
Contract jobs citing Data Engineering 296 508 288
As % of all contract jobs advertised in England 0.98% 0.68% 0.30%
As % of the Processes & Methodologies category 1.13% 0.78% 0.35%
Number of daily rates quoted 253 401 181
Median daily rate £525 £550 £550
Median daily rate % change year-on-year -4.55% - +12.82%
10th Percentile £390 £419 £375
90th Percentile £675 £713 £675
UK median daily rate £525 £550 £550
% change year-on-year -4.55% - +11.68%
Number of hourly rates quoted 15 5 0
Median hourly rate £22.50 £52.50 -
Median hourly rate % change year-on-year -57.14% - -
UK median hourly rate £23.75 £43.75 £75.00
% change year-on-year -45.71% -41.67% +61.29%

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for process or methodology skills.

All Process and Methodology Skills
England
Contract vacancies with a requirement for process or methodology skills 26,177 64,808 82,788
As % of all contract IT jobs advertised in England 86.35% 86.43% 87.20%
Number of daily rates quoted 16,765 42,836 55,469
Median daily rate £475 £475 £475
10th Percentile £300 £300 £300
90th Percentile £675 £650 £650
UK median daily rate £475 £475 £463
% change year-on-year - +2.70% +2.78%
Number of hourly rates quoted 994 1,995 2,118
Median hourly rate £35.00 £24.00 £22.00
Median hourly rate % change year-on-year +45.83% +9.09% -6.38%
10th Percentile £12.50 £11.97 £11.44
90th Percentile £57.50 £53.75 £51.00
Median hourly rate £35.00 £23.75 £22.00
% change year-on-year +47.37% +7.95% -4.50%

Data Engineering
Job Vacancy Trend in England

Job postings citing Data Engineering as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Engineering in England

Data Engineering
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Data Engineering in England.

Daily rate trend for Data Engineering in England

Data Engineering
Daily Rate Histogram in England

Daily rate distribution for jobs citing Data Engineering in England over the 6 months to 23 November 2020.

Daily rate histogram for Data Engineering in England

Data Engineering
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Data Engineering in England.

Hourly rate trend for Data Engineering in England

Data Engineering
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Data Engineering in England over the 6 months to 23 November 2020.

Hourly rate histogram for Data Engineering in England

Data Engineering
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineering within the England region over the 6 months to 23 November 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +21 171 £550 - 59
North of England +125 52 £450 -10.00% 26
Yorkshire +87 31 £450 -10.00% 14
South East +141 19 £475 -9.52% 23
South West +101 16 £601 -17.07% 4
North West +72 13 £523 -0.48% 5
East of England +75 9 £475 -13.64% 7
North East +41 7 £431 +1.47% 7
Midlands +77 5 £550 +15.79% 9
East Midlands +49 3 - - 4
West Midlands +51 2 £550 +4.76% 5
Data Engineering
UK

For the 6 months to 23 November 2020, IT contractor jobs citing Data Engineering also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Data Engineering.

1 175 (59.12%) Python
2 122 (41.22%) Agile Software Development
3 113 (38.18%) SQL
4 95 (32.09%) Big Data
5 86 (29.05%) AWS
6 79 (26.69%) Java
7 75 (25.34%) Data Science
8 74 (25.00%) ETL
8 74 (25.00%) DevOps
9 73 (24.66%) Azure
10 70 (23.65%) Data Modelling
11 61 (20.61%) Business Intelligence
12 54 (18.24%) Apache Spark
13 51 (17.23%) Git (software)
13 51 (17.23%) Test Automation
13 51 (17.23%) Analytics
13 51 (17.23%) Data Warehouse
14 50 (16.89%) Security Cleared
15 49 (16.55%) Jenkins
16 46 (15.54%) Docker
16 46 (15.54%) Scrum
17 43 (14.53%) Hadoop
18 42 (14.19%) JSON
18 42 (14.19%) SC Cleared
19 41 (13.85%) Finance
19 41 (13.85%) GitHub
19 41 (13.85%) Kubernetes
20 40 (13.51%) Scala
21 39 (13.18%) Data Lake
22 38 (12.84%) React

Data Engineering
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 54 (18.24%) Apache Spark
2 34 (11.49%) Confluence
3 29 (9.80%) Cloud Foundry
4 25 (8.45%) Mule
5 10 (3.38%) Apache
6 8 (2.70%) Apache Airflow
7 7 (2.36%) Elasticsearch
8 6 (2.03%) nginx
9 5 (1.69%) Jupyter
10 3 (1.01%) SharePoint
11 2 (0.68%) ArcGIS
11 2 (0.68%) SAS
11 2 (0.68%) SharePoint 2010
11 2 (0.68%) SharePoint 2013
12 1 (0.34%) IIS
Applications
1 2 (0.68%) Microsoft Office
2 1 (0.34%) Microsoft Excel
2 1 (0.34%) Spreadsheet
Business Applications
1 1 (0.34%) Pegasus Opera
1 1 (0.34%) Sage 50
1 1 (0.34%) Sage X3
Cloud Services
1 86 (29.05%) AWS
2 73 (24.66%) Azure
3 41 (13.85%) GitHub
4 33 (11.15%) PaaS
4 33 (11.15%) Power Platform
5 31 (10.47%) GCP
6 28 (9.46%) Slack
7 26 (8.78%) IaaS
8 22 (7.43%) Amazon S3
9 21 (7.09%) Azure Data Factory
10 16 (5.41%) Serverless
11 13 (4.39%) Amazon EMR
12 12 (4.05%) AWS Lambda
13 7 (2.36%) AWS Step Functions
14 6 (2.03%) AWS CloudFormation
15 5 (1.69%) Amazon EKS
15 5 (1.69%) Amazon SQS
16 4 (1.35%) Dynamics 365
16 4 (1.35%) npm
17 3 (1.01%) Amazon SageMaker
Communications & Networking
1 3 (1.01%) Firewall
1 3 (1.01%) HTTP
1 3 (1.01%) HTTPS
1 3 (1.01%) Internet
1 3 (1.01%) SSL
2 1 (0.34%) Kerberos
Database & Business Intelligence
1 95 (32.09%) Big Data
2 51 (17.23%) Data Warehouse
3 43 (14.53%) Hadoop
4 39 (13.18%) Data Lake
5 34 (11.49%) Apache Hive
6 33 (11.15%) Power BI
7 28 (9.46%) NoSQL
8 27 (9.12%) Relational Database
9 21 (7.09%) Impala
10 17 (5.74%) SQL Server
11 15 (5.07%) Tableau
12 13 (4.39%) BigQuery
12 13 (4.39%) PostgreSQL
13 12 (4.05%) Azure SQL Database
14 11 (3.72%) Amazon Redshift
14 11 (3.72%) SQL Server Reporting Services
15 10 (3.38%) Azure SQL Data Warehouse
15 10 (3.38%) SQL Server Analysis Services
15 10 (3.38%) SQL Server Integration Services
16 9 (3.04%) MS Access
Development Applications
1 51 (17.23%) Git (software)
2 49 (16.55%) Jenkins
3 37 (12.50%) Maven
4 35 (11.82%) JIRA
5 32 (10.81%) Sonatype Nexus
6 28 (9.46%) Mockito
7 27 (9.12%) Android Studio
7 27 (9.12%) CocoaPods
7 27 (9.12%) JUnit
7 27 (9.12%) Xcode
8 26 (8.78%) IntelliJ
9 8 (2.70%) RStudio
10 6 (2.03%) Bitbucket
10 6 (2.03%) Vagrant
11 5 (1.69%) Atlassian Bamboo
11 5 (1.69%) CircleCI
11 5 (1.69%) Selenium
12 4 (1.35%) Gradle
12 4 (1.35%) SonarQube
12 4 (1.35%) Travis CI
General
1 41 (13.85%) Finance
2 21 (7.09%) Banking
3 16 (5.41%) Public Sector
4 9 (3.04%) Marketing
5 8 (2.70%) Games
5 8 (2.70%) Retail
6 7 (2.36%) Front Office
7 6 (2.03%) Manufacturing
7 6 (2.03%) Telecoms
8 5 (1.69%) Electronics
8 5 (1.69%) Pharmaceutical
8 5 (1.69%) Retail Banking
9 4 (1.35%) Advertising
10 2 (0.68%) Investment Banking
11 1 (0.34%) Law
11 1 (0.34%) Legal
11 1 (0.34%) Publishing
Job Titles
1 134 (45.27%) Data Engineer
2 34 (11.49%) Developer
3 31 (10.47%) Python Engineer
4 27 (9.12%) Data Scientist
5 24 (8.11%) AWS Engineer
6 23 (7.77%) DevOps Engineer
7 22 (7.43%) Azure Engineer
8 19 (6.42%) Architect
8 19 (6.42%) Big Data Engineer
9 16 (5.41%) Cloud Engineer
10 11 (3.72%) Senior Data Engineer
11 9 (3.04%) Data Architect
11 9 (3.04%) Python Developer
11 9 (3.04%) Senior DevOps
11 9 (3.04%) Senior DevOps Engineer
12 8 (2.70%) Hadoop Engineer
12 8 (2.70%) Head of Engineering
13 7 (2.36%) Java Engineer
13 7 (2.36%) Solutions Architect
14 6 (2.03%) Java Developer
Libraries, Frameworks & Software Standards
1 42 (14.19%) JSON
2 38 (12.84%) React
3 36 (12.16%) REST
4 34 (11.49%) Node.js
5 31 (10.47%) Kafka
5 31 (10.47%) Spring
6 30 (10.14%) Spring Boot
7 27 (9.12%) WireMock
8 16 (5.41%) PySpark
9 15 (5.07%) Web Services
10 11 (3.72%) .NET
11 9 (3.04%) HTML
12 7 (2.36%) AngularJS
12 7 (2.36%) XML
12 7 (2.36%) YAML
13 6 (2.03%) Django
13 6 (2.03%) TensorFlow
14 5 (1.69%) .NET Framework
14 5 (1.69%) Backbone.js
14 5 (1.69%) CSS
Miscellaneous
1 30 (10.14%) Mobile App
2 27 (9.12%) Analytical Skills
3 21 (7.09%) Greenfield Project
4 10 (3.38%) Algorithms
4 10 (3.38%) iPad
5 8 (2.70%) Cloud Native
6 7 (2.36%) Data Structures
6 7 (2.36%) User Experience
7 5 (1.69%) Lidar
7 5 (1.69%) Reference Data
8 4 (1.35%) Blog
8 4 (1.35%) Management Information System
9 3 (1.01%) Fixed Income
9 3 (1.01%) FMCG
9 3 (1.01%) Hedge funds
9 3 (1.01%) Life Science
9 3 (1.01%) Linux Command Line
9 3 (1.01%) Self-Motivation
10 2 (0.68%) Linked Data
10 2 (0.68%) Mobile Banking
Operating Systems
1 27 (9.12%) Android
1 27 (9.12%) Apple iOS
2 12 (4.05%) Linux
2 12 (4.05%) Unix
3 9 (3.04%) AIX
4 2 (0.68%) Ubuntu
4 2 (0.68%) Windows
5 1 (0.34%) Robot Operating System
Processes & Methodologies
1 122 (41.22%) Agile Software Development
2 75 (25.34%) Data Science
3 74 (25.00%) DevOps
3 74 (25.00%) ETL
4 70 (23.65%) Data Modelling
5 61 (20.61%) Business Intelligence
6 51 (17.23%) Analytics
6 51 (17.23%) Test Automation
7 46 (15.54%) Scrum
8 33 (11.15%) Visualisation
9 31 (10.47%) Kanban
10 30 (10.14%) Data Ingestion
10 30 (10.14%) ETL Development
11 29 (9.80%) Machine Learning
11 29 (9.80%) Pair Programming
11 29 (9.80%) Scaled Agile Framework
12 28 (9.46%) Software Engineering
13 27 (9.12%) Android Development
13 27 (9.12%) Continuous Integration
13 27 (9.12%) iOS Development
Programming Languages
1 175 (59.12%) Python
2 113 (38.18%) SQL
3 79 (26.69%) Java
4 40 (13.51%) Scala
5 31 (10.47%) Java 8
6 27 (9.12%) Apple Swift
6 27 (9.12%) Kotlin
7 24 (8.11%) R
8 13 (4.39%) C#
9 10 (3.38%) JavaScript
9 10 (3.38%) PowerShell
10 9 (3.04%) Go
11 7 (2.36%) Bash Shell
11 7 (2.36%) VBA
12 6 (2.03%) T-SQL
13 5 (1.69%) MATLAB
14 4 (1.35%) PL/SQL
14 4 (1.35%) TypeScript
15 3 (1.01%) C
15 3 (1.01%) C++
Qualifications
1 50 (16.89%) Security Cleared
2 42 (14.19%) SC Cleared
3 17 (5.74%) Degree
4 9 (3.04%) AWS Certification
5 6 (2.03%) Computer Science Degree
6 3 (1.01%) PhD
6 3 (1.01%) TOGAF Certification
7 2 (0.68%) BPSS Clearance
7 2 (0.68%) CCNA
7 2 (0.68%) Cisco Certification
7 2 (0.68%) Master's Degree
7 2 (0.68%) Numerate Degree
8 1 (0.34%) DBS Check
8 1 (0.34%) DV Cleared
8 1 (0.34%) ISTQB
8 1 (0.34%) Microsoft Certification
8 1 (0.34%) PMP
8 1 (0.34%) Postgraduate
Quality Assurance & Compliance
1 27 (9.12%) QA
2 16 (5.41%) Data Quality
3 2 (0.68%) SLA
4 1 (0.34%) Disclosure Scotland
4 1 (0.34%) GDPR
4 1 (0.34%) ISO/IEC 27001
System Software
1 46 (15.54%) Docker
2 24 (8.11%) HDFS
3 4 (1.35%) Virtual Machines
4 2 (0.68%) Apache Flume
4 2 (0.68%) VirtualBox
4 2 (0.68%) VMware Infrastructure
Systems Management
1 41 (13.85%) Kubernetes
2 32 (10.81%) Terraform
3 11 (3.72%) Ansible
4 6 (2.03%) Packer
5 5 (1.69%) Argo
5 5 (1.69%) Hadoop YARN
6 4 (1.35%) Docker Swarm
6 4 (1.35%) Opscode Chef
7 2 (0.68%) Kibana
7 2 (0.68%) Nessus
8 1 (0.34%) Grafana
8 1 (0.34%) HP ALM
8 1 (0.34%) HP Quality Center
8 1 (0.34%) Prometheus
8 1 (0.34%) Puppet
8 1 (0.34%) Single Sign-On
Vendors
1 36 (12.16%) Databricks
2 29 (9.80%) Microsoft
3 26 (8.78%) Cloudera
3 26 (8.78%) Splunk
4 25 (8.45%) AppDynamics
5 24 (8.11%) Google
6 13 (4.39%) Informatica
7 9 (3.04%) SAP
8 8 (2.70%) Talend
9 7 (2.36%) Hortonworks
9 7 (2.36%) Oracle
10 5 (1.69%) Atlassian
11 4 (1.35%) Veracode
12 3 (1.01%) IBM
13 2 (0.68%) Alteryx
13 2 (0.68%) Bloomberg
13 2 (0.68%) Cisco
13 2 (0.68%) Twitter
13 2 (0.68%) VMware
14 1 (0.34%) MapR