Period
to 29 May 2020

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Data Engineering skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Engineering over the 6 months to 29 May 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Engineering
UK > England
6 months to
29 May 2020
Same period 2019 Same period 2018
Rank 269 386 594
Rank change year-on-year +117 +208 +134
Contract jobs citing Data Engineering 358 538 282
As % of all contract jobs advertised in England 0.86% 0.65% 0.31%
As % of the Processes & Methodologies category 1.00% 0.74% 0.35%
Number of daily rates quoted 227 405 229
Median daily rate £550 £525 £525
Median daily rate % change year-on-year +4.76% - -4.55%
10th Percentile £393 £413 £418
90th Percentile £750 £688 £675
UK median daily rate £538 £525 £513
% change year-on-year +2.38% +2.44% -6.82%
Number of hourly rates quoted 9 3 0
Median hourly rate £35.00 £35.00 -
UK median hourly rate £35.00 £35.00 -

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for process or methodology skills.

All Process and Methodology Skills
England
Contract vacancies with a requirement for process or methodology skills 35,664 72,744 80,337
As % of all contract IT jobs advertised in England 85.77% 87.60% 87.10%
Number of daily rates quoted 22,814 48,413 53,325
Median daily rate £475 £475 £463
Median daily rate % change year-on-year - +2.70% +2.78%
10th Percentile £300 £306 £300
90th Percentile £675 £650 £638
UK median daily rate £475 £475 £450
% change year-on-year - +5.56% +2.86%
Number of hourly rates quoted 1,178 1,885 2,125
Median hourly rate £28.75 £24.91 £22.50
Median hourly rate % change year-on-year +15.42% +10.71% -10.00%
10th Percentile £12.75 £12.00 £11.18
90th Percentile £53.08 £52.50 £50.00
Median hourly rate £30.00 £24.91 £22.00
% change year-on-year +20.43% +13.23% -12.42%

Data Engineering
Job Vacancy Trend in England

Job postings citing Data Engineering as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Engineering in England

Data Engineering
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Data Engineering in England.

Daily rate trend for Data Engineering in England

Data Engineering
Daily Rate Histogram in England

Daily rate distribution for jobs citing Data Engineering in England over the 6 months to 29 May 2020.

Daily rate histogram for Data Engineering in England

Data Engineering
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Data Engineering in England.

Hourly rate trend for Data Engineering in England

Data Engineering
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineering within the England region over the 6 months to 29 May 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
London +71 227 £550 +4.76% 52
South East +128 55 £515 -1.90% 7
Midlands +101 26 £450 -5.26% 3
East of England +50 25 £475 +1.33% 3
West Midlands +75 21 £475 +15.15% 2
North of England +65 11 £613 +22.50% 6
South West +48 6 £431 -38.39% 1
North East +28 6 £650 +30.00%
East Midlands +43 5 £450 -7.69% 1
Yorkshire +49 2 £550 +12.82% 1
North West +45 2 £650 +23.11% 5
Data Engineering
UK

For the 6 months to 29 May 2020, IT contractor jobs citing Data Engineering also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the England region with a requirement for Data Engineering.

1 188 (52.51%) Python
2 151 (42.18%) SQL
3 135 (37.71%) ETL
4 134 (37.43%) AWS
5 130 (36.31%) Agile Software Development
6 123 (34.36%) DevOps
7 111 (31.01%) Big Data
7 111 (31.01%) Analytics
8 109 (30.45%) Azure
9 89 (24.86%) Data Warehouse
10 85 (23.74%) Data Science
11 81 (22.63%) Data Modelling
12 80 (22.35%) Java
12 80 (22.35%) Apache Spark
13 74 (20.67%) Business Intelligence
14 72 (20.11%) Git (software)
14 72 (20.11%) Hadoop
15 68 (18.99%) Finance
16 59 (16.48%) Software Engineering
16 59 (16.48%) GCP
17 57 (15.92%) Docker
18 55 (15.36%) Jenkins
18 55 (15.36%) Microsoft
19 54 (15.08%) Scrum
20 52 (14.53%) Scala
20 52 (14.53%) NoSQL
21 50 (13.97%) Machine Learning
22 47 (13.13%) SQL Server
22 47 (13.13%) Data Lake
23 46 (12.85%) Terraform

Data Engineering
Co-occurring IT Skills in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 80 (22.35%) Apache Spark
2 30 (8.38%) SAS
3 14 (3.91%) Apache
4 13 (3.63%) Confluence
5 11 (3.07%) Apache Airflow
5 11 (3.07%) WebLogic
6 7 (1.96%) Jupyter
7 6 (1.68%) Elasticsearch
7 6 (1.68%) SharePoint
8 2 (0.56%) Luigi
9 1 (0.28%) IBM Domino
9 1 (0.28%) IIS
9 1 (0.28%) OpenStack
9 1 (0.28%) WebSphere
9 1 (0.28%) WebSphere Application Server
Applications
1 6 (1.68%) Microsoft Excel
2 1 (0.28%) MS Visio
Business Applications
1 3 (0.84%) Dynamics AX
2 2 (0.56%) Sparx Enterprise Architect
3 1 (0.28%) FINCAD Analytics
3 1 (0.28%) Magento
3 1 (0.28%) NetSuite
3 1 (0.28%) Shopify
Cloud Services
1 134 (37.43%) AWS
2 109 (30.45%) Azure
3 59 (16.48%) GCP
4 46 (12.85%) Power Platform
5 42 (11.73%) Amazon S3
6 36 (10.06%) Serverless
7 34 (9.50%) Azure Data Factory
8 31 (8.66%) AWS Lambda
9 26 (7.26%) Amazon EC2
10 23 (6.42%) Amazon EMR
11 18 (5.03%) AWS CloudFormation
12 17 (4.75%) PaaS
13 16 (4.47%) Amazon Kinesis
14 11 (3.07%) Amazon Glacier
15 10 (2.79%) Amazon SQS
15 10 (2.79%) Virtual Private Cloud
16 9 (2.51%) Amazon SageMaker
16 9 (2.51%) SaaS
17 8 (2.23%) Cloud Computing
18 7 (1.96%) PowerApps
Communications & Networking
1 8 (2.23%) HTTP
2 6 (1.68%) Firewall
3 5 (1.40%) Skype
4 4 (1.12%) HTTPS
4 4 (1.12%) Kerberos
4 4 (1.12%) SSL
4 4 (1.12%) VPN
5 3 (0.84%) DNS
6 2 (0.56%) Internet
7 1 (0.28%) PuTTY
Database & Business Intelligence
1 111 (31.01%) Big Data
2 89 (24.86%) Data Warehouse
3 72 (20.11%) Hadoop
4 52 (14.53%) NoSQL
5 47 (13.13%) Data Lake
5 47 (13.13%) SQL Server
6 46 (12.85%) Power BI
7 40 (11.17%) Apache Hive
8 38 (10.61%) Amazon Redshift
9 32 (8.94%) Relational Database
10 28 (7.82%) Amazon Athena
11 25 (6.98%) Azure SQL Database
11 25 (6.98%) Pentaho
12 24 (6.70%) Amazon DynamoDB
12 24 (6.70%) Impala
13 22 (6.15%) MongoDB
14 21 (5.87%) Amazon RDS
15 19 (5.31%) SAS EBI
16 18 (5.03%) PostgreSQL
17 17 (4.75%) BusinessObjects XI
Development Applications
1 72 (20.11%) Git (software)
2 55 (15.36%) Jenkins
3 24 (6.70%) JIRA
4 20 (5.59%) GitLab
5 18 (5.03%) Bitbucket
6 13 (3.63%) Maven
6 13 (3.63%) Subversion
7 11 (3.07%) Artifactory
8 5 (1.40%) Gerrit
8 5 (1.40%) Selenium
8 5 (1.40%) Visual Studio Team System
9 3 (0.84%) Postman
10 2 (0.56%) Jasmine
10 2 (0.56%) Karma Test Runner
10 2 (0.56%) Mocha
10 2 (0.56%) Snyk
10 2 (0.56%) SonarQube
10 2 (0.56%) TestLink
11 1 (0.28%) Atlassian Bamboo
11 1 (0.28%) SoapUI
General
1 68 (18.99%) Finance
2 31 (8.66%) Public Sector
3 19 (5.31%) Retail
4 15 (4.19%) Banking
5 8 (2.23%) Marketing
6 7 (1.96%) Front Office
7 6 (1.68%) Manufacturing
7 6 (1.68%) Pharmaceutical
8 5 (1.40%) Legal
9 3 (0.84%) Aerospace
10 2 (0.56%) Automotive
10 2 (0.56%) Electronics
10 2 (0.56%) Financial Institution
10 2 (0.56%) Investment Banking
10 2 (0.56%) Telecoms
11 1 (0.28%) Billing
11 1 (0.28%) Games
11 1 (0.28%) Law
11 1 (0.28%) Military
Job Titles
1 154 (43.02%) Data Engineer
2 49 (13.69%) Developer
3 48 (13.41%) Architect
4 35 (9.78%) AWS Engineer
5 31 (8.66%) DevOps Engineer
6 29 (8.10%) Azure Engineer
7 27 (7.54%) Cloud Engineer
8 26 (7.26%) Software Engineer
9 24 (6.70%) Data Architect
9 24 (6.70%) Python Engineer
10 20 (5.59%) Senior DevOps
11 18 (5.03%) Senior Data Engineer
12 17 (4.75%) Data Scientist
12 17 (4.75%) Senior DevOps Engineer
13 16 (4.47%) Big Data Engineer
14 15 (4.19%) Cloud Architect
15 14 (3.91%) Python Developer
16 12 (3.35%) Solutions Architect
17 11 (3.07%) Analyst
18 10 (2.79%) Hadoop Engineer
Libraries, Frameworks & Software Standards
1 38 (10.61%) Kafka
2 16 (4.47%) .NET
3 15 (4.19%) React
4 14 (3.91%) Pandas
4 14 (3.91%) Web Services
5 13 (3.63%) NumPy
5 13 (3.63%) REST
6 11 (3.07%) Django
6 11 (3.07%) PySpark
6 11 (3.07%) scikit-learn
7 8 (2.23%) AngularJS
7 8 (2.23%) CSS
7 8 (2.23%) HTML
8 7 (1.96%) OAuth
8 7 (1.96%) RESTful
8 7 (1.96%) TensorFlow
9 6 (1.68%) D3.js
9 6 (1.68%) SQLAlchemy
10 5 (1.40%) Flask
10 5 (1.40%) Node.js
Miscellaneous
1 32 (8.94%) Analytical Skills
2 26 (7.26%) Greenfield Project
3 16 (4.47%) Data Structures
4 12 (3.35%) Hybrid Cloud
5 11 (3.07%) Reference Data
5 11 (3.07%) User Experience
6 10 (2.79%) Data Centre
7 9 (2.51%) Algorithms
8 8 (2.23%) Public Cloud
9 7 (1.96%) Cloud Native
10 6 (1.68%) Management Information System
11 5 (1.40%) Linux Command Line
11 5 (1.40%) Self-Motivation
12 4 (1.12%) Derivative
12 4 (1.12%) Enterprise Software
12 4 (1.12%) Fixed Income
12 4 (1.12%) Hedge funds
12 4 (1.12%) Mobile App
13 3 (0.84%) Blog
13 3 (0.84%) FMCG
Operating Systems
1 42 (11.73%) Linux
2 35 (9.78%) Unix
3 1 (0.28%) Apple iOS
3 1 (0.28%) VME
3 1 (0.28%) Windows
Processes & Methodologies
1 135 (37.71%) ETL
2 130 (36.31%) Agile Software Development
3 123 (34.36%) DevOps
4 111 (31.01%) Analytics
5 85 (23.74%) Data Science
6 81 (22.63%) Data Modelling
7 74 (20.67%) Business Intelligence
8 59 (16.48%) Software Engineering
9 54 (15.08%) Scrum
10 50 (13.97%) Machine Learning
11 46 (12.85%) Visualisation
12 42 (11.73%) Data Analytics
13 39 (10.89%) Continuous Integration
14 36 (10.06%) Infrastructure as Code
15 35 (9.78%) Data Visualisation
16 31 (8.66%) Artificial Intelligence
16 31 (8.66%) Data Architecture
17 30 (8.38%) Stakeholder Management
18 27 (7.54%) Data Analysis
19 26 (7.26%) Mathematics
Programming Languages
1 188 (52.51%) Python
2 151 (42.18%) SQL
3 80 (22.35%) Java
4 52 (14.53%) Scala
5 34 (9.50%) C#
6 24 (6.70%) PL/SQL
7 19 (5.31%) JavaScript
8 17 (4.75%) R
9 12 (3.35%) Bash Shell
9 12 (3.35%) Shell Script
10 11 (3.07%) SAS Macro
11 10 (2.79%) Perl
11 10 (2.79%) T-SQL
12 9 (2.51%) Go
13 7 (1.96%) PowerShell
14 5 (1.40%) Ruby
14 5 (1.40%) TypeScript
15 4 (1.12%) C++
16 3 (0.84%) C
16 3 (0.84%) CQL
Qualifications
1 44 (12.29%) Security Cleared
2 41 (11.45%) SC Cleared
3 31 (8.66%) Degree
4 10 (2.79%) AWS Certification
5 6 (1.68%) PhD
6 4 (1.12%) Master's Degree
7 3 (0.84%) Computer Science Degree
7 3 (0.84%) DV Cleared
7 3 (0.84%) Numerate Degree
8 2 (0.56%) BPSS Clearance
8 2 (0.56%) MBA
9 1 (0.28%) APMP
9 1 (0.28%) ISEB
9 1 (0.28%) ISTQB
9 1 (0.28%) Oracle Certification
9 1 (0.28%) Postgraduate
9 1 (0.28%) TOGAF Certification
Quality Assurance & Compliance
1 16 (4.47%) QA
2 15 (4.19%) Data Quality
3 3 (0.84%) GDPR
4 2 (0.56%) GxP
5 1 (0.28%) COBIT
5 1 (0.28%) ISO/IEC 27001
System Software
1 57 (15.92%) Docker
2 18 (5.03%) HDFS
3 8 (2.23%) Virtual Machines
4 2 (0.56%) Apache Flume
5 1 (0.28%) VMware Infrastructure
Systems Management
1 46 (12.85%) Terraform
2 43 (12.01%) Kubernetes
3 37 (10.34%) Ansible
4 6 (1.68%) Oozie
5 5 (1.40%) Hadoop YARN
6 4 (1.12%) Ambari
6 4 (1.12%) Grafana
6 4 (1.12%) Opscode Chef
6 4 (1.12%) Single Sign-On
7 2 (0.56%) HP ALM
7 2 (0.56%) Kibana
7 2 (0.56%) Puppet
8 1 (0.28%) Istio
8 1 (0.28%) Kubeflow
8 1 (0.28%) linkerd
8 1 (0.28%) Prometheus
Vendors
1 55 (15.36%) Microsoft
2 44 (12.29%) Oracle
3 37 (10.34%) Cloudera
4 33 (9.22%) Google
5 32 (8.94%) Tableau
6 28 (7.82%) Databricks
7 20 (5.59%) Informatica
8 18 (5.03%) Talend
9 17 (4.75%) SAP
10 9 (2.51%) Alteryx
11 6 (1.68%) Hortonworks
12 4 (1.12%) Teradata
12 4 (1.12%) Trillium
13 3 (0.84%) Birst
13 3 (0.84%) Splunk
13 3 (0.84%) Sybase
14 2 (0.56%) Foundry
14 2 (0.56%) Mapbox
14 2 (0.56%) Palantir
14 2 (0.56%) Sparx