Period
to 10 July 2020

The following table provides summary statistics for contract job vacancies with a requirement for Data Cleansing skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Cleansing over the 6 months to 10 July 2020 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Cleansing (Data Cleaning, Data Scrubbing)
UK
6 months to
10 Jul 2020
Same period 2019 Same period 2018
Rank 396 444 490
Rank change year-on-year +48 +46 -40
Contract jobs citing Data Cleansing 188 480 462
As % of all contract jobs advertised in the UK 0.46% 0.51% 0.44%
As % of the Processes & Methodologies category 0.53% 0.59% 0.51%
Number of daily rates quoted 121 350 293
Median daily rate £475 £481 £425
Median daily rate % change year-on-year -1.30% +13.24% +6.25%
10th Percentile £325 £250 £275
90th Percentile £625 £626 £588
UK excluding London median daily rate £463 £445 £425
% change year-on-year +3.93% +4.71% +10.39%
Number of hourly rates quoted 8 7 14
Median hourly rate £33.75 £22.50 £19.75
Median hourly rate % change year-on-year +50.00% +13.92% +19.70%
10th Percentile £20.13 £14.75 £10.80
90th Percentile £42.88 £29.00 £38.50
UK excluding London median hourly rate £22.50 £20.75 £15.00
% change year-on-year +8.43% +38.33% -9.09%

Data Cleansing is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for process or methodology skills.

All Process and Methodology Skills
UK
Contract vacancies with a requirement for process or methodology skills 35,211 81,519 90,377
As % of all contract IT jobs advertised in the UK 85.83% 87.06% 86.90%
Number of daily rates quoted 22,169 53,676 59,547
Median daily rate £475 £475 £450
Median daily rate % change year-on-year - +5.56% +2.27%
10th Percentile £300 £300 £300
90th Percentile £675 £650 £638
UK excluding London median daily rate £450 £438 £423
% change year-on-year +2.86% +3.55% +5.63%
Number of hourly rates quoted 1,218 2,297 2,462
Median hourly rate £31.61 £24.66 £21.50
Median hourly rate % change year-on-year +28.18% +14.70% -14.00%
10th Percentile £12.76 £11.85 £11.17
90th Percentile £54.00 £52.50 £50.00
Median hourly rate £24.20 £24.00 £20.00
% change year-on-year +0.81% +20.00% -20.00%

Data Cleansing
Job Vacancy Trend

Job postings citing Data Cleansing as a proportion of all IT jobs advertised.

Job vacancy trend for Data Cleansing in the UK

Data Cleansing
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Cleansing.

Daily rate trend for Data Cleansing in the UK

Data Cleansing
Daily Rate Histogram

Daily rate distribution for jobs citing Data Cleansing over the 6 months to 10 July 2020.

Daily rate histogram for Data Cleansing in the UK

Data Cleansing
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Cleansing.

Hourly rate trend for Data Cleansing in the UK

Data Cleansing
Hourly Rate Histogram

Hourly rate distribution of jobs citing Data Cleansing over the 6 months to 10 July 2020.

Hourly rate histogram for Data Cleansing in the UK

Data Cleansing
Top 14 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Cleansing within the UK over the 6 months to 10 July 2020. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +16 174 £475 -2.56% 30
London +73 108 £495 -5.71% 15
UK excluding London +82 73 £463 +3.93% 16
South East +116 31 £475 +11.76% 4
Work from Home -10 15 £425 -5.56% 6
East of England +54 10 £495 -1.00% 4
North of England +84 9 £360 -22.16% 1
Midlands +49 8 £375 -6.25% 3
Wales +38 8 £475 +2.70% 1
South West +74 7 £375 -25.00% 3
West Midlands +61 5 £350 -12.50% 2
North West +54 5 £360 -22.16% 1
Yorkshire +74 4 £175 -66.67%
East Midlands +35 3 £488 +19.63% 1

For the 6 months to 10 July 2020, IT contractor jobs citing Data Cleansing also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Cleansing.

1 102 (54.26%) Migration
2 91 (48.40%) SQL
3 80 (42.55%) Data Migration
4 49 (26.06%) Validation
4 49 (26.06%) ETL
5 46 (24.47%) Data Quality
6 45 (23.94%) Finance
6 45 (23.94%) Microsoft Excel
6 45 (23.94%) Data Modelling
7 44 (23.40%) Data Analysis
8 42 (22.34%) Business Intelligence
9 41 (21.81%) Oracle
10 38 (20.21%) SQL Server
11 36 (19.15%) Analytics
12 34 (18.09%) Agile Software Development
13 29 (15.43%) Python
14 26 (13.83%) SAP
15 25 (13.30%) Data Management
15 25 (13.30%) Data Governance
15 25 (13.30%) Analytical Skills
16 23 (12.23%) Microsoft
17 22 (11.70%) GDPR
18 21 (11.17%) Problem-Solving
19 20 (10.64%) Data Validation
20 18 (9.57%) Data Mapping
20 18 (9.57%) ERP
21 17 (9.04%) Big Data
21 17 (9.04%) Public Sector
22 16 (8.51%) Apache Spark
22 16 (8.51%) Security Cleared

Data Cleansing
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 16 (8.51%) Apache Spark
2 6 (3.19%) Apache
3 4 (2.13%) Apache Airflow
3 4 (2.13%) Elasticsearch
3 4 (2.13%) SharePoint
4 3 (1.60%) Jupyter
5 2 (1.06%) Confluence
5 2 (1.06%) Oracle Workflow
6 1 (0.53%) SAS
Applications
1 45 (23.94%) Microsoft Excel
2 9 (4.79%) Microsoft Office
3 4 (2.13%) Microsoft PowerPoint
4 2 (1.06%) Microsoft Project
4 2 (1.06%) MS Visio
Business Applications
1 8 (4.26%) Northgate Housing
2 7 (3.72%) SAP S/4HANA
3 5 (2.66%) SAP ERP
4 4 (2.13%) Dynamics AX
5 3 (1.60%) Dynamics CRM
5 3 (1.60%) SAP MDG
6 2 (1.06%) Oracle BPM
6 2 (1.06%) Oracle Cash Management
6 2 (1.06%) Oracle Payables
6 2 (1.06%) Oracle Procure-to-Pay
6 2 (1.06%) Oracle Receivables
6 2 (1.06%) SAP MDM
7 1 (0.53%) Eloqua
7 1 (0.53%) NetSuite
7 1 (0.53%) Oracle Payroll
7 1 (0.53%) Salesforce.com CRM
7 1 (0.53%) SAP Oil and Gas
7 1 (0.53%) SAP PP
7 1 (0.53%) SAP R/3
7 1 (0.53%) SAP SD
Cloud Services
1 13 (6.91%) Power Platform
2 8 (4.26%) AWS
2 8 (4.26%) Azure
3 7 (3.72%) Dynamics 365
4 5 (2.66%) GCP
5 3 (1.60%) Azure Data Factory
5 3 (1.60%) OpenShift
5 3 (1.60%) PaaS
5 3 (1.60%) SaaS
6 2 (1.06%) Azure Machine Learning
6 2 (1.06%) Azure Stack
6 2 (1.06%) Cloud Computing
6 2 (1.06%) GitHub
6 2 (1.06%) Google Analytics
6 2 (1.06%) Trello
7 1 (0.53%) AdWords
7 1 (0.53%) Office 365
7 1 (0.53%) OneDrive
7 1 (0.53%) PowerApps
7 1 (0.53%) SuccessFactors
Communications & Networking
1 4 (2.13%) DNS
2 3 (1.60%) HTTP
3 2 (1.06%) Radio Access Network
4 1 (0.53%) 2G
4 1 (0.53%) 3G
4 1 (0.53%) 4G
4 1 (0.53%) 5G
4 1 (0.53%) Internet
Database & Business Intelligence
1 38 (20.21%) SQL Server
2 17 (9.04%) Big Data
3 15 (7.98%) Relational Database
4 14 (7.45%) Data Mining
5 13 (6.91%) Data Warehouse
5 13 (6.91%) Power BI
6 12 (6.38%) Hadoop
7 10 (5.32%) Apache Hive
7 10 (5.32%) Crystal Reports
7 10 (5.32%) QlikView
7 10 (5.32%) SQL Server Reporting Services
8 9 (4.79%) Impala
8 9 (4.79%) Oracle Reports
9 6 (3.19%) MySQL
9 6 (3.19%) SQL Server Analysis Services
10 4 (2.13%) BigQuery
10 4 (2.13%) Microsoft Analysis Services
10 4 (2.13%) MongoDB
10 4 (2.13%) SQL Server Integration Services
11 3 (1.60%) Apache Cassandra
Development Applications
1 8 (4.26%) JIRA
2 6 (3.19%) Git (software)
3 4 (2.13%) LSMW
4 3 (1.60%) Bitbucket
4 3 (1.60%) Jenkins
4 3 (1.60%) JUnit
5 1 (0.53%) Eclipse
5 1 (0.53%) Selenium
5 1 (0.53%) SQL Server Management Studio (SSMS)
5 1 (0.53%) Team Foundation Server
5 1 (0.53%) Visual Studio Team System
5 1 (0.53%) XMLSpy
General
1 45 (23.94%) Finance
2 17 (9.04%) Public Sector
3 13 (6.91%) Local Government
4 9 (4.79%) Banking
5 6 (3.19%) Manufacturing
5 6 (3.19%) Marketing
5 6 (3.19%) Retail
6 4 (2.13%) Front Office
6 4 (2.13%) Telecoms
7 3 (1.60%) Billing
8 2 (1.06%) French Language
8 2 (1.06%) General Ledger
8 2 (1.06%) German Language
8 2 (1.06%) Investment Banking
9 1 (0.53%) Aerospace
9 1 (0.53%) Electronics
Job Titles
1 73 (38.83%) Analyst
2 48 (25.53%) Data Analyst
3 30 (15.96%) Developer
4 17 (9.04%) Business Analyst
4 17 (9.04%) Data Engineer
5 14 (7.45%) Data Migration Lead
6 13 (6.91%) Architect
7 12 (6.38%) Data Manager
8 9 (4.79%) Business Intelligence Developer
8 9 (4.79%) Data Architect
8 9 (4.79%) Data Migration Analyst
8 9 (4.79%) Migration Analyst
8 9 (4.79%) SQL Developer
9 7 (3.72%) Data Migration Specialist
9 7 (3.72%) Migration Specialist
10 6 (3.19%) Data Business Analyst
10 6 (3.19%) Migration Manager
10 6 (3.19%) Project Manager
10 6 (3.19%) SAP Architect
10 6 (3.19%) SQL Analyst
Libraries, Frameworks & Software Standards
1 10 (5.32%) XML
2 8 (4.26%) .NET
2 8 (4.26%) RESTful
3 6 (3.19%) ASP.NET
3 6 (3.19%) Oracle Fusion
4 5 (2.66%) ASP.NET MVC
5 4 (2.13%) CSS
5 4 (2.13%) HTML
5 4 (2.13%) Kafka
6 3 (1.60%) ggplot2
6 3 (1.60%) Gherkin
6 3 (1.60%) JPA
6 3 (1.60%) Matplotlib
6 3 (1.60%) pytest
6 3 (1.60%) SAP Basis
6 3 (1.60%) SAP Fiori
6 3 (1.60%) Seaborn
6 3 (1.60%) Spring
6 3 (1.60%) Spring Boot
7 2 (1.06%) Shiny
Miscellaneous
1 25 (13.30%) Analytical Skills
2 11 (5.85%) Management Information System
3 7 (3.72%) Data Structures
3 7 (3.72%) User Experience
4 4 (2.13%) Algorithms
4 4 (2.13%) Enterprise Software
4 4 (2.13%) Taxonomies
5 3 (1.60%) Greenfield Project
5 3 (1.60%) Reference Data
5 3 (1.60%) Reinsurance
5 3 (1.60%) Self-Motivation
6 2 (1.06%) FMCG
6 2 (1.06%) Freedom of Information
6 2 (1.06%) Shadow IT
6 2 (1.06%) Virtual Team
7 1 (0.53%) Derivative
7 1 (0.53%) Equities
7 1 (0.53%) RIA
7 1 (0.53%) SCADA
7 1 (0.53%) Smartphone
Operating Systems
1 4 (2.13%) Linux
2 3 (1.60%) Windows
3 2 (1.06%) Debian
3 2 (1.06%) Windows Server
4 1 (0.53%) Red Hat Enterprise Linux
Processes & Methodologies
1 102 (54.26%) Migration
2 80 (42.55%) Data Migration
3 49 (26.06%) ETL
3 49 (26.06%) Validation
4 45 (23.94%) Data Modelling
5 44 (23.40%) Data Analysis
6 42 (22.34%) Business Intelligence
7 36 (19.15%) Analytics
8 34 (18.09%) Agile Software Development
9 25 (13.30%) Data Governance
9 25 (13.30%) Data Management
10 21 (11.17%) Problem-Solving
11 20 (10.64%) Data Validation
12 18 (9.57%) Data Mapping
12 18 (9.57%) ERP
13 15 (7.98%) Data Architecture
13 15 (7.98%) Data Engineering
14 14 (7.45%) Scrum
14 14 (7.45%) Visualisation
14 14 (7.45%) Waterfall
Programming Languages
1 91 (48.40%) SQL
2 29 (15.43%) Python
3 15 (7.98%) T-SQL
4 14 (7.45%) Java
5 10 (5.32%) VBA
6 9 (4.79%) Scala
7 8 (4.26%) PL/SQL
8 6 (3.19%) R
9 5 (2.66%) VB
10 3 (1.60%) ABAP
10 3 (1.60%) Bash Shell
10 3 (1.60%) CQL
10 3 (1.60%) Java 8
10 3 (1.60%) JavaScript
10 3 (1.60%) PowerShell
11 2 (1.06%) C
11 2 (1.06%) C#
11 2 (1.06%) Shell Script
12 1 (0.53%) C++
12 1 (0.53%) VB.NET
Qualifications
1 16 (8.51%) Security Cleared
2 13 (6.91%) SC Cleared
3 9 (4.79%) Degree
4 5 (2.66%) BPSS Clearance
5 2 (1.06%) DV Cleared
6 1 (0.53%) BC Cleared
6 1 (0.53%) Computer Science Degree
6 1 (0.53%) ISEB
6 1 (0.53%) MBA
6 1 (0.53%) PhD
Quality Assurance & Compliance
1 46 (24.47%) Data Quality
2 22 (11.70%) GDPR
3 9 (4.79%) QA
4 8 (4.26%) IFRS
4 8 (4.26%) Solvency II
5 2 (1.06%) Sarbanes-Oxley
5 2 (1.06%) SLA
System Software
1 8 (4.26%) HDFS
2 3 (1.60%) Docker
3 1 (0.53%) Active Directory
3 1 (0.53%) VMware Infrastructure
Systems Management
1 6 (3.19%) Kubernetes
2 3 (1.60%) Grafana
3 1 (0.53%) SCCM
Vendors
1 41 (21.81%) Oracle
2 26 (13.83%) SAP
3 23 (12.23%) Microsoft
4 11 (5.85%) Northgate
4 11 (5.85%) Salesforce.com
5 9 (4.79%) Cloudera
6 8 (4.26%) Tableau
7 7 (3.72%) Google
8 5 (2.66%) Ariba
8 5 (2.66%) IFS
9 3 (1.60%) Birst
9 3 (1.60%) IBM
9 3 (1.60%) Informatica
9 3 (1.60%) Salesforce Marketing Cloud
9 3 (1.60%) Sybase
10 2 (1.06%) Hyperion
10 2 (1.06%) Talend
11 1 (0.53%) Databricks
11 1 (0.53%) Samsung
11 1 (0.53%) Vertica