Period
to 20 September 2019

The following table provides summary statistics for contract job vacancies with a requirement for Data Cleansing skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Cleansing over the 6 months to 20 September 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Cleansing (Data Cleaning, Data Scrubbing)
UK
6 months to
20 Sep 2019
Same period 2018 Same period 2017
Rank 497 582 478
Rank change year-on-year +85 -104 +117
Contract jobs citing Data Cleansing 345 332 440
As % of all contract IT jobs advertised in the UK 0.39% 0.32% 0.45%
As % of the Processes & Methodologies category 0.45% 0.37% 0.52%
Number of daily rates quoted 221 202 258
UK median daily rate £433 £425 £425
Median daily rate % change year-on-year +1.76% - +3.03%
10th Percentile £225 £276 £244
90th Percentile £588 £588 £577
UK excluding London median daily rate £424 £425 £400
% change year-on-year -0.29% +6.25% -
Number of hourly rates quoted 8 11 8
UK median hourly rate £22.50 £17.00 £18.00
Median hourly rate % change year-on-year +32.35% -5.56% +12.50%
10th Percentile £15.13 £10.50 £11.43
90th Percentile £28.00 £35.00 £53.30
UK excluding London median hourly rate £20.75 £15.00 £18.00
% change year-on-year +38.33% -16.67% +24.14%

Data Cleansing is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for process or methodology skills.

All Process and Methodology Skills
UK
Contract vacancies with a requirement for process or methodology skills 76,776 89,381 85,081
As % of all contract IT jobs advertised in the UK 86.54% 86.81% 86.08%
Number of daily rates quoted 50,387 59,004 55,973
UK median daily rate £475 £450 £450
Median daily rate % change year-on-year +5.56% - +5.88%
10th Percentile £300 £300 £278
90th Percentile £650 £638 £625
UK excluding London median daily rate £438 £425 £400
% change year-on-year +2.94% +6.25% -
Number of hourly rates quoted 2,289 2,466 2,107
UK median hourly rate £24.00 £20.50 £24.00
Median hourly rate % change year-on-year +17.07% -14.58% +4.35%
10th Percentile £11.80 £11.17 £11.25
90th Percentile £53.75 £50.00 £50.00
UK excluding London median hourly rate £23.75 £20.00 £23.75
% change year-on-year +18.75% -15.79% +1.06%

Data Cleansing
Job Vacancy Trend

Job postings citing Data Cleansing as a percentage of all IT jobs advertised.

Job vacancy trend for Data Cleansing in the UK

Data Cleansing
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Cleansing.

Contractor daily rate trend for Data Cleansing in the UK

Data Cleansing
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Cleansing over the 6 months to 20 September 2019.

Contractor daily rate histogram for Data Cleansing in the UK

Data Cleansing
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Cleansing.

Contractor hourly rate trend for Data Cleansing in the UK

Data Cleansing
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Data Cleansing over the 6 months to 20 September 2019.

Contractor hourly rate histogram for Data Cleansing in the UK

Data Cleansing
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Cleansing within the UK over the 6 months to 20 September 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +89 333 £430 +1.18% 58
UK excluding London +28 193 £424 -0.29% 53
London +87 145 £470 +4.44% 17
South East +11 63 £417 -1.94% 13
Midlands +41 36 £406 -9.22% 6
East of England +15 30 £425 -5.56% 5
North of England +33 29 £400 +12.68% 11
South West -6 23 £388 -11.43% 6
West Midlands +45 19 £350 -26.32% 3
North West +26 19 £400 +6.67% 10
East Midlands +22 17 £419 -1.47% 3
Yorkshire +26 9 £488 +44.44% 1
Wales +24 5 £450 +51.26% 8
Northern Ireland - 4 £450 -
Scotland +23 3 £400 -5.33% 4
North East +13 1 £400 +0.31%

For the 6 months to 20 September 2019, IT contractor jobs citing Data Cleansing also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Cleansing.

1 124 (35.94%) Migration
2 103 (29.86%) SQL
3 100 (28.99%) Finance
4 99 (28.70%) Data Migration
5 70 (20.29%) Data Modelling
6 68 (19.71%) ETL
7 65 (18.84%) SQL Server
8 64 (18.55%) Data Analysis
9 61 (17.68%) Business Intelligence
10 59 (17.10%) Python
10 59 (17.10%) Data Quality
11 57 (16.52%) Oracle
11 57 (16.52%) Data Science
12 55 (15.94%) Analytical Skills
13 52 (15.07%) Big Data
14 49 (14.20%) SAP
15 47 (13.62%) Microsoft Excel
16 45 (13.04%) Azure
16 45 (13.04%) Power Platform
16 45 (13.04%) Power BI
17 44 (12.75%) Analytics
18 42 (12.17%) Apache Spark
19 40 (11.59%) AWS
20 39 (11.30%) Degree
21 37 (10.72%) ERP
21 37 (10.72%) Microsoft
21 37 (10.72%) Data Management
22 36 (10.43%) Mentoring
23 35 (10.14%) Problem-Solving
24 34 (9.86%) SQL Server Integration Services

Data Cleansing
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 42 (12.17%) Apache Spark
2 26 (7.54%) Apache
2 26 (7.54%) Apache Airflow
3 9 (2.61%) SharePoint
4 4 (1.16%) Confluence
5 3 (0.87%) OpenEdge
6 2 (0.58%) BizTalk Server
6 2 (0.58%) Elasticsearch
6 2 (0.58%) Jupyter
7 1 (0.29%) JBoss
7 1 (0.29%) Oracle 10gAS
7 1 (0.29%) Oracle Application Server
7 1 (0.29%) SAS
Applications
1 47 (13.62%) Microsoft Excel
2 13 (3.77%) Microsoft Office
3 11 (3.19%) MS Visio
4 10 (2.90%) Microsoft PowerPoint
5 2 (0.58%) Microsoft Project
6 1 (0.29%) EViews
6 1 (0.29%) Spreadsheet
6 1 (0.29%) SPSS
6 1 (0.29%) Stata
Business Applications
1 13 (3.77%) Dynamics CRM
2 8 (2.32%) SAP S/4HANA
3 6 (1.74%) Salesforce.com CRM
4 5 (1.45%) Oracle EBS
4 5 (1.45%) Oracle ERP
4 5 (1.45%) SAP ERP
4 5 (1.45%) SAP Oil and Gas
5 4 (1.16%) NetSuite
5 4 (1.16%) SAP CO
5 4 (1.16%) SAP FI
5 4 (1.16%) SAP FI/CO
5 4 (1.16%) Teamcenter
6 3 (0.87%) Dynamics AX
6 3 (0.87%) Oracle EBS R12
6 3 (0.87%) Oracle Payables
7 2 (0.58%) Oracle Applications
7 2 (0.58%) Oracle ASCP
7 2 (0.58%) Oracle HRMS
7 2 (0.58%) Oracle iProcurement
7 2 (0.58%) SAP CRM
Cloud Services
1 45 (13.04%) Azure
1 45 (13.04%) Power Platform
2 40 (11.59%) AWS
3 29 (8.41%) GCP
4 22 (6.38%) Dynamics 365
5 5 (1.45%) Amazon EMR
5 5 (1.45%) Office 365
6 4 (1.16%) Salesforce Sales Cloud
7 3 (0.87%) Amazon S3
7 3 (0.87%) Cloud Computing
8 2 (0.58%) PaaS
8 2 (0.58%) SaaS
9 1 (0.29%) Amazon EC2
9 1 (0.29%) AWS Lambda
9 1 (0.29%) GitHub
9 1 (0.29%) Google Analytics
9 1 (0.29%) OneDrive
9 1 (0.29%) Serverless
9 1 (0.29%) Yammer
Communications & Networking
1 4 (1.16%) DNS
1 4 (1.16%) Internet
2 3 (0.87%) Firewall
3 1 (0.29%) TCP/IP
Database & Business Intelligence
1 65 (18.84%) SQL Server
2 52 (15.07%) Big Data
3 45 (13.04%) Power BI
4 34 (9.86%) Data Warehouse
4 34 (9.86%) SQL Server Integration Services
5 14 (4.06%) Hadoop
6 13 (3.77%) Data Lake
7 12 (3.48%) QlikView
7 12 (3.48%) Relational Database
8 11 (3.19%) NoSQL
9 10 (2.90%) SQL Server Reporting Services
10 9 (2.61%) Data Mining
10 9 (2.61%) MySQL
10 9 (2.61%) Oracle Database
10 9 (2.61%) SQL Server 2016
11 8 (2.32%) Oracle Reports
12 7 (2.03%) HBase
12 7 (2.03%) MongoDB
12 7 (2.03%) SQL Server Analysis Services
13 6 (1.74%) Oracle BI EE
Development Applications
1 4 (1.16%) JIRA
2 3 (0.87%) Oracle Forms
3 1 (0.29%) ERwin
3 1 (0.29%) Git (software)
3 1 (0.29%) Jenkins
3 1 (0.29%) LSMW
General
1 100 (28.99%) Finance
2 16 (4.64%) Public Sector
3 13 (3.77%) Retail
4 11 (3.19%) Law
5 10 (2.90%) Manufacturing
5 10 (2.90%) Marketing
6 9 (2.61%) Pharmaceutical
7 8 (2.32%) Front Office
8 6 (1.74%) Publishing
9 5 (1.45%) Banking
9 5 (1.45%) Telecoms
10 4 (1.16%) Advertising
11 3 (0.87%) Electronics
11 3 (0.87%) General Ledger
12 2 (0.58%) Billing
13 1 (0.29%) Aerospace
13 1 (0.29%) Arabic Language
13 1 (0.29%) Games
13 1 (0.29%) Legal
13 1 (0.29%) Local Government
Job Titles
1 117 (33.91%) Analyst
2 81 (23.48%) Data Analyst
3 51 (14.78%) Developer
4 41 (11.88%) Data Engineer
5 31 (8.99%) Python Engineer
6 28 (8.12%) Big Data Engineer
7 22 (6.38%) Architect
8 21 (6.09%) Consultant
9 20 (5.80%) Administrator
10 18 (5.22%) Data Architect
11 15 (4.35%) SQL Developer
12 14 (4.06%) Project Manager
13 13 (3.77%) Systems Administrator
14 12 (3.48%) Python Developer
15 11 (3.19%) Data Consultant
15 11 (3.19%) Data Migration Lead
15 11 (3.19%) Migration Analyst
16 10 (2.90%) Business Analyst
16 10 (2.90%) SAP Analyst
16 10 (2.90%) Technical Analyst
Libraries, Frameworks & Software Standards
1 30 (8.70%) PySpark
2 20 (5.80%) XML
3 16 (4.64%) JSON
4 7 (2.03%) MDX
4 7 (2.03%) Oracle Fusion
5 4 (1.16%) REST
6 3 (0.87%) HTML
6 3 (0.87%) Kafka
6 3 (0.87%) LAMP
6 3 (0.87%) XSD
7 2 (0.58%) .NET
7 2 (0.58%) ASP.NET
7 2 (0.58%) BAPI
7 2 (0.58%) LINQ
7 2 (0.58%) Middleware
7 2 (0.58%) Oracle GoldenGate
7 2 (0.58%) RESTful
7 2 (0.58%) SOAP
7 2 (0.58%) Web Services
7 2 (0.58%) XSLT
Miscellaneous
1 55 (15.94%) Analytical Skills
2 23 (6.67%) Data Structures
3 16 (4.64%) Management Information System
4 11 (3.19%) Algorithms
5 9 (2.61%) Self-Motivation
6 5 (1.45%) NHS
7 4 (1.16%) Enterprise Storage
7 4 (1.16%) FMCG
7 4 (1.16%) Reference Data
7 4 (1.16%) Taxonomies
8 3 (0.87%) Cyberattack
8 3 (0.87%) Greenfield Project
8 3 (0.87%) Life Science
9 2 (0.58%) CMDB
10 1 (0.29%) Blog
10 1 (0.29%) Freedom of Information
10 1 (0.29%) Freedom of Information Act
10 1 (0.29%) iPad
10 1 (0.29%) Linked Data
10 1 (0.29%) User Experience
Operating Systems
1 30 (8.70%) Linux
2 18 (5.22%) Windows
3 5 (1.45%) Unix
4 2 (0.58%) Mac OS X
5 1 (0.29%) AIX
5 1 (0.29%) HPUX
Processes & Methodologies
1 124 (35.94%) Migration
2 99 (28.70%) Data Migration
3 70 (20.29%) Data Modelling
4 68 (19.71%) ETL
5 64 (18.55%) Data Analysis
6 61 (17.68%) Business Intelligence
7 57 (16.52%) Data Science
8 44 (12.75%) Analytics
9 37 (10.72%) Data Management
9 37 (10.72%) ERP
10 36 (10.43%) Mentoring
11 35 (10.14%) Problem-Solving
12 34 (9.86%) CRM
13 33 (9.57%) Data Engineering
14 32 (9.28%) Data Mapping
15 30 (8.70%) Agile Software Development
15 30 (8.70%) Validation
16 29 (8.41%) Data Governance
17 27 (7.83%) Coaching
18 25 (7.25%) Data Transformation
Programming Languages
1 103 (29.86%) SQL
2 59 (17.10%) Python
3 18 (5.22%) JavaScript
4 17 (4.93%) PowerShell
5 15 (4.35%) PL/SQL
6 9 (2.61%) C
6 9 (2.61%) VBA
7 7 (2.03%) Data Analysis Expressions (DAX)
8 5 (1.45%) C#
8 5 (1.45%) Java
8 5 (1.45%) Shell Script
8 5 (1.45%) T-SQL
9 4 (1.16%) R
10 2 (0.58%) ABAP
11 1 (0.29%) Cypher
11 1 (0.29%) MATLAB
11 1 (0.29%) Perl
11 1 (0.29%) PHP
11 1 (0.29%) Scala
Qualifications
1 39 (11.30%) Degree
2 34 (9.86%) Security Cleared
3 27 (7.83%) SC Cleared
4 9 (2.61%) Computer Science Degree
5 7 (2.03%) DV Cleared
6 5 (1.45%) ACCA
6 5 (1.45%) CIMA
7 3 (0.87%) BC Cleared
8 2 (0.58%) PhD
9 1 (0.29%) BPSS Clearance
9 1 (0.29%) CIPFA
9 1 (0.29%) DBS Check
9 1 (0.29%) Numerate Degree
9 1 (0.29%) PMI Certification
9 1 (0.29%) PMP
9 1 (0.29%) VCP4
Quality Assurance & Compliance
1 59 (17.10%) Data Quality
2 15 (4.35%) GDPR
3 14 (4.06%) QA
4 3 (0.87%) IFRS
4 3 (0.87%) Solvency II
5 1 (0.29%) Disclosure Scotland
5 1 (0.29%) ISO/IEC 27001
5 1 (0.29%) PSD2
System Software
1 20 (5.80%) Active Directory
2 8 (2.32%) Docker
3 7 (2.03%) HDFS
4 4 (1.16%) VMware Infrastructure
5 3 (0.87%) Apache Flume
6 2 (0.58%) Oracle RAC
7 1 (0.29%) Virtual Servers
Systems Management
1 3 (0.87%) Data Guard
1 3 (0.87%) Hadoop YARN
2 2 (0.58%) Oracle RMAN
3 1 (0.29%) EMC NetWorker
3 1 (0.29%) HP Data Protector
3 1 (0.29%) Tivoli Storage Manager
Vendors
1 57 (16.52%) Oracle
2 49 (14.20%) SAP
3 37 (10.72%) Microsoft
4 30 (8.70%) Google
5 15 (4.35%) Tableau
6 10 (2.90%) Salesforce.com
7 9 (2.61%) Ariba
8 6 (1.74%) Informatica
9 5 (1.45%) Alteryx
9 5 (1.45%) Cloudera
9 5 (1.45%) Siebel
9 5 (1.45%) Tagetik
9 5 (1.45%) Talend
10 4 (1.16%) Siemens
10 4 (1.16%) VMware
11 3 (0.87%) Concur
11 3 (0.87%) IDERA
11 3 (0.87%) MuleSoft
11 3 (0.87%) Teradata
11 3 (0.87%) Workday