Period
to 17 January 2019

The following table provides summary statistics for contract job vacancies with a requirement for Data Cleansing skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Cleansing over the 6 months to 17 January 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Cleansing (Data Cleaning, Data Scrubbing)
UK
6 months to
17 Jan 2019
Same period 2018 Same period 2017
Rank 574 514 527
Rank change year-on-year -60 +13 -3
Contract jobs citing Data Cleansing 316 416 370
As % of all contract IT jobs advertised in the UK 0.32% 0.41% 0.38%
As % of the Processes & Methodologies category 0.37% 0.48% 0.45%
Number of daily rates quoted 193 262 259
UK median daily rate £450 £425 £438
Median daily rate % change year-on-year +5.88% -2.86% +9.38%
10th Percentile £307 £256 £224
90th Percentile £588 £575 £625
UK excluding London median daily rate £425 £400 £429
% change year-on-year +6.25% -6.84% +10.81%
Number of hourly rates quoted 5 9 9
UK median hourly rate £17.50 £19.00 £20.00
Median hourly rate % change year-on-year -7.89% -5.00% +29.03%
10th Percentile £16.21 £15.45 £15.70
90th Percentile £24.70 £54.60 £23.10
UK excluding London median hourly rate £17.50 £19.00 £19.72
% change year-on-year -7.89% -3.65% +74.44%

Data Cleansing is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for process or methodology skills.

All Process and Methodology Skills
UK
Contract vacancies with a requirement for process or methodology skills 86,410 86,099 82,940
As % of all contract IT jobs advertised in the UK 86.92% 85.83% 85.20%
Number of daily rates quoted 57,036 57,590 54,781
UK median daily rate £475 £450 £425
Median daily rate % change year-on-year +5.56% +5.88% +1.19%
10th Percentile £300 £281 £263
90th Percentile £648 £638 £613
UK excluding London median daily rate £425 £405 £400
% change year-on-year +4.86% +1.33% +3.23%
Number of hourly rates quoted 2,199 2,021 2,396
UK median hourly rate £23.50 £23.00 £22.84
Median hourly rate % change year-on-year +2.17% +0.70% -0.70%
10th Percentile £11.25 £11.25 £11.03
90th Percentile £50.02 £49.75 £48.75
UK excluding London median hourly rate £22.50 £24.00 £22.50
% change year-on-year -6.25% +6.67% -10.00%

Data Cleansing
Job Vacancy Trend

Job postings citing Data Cleansing as a percentage of all IT jobs advertised.

Job vacancy trend for Data Cleansing in the UK

Data Cleansing
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Cleansing.

Contractor daily rate trend for Data Cleansing in the UK

Data Cleansing
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Cleansing over the 6 months to 17 January 2019.

Contractor daily rate histogram for Data Cleansing in the UK

Data Cleansing
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Cleansing.

Contractor hourly rate trend for Data Cleansing in the UK

Data Cleansing
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Cleansing within the UK over the 6 months to 17 January 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -53 302 £450 +4.35% 79
UK excluding London -64 186 £425 +6.25% 49
London -42 124 £475 +5.56% 35
South East -2 67 £475 +5.56% 11
North of England -3 44 £365 +8.15% 12
Midlands -9 29 £425 +21.43% 9
East of England +8 27 £475 +38.28% 6
Yorkshire -1 23 £425 +47.83% 2
West Midlands -18 22 £413 +26.92% 7
North West -17 13 £290 -22.67% 9
Scotland +4 10 £438 +16.67% 4
North East -4 8 £350 +16.67% 1
East Midlands -1 7 £425 -8.11% 2
South West -36 6 £575 +21.05% 6
Northern Ireland +27 2 £320 -
Wales -26 1 £475 +58.33% 1

For the 6 months to 17 January 2019, IT contractor jobs citing Data Cleansing also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Cleansing.

1 149 (47.15%) Migration
2 126 (39.87%) Data Migration
3 117 (37.03%) SQL
4 111 (35.13%) Finance
5 79 (25.00%) Data Analysis
6 77 (24.37%) ETL
7 69 (21.84%) Data Modelling
8 67 (21.20%) Data Quality
9 54 (17.09%) Business Intelligence
10 53 (16.77%) Microsoft Excel
11 52 (16.46%) SAP
12 49 (15.51%) Analytical Skills
13 44 (13.92%) Data Mapping
13 44 (13.92%) Python
14 43 (13.61%) Oracle
15 42 (13.29%) Analytics
16 41 (12.97%) Agile Software Development
17 40 (12.66%) Data Management
17 40 (12.66%) Microsoft
18 39 (12.34%) Visualisation
19 37 (11.71%) CRM
19 37 (11.71%) SQL Server
20 36 (11.39%) Data Warehouse
21 32 (10.13%) Validation
21 32 (10.13%) Microsoft Azure
22 31 (9.81%) User Acceptance Testing
23 30 (9.49%) ERP
23 30 (9.49%) Problem-Solving
24 29 (9.18%) Power BI
25 28 (8.86%) SQL Server Integration Services

Data Cleansing
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 16 (5.06%) Apache Spark
2 12 (3.80%) Elasticsearch
3 10 (3.16%) Apache
4 9 (2.85%) Apache Airflow
4 9 (2.85%) SharePoint
5 6 (1.90%) MS Exchange
6 4 (1.27%) Jupyter
7 1 (0.32%) CMS
7 1 (0.32%) Confluence
7 1 (0.32%) Luigi
7 1 (0.32%) SAS
7 1 (0.32%) Skype for Business
Applications
1 53 (16.77%) Microsoft Excel
2 10 (3.16%) Microsoft Office
3 5 (1.58%) Spreadsheet
4 1 (0.32%) Microsoft PowerPoint
4 1 (0.32%) Microsoft Project
4 1 (0.32%) Solid Edge
Business Applications
1 22 (6.96%) Dynamics CRM
1 22 (6.96%) SAP S/4HANA
2 18 (5.70%) Oracle EBS R12
3 16 (5.06%) Oracle Receivables
4 14 (4.43%) Oracle Payables
5 12 (3.80%) CSG Singleview
6 8 (2.53%) Oracle Procure-to-Pay
6 8 (2.53%) SAP MDG
7 5 (1.58%) Oracle Financials
7 5 (1.58%) SAP FI
7 5 (1.58%) SAP HR
7 5 (1.58%) SAP MM
8 4 (1.27%) Dynamics AX
8 4 (1.27%) NetSuite
8 4 (1.27%) Oracle Cash Management
8 4 (1.27%) Oracle EBS
8 4 (1.27%) Oracle General Ledger
8 4 (1.27%) Workday HCM
9 3 (0.95%) Oracle iProcurement
9 3 (0.95%) SAP SD
Cloud Services
1 32 (10.13%) Microsoft Azure
2 25 (7.91%) Dynamics 365
3 20 (6.33%) Amazon AWS
4 11 (3.48%) Google Cloud Platform
5 6 (1.90%) Amazon S3
5 6 (1.90%) SaaS
6 5 (1.58%) Amazon EMR
7 4 (1.27%) SuccessFactors
8 3 (0.95%) Adobe Analytics
8 3 (0.95%) Amazon EC2
8 3 (0.95%) Google Analytics
8 3 (0.95%) Google Tag Manager
9 2 (0.63%) Office 365
9 2 (0.63%) Salesforce Sales Cloud
10 1 (0.32%) Amazon Kinesis
10 1 (0.32%) FinancialForce
10 1 (0.32%) Mimecast
10 1 (0.32%) OneDrive
10 1 (0.32%) Serverless
10 1 (0.32%) Veeva
Communications & Networking
1 4 (1.27%) ATM
1 4 (1.27%) Intranet
2 2 (0.63%) Internet
2 2 (0.63%) Kerberos
3 1 (0.32%) DNS
3 1 (0.32%) Skype
Database & Business Intelligence
1 37 (11.71%) SQL Server
2 36 (11.39%) Data Warehouse
3 29 (9.18%) Power BI
4 28 (8.86%) SQL Server Integration Services
5 24 (7.59%) SQL Server Reporting Services
6 17 (5.38%) Relational Database
7 15 (4.75%) Big Data
7 15 (4.75%) SQL Server Analysis Services
8 12 (3.80%) Neo4j
9 11 (3.48%) BusinessObjects
10 10 (3.16%) MS Access
11 9 (2.85%) Data Mining
12 7 (2.22%) Hadoop
13 6 (1.90%) Amazon Redshift
13 6 (1.90%) Oracle BI EE
13 6 (1.90%) Oracle Database
13 6 (1.90%) Oracle Reports
13 6 (1.90%) SAP Data Services
14 5 (1.58%) Azure SQL Data Warehouse
14 5 (1.58%) RDBMS
Development Applications
1 9 (2.85%) LSMW
2 6 (1.90%) Team Foundation Server
2 6 (1.90%) Toad
2 6 (1.90%) Visual Studio Team System
3 5 (1.58%) Visual Studio
4 4 (1.27%) ERwin
4 4 (1.27%) JIRA
5 1 (0.32%) Subversion
General
1 111 (35.13%) Finance
2 13 (4.11%) Billing
3 11 (3.48%) Retail
4 10 (3.16%) Marketing
5 9 (2.85%) Legal
6 8 (2.53%) Banking
7 6 (1.90%) Games
7 6 (1.90%) Law
8 4 (1.27%) General Ledger
8 4 (1.27%) Local Government
8 4 (1.27%) Manufacturing
8 4 (1.27%) Telecoms
9 3 (0.95%) Corporate Banking
9 3 (0.95%) Electronics
9 3 (0.95%) Financial Institution
9 3 (0.95%) Pharmaceutical
10 2 (0.63%) Aerospace
10 2 (0.63%) Investment Banking
10 2 (0.63%) Publishing
11 1 (0.32%) Arabic Language
Job Titles
1 128 (40.51%) Analyst
2 91 (28.80%) Data Analyst
3 49 (15.51%) Developer
4 29 (9.18%) Data Migration Analyst
4 29 (9.18%) Migration Analyst
5 24 (7.59%) Business Analyst
5 24 (7.59%) Consultant
6 18 (5.70%) Financial Analyst
7 17 (5.38%) Data Engineer
8 15 (4.75%) Data Consultant
9 13 (4.11%) Project Manager
9 13 (4.11%) SAP Consultant
9 13 (4.11%) SQL Analyst
10 12 (3.80%) SQL Data Analyst
10 12 (3.80%) SQL Developer
11 11 (3.48%) Architect
11 11 (3.48%) SAP Data Consultant
12 10 (3.16%) Administrator
12 10 (3.16%) Data Architect
12 10 (3.16%) Data Scientist
Libraries, Frameworks & Software Standards
1 11 (3.48%) XML
2 9 (2.85%) PySpark
2 9 (2.85%) Web Services
3 8 (2.53%) .NET
3 8 (2.53%) Middleware
4 6 (1.90%) NumPy
5 5 (1.58%) Oracle Fusion
5 5 (1.58%) SOAP
6 4 (1.27%) D3.js
6 4 (1.27%) React
6 4 (1.27%) Unity (Game Engine)
6 4 (1.27%) Unreal Engine
7 3 (0.95%) .NET Core
7 3 (0.95%) AngularJS
7 3 (0.95%) ASP.NET MVC
7 3 (0.95%) ASP.NET Web API
7 3 (0.95%) Matplotlib
7 3 (0.95%) Pandas
7 3 (0.95%) scikit-learn
7 3 (0.95%) SciPy
Miscellaneous
1 49 (15.51%) Analytical Skills
2 18 (5.70%) Management Information System
3 13 (4.11%) Data Structures
4 12 (3.80%) Algorithms
5 8 (2.53%) Freedom of Information
6 6 (1.90%) Analytical Mindset
6 6 (1.90%) Tandem
6 6 (1.90%) Virtual Team
7 5 (1.58%) Enterprise Cloud
7 5 (1.58%) Taxonomies
8 4 (1.27%) Private Cloud
8 4 (1.27%) Self-Motivation
9 3 (0.95%) Credit Derivative
9 3 (0.95%) Data Centre
9 3 (0.95%) Derivative
9 3 (0.95%) FMCG
9 3 (0.95%) Foreign Exchange (FX)
9 3 (0.95%) Greenfield Project
9 3 (0.95%) W3C
10 2 (0.63%) NHS
Operating Systems
1 6 (1.90%) Linux
2 4 (1.27%) Windows
3 2 (0.63%) Apple iOS
Processes & Methodologies
1 149 (47.15%) Migration
2 126 (39.87%) Data Migration
3 79 (25.00%) Data Analysis
4 77 (24.37%) ETL
5 69 (21.84%) Data Modelling
6 54 (17.09%) Business Intelligence
7 44 (13.92%) Data Mapping
8 42 (13.29%) Analytics
9 41 (12.97%) Agile Software Development
10 40 (12.66%) Data Management
11 39 (12.34%) Visualisation
12 37 (11.71%) CRM
13 32 (10.13%) Validation
14 31 (9.81%) User Acceptance Testing
15 30 (9.49%) ERP
15 30 (9.49%) Problem-Solving
16 27 (8.54%) Data Governance
16 27 (8.54%) Data Integration
17 26 (8.23%) Data Science
18 25 (7.91%) Data Architecture
Programming Languages
1 117 (37.03%) SQL
2 44 (13.92%) Python
3 19 (6.01%) Java
4 17 (5.38%) R
5 16 (5.06%) VBA
6 14 (4.43%) T-SQL
7 11 (3.48%) Cypher
8 10 (3.16%) C#
9 7 (2.22%) Data Analysis Expressions (DAX)
10 6 (1.90%) JavaScript
10 6 (1.90%) PL/SQL
10 6 (1.90%) PowerShell
10 6 (1.90%) Scala
11 2 (0.63%) PHP
12 1 (0.32%) ABAP
12 1 (0.32%) Bash Shell
12 1 (0.32%) C++
12 1 (0.32%) VB
Qualifications
1 19 (6.01%) Security Cleared
2 15 (4.75%) Degree
3 11 (3.48%) SC Cleared
4 4 (1.27%) DBS Check
4 4 (1.27%) PhD
5 2 (0.63%) ACCA
5 2 (0.63%) BPSS Clearance
5 2 (0.63%) CIMA
6 1 (0.32%) AAT
6 1 (0.32%) APMP
6 1 (0.32%) Computer Science Degree
6 1 (0.32%) CTC Cleared
6 1 (0.32%) PRINCE2 Practitioner
Quality Assurance & Compliance
1 67 (21.20%) Data Quality
2 21 (6.65%) QA
3 19 (6.01%) GDPR
4 5 (1.58%) PMO
5 3 (0.95%) WCAG
6 2 (0.63%) PCI DSS
7 1 (0.32%) ISO/IEC 27001
7 1 (0.32%) Solvency II
System Software
1 4 (1.27%) Active Directory
2 3 (0.95%) Apache Flume
3 2 (0.63%) HDFS
4 1 (0.32%) Cronacle
4 1 (0.32%) Virtual Machines
Systems Management
1 2 (0.63%) Hadoop YARN
2 1 (0.32%) Control-M
2 1 (0.32%) Kibana
2 1 (0.32%) logstash
2 1 (0.32%) Oozie
Vendors
1 52 (16.46%) SAP
2 43 (13.61%) Oracle
3 40 (12.66%) Microsoft
4 17 (5.38%) Tableau
5 12 (3.80%) Google
6 7 (2.22%) Salesforce.com
6 7 (2.22%) Workday
7 4 (1.27%) Alteryx
7 4 (1.27%) MuleSoft
7 4 (1.27%) PeopleSoft
8 3 (0.95%) Adobe
8 3 (0.95%) Cloudera
8 3 (0.95%) Hortonworks
8 3 (0.95%) MicroStrategy
8 3 (0.95%) Remedy
9 2 (0.63%) FIS
9 2 (0.63%) IBM
9 2 (0.63%) JD Edwards
9 2 (0.63%) SmartStream
9 2 (0.63%) Talend