Period
to 14 November 2018

The following table provides summary statistics for contract job vacancies with a requirement for Data Cleansing skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Cleansing over the 6 months to 14 November 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Cleansing (Data Cleaning, Data Scrubbing)
UK
6 months to
14 Nov 2018
Same period 2017 Same period 2016
Rank 601 490 527
Rank change year-on-year -111 +37 +29
Contract jobs citing Data Cleansing 309 457 399
As % of all contract IT jobs advertised in the UK 0.30% 0.44% 0.38%
As % of the Processes & Methodologies category 0.34% 0.52% 0.44%
Number of daily rates quoted 177 281 258
UK median daily rate £438 £425 £425
Median daily rate % change year-on-year +2.94% - +9.68%
10th Percentile £312 £250 £225
90th Percentile £600 £588 £613
UK excluding London median daily rate £425 £400 £400
% change year-on-year +6.25% - +5.61%
Number of hourly rates quoted 9 8 12
UK median hourly rate £17.43 £35.00 £20.00
Median hourly rate % change year-on-year -50.21% +75.00% +31.15%
10th Percentile £11.18 £16.98 £14.25
90th Percentile £29.35 £55.40 £33.66
UK excluding London median hourly rate £17.43 £41.50 £18.94
% change year-on-year -58.01% +119.11% +24.20%

Data Cleansing is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for process or methodology skills.

All Process and Methodology Skills
UK
Contract vacancies with a requirement for process or methodology skills 90,109 88,342 90,019
As % of all contract IT jobs advertised in the UK 86.35% 85.75% 85.22%
Number of daily rates quoted 59,635 58,699 59,322
UK median daily rate £460 £450 £425
Median daily rate % change year-on-year +2.22% +5.88% +3.03%
10th Percentile £300 £277 £263
90th Percentile £638 £625 £600
UK excluding London median daily rate £425 £400 £400
% change year-on-year +6.25% - +5.26%
Number of hourly rates quoted 2,355 2,130 2,480
UK median hourly rate £22.00 £23.11 £22.50
Median hourly rate % change year-on-year -4.79% +2.70% +2.27%
10th Percentile £11.25 £11.25 £11.25
90th Percentile £50.50 £49.53 £48.04
UK excluding London median hourly rate £21.50 £24.00 £22.50
% change year-on-year -10.42% +6.67% -

Data Cleansing
Job Vacancy Trend

Job postings citing Data Cleansing as a percentage of all IT jobs advertised.

Job vacancy trend for Data Cleansing in the UK

Data Cleansing
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Cleansing.

Contractor daily rate trend for Data Cleansing in the UK

Data Cleansing
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Cleansing over the 6 months to 14 November 2018.

Contractor daily rate histogram for Data Cleansing in the UK

Data Cleansing
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Cleansing.

Contractor hourly rate trend for Data Cleansing in the UK

Data Cleansing
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Data Cleansing over the 6 months to 14 November 2018.

Contractor hourly rate histogram for Data Cleansing in the UK

Data Cleansing
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Cleansing within the UK over the 6 months to 14 November 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -109 287 £443 +4.12% 67
UK excluding London -47 191 £425 +6.25% 55
London -106 110 £450 - 18
South East +5 72 £475 +11.76% 13
East of England +10 34 £423 +30.00% 8
North of England -21 34 £365 -2.67% 16
Midlands -17 27 £400 +3.23% 8
West Midlands -34 18 £400 +15.52% 5
Yorkshire -7 17 £375 -10.45% 9
Scotland -12 17 £450 +20.00% 2
North West -28 11 £325 -15.58% 4
East Midlands +11 9 £394 -7.35% 3
North East +1 6 £350 +16.67% 3
South West -36 5 £531 +13.03% 4
Northern Ireland +37 1 £320 -22.42%
Wales -31 1 £385 +54.00% 4

For the 6 months to 14 November 2018, IT contractor jobs citing Data Cleansing also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Cleansing.

1 138 (44.66%) Migration
2 117 (37.86%) Data Migration
3 106 (34.30%) SQL
4 98 (31.72%) Finance
5 94 (30.42%) Data Analysis
6 71 (22.98%) ETL
7 70 (22.65%) Data Quality
8 65 (21.04%) Business Intelligence
9 62 (20.06%) Data Modelling
10 60 (19.42%) Microsoft Excel
11 59 (19.09%) SAP
12 54 (17.48%) Microsoft
13 52 (16.83%) Analytics
14 50 (16.18%) Data Management
15 44 (14.24%) SQL Server
16 42 (13.59%) Oracle
17 41 (13.27%) Data Mapping
18 40 (12.94%) Analytical Skills
19 38 (12.30%) Data Warehouse
20 37 (11.97%) Visualisation
20 37 (11.97%) Power BI
21 36 (11.65%) User Acceptance Testing
21 36 (11.65%) ERP
21 36 (11.65%) Agile Software Development
22 33 (10.68%) Validation
23 29 (9.39%) CRM
24 27 (8.74%) SQL Server Integration Services
25 26 (8.41%) Python
25 26 (8.41%) Microsoft Azure
26 24 (7.77%) Data Architecture

Data Cleansing
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 13 (4.21%) Elasticsearch
2 9 (2.91%) SharePoint
3 6 (1.94%) Apache Spark
4 3 (0.97%) Jupyter
4 3 (0.97%) MS Exchange
5 1 (0.32%) Apache Airflow
5 1 (0.32%) CMS
5 1 (0.32%) Confluence
5 1 (0.32%) Luigi
5 1 (0.32%) Oracle SOA Suite
5 1 (0.32%) SAS
5 1 (0.32%) Skype for Business
Applications
1 60 (19.42%) Microsoft Excel
2 11 (3.56%) Microsoft Office
3 3 (0.97%) Microsoft PowerPoint
4 2 (0.65%) MS Visio
4 2 (0.65%) Spreadsheet
5 1 (0.32%) Solid Edge
Business Applications
1 21 (6.80%) Dynamics CRM
2 19 (6.15%) SAP S/4HANA
3 18 (5.83%) Oracle EBS R12
4 15 (4.85%) Oracle Payables
4 15 (4.85%) Oracle Receivables
5 13 (4.21%) CSG Singleview
6 12 (3.88%) SAP ERP
7 9 (2.91%) Oracle Procure-to-Pay
7 9 (2.91%) Workday HCM
8 8 (2.59%) Oracle Financials
8 8 (2.59%) SAP MM
9 6 (1.94%) SAP APO
9 6 (1.94%) SAP MDM
10 5 (1.62%) Dynamics AX
11 4 (1.29%) SAP HR
12 3 (0.97%) Oracle 11i
12 3 (0.97%) Oracle EBS
12 3 (0.97%) Oracle ERP
12 3 (0.97%) Oracle iProcurement
12 3 (0.97%) SAP SD
Cloud Services
1 26 (8.41%) Microsoft Azure
2 21 (6.80%) Dynamics 365
3 6 (1.94%) Amazon AWS
4 4 (1.29%) SaaS
5 3 (0.97%) SuccessFactors
6 2 (0.65%) Salesforce Sales Cloud
7 1 (0.32%) Cloud Computing
7 1 (0.32%) Mimecast
7 1 (0.32%) Office 365
7 1 (0.32%) OneDrive
7 1 (0.32%) PaaS
7 1 (0.32%) Slack
7 1 (0.32%) Trello
7 1 (0.32%) Veeva
Communications & Networking
1 4 (1.29%) ATM
2 2 (0.65%) Kerberos
3 1 (0.32%) DNS
3 1 (0.32%) Radio Access Network
3 1 (0.32%) Skype
3 1 (0.32%) SMS
Database & Business Intelligence
1 44 (14.24%) SQL Server
2 38 (12.30%) Data Warehouse
3 37 (11.97%) Power BI
4 27 (8.74%) SQL Server Integration Services
5 18 (5.83%) SQL Server Reporting Services
6 15 (4.85%) SAP Data Services
6 15 (4.85%) SQL Server Analysis Services
7 14 (4.53%) Big Data
7 14 (4.53%) Relational Database
8 13 (4.21%) Data Mining
9 11 (3.56%) Neo4j
9 11 (3.56%) SAP HANA
10 10 (3.24%) BusinessObjects
10 10 (3.24%) Data Lake
10 10 (3.24%) MS Access
11 9 (2.91%) SQL Server 2012
12 8 (2.59%) SQL Server 2016
13 7 (2.27%) Hadoop
13 7 (2.27%) Microsoft Analysis Services
13 7 (2.27%) Oracle Reports
Development Applications
1 10 (3.24%) LSMW
2 9 (2.91%) JIRA
3 7 (2.27%) Toad
4 4 (1.29%) ERwin
4 4 (1.29%) Subversion
5 3 (0.97%) Team Foundation Server
5 3 (0.97%) Visual Studio Team System
6 1 (0.32%) RStudio
6 1 (0.32%) Visual Studio
General
1 98 (31.72%) Finance
2 16 (5.18%) Retail
3 13 (4.21%) Billing
4 9 (2.91%) Banking
4 9 (2.91%) Law
5 8 (2.59%) Legal
6 7 (2.27%) Manufacturing
7 6 (1.94%) Marketing
7 6 (1.94%) Pharmaceutical
8 4 (1.29%) Games
8 4 (1.29%) Telecoms
9 3 (0.97%) Corporate Banking
9 3 (0.97%) Electronics
9 3 (0.97%) Financial Institution
9 3 (0.97%) Local Government
10 2 (0.65%) General Ledger
10 2 (0.65%) Investment Banking
11 1 (0.32%) Advertising
11 1 (0.32%) Automotive
11 1 (0.32%) Publishing
Job Titles
1 125 (40.45%) Analyst
2 87 (28.16%) Data Analyst
3 47 (15.21%) Developer
4 31 (10.03%) Migration Analyst
5 30 (9.71%) Data Migration Analyst
6 28 (9.06%) Business Analyst
7 21 (6.80%) Consultant
8 20 (6.47%) Financial Analyst
9 19 (6.15%) Administrator
10 15 (4.85%) Architect
10 15 (4.85%) Business Intelligence Developer
10 15 (4.85%) Data Consultant
10 15 (4.85%) SAP Analyst
11 13 (4.21%) Power BI Developer
11 13 (4.21%) SAP Consultant
12 12 (3.88%) SQL Developer
13 11 (3.56%) SAP Data Consultant
14 10 (3.24%) Project Manager
14 10 (3.24%) SQL Analyst
15 9 (2.91%) Data Engineer
Libraries, Frameworks & Software Standards
1 16 (5.18%) XML
2 9 (2.91%) Middleware
3 8 (2.59%) Oracle Fusion
4 5 (1.62%) BAPI
5 4 (1.29%) D3.js
5 4 (1.29%) Unity (Game Engine)
5 4 (1.29%) Unreal Engine
6 3 (0.97%) Matplotlib
6 3 (0.97%) NumPy
6 3 (0.97%) Pandas
7 2 (0.65%) jQuery
7 2 (0.65%) REST
7 2 (0.65%) Web Services
8 1 (0.32%) .NET
8 1 (0.32%) HTML
8 1 (0.32%) Kafka
8 1 (0.32%) SAML
8 1 (0.32%) SAP XI
8 1 (0.32%) SOAP
8 1 (0.32%) Spring
Miscellaneous
1 40 (12.94%) Analytical Skills
2 17 (5.50%) Data Structures
3 15 (4.85%) Management Information System
4 14 (4.53%) Algorithms
5 9 (2.91%) Analytical Mindset
6 7 (2.27%) FMCG
7 6 (1.94%) Computer Science
7 6 (1.94%) Data Centre
7 6 (1.94%) Taxonomies
7 6 (1.94%) Virtual Team
8 5 (1.62%) Freedom of Information
8 5 (1.62%) Private Cloud
9 4 (1.29%) AS400
9 4 (1.29%) Enterprise Cloud
9 4 (1.29%) NHS
9 4 (1.29%) Self-Motivation
9 4 (1.29%) Tandem
10 3 (0.97%) Credit Derivative
10 3 (0.97%) Foreign Exchange (FX)
10 3 (0.97%) W3C
Operating Systems
1 10 (3.24%) Linux
2 9 (2.91%) Windows
3 2 (0.65%) Apple iOS
4 1 (0.32%) CentOS
Processes & Methodologies
1 138 (44.66%) Migration
2 117 (37.86%) Data Migration
3 94 (30.42%) Data Analysis
4 71 (22.98%) ETL
5 65 (21.04%) Business Intelligence
6 62 (20.06%) Data Modelling
7 52 (16.83%) Analytics
8 50 (16.18%) Data Management
9 41 (13.27%) Data Mapping
10 37 (11.97%) Visualisation
11 36 (11.65%) Agile Software Development
11 36 (11.65%) ERP
11 36 (11.65%) User Acceptance Testing
12 33 (10.68%) Validation
13 29 (9.39%) CRM
14 24 (7.77%) Data Architecture
15 23 (7.44%) Problem-Solving
16 22 (7.12%) Data Integration
17 21 (6.80%) Data Analytics
18 20 (6.47%) Data Governance
Programming Languages
1 106 (34.30%) SQL
2 26 (8.41%) Python
3 20 (6.47%) T-SQL
4 18 (5.83%) VBA
5 17 (5.50%) Java
6 11 (3.56%) Cypher
7 10 (3.24%) PowerShell
8 9 (2.91%) R
9 8 (2.59%) Data Analysis Expressions (DAX)
9 8 (2.59%) JavaScript
10 6 (1.94%) C#
10 6 (1.94%) PL/SQL
11 4 (1.29%) Scala
12 2 (0.65%) ABAP
12 2 (0.65%) C++
13 1 (0.32%) C
13 1 (0.32%) FoxPro (VFP)
13 1 (0.32%) PHP
13 1 (0.32%) Shell Script
13 1 (0.32%) VB
Qualifications
1 10 (3.24%) Security Cleared
2 7 (2.27%) Degree
3 5 (1.62%) SC Cleared
4 3 (0.97%) DBS Check
4 3 (0.97%) PhD
5 2 (0.65%) ACCA
5 2 (0.65%) BPSS Clearance
5 2 (0.65%) CIMA
6 1 (0.32%) AAT
6 1 (0.32%) Computer Science Degree
6 1 (0.32%) MCSE
6 1 (0.32%) Microsoft Certification
6 1 (0.32%) TOGAF Certification
Quality Assurance & Compliance
1 70 (22.65%) Data Quality
2 14 (4.53%) QA
3 9 (2.91%) GDPR
4 4 (1.29%) PMO
5 3 (0.97%) WCAG
6 2 (0.65%) PCI DSS
7 1 (0.32%) Solvency II
System Software
1 10 (3.24%) Active Directory
2 2 (0.65%) Apache Flume
3 1 (0.32%) Cronacle
3 1 (0.32%) HDFS
3 1 (0.32%) Virtual Machines
Systems Management
1 6 (1.94%) HP ALM
2 1 (0.32%) Control-M
2 1 (0.32%) Hadoop YARN
2 1 (0.32%) Kibana
2 1 (0.32%) logstash
2 1 (0.32%) Oozie
2 1 (0.32%) Systems Management Server (SMS)
Vendors
1 59 (19.09%) SAP
2 54 (17.48%) Microsoft
3 42 (13.59%) Oracle
4 10 (3.24%) Tableau
5 9 (2.91%) Workday
6 7 (2.27%) Salesforce.com
7 6 (1.94%) Cloudera
7 6 (1.94%) HP
8 5 (1.62%) JD Edwards
9 3 (0.97%) Alteryx
9 3 (0.97%) MuleSoft
9 3 (0.97%) PeopleSoft
10 2 (0.65%) Adobe
10 2 (0.65%) CA
10 2 (0.65%) Computacenter
10 2 (0.65%) FIS
10 2 (0.65%) Hortonworks
10 2 (0.65%) SmartStream
10 2 (0.65%) Talend
11 1 (0.32%) ComArch