Period
to 17 August 2018

The following table provides summary statistics for contract job vacancies with a requirement for Data Cleansing skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Cleansing over the 6 months to 17 August 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Cleansing (Data Cleaning, Data Scrubbing)
UK
6 months to
17 Aug 2018
Same period 2017 Same period 2016
Rank 568 466 550
Rank change year-on-year -102 +84 -2
Contract jobs citing Data Cleansing 344 442 371
As % of all contract IT jobs advertised in the UK 0.33% 0.46% 0.34%
As % of the Processes & Methodologies category 0.39% 0.54% 0.40%
Number of daily rates quoted 208 254 234
UK median daily rate £425 £425 £410
Median daily rate % change year-on-year - +3.66% +3.80%
10th Percentile £261 £250 £200
90th Percentile £588 £580 £575
UK excluding London median daily rate £425 £400 £409
% change year-on-year +6.25% -2.14% +12.76%
Number of hourly rates quoted 12 6 8
UK median hourly rate £15.00 £16.31 £18.00
Median hourly rate % change year-on-year -8.05% -9.38% -5.26%
10th Percentile £10.60 £10.88 £13.28
90th Percentile £39.50 £23.25 £33.79
UK excluding London median hourly rate £13.00 £14.63 £14.50
% change year-on-year -11.11% +0.86% -23.68%

Data Cleansing is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for process or methodology skills.

All Process and Methodology Skills
UK
Contract vacancies with a requirement for process or methodology skills 88,862 81,893 92,305
As % of all contract IT jobs advertised in the UK 86.23% 85.55% 84.84%
Number of daily rates quoted 58,641 53,667 60,922
UK median daily rate £450 £450 £425
Median daily rate % change year-on-year - +5.88% +6.25%
10th Percentile £300 £275 £263
90th Percentile £638 £625 £600
UK excluding London median daily rate £425 £400 £400
% change year-on-year +6.25% - +6.67%
Number of hourly rates quoted 2,390 2,076 2,301
UK median hourly rate £21.02 £24.86 £23.50
Median hourly rate % change year-on-year -15.45% +5.79% +8.60%
10th Percentile £11.18 £11.41 £11.25
90th Percentile £50.00 £50.25 £48.00
UK excluding London median hourly rate £20.00 £25.00 £24.00
% change year-on-year -20.00% +4.17% +10.34%

Data Cleansing
Job Vacancy Trend

Job postings citing Data Cleansing as a percentage of all IT jobs advertised.

Job vacancy trend for Data Cleansing in the UK

Data Cleansing
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Cleansing.

Contractor daily rate trend for Data Cleansing in the UK

Data Cleansing
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Cleansing over the 6 months to 17 August 2018.

Contractor daily rate histogram for Data Cleansing in the UK

Data Cleansing
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Cleansing.

Contractor hourly rate trend for Data Cleansing in the UK

Data Cleansing
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Data Cleansing over the 6 months to 17 August 2018.

Contractor hourly rate histogram for Data Cleansing in the UK

Data Cleansing
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Cleansing within the UK over the 6 months to 17 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -107 317 £425 -3.13% 46
UK excluding London -21 218 £425 +6.25% 33
London -117 118 £426 -5.38% 18
South East +20 80 £425 -5.56% 11
North of England -29 40 £355 -8.39% 6
Midlands -24 32 £425 +9.68% 3
East of England -7 31 £475 +80.95% 7
North West -19 20 £388 +1.97% 2
Scotland -39 19 £360 +0.70% 3
East Midlands -7 18 £419 -6.94%
West Midlands -32 14 £450 +31.39% 3
South West -2 13 £469 +60.94% 1
Yorkshire -24 11 £325 -31.22% 2
North East -3 9 £438 +130.26% 2
Wales -18 4 £298 -13.14% 2

For the 6 months to 17 August 2018, IT contractor jobs citing Data Cleansing also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Cleansing.

1 151 (43.90%) Migration
2 131 (38.08%) Data Migration
3 111 (32.27%) SQL
4 107 (31.10%) Data Analysis
5 79 (22.97%) Finance
6 78 (22.67%) ETL
7 76 (22.09%) Data Quality
8 71 (20.64%) Microsoft
9 67 (19.48%) Business Intelligence
9 67 (19.48%) Analytics
10 66 (19.19%) Data Modelling
11 65 (18.90%) Microsoft Excel
12 61 (17.73%) SQL Server
13 60 (17.44%) Agile Software Development
14 57 (16.57%) Analytical Skills
15 56 (16.28%) Data Warehouse
16 52 (15.12%) Visualisation
17 48 (13.95%) Oracle
18 46 (13.37%) Validation
19 44 (12.79%) ERP
19 44 (12.79%) Security Cleared
20 43 (12.50%) SAP
21 42 (12.21%) Python
22 41 (11.92%) Data Management
23 39 (11.34%) Power BI
24 38 (11.05%) Data Mapping
25 36 (10.47%) SQL Server Integration Services
26 33 (9.59%) SC Cleared
26 33 (9.59%) T-SQL
27 31 (9.01%) Stakeholder Management

Data Cleansing
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 19 (5.52%) Elasticsearch
2 13 (3.78%) Jupyter
3 11 (3.20%) Apache
4 6 (1.74%) SharePoint
5 5 (1.45%) Apache Spark
6 3 (0.87%) CMS
7 2 (0.58%) Confluence
7 2 (0.58%) SAS
8 1 (0.29%) Oracle SOA Suite
Applications
1 65 (18.90%) Microsoft Excel
2 16 (4.65%) Microsoft Office
3 12 (3.49%) Microsoft PowerPoint
4 4 (1.16%) Microsoft Project
5 3 (0.87%) MS Visio
6 2 (0.58%) Spreadsheet
Business Applications
1 11 (3.20%) Dynamics CRM
2 10 (2.91%) Dynamics AX
2 10 (2.91%) SAP ERP
3 9 (2.62%) Workday HCM
4 7 (2.03%) SAP MM
5 6 (1.74%) SAP APO
5 6 (1.74%) SAP S/4HANA
6 5 (1.45%) Maximo
6 5 (1.45%) Oracle EBS R12
6 5 (1.45%) SAP MDM
7 4 (1.16%) Oracle Financials
7 4 (1.16%) Salesforce.com CRM
7 4 (1.16%) SAP HR
8 3 (0.87%) CSG Singleview
8 3 (0.87%) Oracle 11i
8 3 (0.87%) Oracle Payables
8 3 (0.87%) Oracle Receivables
9 2 (0.58%) Dynamics NAV
9 2 (0.58%) Oracle Retail
9 2 (0.58%) SAP HCM
Cloud Services
1 18 (5.23%) Amazon AWS
1 18 (5.23%) Microsoft Azure
2 13 (3.78%) Dynamics 365
3 3 (0.87%) SuccessFactors
4 2 (0.58%) Oracle Service Cloud
4 2 (0.58%) SaaS
5 1 (0.29%) Azure Data Factory
5 1 (0.29%) Azure Functions
5 1 (0.29%) Cloud Computing
5 1 (0.29%) GitHub
5 1 (0.29%) Google Cloud Platform
5 1 (0.29%) Lucidchart
5 1 (0.29%) PaaS
5 1 (0.29%) Serverless
5 1 (0.29%) Slack
5 1 (0.29%) Trello
Communications & Networking
1 7 (2.03%) SMS
2 3 (0.87%) NAS
3 1 (0.29%) ATM
3 1 (0.29%) DNS
3 1 (0.29%) Kerberos
3 1 (0.29%) Radio Access Network
3 1 (0.29%) SNA
3 1 (0.29%) WebEx
Database & Business Intelligence
1 61 (17.73%) SQL Server
2 56 (16.28%) Data Warehouse
3 39 (11.34%) Power BI
4 36 (10.47%) SQL Server Integration Services
5 23 (6.69%) Big Data
6 22 (6.40%) Data Mining
6 22 (6.40%) SQL Server Analysis Services
7 16 (4.65%) Microsoft Analysis Services
7 16 (4.65%) Relational Database
8 15 (4.36%) SQL Server Reporting Services
9 13 (3.78%) Hadoop
9 13 (3.78%) SAP Data Services
9 13 (3.78%) SQL Server 2012
10 11 (3.20%) BusinessObjects
10 11 (3.20%) SQL Server 2016
11 10 (2.91%) HBase
12 9 (2.62%) Data Lake
12 9 (2.62%) Oracle Database
13 8 (2.33%) Neo4j
14 7 (2.03%) SAP HANA
Development Applications
1 10 (2.91%) Jenkins
2 9 (2.62%) Git (software)
3 7 (2.03%) JIRA
4 6 (1.74%) Toad
5 5 (1.45%) LSMW
6 4 (1.16%) ERwin
6 4 (1.16%) Subversion
7 2 (0.58%) Oracle Forms
8 1 (0.29%) Cucumber
8 1 (0.29%) GitLab
8 1 (0.29%) PowerDesigner
8 1 (0.29%) RStudio
General
1 79 (22.97%) Finance
2 27 (7.85%) Retail
3 13 (3.78%) Manufacturing
4 11 (3.20%) Games
5 10 (2.91%) Marketing
6 9 (2.62%) Law
7 8 (2.33%) Banking
8 5 (1.45%) Billing
8 5 (1.45%) Legal
9 4 (1.16%) Telecoms
10 3 (0.87%) Automotive
10 3 (0.87%) Electronics
10 3 (0.87%) Investment Banking
10 3 (0.87%) Pharmaceutical
11 2 (0.58%) Back Office
11 2 (0.58%) French Language
11 2 (0.58%) Publishing
11 2 (0.58%) Retail Banking
12 1 (0.29%) German Language
12 1 (0.29%) Italian Language
Job Titles
1 116 (33.72%) Analyst
2 83 (24.13%) Data Analyst
3 67 (19.48%) Developer
4 25 (7.27%) Consultant
5 23 (6.69%) Business Analyst
6 21 (6.10%) Business Intelligence Developer
6 21 (6.10%) Project Manager
7 20 (5.81%) Migration Analyst
8 19 (5.52%) Administrator
8 19 (5.52%) Data Scientist
8 19 (5.52%) Power BI Developer
9 18 (5.23%) Data Migration Analyst
10 15 (4.36%) Architect
11 14 (4.07%) Data Manager
12 13 (3.78%) Data Migration Lead
13 11 (3.20%) Data Consultant
14 10 (2.91%) Big Data Developer
14 10 (2.91%) Migration Manager
14 10 (2.91%) SAP Analyst
15 9 (2.62%) Data Migration Manager
Libraries, Frameworks & Software Standards
1 21 (6.10%) XML
2 12 (3.49%) D3.js
2 12 (3.49%) REST
3 11 (3.20%) JSON
3 11 (3.20%) Kafka
3 11 (3.20%) Matplotlib
3 11 (3.20%) NumPy
3 11 (3.20%) Pandas
3 11 (3.20%) Unity (Game Engine)
3 11 (3.20%) Unreal Engine
4 10 (2.91%) SOAP
5 8 (2.33%) JMS
6 7 (2.03%) Oracle Fusion
7 4 (1.16%) BAPI
7 4 (1.16%) Web Services
8 3 (0.87%) .NET
8 3 (0.87%) HTML
9 2 (0.58%) AngularJS
9 2 (0.58%) jQuery
9 2 (0.58%) Middleware
Miscellaneous
1 57 (16.57%) Analytical Skills
2 19 (5.52%) Data Structures
2 19 (5.52%) Management Information System
3 14 (4.07%) Private Cloud
4 12 (3.49%) Algorithms
5 7 (2.03%) Analytical Mindset
6 6 (1.74%) Data Centre
6 6 (1.74%) FMCG
6 6 (1.74%) Mainframe
6 6 (1.74%) Self-Motivation
6 6 (1.74%) Taxonomies
6 6 (1.74%) User Experience
7 4 (1.16%) AS400
7 4 (1.16%) NHS
7 4 (1.16%) Reference Data
8 3 (0.87%) Computer Science
8 3 (0.87%) Credit Risk
8 3 (0.87%) Greenfield Project
8 3 (0.87%) Virtual Team
9 2 (0.58%) Driving Licence
Operating Systems
1 22 (6.40%) Linux
2 12 (3.49%) Windows
3 4 (1.16%) Unix
4 1 (0.29%) CentOS
4 1 (0.29%) Windows Server
Processes & Methodologies
1 151 (43.90%) Migration
2 131 (38.08%) Data Migration
3 107 (31.10%) Data Analysis
4 78 (22.67%) ETL
5 67 (19.48%) Analytics
5 67 (19.48%) Business Intelligence
6 66 (19.19%) Data Modelling
7 60 (17.44%) Agile Software Development
8 52 (15.12%) Visualisation
9 46 (13.37%) Validation
10 44 (12.79%) ERP
11 41 (11.92%) Data Management
12 38 (11.05%) Data Mapping
13 31 (9.01%) Stakeholder Management
14 30 (8.72%) CRM
15 29 (8.43%) Collaborative Working
16 28 (8.14%) Data Analytics
17 26 (7.56%) Data Science
17 26 (7.56%) Data Visualisation
18 23 (6.69%) Data Transformation
Programming Languages
1 111 (32.27%) SQL
2 42 (12.21%) Python
3 33 (9.59%) T-SQL
4 25 (7.27%) Java
5 23 (6.69%) R
6 13 (3.78%) PowerShell
7 12 (3.49%) Data Analysis Expressions (DAX)
8 10 (2.91%) PL/SQL
9 9 (2.62%) Bash Shell
9 9 (2.62%) JavaScript
10 8 (2.33%) Cypher
10 8 (2.33%) VBA
11 3 (0.87%) C
11 3 (0.87%) C#
11 3 (0.87%) Natural
11 3 (0.87%) Scala
12 1 (0.29%) C++
12 1 (0.29%) MATLAB
12 1 (0.29%) Shell Script
12 1 (0.29%) X++
Qualifications
1 44 (12.79%) Security Cleared
2 33 (9.59%) SC Cleared
3 9 (2.62%) DV Cleared
4 6 (1.74%) Degree
5 4 (1.16%) DBS Check
6 3 (0.87%) TOGAF Certification
7 2 (0.58%) MCSE
7 2 (0.58%) Microsoft Certification
7 2 (0.58%) PRINCE2 Certification
8 1 (0.29%) AAT
8 1 (0.29%) ACCA
8 1 (0.29%) BPSS Clearance
8 1 (0.29%) CIMA
8 1 (0.29%) Computer Science Degree
8 1 (0.29%) ISEB
Quality Assurance & Compliance
1 76 (22.09%) Data Quality
2 12 (3.49%) GDPR
3 7 (2.03%) QA
4 5 (1.45%) PMO
5 2 (0.58%) PCI DSS
6 1 (0.29%) Disclosure Scotland
6 1 (0.29%) ISO 20022
6 1 (0.29%) SLA
6 1 (0.29%) Solvency II
6 1 (0.29%) WCAG
System Software
1 9 (2.62%) Active Directory
2 5 (1.45%) Virtual Machines
3 2 (0.58%) Apache Flume
4 1 (0.29%) HDFS
Systems Management
1 6 (1.74%) HP ALM
2 3 (0.87%) Systems Management Server (SMS)
3 2 (0.58%) Grafana
3 2 (0.58%) Kibana
3 2 (0.58%) Tivoli
4 1 (0.29%) Single Sign-On
Vendors
1 71 (20.64%) Microsoft
2 48 (13.95%) Oracle
3 43 (12.50%) SAP
4 22 (6.40%) Salesforce.com
5 21 (6.10%) Tableau
6 15 (4.36%) Cloudera
7 9 (2.62%) Workday
8 8 (2.33%) Google
8 8 (2.33%) Hortonworks
9 6 (1.74%) HP
9 6 (1.74%) JD Edwards
10 5 (1.45%) Cognos
10 5 (1.45%) IBM
11 4 (1.16%) ESRI
11 4 (1.16%) Talend
12 3 (0.87%) Conga
12 3 (0.87%) Siebel
12 3 (0.87%) Software AG
13 2 (0.58%) Adobe
13 2 (0.58%) Informatica