Period
to 21 May 2018

The following table provides summary statistics for contract job vacancies with a requirement for Data Cleansing skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Cleansing over the 6 months to 21 May 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Cleansing (Data Cleaning, Data Scrubbing)
UK
6 months to
21 May 2018
Same period 2017 Same period 2016
Rank 541 477 543
Rank change year-on-year -64 +66 -55
Contract jobs citing Data Cleansing 367 374 377
As % of all contract IT jobs advertised in the UK 0.36% 0.42% 0.36%
As % of the Processes & Methodologies category 0.43% 0.49% 0.43%
Number of daily rates quoted 244 242 253
UK median daily rate £425 £425 £415
Median daily rate % change year-on-year - +2.41% -1.19%
10th Percentile £269 £181 £263
90th Percentile £575 £587 £575
UK excluding London median daily rate £425 £400 £403
% change year-on-year +6.25% -0.62% +8.78%
Number of hourly rates quoted 10 4 6
UK median hourly rate £17.25 £16.31 £16.00
Median hourly rate % change year-on-year +5.75% +1.95% -20.00%
10th Percentile £10.44 £10.76 £10.50
90th Percentile £35.50 £18.00 £18.75
UK excluding London median hourly rate £14.50 £16.31 £14.00
% change year-on-year -11.11% +16.52% -58.41%

Data Cleansing is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for process or methodology skills.

All Process and Methodology Skills
UK
Contract vacancies with a requirement for process or methodology skills 86,297 76,245 88,684
As % of all contract IT jobs advertised in the UK 85.73% 84.63% 84.00%
Number of daily rates quoted 56,940 50,019 58,259
UK median daily rate £450 £438 £425
Median daily rate % change year-on-year +2.86% +2.94% +6.25%
10th Percentile £300 £275 £263
90th Percentile £638 £625 £606
UK excluding London median daily rate £425 £400 £400
% change year-on-year +6.13% - +6.67%
Number of hourly rates quoted 2,268 2,079 2,320
UK median hourly rate £22.00 £25.00 £25.00
Median hourly rate % change year-on-year -12.00% - +19.05%
10th Percentile £11.17 £11.46 £11.63
90th Percentile £50.00 £52.50 £50.59
UK excluding London median hourly rate £20.50 £25.00 £26.92
% change year-on-year -18.00% -7.11% +22.34%

Data Cleansing
Job Vacancy Trend

Job postings citing Data Cleansing as a percentage of all IT jobs advertised.

Job vacancy trend for Data Cleansing in the UK

Data Cleansing
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Cleansing.

Contractor daily rate trend for Data Cleansing in the UK

Data Cleansing
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Cleansing over the 6 months to 21 May 2018.

Contractor daily rate histogram for Data Cleansing in the UK

Data Cleansing
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Cleansing.

Contractor hourly rate trend for Data Cleansing in the UK

Data Cleansing
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Data Cleansing over the 6 months to 21 May 2018.

Contractor hourly rate histogram for Data Cleansing in the UK

Data Cleansing
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Cleansing within the UK over the 6 months to 21 May 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -58 332 £425 - 66
UK excluding London -7 209 £425 +6.25% 47
London -99 147 £425 - 28
South East +8 75 £425 +4.93% 12
Midlands -7 45 £425 +9.68% 11
North of England -29 34 £375 -6.25% 6
West Midlands -23 24 £400 +15.94% 5
East Midlands +2 21 £475 +5.56% 6
East of England -7 16 £463 -9.76% 7
North West -26 16 £400 - 5
Scotland -34 15 £375 +15.38% 2
Wales -1 14 £325 +1.56% 7
Yorkshire -21 12 £288 -30.72% 1
South West +8 11 £488 +219.67% 2
North East +15 6 £438 +130.26%

For the 6 months to 21 May 2018, IT contractor jobs citing Data Cleansing also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Cleansing.

1 144 (39.24%) Migration
2 127 (34.60%) SQL
3 118 (32.15%) Data Migration
4 97 (26.43%) Data Analysis
5 83 (22.62%) Microsoft
5 83 (22.62%) Data Quality
6 82 (22.34%) Finance
7 78 (21.25%) Analytical Skills
8 76 (20.71%) Agile Software Development
9 71 (19.35%) Business Intelligence
10 68 (18.53%) Analytics
11 67 (18.26%) Microsoft Excel
12 66 (17.98%) ETL
13 65 (17.71%) SQL Server
14 64 (17.44%) Visualisation
15 61 (16.62%) Data Modelling
16 54 (14.71%) Security Cleared
17 53 (14.44%) Python
17 53 (14.44%) Oracle
18 50 (13.62%) Data Warehouse
19 44 (11.99%) SC Cleared
20 42 (11.44%) Tableau
20 42 (11.44%) Data Management
21 41 (11.17%) Collaborative Working
22 39 (10.63%) Data Science
22 39 (10.63%) Validation
22 39 (10.63%) SQL Server Integration Services
23 38 (10.35%) R
23 38 (10.35%) Data Mining
23 38 (10.35%) Power BI

Data Cleansing
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 31 (8.45%) Jupyter
2 17 (4.63%) SharePoint
3 11 (3.00%) Apache
4 10 (2.72%) Elasticsearch
5 4 (1.09%) Apache Spark
6 3 (0.82%) SAS
7 2 (0.54%) CMS
8 1 (0.27%) Confluence
8 1 (0.27%) Documentum
8 1 (0.27%) Oracle Workflow
Applications
1 67 (18.26%) Microsoft Excel
2 22 (5.99%) Microsoft Office
3 12 (3.27%) Microsoft PowerPoint
4 9 (2.45%) MS Visio
5 7 (1.91%) Microsoft Project
6 3 (0.82%) Spreadsheet
Business Applications
1 18 (4.90%) Dynamics CRM
2 10 (2.72%) Dynamics AX
3 4 (1.09%) Maximo
4 3 (0.82%) NetSuite
4 3 (0.82%) SAP S/4HANA
5 2 (0.54%) Oracle Cash Management
5 2 (0.54%) Oracle EBS R12
5 2 (0.54%) Oracle General Ledger
5 2 (0.54%) Oracle Payables
5 2 (0.54%) Oracle Receivables
5 2 (0.54%) Salesforce.com CRM
5 2 (0.54%) SAP CO
5 2 (0.54%) SAP FI
5 2 (0.54%) SAP FI/CO
5 2 (0.54%) SAP HCM
5 2 (0.54%) SAP HR
6 1 (0.27%) JDE OneWorld
6 1 (0.27%) Oracle Financials
6 1 (0.27%) SAP MM
6 1 (0.27%) SAP PP
Cloud Services
1 18 (4.90%) Amazon AWS
2 14 (3.81%) Dynamics 365
3 7 (1.91%) Microsoft Azure
4 5 (1.36%) Slack
4 5 (1.36%) Trello
5 3 (0.82%) Office 365
5 3 (0.82%) SuccessFactors
6 2 (0.54%) Cloud Computing
6 2 (0.54%) Google Cloud Platform
6 2 (0.54%) Oracle Service Cloud
6 2 (0.54%) SaaS
7 1 (0.27%) Azure Data Factory
7 1 (0.27%) GitHub
7 1 (0.27%) Lucidchart
7 1 (0.27%) OneDrive
7 1 (0.27%) Serverless
Communications & Networking
1 13 (3.54%) SMS
2 4 (1.09%) NAS
3 2 (0.54%) Internet
4 1 (0.27%) Extranet
4 1 (0.27%) Kerberos
4 1 (0.27%) SNA
4 1 (0.27%) WebEx
Database & Business Intelligence
1 65 (17.71%) SQL Server
2 50 (13.62%) Data Warehouse
3 39 (10.63%) SQL Server Integration Services
4 38 (10.35%) Data Mining
4 38 (10.35%) Power BI
5 22 (5.99%) SQL Server Analysis Services
6 21 (5.72%) Relational Database
7 18 (4.90%) Big Data
8 15 (4.09%) SQL Server 2012
9 13 (3.54%) Hadoop
9 13 (3.54%) SQL Server Reporting Services
10 12 (3.27%) BusinessObjects
11 10 (2.72%) HBase
12 9 (2.45%) Microsoft Analysis Services
13 8 (2.18%) Oracle Database
13 8 (2.18%) SQL Server 2008
14 7 (1.91%) QlikView
15 6 (1.63%) GIS
15 6 (1.63%) SQL Server 2016
16 5 (1.36%) Geospatial Data
Development Applications
1 10 (2.72%) Jenkins
2 9 (2.45%) Git (software)
3 4 (1.09%) ERwin
3 4 (1.09%) Team Foundation Server
4 3 (0.82%) Toad
5 2 (0.54%) Oracle Forms
6 1 (0.27%) Cucumber
6 1 (0.27%) GitLab
6 1 (0.27%) JIRA
6 1 (0.27%) LSMW
6 1 (0.27%) PowerDesigner
6 1 (0.27%) SQL Server Management Studio (SSMS)
General
1 82 (22.34%) Finance
2 24 (6.54%) Games
3 19 (5.18%) Retail
4 12 (3.27%) Banking
4 12 (3.27%) Manufacturing
5 11 (3.00%) Marketing
6 7 (1.91%) Law
6 7 (1.91%) Legal
7 5 (1.36%) Pharmaceutical
7 5 (1.36%) Telecoms
8 4 (1.09%) Back Office
8 4 (1.09%) Billing
9 3 (0.82%) Electronics
9 3 (0.82%) French Language
9 3 (0.82%) Investment Banking
10 2 (0.54%) Automotive
10 2 (0.54%) Dutch Language
10 2 (0.54%) Front Office
10 2 (0.54%) Publishing
10 2 (0.54%) Retail Banking
Job Titles
1 107 (29.16%) Analyst
2 79 (21.53%) Data Analyst
3 73 (19.89%) Developer
4 35 (9.54%) Consultant
5 32 (8.72%) Data Scientist
6 22 (5.99%) Business Analyst
6 22 (5.99%) Project Manager
7 19 (5.18%) Business Intelligence Developer
8 18 (4.90%) Data Manager
9 16 (4.36%) Migration Manager
10 15 (4.09%) Administrator
10 15 (4.09%) Data Migration Manager
10 15 (4.09%) Power BI Developer
11 14 (3.81%) Architect
12 12 (3.27%) Migration Analyst
13 11 (3.00%) Data Migration Analyst
13 11 (3.00%) ETL Developer
13 11 (3.00%) Tableau Developer
14 10 (2.72%) Data Consultant
14 10 (2.72%) SQL Developer
Libraries, Frameworks & Software Standards
1 28 (7.63%) NumPy
1 28 (7.63%) Pandas
2 27 (7.36%) Matplotlib
3 26 (7.08%) D3.js
4 25 (6.81%) Unity (Game Engine)
4 25 (6.81%) Unreal Engine
5 16 (4.36%) XML
6 12 (3.27%) .NET
6 12 (3.27%) JSON
7 11 (3.00%) Kafka
8 10 (2.72%) REST
8 10 (2.72%) SOAP
9 8 (2.18%) JMS
10 5 (1.36%) Oracle Fusion
11 4 (1.09%) PySpark
12 3 (0.82%) HTML
12 3 (0.82%) Node.js
12 3 (0.82%) Web Services
13 2 (0.54%) AngularJS
13 2 (0.54%) RabbitMQ
Miscellaneous
1 78 (21.25%) Analytical Skills
2 24 (6.54%) Management Information System
3 18 (4.90%) Data Structures
4 16 (4.36%) Computer Science
5 14 (3.81%) User Experience
6 12 (3.27%) Private Cloud
6 12 (3.27%) Self-Motivation
7 6 (1.63%) Data Centre
7 6 (1.63%) Mainframe
8 5 (1.36%) Life Science
8 5 (1.36%) Taxonomies
9 4 (1.09%) Algorithms
9 4 (1.09%) Greenfield Project
9 4 (1.09%) Replication
10 3 (0.82%) Credit Risk
10 3 (0.82%) NHS
10 3 (0.82%) Reference Data
11 2 (0.54%) Enterprise Software
11 2 (0.54%) Online Banking
11 2 (0.54%) Social Media
Operating Systems
1 17 (4.63%) Linux
2 8 (2.18%) Windows
3 5 (1.36%) Unix
4 3 (0.82%) Windows Server
Processes & Methodologies
1 144 (39.24%) Migration
2 118 (32.15%) Data Migration
3 97 (26.43%) Data Analysis
4 76 (20.71%) Agile Software Development
5 71 (19.35%) Business Intelligence
6 68 (18.53%) Analytics
7 66 (17.98%) ETL
8 64 (17.44%) Visualisation
9 61 (16.62%) Data Modelling
10 42 (11.44%) Data Management
11 41 (11.17%) Collaborative Working
12 39 (10.63%) Data Science
12 39 (10.63%) Validation
13 37 (10.08%) CRM
14 36 (9.81%) Statistics
15 34 (9.26%) Decision-Making
16 33 (8.99%) Machine Learning
17 31 (8.45%) Sentiment Analysis
17 31 (8.45%) Stakeholder Management
17 31 (8.45%) Trend Analysis
Programming Languages
1 127 (34.60%) SQL
2 53 (14.44%) Python
3 38 (10.35%) R
4 33 (8.99%) T-SQL
5 17 (4.63%) JavaScript
6 16 (4.36%) Java
7 12 (3.27%) Data Analysis Expressions (DAX)
8 11 (3.00%) VBA
9 10 (2.72%) PL/SQL
10 9 (2.45%) Bash Shell
10 9 (2.45%) PowerShell
11 8 (2.18%) C#
12 3 (0.82%) Natural
12 3 (0.82%) VB
13 2 (0.54%) C
13 2 (0.54%) Scala
14 1 (0.27%) Perl
14 1 (0.27%) Ruby
14 1 (0.27%) VBScript
14 1 (0.27%) X++
Qualifications
1 54 (14.71%) Security Cleared
2 44 (11.99%) SC Cleared
3 28 (7.63%) Degree
4 9 (2.45%) DV Cleared
5 4 (1.09%) DBS Check
5 4 (1.09%) MCSE
5 4 (1.09%) Microsoft Certification
5 4 (1.09%) PRINCE2 Certification
6 3 (0.82%) BPSS Clearance
7 2 (0.54%) TOGAF Certification
8 1 (0.27%) Computer Science Degree
8 1 (0.27%) ISEB
8 1 (0.27%) PRINCE2 Practitioner
Quality Assurance & Compliance
1 83 (22.62%) Data Quality
2 17 (4.63%) GDPR
3 5 (1.36%) QA
4 4 (1.09%) PMO
5 3 (0.82%) Disclosure Scotland
6 1 (0.27%) ISO 20022
6 1 (0.27%) SLA
6 1 (0.27%) WCAG
System Software
1 6 (1.63%) Virtual Machines
2 3 (0.82%) Active Directory
3 2 (0.54%) Apache Flume
4 1 (0.27%) HDFS
Systems Management
1 2 (0.54%) Grafana
1 2 (0.54%) Kibana
1 2 (0.54%) Systems Management Server (SMS)
1 2 (0.54%) Tivoli
2 1 (0.27%) Single Sign-On
Vendors
1 83 (22.62%) Microsoft
2 53 (14.44%) Oracle
3 42 (11.44%) Tableau
4 36 (9.81%) SAP
5 21 (5.72%) Salesforce.com
6 10 (2.72%) Cloudera
7 9 (2.45%) Google
8 8 (2.18%) Hortonworks
9 5 (1.36%) Cognos
9 5 (1.36%) IBM
9 5 (1.36%) Talend
10 4 (1.09%) Alteryx
10 4 (1.09%) ESRI
10 4 (1.09%) Progress
11 3 (0.82%) Conga
11 3 (0.82%) JD Edwards
11 3 (0.82%) Micro Focus
11 3 (0.82%) Software AG
11 3 (0.82%) Teradata
11 3 (0.82%) Vertica