Period
to 19 February 2018

The following table provides summary statistics for contract job vacancies with a requirement for Data Cleansing skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Cleansing over the 6 months to 19 February 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Cleansing (Data Cleaning, Data Scrubbing)
UK
6 months to
19 Feb 2018
Same period 2017 Same period 2016
Rank 508 492 515
Rank change year-on-year -16 +23 -61
Contract jobs citing Data Cleansing 390 362 415
As % of all contract IT jobs advertised in the UK 0.39% 0.38% 0.38%
As % of the Processes & Methodologies category 0.46% 0.46% 0.46%
Number of daily rates quoted 252 254 303
UK median daily rate £425 £425 £400
Median daily rate % change year-on-year - +6.25% -3.32%
10th Percentile £257 £182 £273
90th Percentile £575 £625 £575
UK excluding London median daily rate £420 £413 £400
% change year-on-year +1.82% +3.13% +8.11%
Number of hourly rates quoted 8 8 6
UK median hourly rate £30.25 £19.47 £16.00
Median hourly rate % change year-on-year +55.37% +21.69% +4.00%
10th Percentile £17.94 £15.27 £10.30
90th Percentile £55.40 £24.28 £18.75
UK excluding London median hourly rate £30.25 £19.72 £11.31
% change year-on-year +53.40% +74.44% +2.77%

Data Cleansing is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for process or methodology skills.

All Process and Methodology Skills
UK
Contract vacancies with a requirement for process or methodology skills 85,325 79,198 89,420
As % of all contract IT jobs advertised in the UK 84.71% 83.79% 82.82%
Number of daily rates quoted 57,012 52,465 58,154
UK median daily rate £450 £425 £425
Median daily rate % change year-on-year +5.88% - +6.25%
10th Percentile £288 £263 £263
90th Percentile £638 £613 £600
UK excluding London median daily rate £413 £400 £390
% change year-on-year +3.13% +2.56% +4.00%
Number of hourly rates quoted 2,051 2,203 2,639
UK median hourly rate £24.00 £25.00 £24.25
Median hourly rate % change year-on-year -4.00% +3.09% +21.25%
10th Percentile £11.50 £11.26 £11.38
90th Percentile £50.60 £49.75 £50.00
UK excluding London median hourly rate £24.29 £25.00 £26.00
% change year-on-year -2.84% -3.85% +23.81%

Data Cleansing
Job Vacancy Trend

Job postings citing Data Cleansing as a percentage of all IT jobs advertised.

Job vacancy trend for Data Cleansing in the UK

Data Cleansing
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Cleansing.

Contractor daily rate trend for Data Cleansing in the UK

Data Cleansing
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Cleansing over the 6 months to 19 February 2018.

Contractor daily rate histogram for Data Cleansing in the UK

Data Cleansing
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Cleansing.

Contractor hourly rate trend for Data Cleansing in the UK

Data Cleansing
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Data Cleansing over the 6 months to 19 February 2018.

Contractor hourly rate histogram for Data Cleansing in the UK

Data Cleansing
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Cleansing within the UK over the 6 months to 19 February 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +1 351 £425 -2.86% 73
UK excluding London +44 218 £420 +1.82% 51
London -58 160 £425 -5.56% 27
South East +27 71 £460 +19.48% 13
Midlands -13 37 £350 -6.04% 8
North of England +47 35 £338 -28.95% 9
East of England -26 28 £400 -12.81% 12
West Midlands +12 24 £338 -20.59% 4
North West +23 20 £375 -37.50% 5
Wales +15 18 £275 +44.74% 5
South West +8 14 £475 +150.00% 4
Scotland -9 14 £375 -3.23%
East Midlands -13 13 £500 +100.00% 4
Yorkshire -4 9 £375 -3.23% 4
North East - 6 £300 -
Northern Ireland - 1 - -

For the 6 months to 19 February 2018, IT contractor jobs citing Data Cleansing also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Data Cleansing.

1 167 (42.82%) SQL
2 156 (40.00%) Migration
3 125 (32.05%) Data Quality
4 123 (31.54%) Data Migration
4 123 (31.54%) Data Modelling
5 106 (27.18%) Finance
6 96 (24.62%) ETL
7 91 (23.33%) Business Intelligence
8 85 (21.79%) Data Analysis
9 76 (19.49%) SQL Server
10 75 (19.23%) Microsoft
11 73 (18.72%) Analytical Skills
12 70 (17.95%) Oracle
13 64 (16.41%) Data Management
13 64 (16.41%) Analytics
14 56 (14.36%) Microsoft Excel
15 55 (14.10%) SAP
16 53 (13.59%) Visualisation
17 50 (12.82%) User Acceptance Testing
18 49 (12.56%) Agile Software Development
19 47 (12.05%) Python
19 47 (12.05%) Data Transformation
20 44 (11.28%) Big Data
21 43 (11.03%) R
21 43 (11.03%) SQL Server Integration Services
21 43 (11.03%) XML
22 40 (10.26%) Data Warehouse
22 40 (10.26%) Validation
22 40 (10.26%) Data Mapping
22 40 (10.26%) Tableau

Data Cleansing
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 31 (7.95%) SharePoint
2 22 (5.64%) Jupyter
3 9 (2.31%) Apache
4 5 (1.28%) Oracle Workflow
4 5 (1.28%) SAS
5 3 (0.77%) Apache Spark
6 2 (0.51%) Elasticsearch
6 2 (0.51%) SharePoint 2010
6 2 (0.51%) SharePoint 2013
7 1 (0.26%) Apache Pig
7 1 (0.26%) BizTalk Server
7 1 (0.26%) Documentum
7 1 (0.26%) IBM Notes
7 1 (0.26%) NetWeaver
7 1 (0.26%) SugarCRM
Applications
1 56 (14.36%) Microsoft Excel
2 32 (8.21%) Microsoft Office
3 25 (6.41%) MS Visio
4 15 (3.85%) Microsoft Project
5 8 (2.05%) Microsoft PowerPoint
6 5 (1.28%) SPSS
7 3 (0.77%) Spreadsheet
8 1 (0.26%) Stata
Business Applications
1 19 (4.87%) Dynamics CRM
2 15 (3.85%) SAP MM
3 12 (3.08%) Elite 3E
4 11 (2.82%) SAP S/4HANA
5 8 (2.05%) SAP MDG
6 7 (1.79%) SAP APO
7 6 (1.54%) SAP MDM
8 5 (1.28%) Dynamics AX
8 5 (1.28%) SAP ERP
9 4 (1.03%) Cognos TM1
9 4 (1.03%) iTrent
9 4 (1.03%) Oracle ERP
9 4 (1.03%) SAP CO
9 4 (1.03%) SAP FI
9 4 (1.03%) SAP FI/CO
10 3 (0.77%) Oracle EBS R12
10 3 (0.77%) Oracle Procure-to-Pay
11 2 (0.51%) Oracle Cash Management
11 2 (0.51%) Oracle General Ledger
11 2 (0.51%) Oracle Receivables
Cloud Services
1 11 (2.82%) Amazon AWS
2 10 (2.56%) Slack
2 10 (2.56%) Trello
3 9 (2.31%) Dynamics 365
4 8 (2.05%) Microsoft Azure
5 5 (1.28%) Office 365
6 3 (0.77%) Google Cloud Platform
7 2 (0.51%) Azure Data Factory
7 2 (0.51%) Cloud Computing
7 2 (0.51%) SaaS
8 1 (0.26%) GitHub
8 1 (0.26%) OneDrive
8 1 (0.26%) Salesforce Sales Cloud
8 1 (0.26%) SuccessFactors
Communications & Networking
1 10 (2.56%) SMS
2 2 (0.51%) Internet
3 1 (0.26%) Extranet
3 1 (0.26%) Kerberos
3 1 (0.26%) NAS
Database & Business Intelligence
1 76 (19.49%) SQL Server
2 44 (11.28%) Big Data
3 43 (11.03%) SQL Server Integration Services
4 40 (10.26%) Data Warehouse
5 39 (10.00%) Data Mining
6 37 (9.49%) Relational Database
7 34 (8.72%) Power BI
8 27 (6.92%) BusinessObjects
9 23 (5.90%) Oracle Database
10 18 (4.62%) SQL Server Analysis Services
11 15 (3.85%) Hadoop
12 14 (3.59%) SAP Data Services
12 14 (3.59%) SQL Server 2012
13 12 (3.08%) SQL Server Reporting Services
14 11 (2.82%) QlikView
14 11 (2.82%) SQL Server 2008
15 10 (2.56%) Geospatial Data
16 8 (2.05%) NoSQL
16 8 (2.05%) Star Schema
17 7 (1.79%) RDBMS
Development Applications
1 15 (3.85%) LSMW
2 10 (2.56%) JIRA
3 6 (1.54%) Team Foundation Server
4 4 (1.03%) SQL Server Management Studio (SSMS)
5 3 (0.77%) ERwin
6 2 (0.51%) Rational Rhapsody
6 2 (0.51%) Visual Studio
7 1 (0.26%) Cucumber
7 1 (0.26%) Git (software)
7 1 (0.26%) GitLab
General
1 106 (27.18%) Finance
2 17 (4.36%) Games
3 16 (4.10%) Banking
4 15 (3.85%) Pharmaceutical
5 14 (3.59%) Law
6 13 (3.33%) Legal
7 12 (3.08%) Marketing
8 11 (2.82%) Telecoms
9 7 (1.79%) Retail
10 6 (1.54%) Publishing
11 5 (1.28%) Manufacturing
12 4 (1.03%) Front Office
13 3 (0.77%) Back Office
13 3 (0.77%) Electronics
14 2 (0.51%) Billing
14 2 (0.51%) Dutch Language
14 2 (0.51%) French Language
14 2 (0.51%) Investment Banking
15 1 (0.26%) Corporate Banking
15 1 (0.26%) Czech Language
Job Titles
1 130 (33.33%) Analyst
2 87 (22.31%) Data Analyst
3 79 (20.26%) Developer
4 38 (9.74%) Consultant
5 34 (8.72%) Business Analyst
6 26 (6.67%) Data Scientist
7 19 (4.87%) Architect
8 18 (4.62%) Oracle Developer
8 18 (4.62%) SQL Developer
9 17 (4.36%) Data Consultant
10 15 (3.85%) Data Architect
10 15 (3.85%) Data Manager
11 14 (3.59%) Business Intelligence Developer
12 13 (3.33%) DBA
12 13 (3.33%) Migration Manager
12 13 (3.33%) Oracle DBA
13 12 (3.08%) Data Migration Manager
13 12 (3.08%) SAP Consultant
14 11 (2.82%) ETL Developer
14 11 (2.82%) Project Manager
Libraries, Frameworks & Software Standards
1 43 (11.03%) XML
2 33 (8.46%) JSON
3 23 (5.90%) NumPy
3 23 (5.90%) Pandas
4 22 (5.64%) D3.js
5 19 (4.87%) Matplotlib
6 18 (4.62%) Unity (Game Engine)
6 18 (4.62%) Unreal Engine
7 15 (3.85%) .NET
8 7 (1.79%) JMS
8 7 (1.79%) Kafka
9 6 (1.54%) Oracle GoldenGate
10 5 (1.28%) Natural Language Processing
10 5 (1.28%) Oracle Fusion
11 4 (1.03%) .NET Framework
11 4 (1.03%) BAPI
12 3 (0.77%) MDX
12 3 (0.77%) Middleware
12 3 (0.77%) scikit-learn
12 3 (0.77%) Web Services
Miscellaneous
1 73 (18.72%) Analytical Skills
2 31 (7.95%) Data Structures
3 20 (5.13%) Computer Science
4 19 (4.87%) Management Information System
5 9 (2.31%) User Experience
6 7 (1.79%) Life Science
7 6 (1.54%) Algorithms
7 6 (1.54%) AS400
7 6 (1.54%) Virtual Team
8 4 (1.03%) Reference Data
8 4 (1.03%) Taxonomies
9 3 (0.77%) Greenfield Project
9 3 (0.77%) iSeries
9 3 (0.77%) NHS
10 2 (0.51%) Data Protection Act
10 2 (0.51%) Fixed Income
10 2 (0.51%) FMCG
10 2 (0.51%) Online Banking
10 2 (0.51%) Reinsurance
10 2 (0.51%) Replication
Operating Systems
1 4 (1.03%) Linux
1 4 (1.03%) Unix
2 2 (0.51%) Windows
2 2 (0.51%) Windows Server
3 1 (0.26%) VMS
Processes & Methodologies
1 156 (40.00%) Migration
2 123 (31.54%) Data Migration
2 123 (31.54%) Data Modelling
3 96 (24.62%) ETL
4 91 (23.33%) Business Intelligence
5 85 (21.79%) Data Analysis
6 64 (16.41%) Analytics
6 64 (16.41%) Data Management
7 53 (13.59%) Visualisation
8 50 (12.82%) User Acceptance Testing
9 49 (12.56%) Agile Software Development
10 47 (12.05%) Data Transformation
11 40 (10.26%) Data Mapping
11 40 (10.26%) Validation
12 35 (8.97%) CRM
12 35 (8.97%) Data Science
12 35 (8.97%) Statistics
13 34 (8.72%) Business Analysis
13 34 (8.72%) Collaborative Working
13 34 (8.72%) Data Architecture
Programming Languages
1 167 (42.82%) SQL
2 47 (12.05%) Python
3 43 (11.03%) R
4 27 (6.92%) PL/SQL
5 25 (6.41%) T-SQL
6 23 (5.90%) Java
7 21 (5.38%) JavaScript
8 17 (4.36%) VBA
9 13 (3.33%) C#
10 5 (1.28%) Data Analysis Expressions (DAX)
10 5 (1.28%) MATLAB
10 5 (1.28%) VB
11 4 (1.03%) PowerShell
12 3 (0.77%) Apex Code
12 3 (0.77%) Scala
12 3 (0.77%) Shell Script
13 2 (0.51%) ABAP
13 2 (0.51%) GraphQL
13 2 (0.51%) PHP
14 1 (0.26%) C
Qualifications
1 36 (9.23%) Security Cleared
2 32 (8.21%) Degree
3 17 (4.36%) DV Cleared
3 17 (4.36%) SC Cleared
4 7 (1.79%) BPSS Clearance
5 5 (1.28%) Computer Science Degree
6 2 (0.51%) MCSE
6 2 (0.51%) Microsoft Certification
6 2 (0.51%) PRINCE2 Certification
7 1 (0.26%) CTC Cleared
7 1 (0.26%) ITIL Certification
7 1 (0.26%) Numerate Degree
7 1 (0.26%) PRINCE2 Practitioner
Quality Assurance & Compliance
1 125 (32.05%) Data Quality
2 17 (4.36%) GDPR
3 8 (2.05%) GxP
3 8 (2.05%) Sarbanes-Oxley
4 7 (1.79%) PMO
5 3 (0.77%) Disclosure Scotland
5 3 (0.77%) QA
6 1 (0.26%) SLA
System Software
1 14 (3.59%) Oracle Clusterware
1 14 (3.59%) Oracle RAC
2 1 (0.26%) Active Directory
2 1 (0.26%) HDFS
2 1 (0.26%) Virtual Machines
Systems Management
1 16 (4.10%) Data Guard
2 14 (3.59%) Oracle Flashback
2 14 (3.59%) Oracle RMAN
3 1 (0.26%) Systems Management Server (SMS)
Vendors
1 75 (19.23%) Microsoft
2 70 (17.95%) Oracle
3 55 (14.10%) SAP
4 40 (10.26%) Tableau
5 14 (3.59%) Salesforce.com
6 10 (2.56%) Intapp
7 7 (1.79%) Alteryx
7 7 (1.79%) Cognos
8 6 (1.54%) Informatica
9 5 (1.28%) Talend
9 5 (1.28%) Teradata
10 4 (1.03%) Google
10 4 (1.03%) IBM
10 4 (1.03%) Workday
11 3 (0.77%) Micro Focus
11 3 (0.77%) Vertica
12 2 (0.51%) CA
12 2 (0.51%) JD Edwards
12 2 (0.51%) Sage
12 2 (0.51%) SmartStream