Period
to 23 November 2017

The following table provides summary statistics for contract job vacancies with a requirement for Data Cleansing skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Cleansing over the 6 months to 23 November 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Cleansing (Data Cleaning, Data Scrubbing)
UK
6 months to
23 Nov 2017
Same period 2016 Same period 2015
Rank 478 513 547
Rank change year-on-year +35 +34 -61
Contract jobs citing Data Cleansing 455 414 379
As % of all contract IT jobs advertised in the UK 0.44% 0.39% 0.33%
As % of the Processes & Methodologies category 0.52% 0.47% 0.41%
Number of daily rates quoted 277 270 252
UK median daily rate £425 £425 £388
Median daily rate % change year-on-year - +9.68% -3.13%
10th Percentile £228 £218 £257
90th Percentile £590 £613 £550
UK excluding London median daily rate £400 £413 £385
% change year-on-year -3.03% +7.14% +10.00%
Number of hourly rates quoted 10 14 9
UK median hourly rate £23.75 £20.00 £15.50
Median hourly rate % change year-on-year +18.75% +29.03% -5.73%
10th Percentile £15.85 £14.25 £9.85
90th Percentile £53.80 £33.40 £23.80
UK excluding London median hourly rate £19.00 £18.94 £15.25
% change year-on-year +0.32% +24.20% -0.88%

Data Cleansing is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for process or methodology skills.

All Process and Methodology Skills
UK
Contract vacancies with a requirement for process or methodology skills 87085 88317 92969
As % of all contract IT jobs advertised in the UK 84.46% 83.90% 81.79%
Number of daily rates quoted 58028 58368 60222
UK median daily rate £450 £425 £415
Median daily rate % change year-on-year +5.88% +2.41% +3.75%
10th Percentile £281 £263 £263
90th Percentile £631 £600 £600
UK excluding London median daily rate £400 £400 £385
% change year-on-year - +3.90% +2.67%
Number of hourly rates quoted 2061 2366 2748
UK median hourly rate £23.75 £23.89 £22.50
Median hourly rate % change year-on-year -0.58% +6.17% +18.42%
10th Percentile £11.50 £11.25 £11.28
90th Percentile £50.00 £48.75 £47.50
UK excluding London median hourly rate £24.00 £24.00 £23.75
% change year-on-year - +1.05% +18.75%

Data Cleansing
Job Vacancy Trend

Job postings citing Data Cleansing as a percentage of all IT jobs advertised.

Job vacancy trend for Data Cleansing in the UK

Data Cleansing
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Data Cleansing.

Contractor daily rate trend for Data Cleansing in the UK

Data Cleansing
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Data Cleansing over the 6 months to 23 November 2017.

Contractor daily rate histogram for Data Cleansing in the UK

Data Cleansing
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Data Cleansing.

Contractor hourly rate trend for Data Cleansing in the UK

Data Cleansing
Contractor Hourly Rate Histogram

The hourly rate distribution of IT jobs citing Data Cleansing over the 6 months to 23 November 2017.

Contractor hourly rate histogram for Data Cleansing in the UK

Data Cleansing
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Cleansing within the UK over the 6 months to 23 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +30 423 £425 -2.38% 38
UK excluding London +45 226 £400 -3.03% 30
London +13 211 £450 -2.17% 17
South East +17 67 £425 +7.59% 6
North of England +77 42 £338 -32.50% 4
East of England -20 36 £344 -23.67% 1
Midlands -9 35 £350 -13.58% 8
North West +39 28 £375 -37.50% 1
West Midlands +33 20 £313 -34.21% 4
South West -10 17 £473 +31.25% 1
Scotland +11 15 £375 -16.67% 6
East Midlands -39 15 £450 +20.00% 3
Wales +22 12 £275 -24.14% 4
Yorkshire +17 9 £294 -30.88% 3
North East +65 5 £300 -35.14%
Northern Ireland - 2 £413 -

For the 6 months to 23 November 2017, IT contractor jobs citing Data Cleansing also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for Data Cleansing.

1 205 (45.05%) SQL
2 191 (41.98%) Migration
3 169 (37.14%) Data Modelling
4 163 (35.82%) Data Migration
5 152 (33.41%) Data Quality
6 135 (29.67%) ETL
7 116 (25.49%) Finance
8 105 (23.08%) Oracle
9 99 (21.76%) Business Intelligence
10 91 (20.00%) Data Analysis
11 85 (18.68%) SQL Server
12 77 (16.92%) SAP
13 74 (16.26%) Microsoft
14 72 (15.82%) Analytics
15 70 (15.38%) Data Management
16 69 (15.16%) Analytical Skills
17 64 (14.07%) Relational Database
18 63 (13.85%) Data Transformation
19 62 (13.63%) Big Data
20 60 (13.19%) Data Warehouse
21 59 (12.97%) XML
21 59 (12.97%) Security Cleared
22 58 (12.75%) SQL Server Integration Services
23 56 (12.31%) Agile Software Development
24 53 (11.65%) User Acceptance Testing
25 49 (10.77%) Collaborative Working
26 46 (10.11%) Data Mapping
27 45 (9.89%) Microsoft Excel
28 44 (9.67%) CRM
28 44 (9.67%) Python

Data Cleansing
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 22 (4.84%) SharePoint
2 20 (4.40%) Apache
3 9 (1.98%) Apache Spark
4 7 (1.54%) SAS
5 6 (1.32%) Jupyter
6 5 (1.10%) Oracle Workflow
7 4 (0.88%) Elasticsearch
8 3 (0.66%) Apache Pig
8 3 (0.66%) SharePoint 2010
8 3 (0.66%) SharePoint 2013
9 2 (0.44%) Confluence
9 2 (0.44%) IBM Notes
9 2 (0.44%) WebSphere
10 1 (0.22%) BizTalk Server
10 1 (0.22%) JBoss
10 1 (0.22%) NetWeaver
10 1 (0.22%) Oracle SOA Suite
10 1 (0.22%) SugarCRM
Applications
1 45 (9.89%) Microsoft Excel
2 27 (5.93%) Microsoft Office
3 22 (4.84%) MS Visio
4 13 (2.86%) Microsoft Project
5 11 (2.42%) Microsoft PowerPoint
6 8 (1.76%) InfoPath
7 5 (1.10%) SPSS
8 3 (0.66%) Spreadsheet
9 2 (0.44%) Stata
Business Applications
1 15 (3.30%) Dynamics CRM
1 15 (3.30%) SAP MM
2 11 (2.42%) SAP S/4HANA
3 9 (1.98%) SAP ERP
4 8 (1.76%) SAP CRM
4 8 (1.76%) SAP MDG
5 7 (1.54%) SAP APO
6 6 (1.32%) SAP MDM
7 5 (1.10%) Oracle ERP
7 5 (1.10%) SAP CO
7 5 (1.10%) SAP FI
7 5 (1.10%) SAP FI/CO
8 4 (0.88%) Cognos TM1
8 4 (0.88%) Dynamics AX
8 4 (0.88%) iTrent
8 4 (0.88%) SAP HR
9 3 (0.66%) Markit EDM
9 3 (0.66%) Oracle BPM
9 3 (0.66%) Oracle EBS
9 3 (0.66%) Oracle Procure-to-Pay
Cloud Services
1 30 (6.59%) Amazon AWS
2 11 (2.42%) Microsoft Azure
3 6 (1.32%) Slack
3 6 (1.32%) Trello
4 5 (1.10%) SuccessFactors
5 4 (0.88%) Dynamics 365
6 3 (0.66%) Azure Data Factory
7 2 (0.44%) Google Cloud Platform
7 2 (0.44%) Office 365
8 1 (0.22%) GitHub
8 1 (0.22%) Salesforce Sales Cloud
Communications & Networking
1 5 (1.10%) SMS
2 4 (0.88%) Wi-Fi
3 2 (0.44%) SNA
4 1 (0.22%) Broadband
4 1 (0.22%) Internet
4 1 (0.22%) Kerberos
4 1 (0.22%) MPLS
Database & Business Intelligence
1 85 (18.68%) SQL Server
2 64 (14.07%) Relational Database
3 62 (13.63%) Big Data
4 60 (13.19%) Data Warehouse
5 58 (12.75%) SQL Server Integration Services
6 30 (6.59%) Hadoop
7 29 (6.37%) Data Mining
8 28 (6.15%) Power BI
9 26 (5.71%) Oracle Database
10 24 (5.27%) BusinessObjects
11 18 (3.96%) HBase
12 17 (3.74%) SQL Server Analysis Services
13 16 (3.52%) QlikView
14 15 (3.30%) SAP Data Services
15 14 (3.08%) Oracle Reports
16 13 (2.86%) NoSQL
16 13 (2.86%) SQL Server 2008
16 13 (2.86%) SQL Server Reporting Services
17 10 (2.20%) MySQL
17 10 (2.20%) RDBMS
Development Applications
1 16 (3.52%) LSMW
2 13 (2.86%) Talend Open Studio
3 11 (2.42%) JIRA
4 9 (1.98%) Team Foundation Server
5 6 (1.32%) ERwin
6 5 (1.10%) Visual Studio
7 4 (0.88%) Rational Rhapsody
7 4 (0.88%) SQL Server Management Studio (SSMS)
8 2 (0.44%) Cucumber
8 2 (0.44%) Selenium
9 1 (0.22%) Git (software)
9 1 (0.22%) GitLab
9 1 (0.22%) Jenkins
9 1 (0.22%) JMeter
9 1 (0.22%) JUnit
9 1 (0.22%) LoadRunner
9 1 (0.22%) VSS/SourceSafe
9 1 (0.22%) WebDriver
General
1 116 (25.49%) Finance
2 23 (5.05%) Banking
3 16 (3.52%) Pharmaceutical
4 15 (3.30%) Marketing
4 15 (3.30%) Telecoms
5 12 (2.64%) Legal
5 12 (2.64%) Publishing
5 12 (2.64%) Retail
6 11 (2.42%) Law
7 10 (2.20%) Manufacturing
8 6 (1.32%) Electronics
9 4 (0.88%) Financial Institution
9 4 (0.88%) Front Office
9 4 (0.88%) Games
10 2 (0.44%) Advertising
10 2 (0.44%) Back Office
10 2 (0.44%) Billing
10 2 (0.44%) Investment Banking
11 1 (0.22%) Dutch Language
11 1 (0.22%) Retail Banking
Job Titles
1 156 (34.29%) Analyst
2 99 (21.76%) Data Analyst
3 82 (18.02%) Developer
4 41 (9.01%) Business Analyst
5 33 (7.25%) Consultant
6 26 (5.71%) Architect
7 24 (5.27%) SQL Developer
8 23 (5.05%) Data Scientist
9 21 (4.62%) Oracle Developer
10 20 (4.40%) Data Architect
10 20 (4.40%) Data Manager
10 20 (4.40%) Data Migration Specialist
10 20 (4.40%) Migration Specialist
11 19 (4.18%) Data Consultant
12 18 (3.96%) Project Manager
13 14 (3.08%) ETL Developer
14 13 (2.86%) DBA
14 13 (2.86%) Migration Consultant
14 13 (2.86%) Oracle DBA
15 11 (2.42%) Data Migration Consultant
Libraries, Frameworks & Software Standards
1 59 (12.97%) XML
2 42 (9.23%) JSON
3 20 (4.40%) Kafka
4 18 (3.96%) JMS
5 10 (2.20%) D3.js
6 8 (1.76%) NumPy
6 8 (1.76%) Oracle GoldenGate
6 8 (1.76%) Pandas
7 7 (1.54%) .NET
8 6 (1.32%) Natural Language Processing
8 6 (1.32%) Web Services
9 5 (1.10%) Oracle Fusion
9 5 (1.10%) Unity (Game Engine)
9 5 (1.10%) Unreal Engine
10 4 (0.88%) .NET Framework
10 4 (0.88%) BAPI
10 4 (0.88%) Matplotlib
11 3 (0.66%) MDX
11 3 (0.66%) Middleware
11 3 (0.66%) RHadoop
Miscellaneous
1 69 (15.16%) Analytical Skills
2 35 (7.69%) Data Structures
3 18 (3.96%) Management Information System
4 14 (3.08%) Computer Science
4 14 (3.08%) Reference Data
5 13 (2.86%) Algorithms
6 8 (1.76%) Blog
6 8 (1.76%) Virtual Team
7 6 (1.32%) AS400
7 6 (1.32%) Taxonomies
8 4 (0.88%) Greenfield Project
8 4 (0.88%) Life Science
8 4 (0.88%) Mainframe
8 4 (0.88%) User Experience
9 3 (0.66%) Digital Media
9 3 (0.66%) iSeries
10 2 (0.44%) CMDB
10 2 (0.44%) Data Protection Act
10 2 (0.44%) FMCG
10 2 (0.44%) Social Network
Operating Systems
1 17 (3.74%) Unix
2 14 (3.08%) Linux
3 8 (1.76%) Mac OS X
4 1 (0.22%) VMS
Processes & Methodologies
1 191 (41.98%) Migration
2 169 (37.14%) Data Modelling
3 163 (35.82%) Data Migration
4 135 (29.67%) ETL
5 99 (21.76%) Business Intelligence
6 91 (20.00%) Data Analysis
7 72 (15.82%) Analytics
8 70 (15.38%) Data Management
9 63 (13.85%) Data Transformation
10 56 (12.31%) Agile Software Development
11 53 (11.65%) User Acceptance Testing
12 49 (10.77%) Collaborative Working
13 46 (10.11%) Data Mapping
14 44 (9.67%) CRM
15 43 (9.45%) ERP
15 43 (9.45%) Project Management
16 40 (8.79%) Coaching
16 40 (8.79%) Post-Production
17 39 (8.57%) Validation
18 38 (8.35%) Data Integration
Programming Languages
1 205 (45.05%) SQL
2 44 (9.67%) Python
3 43 (9.45%) Java
4 37 (8.13%) R
5 34 (7.47%) PL/SQL
6 18 (3.96%) T-SQL
7 16 (3.52%) VBA
8 10 (2.20%) C#
9 9 (1.98%) JavaScript
10 7 (1.54%) Scala
11 6 (1.32%) Apex Code
12 5 (1.10%) MATLAB
12 5 (1.10%) VB
13 4 (0.88%) C
13 4 (0.88%) Data Analysis Expressions (DAX)
13 4 (0.88%) Shell Script
14 3 (0.66%) GraphQL
15 2 (0.44%) PHP
15 2 (0.44%) PowerShell
16 1 (0.22%) Groovy
Qualifications
1 59 (12.97%) Security Cleared
2 29 (6.37%) Degree
3 27 (5.93%) DV Cleared
4 25 (5.49%) SC Cleared
5 8 (1.76%) Computer Science Degree
6 6 (1.32%) CTC Cleared
6 6 (1.32%) Numerate Degree
7 5 (1.10%) BPSS Clearance
8 3 (0.66%) ITIL Certification
9 1 (0.22%) Postgraduate
Quality Assurance & Compliance
1 152 (33.41%) Data Quality
2 11 (2.42%) PMO
3 10 (2.20%) GDPR
4 8 (1.76%) GxP
4 8 (1.76%) Sarbanes-Oxley
5 7 (1.54%) QA
6 2 (0.44%) SLA
6 2 (0.44%) Solvency II
7 1 (0.22%) Disclosure Scotland
7 1 (0.22%) GAAP
System Software
1 14 (3.08%) Oracle Clusterware
1 14 (3.08%) Oracle RAC
2 2 (0.44%) Apache Flume
3 1 (0.22%) HDFS
Systems Management
1 16 (3.52%) Data Guard
2 14 (3.08%) Oracle Flashback
2 14 (3.08%) Oracle RMAN
3 1 (0.22%) Systems Management Server (SMS)
Vendors
1 105 (23.08%) Oracle
2 77 (16.92%) SAP
3 74 (16.26%) Microsoft
4 31 (6.81%) Tableau
5 21 (4.62%) Salesforce.com
6 13 (2.86%) Talend
7 12 (2.64%) Informatica
8 9 (1.98%) HP
9 8 (1.76%) IBM
9 8 (1.76%) Siebel
10 7 (1.54%) Cognos
11 6 (1.32%) Alteryx
11 6 (1.32%) Callidus
12 5 (1.10%) Splunk
13 4 (0.88%) Ariba
13 4 (0.88%) Concur
13 4 (0.88%) Workday
13 4 (0.88%) Yardi
14 3 (0.66%) Marketo
14 3 (0.66%) Sage