Period
to 19 November 2017

The following table provides summary statistics for contract job vacancies with a requirement for Sqoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Sqoop over the 6 months to 19 November 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Sqoop
UK
6 months to
19 Nov 2017
Same period 2016 Same period 2015
Rank 691 750 836
Rank change year-on-year +59 +86 -6
Contract jobs citing Sqoop 184 146 56
As % of all contract IT jobs advertised in the UK 0.18% 0.14% 0.049%
As % of the Database & Business Intelligence category 0.82% 0.62% 0.21%
Number of daily rates quoted 135 90 30
UK median daily rate £525 £550 £600
Median daily rate % change year-on-year -4.55% -8.33% -22.58%
10th Percentile £318 £413 £423
90th Percentile £600 £743 £814
UK excluding London median daily rate £475 £550 £500
% change year-on-year -13.64% +10.00% -
Number of hourly rates quoted 1 0 0
UK median hourly rate £35.00 - -
UK excluding London median hourly rate £35.00 - -

Sqoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
UK
Contract vacancies with a requirement for database or business intelligence skills 22415 23702 26642
As % of all contract IT jobs advertised in the UK 22.11% 22.61% 23.25%
Number of daily rates quoted 15311 15735 17553
UK median daily rate £450 £425 £400
Median daily rate % change year-on-year +5.88% +6.25% +0.63%
10th Percentile £310 £285 £269
90th Percentile £625 £600 £575
UK excluding London median daily rate £400 £375 £375
% change year-on-year +6.67% - +7.14%
Number of hourly rates quoted 285 368 406
UK median hourly rate £31.15 £28.18 £29.25
Median hourly rate % change year-on-year +10.54% -3.66% +21.88%
10th Percentile £14.00 £10.00 £12.00
90th Percentile £58.00 £52.05 £52.47
UK excluding London median hourly rate £35.00 £28.18 £30.00
% change year-on-year +24.20% -6.07% +33.33%

Sqoop
Job Vacancy Trend

Job postings citing Sqoop as a percentage of all IT jobs advertised.

Job vacancy trend for Sqoop in the UK

Sqoop
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Sqoop.

Contractor daily rate trend for Sqoop in the UK

Sqoop
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Sqoop over the 6 months to 19 November 2017.

Contractor daily rate histogram for Sqoop in the UK

Sqoop
Top 11 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Sqoop within the UK over the 6 months to 19 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +62 181 £520 -5.45% 7
UK excluding London +82 102 £475 -13.64% 6
London -46 82 £550 - 1
South East +32 51 £500 +17.65% 1
North of England +82 34 £465 -15.45%
Yorkshire +45 32 £462 -17.87%
East of England -3 13 £458 +7.65% 4
North West +25 2 £600 +26.32%
Scotland -4 2 £700 -
Northern Ireland -42 1 - -
South West - 1 £325 -

For the 6 months to 19 November 2017, IT contractor jobs citing Sqoop also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for Sqoop.

1 171 (92.93%) Big Data
2 170 (92.39%) Hadoop
3 169 (91.85%) Apache Spark
4 166 (90.22%) Apache Hive
5 147 (79.89%) Apache Flume
6 127 (69.02%) Kafka
7 122 (66.30%) MapReduce
8 103 (55.98%) HBase
9 101 (54.89%) HDFS
10 98 (53.26%) Java
11 91 (49.46%) Python
12 84 (45.65%) Hadoop YARN
13 81 (44.02%) Oozie
14 79 (42.93%) Impala
15 63 (34.24%) DevOps
16 62 (33.70%) GitHub
17 59 (32.07%) Analytics
18 58 (31.52%) Open Source
19 57 (30.98%) Ambari
20 54 (29.35%) Cloudera
21 51 (27.72%) IBM
22 50 (27.17%) Linux
22 50 (27.17%) Agile Software Development
23 49 (26.63%) ETL
23 49 (26.63%) Scala
24 45 (24.46%) Shell Script
24 45 (24.46%) SQL
25 44 (23.91%) Tableau
26 42 (22.83%) PySpark
27 39 (21.20%) PostgreSQL

Sqoop
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 169 (91.85%) Apache Spark
2 32 (17.39%) Apache Pig
3 12 (6.52%) OpenStack
4 9 (4.89%) Apache
4 9 (4.89%) Elasticsearch
5 6 (3.26%) SAS
6 3 (1.63%) Apache Solr
7 2 (1.09%) Confluence
8 1 (0.54%) JBoss
8 1 (0.54%) Mule
8 1 (0.54%) Tomcat
8 1 (0.54%) WebSphere
Business Applications
1 2 (1.09%) SAP CRM
Cloud Services
1 62 (33.70%) GitHub
2 36 (19.57%) Amazon AWS
3 34 (18.48%) Bluemix
3 34 (18.48%) IBM Cloud
4 11 (5.98%) Google Analytics
5 9 (4.89%) Amazon EMR
5 9 (4.89%) Amazon S3
6 3 (1.63%) Amazon EC2
6 3 (1.63%) Amazon Kinesis
6 3 (1.63%) AWS Lambda
6 3 (1.63%) Google Cloud Platform
6 3 (1.63%) IaaS
6 3 (1.63%) Microsoft Azure
6 3 (1.63%) PaaS
6 3 (1.63%) Serverless
7 2 (1.09%) Cloud Computing
8 1 (0.54%) BIME
8 1 (0.54%) Data Lake Analytics
8 1 (0.54%) Google Tag Manager
8 1 (0.54%) SaaS
Communications & Networking
1 15 (8.15%) LAN
2 14 (7.61%) VPN
2 14 (7.61%) WAN
3 6 (3.26%) Kerberos
4 3 (1.63%) Network Security
4 3 (1.63%) SSL
5 2 (1.09%) SNA
6 1 (0.54%) LDAP
6 1 (0.54%) Multicast
Database & Business Intelligence
1 171 (92.93%) Big Data
2 170 (92.39%) Hadoop
3 166 (90.22%) Apache Hive
4 103 (55.98%) HBase
5 79 (42.93%) Impala
6 39 (21.20%) PostgreSQL
7 30 (16.30%) NoSQL
8 29 (15.76%) SQL Server
9 19 (10.33%) Data Warehouse
10 18 (9.78%) Data Lake
11 16 (8.70%) IBM BigInsights
12 15 (8.15%) SQL Server 2008
13 14 (7.61%) MongoDB
13 14 (7.61%) Oracle ODI
14 11 (5.98%) SQL Server 2012
15 9 (4.89%) Amazon Redshift
16 8 (4.35%) Apache Cassandra
16 8 (4.35%) MySQL
16 8 (4.35%) SAP BW
17 7 (3.80%) SAP Data Services
Development Applications
1 38 (20.65%) Jenkins
2 25 (13.59%) Git (software)
3 20 (10.87%) Talend Open Studio
4 12 (6.52%) Team Foundation Server
5 9 (4.89%) JIRA
6 3 (1.63%) Sonatype Nexus
7 1 (0.54%) Atlassian Bamboo
7 1 (0.54%) Hudson
7 1 (0.54%) RStudio
General
1 25 (13.59%) Finance
2 17 (9.24%) Telecoms
3 7 (3.80%) Marketing
3 7 (3.80%) Retail
4 4 (2.17%) Banking
4 4 (2.17%) Electronics
4 4 (2.17%) Manufacturing
5 1 (0.54%) Legal
Job Titles
1 62 (33.70%) Data Engineer
2 49 (26.63%) Big Data Engineer
3 34 (18.48%) Developer
4 32 (17.39%) Architect
5 24 (13.04%) Hadoop Engineer
6 21 (11.41%) Data Architect
7 19 (10.33%) Big Data Architect
7 19 (10.33%) DevOps Engineer
8 16 (8.70%) Administrator
9 14 (7.61%) Hadoop Administrator
10 13 (7.07%) Hadoop Developer
11 11 (5.98%) Big Data Developer
12 9 (4.89%) Scala Developer
12 9 (4.89%) Solutions Architect
13 8 (4.35%) Technical Architect
14 6 (3.26%) Consultant
15 5 (2.72%) Big Data Solutions Architect
15 5 (2.72%) Cloud Architect
15 5 (2.72%) Cloud Developer
15 5 (2.72%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 127 (69.02%) Kafka
2 42 (22.83%) PySpark
3 38 (20.65%) Spark Streaming
4 26 (14.13%) Web Services
5 16 (8.70%) Sensu
6 13 (7.07%) RESTful
6 13 (7.07%) SOAP
7 12 (6.52%) XML
8 9 (4.89%) JSON
8 9 (4.89%) REST
9 7 (3.80%) Apache Avro
9 7 (3.80%) J2EE
10 5 (2.72%) Akka
10 5 (2.72%) scikit-learn
11 4 (2.17%) Node.js
12 3 (1.63%) .NET
12 3 (1.63%) Spring
13 2 (1.09%) JMS
13 2 (1.09%) Lucene
13 2 (1.09%) Middleware
Miscellaneous
1 19 (10.33%) Analytical Skills
2 12 (6.52%) Greenfield Project
3 10 (5.43%) Computer Science
4 5 (2.72%) Data Centre
4 5 (2.72%) Linked Data
4 5 (2.72%) Semantic Web
5 3 (1.63%) Linux Command Line
6 2 (1.09%) Management Information System
6 2 (1.09%) Social Network
7 1 (0.54%) Algorithms
7 1 (0.54%) Clustering
7 1 (0.54%) Distributed Denial-of-Service
7 1 (0.54%) Fintech
7 1 (0.54%) Grid Computing
7 1 (0.54%) Infotainment
7 1 (0.54%) Private Cloud
7 1 (0.54%) Reference Data
Operating Systems
1 50 (27.17%) Linux
2 26 (14.13%) Unix
3 13 (7.07%) Ubuntu
4 2 (1.09%) Android
4 2 (1.09%) Apple iOS
4 2 (1.09%) Windows
5 1 (0.54%) CentOS
5 1 (0.54%) Debian
5 1 (0.54%) Red Hat Enterprise Linux
Processes & Methodologies
1 122 (66.30%) MapReduce
2 63 (34.24%) DevOps
3 59 (32.07%) Analytics
4 58 (31.52%) Open Source
5 50 (27.17%) Agile Software Development
6 49 (26.63%) ETL
7 35 (19.02%) Continuous Integration
8 34 (18.48%) Data Engineering
9 27 (14.67%) Data Analytics
10 23 (12.50%) Big Data Analytics
11 20 (10.87%) Business Intelligence
11 20 (10.87%) Configuration Management
12 16 (8.70%) Data Modelling
12 16 (8.70%) Disaster Recovery
13 15 (8.15%) Information Security
14 13 (7.07%) Data Strategy
15 12 (6.52%) Resource Allocation
16 11 (5.98%) Workflow
17 10 (5.43%) Data Management
17 10 (5.43%) Scrum
Programming Languages
1 98 (53.26%) Java
2 91 (49.46%) Python
3 49 (26.63%) Scala
4 45 (24.46%) Shell Script
4 45 (24.46%) SQL
5 9 (4.89%) HiveQL
6 5 (2.72%) Bash Shell
6 5 (2.72%) R
6 5 (2.72%) SPARQL
7 3 (1.63%) C#
7 3 (1.63%) VB
8 2 (1.09%) COBOL
8 2 (1.09%) Perl
8 2 (1.09%) PL/SQL
8 2 (1.09%) T-SQL
9 1 (0.54%) JavaScript
Qualifications
1 24 (13.04%) Security Cleared
2 20 (10.87%) SC Cleared
3 9 (4.89%) Degree
4 5 (2.72%) Computer Science Degree
4 5 (2.72%) DV Cleared
5 1 (0.54%) CISA
5 1 (0.54%) CISM
5 1 (0.54%) CISSP
5 1 (0.54%) Master's Degree
Quality Assurance & Compliance
1 7 (3.80%) QA
2 5 (2.72%) Data Quality
3 1 (0.54%) FedRAMP
3 1 (0.54%) PCI DSS
3 1 (0.54%) SLA
System Software
1 147 (79.89%) Apache Flume
2 101 (54.89%) HDFS
3 20 (10.87%) Docker
4 4 (2.17%) Apache ZooKeeper
5 1 (0.54%) Active Directory
5 1 (0.54%) Oracle RAC
Systems Management
1 84 (45.65%) Hadoop YARN
2 81 (44.02%) Oozie
3 57 (30.98%) Ambari
4 26 (14.13%) Ansible
5 20 (10.87%) Kubernetes
6 17 (9.24%) Prometheus
7 14 (7.61%) Control-M
8 7 (3.80%) Puppet
9 5 (2.72%) Opscode Chef
10 2 (1.09%) Kibana
11 1 (0.54%) logstash
11 1 (0.54%) Mesos
Vendors
1 54 (29.35%) Cloudera
2 51 (27.72%) IBM
3 44 (23.91%) Tableau
4 31 (16.85%) Oracle
5 20 (10.87%) Talend
6 17 (9.24%) Hortonworks
7 15 (8.15%) Informatica
8 14 (7.61%) SAP
9 13 (7.07%) Red Hat
10 12 (6.52%) Google
10 12 (6.52%) Salesforce.com
11 5 (2.72%) Microsoft
11 5 (2.72%) Palantir
12 3 (1.63%) MapR
13 2 (1.09%) Atlassian
13 2 (1.09%) SaltStack
13 2 (1.09%) Splunk
14 1 (0.54%) DataFlux
14 1 (0.54%) Hyperion
14 1 (0.54%) MicroStrategy