Period
to 25 November 2017

The following table provides summary statistics for contract job vacancies with a requirement for Apache Pig skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Pig over the 6 months to 25 November 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Pig
UK
6 months to
25 Nov 2017
Same period 2016 Same period 2015
Rank 726 644 737
Rank change year-on-year -82 +93 +12
Contract jobs citing Apache Pig 147 246 176
As % of all contract IT jobs advertised in the UK 0.14% 0.23% 0.15%
As % of the Application Platforms category 0.87% 1.27% 0.87%
Number of daily rates quoted 84 152 85
UK median daily rate £550 £550 £525
Median daily rate % change year-on-year - +4.76% -4.55%
10th Percentile £416 £406 £425
90th Percentile £725 £700 £675
UK excluding London median daily rate £525 £538 £500
% change year-on-year -2.42% +7.60% +5.26%
Number of hourly rates quoted 2 0 2
UK median hourly rate £45.00 - £33.55
UK excluding London median hourly rate £45.00 - £33.55

Apache Pig is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for application platform skills.

All Application Platform Skills
UK
Contract vacancies with a requirement for application platform skills 16961 19368 20167
As % of all contract IT jobs advertised in the UK 16.57% 18.50% 17.63%
Number of daily rates quoted 11168 12541 12691
UK median daily rate £450 £425 £400
Median daily rate % change year-on-year +5.88% +6.25% +5.26%
10th Percentile £263 £250 £230
90th Percentile £606 £588 £563
UK excluding London median daily rate £400 £388 £375
% change year-on-year +3.23% +3.33% +3.45%
Number of hourly rates quoted 424 477 604
UK median hourly rate £20.00 £20.00 £20.50
Median hourly rate % change year-on-year - -2.44% +13.89%
10th Percentile £11.00 £12.10 £11.00
90th Percentile £47.83 £48.53 £43.00
UK excluding London median hourly rate £20.00 £20.50 £20.00
% change year-on-year -2.44% +2.50% +14.29%

Apache Pig
Job Vacancy Trend

Job postings citing Apache Pig as a percentage of all IT jobs advertised.

Job vacancy trend for Apache Pig in the UK

Apache Pig
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Apache Pig.

Contractor daily rate trend for Apache Pig in the UK

Apache Pig
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Apache Pig over the 6 months to 25 November 2017.

Contractor daily rate histogram for Apache Pig in the UK

Apache Pig
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Apache Pig.

Contractor hourly rate trend for Apache Pig in the UK

Apache Pig
Top 12 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Pig within the UK over the 6 months to 25 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -82 147 £550 - 25
London -67 97 £550 - 17
UK excluding London +6 50 £525 -2.42% 8
South East -34 17 £560 +1.82% 2
South West +9 12 £525 +15.38% 2
North of England +40 10 - - 4
East of England -6 10 £488 -11.36%
North West +31 8 - -
Scotland +6 4 - -
Yorkshire +11 2 - - 4
Midlands +20 1 - -
East Midlands 0 1 - -

For the 6 months to 25 November 2017, IT contractor jobs citing Apache Pig also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for Apache Pig.

1 130 (88.44%) Big Data
2 128 (87.07%) Apache Hive
3 120 (81.63%) Hadoop
4 90 (61.22%) Apache Spark
5 76 (51.70%) Java
6 71 (48.30%) MapReduce
7 68 (46.26%) HBase
8 67 (45.58%) Python
9 51 (34.69%) Kafka
10 49 (33.33%) MongoDB
10 49 (33.33%) SQL
11 47 (31.97%) Apache Flume
12 46 (31.29%) HDFS
13 45 (30.61%) Cloudera
14 44 (29.93%) ETL
15 42 (28.57%) Finance
16 41 (27.89%) Impala
17 40 (27.21%) Scala
18 39 (26.53%) Analytical Skills
19 36 (24.49%) NoSQL
20 34 (23.13%) Unix
21 32 (21.77%) Agile Software Development
21 32 (21.77%) Sqoop
22 31 (21.09%) Analytics
22 31 (21.09%) Banking
22 31 (21.09%) Amazon AWS
23 30 (20.41%) Apache Cassandra
23 30 (20.41%) Hadoop YARN
24 29 (19.73%) R
24 29 (19.73%) Machine Learning

Apache Pig
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 90 (61.22%) Apache Spark
2 21 (14.29%) Apache
3 19 (12.93%) Apache Solr
4 9 (6.12%) Jupyter
5 7 (4.76%) Elasticsearch
6 3 (2.04%) Confluence
6 3 (2.04%) JBoss
6 3 (2.04%) Tomcat
6 3 (2.04%) WebSphere
7 2 (1.36%) Oracle Application Server
7 2 (1.36%) Oracle SOA Suite
7 2 (1.36%) SAS
7 2 (1.36%) SharePoint
7 2 (1.36%) WebLogic
7 2 (1.36%) WebSphere Application Server
8 1 (0.68%) Mule
8 1 (0.68%) Oracle Workflow
Applications
1 1 (0.68%) Gephi
1 1 (0.68%) GNU Octave
1 1 (0.68%) Microsoft Excel
1 1 (0.68%) Microsoft Office
Cloud Services
1 31 (21.09%) Amazon AWS
2 16 (10.88%) Microsoft Azure
3 9 (6.12%) Amazon EC2
4 6 (4.08%) GitHub
4 6 (4.08%) Google Cloud Platform
5 5 (3.40%) Cloud Computing
6 4 (2.72%) Slack
7 2 (1.36%) Amazon S3
7 2 (1.36%) IaaS
7 2 (1.36%) PaaS
7 2 (1.36%) SaaS
8 1 (0.68%) Adobe Analytics
8 1 (0.68%) Amazon EMR
8 1 (0.68%) Azure Machine Learning
8 1 (0.68%) Cortana Intelligence Suite
8 1 (0.68%) Data Lake Analytics
8 1 (0.68%) Google Analytics
Communications & Networking
1 10 (6.80%) Kerberos
2 6 (4.08%) Firewall
2 6 (4.08%) SNMP
2 6 (4.08%) SSH
3 3 (2.04%) Network Security
4 2 (1.36%) SSL
Database & Business Intelligence
1 130 (88.44%) Big Data
2 128 (87.07%) Apache Hive
3 120 (81.63%) Hadoop
4 68 (46.26%) HBase
5 49 (33.33%) MongoDB
6 41 (27.89%) Impala
7 36 (24.49%) NoSQL
8 32 (21.77%) Sqoop
9 30 (20.41%) Apache Cassandra
10 24 (16.33%) Data Warehouse
10 24 (16.33%) Mahout
11 18 (12.24%) Data Mining
12 11 (7.48%) Relational Database
13 10 (6.80%) MarkLogic
13 10 (6.80%) Riak
14 9 (6.12%) Cloudera CDH
15 8 (5.44%) Blockchain
15 8 (5.44%) MySQL
15 8 (5.44%) SAP BW
15 8 (5.44%) SQL Server
Development Applications
1 18 (12.24%) Git (software)
2 10 (6.80%) Jenkins
3 8 (5.44%) Gradle
4 6 (4.08%) Ant
4 6 (4.08%) Maven
5 5 (3.40%) HP UFT
6 4 (2.72%) JIRA
7 2 (1.36%) Selenium
7 2 (1.36%) SoapUI
7 2 (1.36%) Sonatype Nexus
7 2 (1.36%) Subversion
7 2 (1.36%) WebDriver
8 1 (0.68%) Cucumber
8 1 (0.68%) Eclipse
8 1 (0.68%) Hudson
8 1 (0.68%) IntelliJ
8 1 (0.68%) NetBeans
8 1 (0.68%) Talend Open Studio
8 1 (0.68%) Team Foundation Server
8 1 (0.68%) Visual Studio
General
1 42 (28.57%) Finance
2 31 (21.09%) Banking
3 10 (6.80%) Retail
4 9 (6.12%) Games
5 8 (5.44%) Investment Banking
6 4 (2.72%) Marketing
7 2 (1.36%) Electronics
7 2 (1.36%) Telecoms
8 1 (0.68%) Aerospace
8 1 (0.68%) Pharmaceutical
Job Titles
1 56 (38.10%) Developer
2 27 (18.37%) Data Engineer
3 24 (16.33%) Big Data Developer
3 24 (16.33%) Big Data Engineer
4 22 (14.97%) Architect
5 21 (14.29%) Data Scientist
6 18 (12.24%) Hadoop Developer
7 12 (8.16%) Java Developer
8 11 (7.48%) Analyst
9 10 (6.80%) Data Architect
10 9 (6.12%) Technical Architect
11 8 (5.44%) Big Data Architect
11 8 (5.44%) Data Analyst
12 7 (4.76%) Scala Developer
13 6 (4.08%) Hadoop Engineer
14 5 (3.40%) Cloud Developer
14 5 (3.40%) Hadoop Architect
14 5 (3.40%) Java Engineer
14 5 (3.40%) Lead Developer
15 4 (2.72%) Designer
Libraries, Frameworks & Software Standards
1 51 (34.69%) Kafka
2 23 (15.65%) Web Services
3 18 (12.24%) Spring
4 14 (9.52%) Hibernate
5 12 (8.16%) RabbitMQ
5 12 (8.16%) scikit-learn
5 12 (8.16%) XML
6 11 (7.48%) JMS
6 11 (7.48%) Natural Language Processing
7 10 (6.80%) Lucene
7 10 (6.80%) Pandas
8 9 (6.12%) Spark Streaming
9 8 (5.44%) NumPy
9 8 (5.44%) Play Framework
10 7 (4.76%) J2EE
10 7 (4.76%) Matplotlib
10 7 (4.76%) Seaborn
11 6 (4.08%) Cascading
11 6 (4.08%) PySpark
11 6 (4.08%) REST
Miscellaneous
1 39 (26.53%) Analytical Skills
2 18 (12.24%) Algorithms
3 11 (7.48%) Fintech
4 10 (6.80%) Computer Science
5 9 (6.12%) Greenfield Project
5 9 (6.12%) Replication
6 6 (4.08%) Mainframe
7 4 (2.72%) Market Risk
8 3 (2.04%) DataPower
8 3 (2.04%) Digital Media
9 2 (1.36%) Management Information System
9 2 (1.36%) Security Operations Centre
9 2 (1.36%) Shadow IT
9 2 (1.36%) Virtual Team
10 1 (0.68%) Distributed Denial-of-Service
10 1 (0.68%) Grid Computing
10 1 (0.68%) Media Streaming
10 1 (0.68%) Over-the-Top Content
10 1 (0.68%) Private Cloud
10 1 (0.68%) Robotics
Operating Systems
1 34 (23.13%) Unix
2 24 (16.33%) Linux
3 10 (6.80%) Red Hat Enterprise Linux
4 9 (6.12%) CentOS
5 8 (5.44%) Windows
6 2 (1.36%) Android
6 2 (1.36%) Apple iOS
7 1 (0.68%) Debian
7 1 (0.68%) Ubuntu
Processes & Methodologies
1 71 (48.30%) MapReduce
2 44 (29.93%) ETL
3 32 (21.77%) Agile Software Development
4 31 (21.09%) Analytics
5 29 (19.73%) Machine Learning
6 28 (19.05%) TDD
7 24 (16.33%) Open Source
8 22 (14.97%) Continuous Integration
8 22 (14.97%) Visualisation
9 16 (10.88%) BDD
9 16 (10.88%) Data Analysis
10 15 (10.20%) Scrum
10 15 (10.20%) Software Engineering
11 14 (9.52%) Data Visualisation
11 14 (9.52%) Mathematics
11 14 (9.52%) Workflow
12 13 (8.84%) Data Modelling
13 12 (8.16%) Data Management
13 12 (8.16%) Data Privacy
14 11 (7.48%) Statistical Modelling
Programming Languages
1 76 (51.70%) Java
2 67 (45.58%) Python
3 49 (33.33%) SQL
4 40 (27.21%) Scala
5 29 (19.73%) R
6 17 (11.56%) JavaScript
7 16 (10.88%) Bash Shell
8 13 (8.84%) C#
8 13 (8.84%) HiveQL
8 13 (8.84%) Perl
9 5 (3.40%) T-SQL
10 4 (2.72%) C++
11 3 (2.04%) Groovy
11 3 (2.04%) PHP
11 3 (2.04%) Shell Script
12 2 (1.36%) C
12 2 (1.36%) COBOL
12 2 (1.36%) PL/SQL
12 2 (1.36%) Ruby
Qualifications
1 10 (6.80%) Degree
2 4 (2.72%) Computer Science Degree
2 4 (2.72%) Master's Degree
3 2 (1.36%) SC Cleared
3 2 (1.36%) Security Cleared
4 1 (0.68%) BPSS Clearance
4 1 (0.68%) CISA
4 1 (0.68%) CISM
4 1 (0.68%) CISSP
4 1 (0.68%) PhD
Quality Assurance & Compliance
1 5 (3.40%) Data Quality
2 4 (2.72%) GDPR
2 4 (2.72%) QA
3 3 (2.04%) PCI DSS
4 1 (0.68%) FedRAMP
4 1 (0.68%) SLA
System Software
1 47 (31.97%) Apache Flume
2 46 (31.29%) HDFS
3 8 (5.44%) Apache ZooKeeper
4 5 (3.40%) Docker
5 1 (0.68%) Active Directory
5 1 (0.68%) Oracle RAC
Systems Management
1 30 (20.41%) Hadoop YARN
2 23 (15.65%) Oozie
3 4 (2.72%) Ambari
3 4 (2.72%) Puppet
4 3 (2.04%) Ansible
5 2 (1.36%) Control-M
5 2 (1.36%) Opscode Chef
6 1 (0.68%) Docker Swarm
6 1 (0.68%) Kibana
6 1 (0.68%) logstash
Vendors
1 45 (30.61%) Cloudera
2 17 (11.56%) Hortonworks
3 16 (10.88%) Tableau
4 15 (10.20%) MapR
4 15 (10.20%) Oracle
4 15 (10.20%) Teradata
5 11 (7.48%) Splunk
6 10 (6.80%) Informatica
7 9 (6.12%) SAP
8 6 (4.08%) Google
8 6 (4.08%) Microsoft
8 6 (4.08%) Perforce
9 3 (2.04%) Atlassian
9 3 (2.04%) IBM
9 3 (2.04%) Palantir
10 2 (1.36%) Ab Initio
10 2 (1.36%) Red Hat
10 2 (1.36%) SaltStack
10 2 (1.36%) ServiceNow
11 1 (0.68%) MicroStrategy