Period
to 21 April 2018

The following table provides summary statistics for contract job vacancies with a requirement for Apache Pig skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Pig over the 6 months to 21 April 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Pig
UK
6 months to
21 Apr 2018
Same period 2017 Same period 2016
Rank 689 599 670
Rank change year-on-year -90 +71 +32
Contract jobs citing Apache Pig 192 246 215
As % of all contract IT jobs advertised in the UK 0.19% 0.27% 0.20%
As % of the Application Platforms category 1.15% 1.56% 1.17%
Number of daily rates quoted 132 172 147
UK median daily rate £550 £550 £525
Median daily rate % change year-on-year - +4.76% +4.48%
10th Percentile £413 £401 £375
90th Percentile £738 £700 £650
UK excluding London median daily rate £485 £475 £450
% change year-on-year +2.11% +5.56% -
Number of hourly rates quoted 0 0 0
UK median hourly rate - - -
UK excluding London median hourly rate - - -

Apache Pig is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for application platform skills.

All Application Platform Skills
UK
Contract vacancies with a requirement for application platform skills 16,672 15,724 18,336
As % of all contract IT jobs advertised in the UK 16.48% 17.09% 17.19%
Number of daily rates quoted 11,051 10,130 11,769
UK median daily rate £450 £425 £410
Median daily rate % change year-on-year +5.88% +3.66% +2.50%
10th Percentile £263 £255 £243
90th Percentile £625 £600 £588
UK excluding London median daily rate £413 £388 £391
% change year-on-year +6.45% -0.90% +4.27%
Number of hourly rates quoted 384 324 457
UK median hourly rate £18.95 £19.50 £20.50
Median hourly rate % change year-on-year -2.85% -4.88% +10.81%
10th Percentile £11.25 £11.40 £11.00
90th Percentile £47.50 £50.00 £47.05
UK excluding London median hourly rate £17.50 £19.00 £20.00
% change year-on-year -7.89% -5.00% +14.29%

Apache Pig
Job Vacancy Trend

Job postings citing Apache Pig as a percentage of all IT jobs advertised.

Job vacancy trend for Apache Pig in the UK

Apache Pig
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Apache Pig.

Contractor daily rate trend for Apache Pig in the UK

Apache Pig
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Apache Pig over the 6 months to 21 April 2018.

Contractor daily rate histogram for Apache Pig in the UK

Apache Pig
Contractor Hourly Rate Trend

This chart provides the 3-month moving average for contractor hourly rates quoted in IT jobs citing Apache Pig.

Contractor hourly rate trend for Apache Pig in the UK

Apache Pig
Top 12 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Pig within the UK over the 6 months to 21 April 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -108 185 £550 - 24
London -128 116 £563 +2.27% 15
UK excluding London -8 71 £485 +2.11% 9
South East -13 23 £500 +11.11% 3
South West +19 15 £450 -10.00% 2
North of England -7 15 £463 +2.78% 1
Yorkshire -2 12 £425 -10.53%
East of England -6 10 £550 -
East Midlands +5 6 £675 +25.58%
Midlands -8 6 £675 +25.58% 3
North West -10 3 £663 +89.29% 1
Scotland - 2 £488 -

For the 6 months to 21 April 2018, IT contractor jobs citing Apache Pig also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Apache Pig.

1 182 (94.79%) Apache Hive
2 180 (93.75%) Hadoop
3 154 (80.21%) Apache Spark
4 147 (76.56%) Big Data
5 108 (56.25%) Python
6 98 (51.04%) HBase
7 97 (50.52%) Scala
8 93 (48.44%) Java
9 84 (43.75%) MapReduce
10 79 (41.15%) MongoDB
11 78 (40.63%) SQL
12 77 (40.10%) Apache Flume
13 72 (37.50%) Machine Learning
14 69 (35.94%) Analytics
15 66 (34.38%) Agile Software Development
16 65 (33.85%) Data Science
17 60 (31.25%) Apache
18 59 (30.73%) NoSQL
19 57 (29.69%) Kafka
20 53 (27.60%) Amazon AWS
21 52 (27.08%) Finance
22 50 (26.04%) Oozie
23 47 (24.48%) Open Source
24 46 (23.96%) Data Warehouse
24 46 (23.96%) Sqoop
24 46 (23.96%) HDFS
25 44 (22.92%) Docker
26 43 (22.40%) ETL
27 39 (20.31%) Apache Cassandra
28 38 (19.79%) Algorithms

Apache Pig
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 154 (80.21%) Apache Spark
2 60 (31.25%) Apache
3 22 (11.46%) Jupyter
4 21 (10.94%) Elasticsearch
5 9 (4.69%) SAS
6 8 (4.17%) Apache Solr
7 4 (2.08%) nginx
8 2 (1.04%) Adobe Experience Manager
8 2 (1.04%) CMS
9 1 (0.52%) SharePoint
Applications
1 3 (1.56%) Chatbot
1 3 (1.56%) SPSS
2 1 (0.52%) Gephi
Cloud Services
1 53 (27.60%) Amazon AWS
2 35 (18.23%) Microsoft Azure
3 15 (7.81%) Google Analytics
4 11 (5.73%) Amazon S3
5 10 (5.21%) Amazon EC2
5 10 (5.21%) Amazon EMR
5 10 (5.21%) AWS Lambda
5 10 (5.21%) Serverless
6 7 (3.65%) Amazon Kinesis
7 6 (3.13%) AWS CloudFormation
8 5 (2.60%) Cloud Computing
9 4 (2.08%) Azure Data Factory
9 4 (2.08%) CloudFront
9 4 (2.08%) IaaS
9 4 (2.08%) PaaS
10 3 (1.56%) SaaS
11 2 (1.04%) GitHub
11 2 (1.04%) Google Cloud Platform
11 2 (1.04%) Virtual Private Cloud
12 1 (0.52%) Azure Machine Learning
Communications & Networking
1 5 (2.60%) DNS
1 5 (2.60%) ICMP
1 5 (2.60%) Kerberos
1 5 (2.60%) TCP/IP
1 5 (2.60%) VPN
2 3 (1.56%) HTTP
2 3 (1.56%) Internet
3 2 (1.04%) Firewall
3 2 (1.04%) Network Security
Database & Business Intelligence
1 182 (94.79%) Apache Hive
2 180 (93.75%) Hadoop
3 147 (76.56%) Big Data
4 98 (51.04%) HBase
5 79 (41.15%) MongoDB
6 59 (30.73%) NoSQL
7 46 (23.96%) Data Warehouse
7 46 (23.96%) Sqoop
8 39 (20.31%) Apache Cassandra
9 31 (16.15%) PostgreSQL
10 28 (14.58%) Mahout
10 28 (14.58%) SQL Server
11 26 (13.54%) MySQL
12 23 (11.98%) Relational Database
13 22 (11.46%) Amazon Redshift
14 15 (7.81%) Flink
15 13 (6.77%) Impala
16 12 (6.25%) Data Lake
17 11 (5.73%) RDBMS
18 10 (5.21%) Redis
Development Applications
1 36 (18.75%) Git (software)
2 26 (13.54%) Jenkins
3 12 (6.25%) Subversion
4 10 (5.21%) Visual Studio
4 10 (5.21%) Visual Studio Team System
5 8 (4.17%) TeamCity
6 7 (3.65%) JUnit
6 7 (3.65%) Vagrant
7 5 (2.60%) Artifactory
7 5 (2.60%) SonarQube
8 3 (1.56%) Atlassian Bamboo
8 3 (1.56%) Maven
9 2 (1.04%) Ant
9 2 (1.04%) Gradle
9 2 (1.04%) HP UFT
9 2 (1.04%) Hudson
9 2 (1.04%) Team Foundation Server
10 1 (0.52%) JIRA
General
1 52 (27.08%) Finance
2 26 (13.54%) Banking
3 21 (10.94%) Retail
4 12 (6.25%) Marketing
5 10 (5.21%) Investment Banking
6 6 (3.13%) Telecoms
7 5 (2.60%) Games
7 5 (2.60%) Private Banking
7 5 (2.60%) Retail Banking
8 3 (1.56%) Advertising
8 3 (1.56%) French Language
9 2 (1.04%) Cantonese Language
9 2 (1.04%) German Language
9 2 (1.04%) Italian Language
9 2 (1.04%) Japanese Language
9 2 (1.04%) Mandarin Language
9 2 (1.04%) Pharmaceutical
9 2 (1.04%) Russian Language
9 2 (1.04%) Spanish Language
10 1 (0.52%) Hindi Language
Job Titles
1 38 (19.79%) Developer
2 37 (19.27%) Data Engineer
2 37 (19.27%) Data Scientist
3 34 (17.71%) Architect
4 26 (13.54%) Data Architect
5 19 (9.90%) Big Data Engineer
6 18 (9.38%) Hadoop Developer
7 16 (8.33%) Big Data Developer
8 14 (7.29%) Big Data Architect
9 11 (5.73%) Cloud Architect
10 10 (5.21%) Python Engineer
11 9 (4.69%) AWS Engineer
11 9 (4.69%) DevOps Engineer
11 9 (4.69%) Senior Data Engineer
12 8 (4.17%) Consultant
12 8 (4.17%) Data Analytics Engineer
12 8 (4.17%) Data Consultant
12 8 (4.17%) Hadoop Architect
13 7 (3.65%) Administrator
13 7 (3.65%) Machine Learning Engineer
Libraries, Frameworks & Software Standards
1 57 (29.69%) Kafka
2 30 (15.63%) scikit-learn
3 29 (15.10%) TensorFlow
4 22 (11.46%) Pandas
5 21 (10.94%) Matplotlib
5 21 (10.94%) NumPy
5 21 (10.94%) PySpark
5 21 (10.94%) Seaborn
6 15 (7.81%) Keras
7 14 (7.29%) MXNet
7 14 (7.29%) Theano
7 14 (7.29%) Web Services
8 12 (6.25%) Node.js
9 11 (5.73%) Natural Language Processing
10 10 (5.21%) CNTK
11 9 (4.69%) Velocity
12 8 (4.17%) JSON
12 8 (4.17%) MLlib
13 6 (3.13%) Apache Avro
13 6 (3.13%) Samza
Miscellaneous
1 38 (19.79%) Algorithms
2 30 (15.63%) Analytical Skills
3 26 (13.54%) Computer Science
4 21 (10.94%) Data Structures
5 13 (6.77%) Greenfield Project
6 11 (5.73%) Fintech
7 10 (5.21%) Replication
8 6 (3.13%) Public Cloud
8 6 (3.13%) Virtual Team
9 3 (1.56%) Management Information System
9 3 (1.56%) MPEG
10 2 (1.04%) Foreign Exchange (FX)
10 2 (1.04%) iPad
10 2 (1.04%) Media Streaming
10 2 (1.04%) Mobile App
10 2 (1.04%) Over-the-Top Content
11 1 (0.52%) Analytical Mindset
11 1 (0.52%) Digital Media
11 1 (0.52%) Self-Motivation
11 1 (0.52%) Social Media
Operating Systems
1 27 (14.06%) Linux
2 6 (3.13%) Unix
3 4 (2.08%) Red Hat Enterprise Linux
4 3 (1.56%) Debian
4 3 (1.56%) Ubuntu
5 2 (1.04%) CentOS
Processes & Methodologies
1 84 (43.75%) MapReduce
2 72 (37.50%) Machine Learning
3 69 (35.94%) Analytics
4 66 (34.38%) Agile Software Development
5 65 (33.85%) Data Science
6 47 (24.48%) Open Source
7 43 (22.40%) ETL
8 31 (16.15%) DevOps
9 25 (13.02%) Visualisation
10 24 (12.50%) Data Architecture
10 24 (12.50%) Data Modelling
10 24 (12.50%) Problem-Solving
11 23 (11.98%) Data Engineering
12 22 (11.46%) Business Intelligence
13 21 (10.94%) E-Commerce
14 20 (10.42%) Linear Regression
14 20 (10.42%) Logistic Regression
14 20 (10.42%) Statistics
15 19 (9.90%) Data Governance
15 19 (9.90%) Scrum
Programming Languages
1 108 (56.25%) Python
2 97 (50.52%) Scala
3 93 (48.44%) Java
4 78 (40.63%) SQL
5 34 (17.71%) R
6 18 (9.38%) Ruby
7 17 (8.85%) JavaScript
8 13 (6.77%) Java 8
9 10 (5.21%) C
10 8 (4.17%) Perl
10 8 (4.17%) PHP
10 8 (4.17%) Shell Script
11 6 (3.13%) C#
11 6 (3.13%) Go
11 6 (3.13%) PL/SQL
12 4 (2.08%) C++
12 4 (2.08%) F#
13 3 (1.56%) XPath
14 2 (1.04%) Bash Shell
15 1 (0.52%) HiveQL
Qualifications
1 24 (12.50%) Degree
2 10 (5.21%) SC Cleared
2 10 (5.21%) Security Cleared
3 9 (4.69%) Master's Degree
4 7 (3.65%) Numerate Degree
5 2 (1.04%) Computer Science Degree
6 1 (0.52%) AWS Certification
6 1 (0.52%) DV Cleared
Quality Assurance & Compliance
1 9 (4.69%) GDPR
2 5 (2.60%) Data Quality
3 1 (0.52%) QA
System Software
1 77 (40.10%) Apache Flume
2 46 (23.96%) HDFS
3 44 (22.92%) Docker
4 15 (7.81%) Apache ZooKeeper
Systems Management
1 50 (26.04%) Oozie
2 34 (17.71%) Hadoop YARN
3 23 (11.98%) Ansible
4 16 (8.33%) Ambari
5 13 (6.77%) Puppet
6 10 (5.21%) Kubernetes
6 10 (5.21%) Terraform
7 9 (4.69%) Consul
7 9 (4.69%) Opscode Chef
8 5 (2.60%) Host Intrusion Detection System
8 5 (2.60%) Network Intrusion Detection System
8 5 (2.60%) Prometheus
8 5 (2.60%) Sysdig
9 4 (2.08%) HAProxy
9 4 (2.08%) Packer
10 3 (1.56%) Docker Swarm
11 2 (1.04%) FreeIPA
11 2 (1.04%) Salt
12 1 (0.52%) HP Quality Center
12 1 (0.52%) Mesos
Vendors
1 37 (19.27%) Cloudera
2 33 (17.19%) Hortonworks
3 32 (16.67%) MapR
4 26 (13.54%) Microsoft
5 20 (10.42%) Talend
6 19 (9.90%) Google
6 19 (9.90%) Oracle
7 17 (8.85%) Tableau
8 13 (6.77%) SAP
9 12 (6.25%) Alteryx
10 9 (4.69%) Salesforce.com
11 8 (4.17%) Informatica
12 6 (3.13%) Vertica
13 3 (1.56%) Adobe
13 3 (1.56%) Cognos
13 3 (1.56%) RapidMiner
13 3 (1.56%) Red Hat
13 3 (1.56%) Teradata
14 2 (1.04%) Capita
14 2 (1.04%) Perforce