Period
to 19 June 2019

The following table provides summary statistics for permanent job vacancies with a requirement for Apache Pig skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Pig over the 6 months to 19 June 2019 with a comparison to the same period in the previous 2 years.

Apache Pig
UK
6 months to
19 Jun 2019
Same period 2018 Same period 2017
Rank 807 942 870
Rank change year-on-year +135 -72 -63
Permanent jobs citing Apache Pig 293 245 313
As % of all permanent IT jobs advertised in the UK 0.20% 0.14% 0.18%
As % of the Application Platforms category 1.35% 0.86% 1.01%
Number of salaries quoted 222 199 228
UK median annual salary £85,000 £60,000 £65,000
Median salary % change year-on-year +41.67% -7.69% -
10th Percentile £60,000 £37,500 £39,625
90th Percentile £130,000 £96,000 £102,500
UK excluding London median annual salary £52,500 £50,000 £52,500
% change year-on-year +5.00% -4.76% -8.70%

Apache Pig is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for application platform skills.

All Application Platform Skills
UK
Permanent vacancies with a requirement for application platform skills 21,695 28,645 30,845
As % of all permanent IT jobs advertised in the UK 15.10% 16.64% 17.91%
Number of salaries quoted 17,049 23,143 25,338
UK median annual salary £50,000 £50,000 £46,000
Median salary % change year-on-year - +8.70% +2.22%
10th Percentile £28,000 £27,500 £26,750
90th Percentile £85,000 £80,000 £75,000
UK excluding London median annual salary £43,000 £42,500 £40,000
% change year-on-year +1.18% +6.25% -

Apache Pig
Job Vacancy Trend

Job postings citing Apache Pig as a percentage of all IT jobs advertised.

Job vacancy trend for Apache Pig in the UK

Apache Pig
Salary Trend

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Apache Pig.

Salary trend for Apache Pig in the UK

Apache Pig
Salary Histogram

The salary distribution of IT jobs citing Apache Pig over the 6 months to 19 June 2019.

Salary histogram for Apache Pig in the UK

Apache Pig
Top 12 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Apache Pig within the UK over the 6 months to 19 June 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +163 285 £85,000 +36.00% 2
London +189 230 £85,000 +13.33% 1
UK excluding London +13 59 £52,500 +5.00% 1
South West +10 28 £50,000 -
South East +28 17 £61,250 +22.50%
East of England +55 6 £75,000 - 1
Scotland +10 5 £65,000 +23.81%
North of England +5 2 £40,000 -20.00%
Midlands +45 1 - -
North West +11 1 £40,000 -20.00%
Yorkshire -8 1 - -
East Midlands - 1 - -

For the 6 months to 19 June 2019, IT jobs citing Apache Pig also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads with a requirement for Apache Pig.

1 272 (92.83%) Hadoop
1 272 (92.83%) Apache Spark
2 252 (86.01%) Big Data
3 228 (77.82%) Apache Hive
4 223 (76.11%) Python
5 210 (71.67%) Amazon AWS
6 199 (67.92%) Scala
7 181 (61.77%) Java
8 178 (60.75%) Kafka
9 162 (55.29%) Cloudera
9 162 (55.29%) HBase
10 152 (51.88%) Machine Learning
11 142 (48.46%) NoSQL
11 142 (48.46%) Microsoft Azure
11 142 (48.46%) Oozie
12 140 (47.78%) Google Cloud Platform
13 136 (46.42%) Data Science
14 127 (43.34%) MongoDB
14 127 (43.34%) SQL
15 126 (43.00%) Agile Software Development
16 124 (42.32%) Analytics
17 118 (40.27%) Law
18 113 (38.57%) MapReduce
19 111 (37.88%) Apache Cassandra
20 106 (36.18%) DevOps
21 99 (33.79%) Apache NiFi
22 93 (31.74%) Impala
23 92 (31.40%) Elasticsearch
24 90 (30.72%) Sqoop
25 85 (29.01%) Hadoop YARN

Apache Pig
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 272 (92.83%) Apache Spark
2 92 (31.40%) Elasticsearch
3 62 (21.16%) Apache
4 43 (14.68%) Apache Solr
5 8 (2.73%) SAS
6 5 (1.71%) Apache Geronimo
6 5 (1.71%) GlassFish
6 5 (1.71%) JBoss
6 5 (1.71%) Tomcat
6 5 (1.71%) WebSphere
7 3 (1.02%) Cloud Foundry
8 1 (0.34%) Apache Airflow
8 1 (0.34%) Confluence
8 1 (0.34%) Jupyter
Applications
1 6 (2.05%) Weka
2 3 (1.02%) GNU Octave
2 3 (1.02%) Microsoft Excel
2 3 (1.02%) Microsoft PowerPoint
2 3 (1.02%) MS Visio
2 3 (1.02%) SPSS
3 1 (0.34%) S-PLUS
3 1 (0.34%) Stata
Cloud Services
1 210 (71.67%) Amazon AWS
2 142 (48.46%) Microsoft Azure
3 140 (47.78%) Google Cloud Platform
4 33 (11.26%) Amazon Kinesis
5 24 (8.19%) Amazon EMR
6 21 (7.17%) Amazon EC2
6 21 (7.17%) Power Platform
7 20 (6.83%) Azure Data Factory
8 15 (5.12%) Amazon CloudWatch
8 15 (5.12%) Amazon SQS
8 15 (5.12%) Cortana Intelligence Suite
9 11 (3.75%) Amazon ECS
9 11 (3.75%) Amazon EKS
10 7 (2.39%) Serverless
11 6 (2.05%) Cloud Computing
12 5 (1.71%) AWS Lambda
13 4 (1.37%) Amazon S3
13 4 (1.37%) AWS CloudFormation
13 4 (1.37%) Google Analytics
13 4 (1.37%) PaaS
Communications & Networking
1 14 (4.78%) Internet
2 4 (1.37%) MQTT
Database & Business Intelligence
1 272 (92.83%) Hadoop
2 252 (86.01%) Big Data
3 228 (77.82%) Apache Hive
4 162 (55.29%) HBase
5 142 (48.46%) NoSQL
6 127 (43.34%) MongoDB
7 111 (37.88%) Apache Cassandra
8 93 (31.74%) Impala
9 90 (30.72%) Sqoop
10 80 (27.30%) Amazon Redshift
11 67 (22.87%) CouchDB
12 62 (21.16%) Couchbase
12 62 (21.16%) Flink
13 57 (19.45%) Data Warehouse
14 28 (9.56%) MySQL
14 28 (9.56%) SQL Server
15 24 (8.19%) QlikView
16 22 (7.51%) DataStage
16 22 (7.51%) Pentaho
17 21 (7.17%) Neo4j
Development Applications
1 42 (14.33%) Git (software)
2 33 (11.26%) Maven
3 29 (9.90%) Ant
3 29 (9.90%) Gradle
4 14 (4.78%) Visual Studio
5 11 (3.75%) Eclipse
5 11 (3.75%) IntelliJ
5 11 (3.75%) NetBeans
6 5 (1.71%) Jenkins
7 2 (0.68%) ER Studio
7 2 (0.68%) ERwin
7 2 (0.68%) Hudson
7 2 (0.68%) JIRA
7 2 (0.68%) PowerDesigner
8 1 (0.34%) Subversion
General
1 118 (40.27%) Law
2 21 (7.17%) Banking
3 19 (6.48%) Finance
4 12 (4.10%) Games
5 6 (2.05%) Marketing
6 3 (1.02%) Electronics
6 3 (1.02%) Private Banking
6 3 (1.02%) Retail Banking
7 2 (0.68%) Retail
7 2 (0.68%) Telecoms
Job Titles
1 131 (44.71%) Data Engineer
2 119 (40.61%) Big Data Engineer
3 49 (16.72%) Hadoop Engineer
4 34 (11.60%) Senior Data Engineer
5 33 (11.26%) Developer
6 32 (10.92%) Python Engineer
7 31 (10.58%) AWS DevOps
7 31 (10.58%) Linux/Unix DevOps
8 29 (9.90%) AWS Engineer
9 25 (8.53%) Architect
9 25 (8.53%) Data Scientist
10 24 (8.19%) Data Architect
10 24 (8.19%) Senior Developer
11 21 (7.17%) Big Data Architect
12 17 (5.80%) Java Developer
13 16 (5.46%) DevOps Engineer
13 16 (5.46%) DevOps Manager
13 16 (5.46%) Linux DevOps Engineer
13 16 (5.46%) Linux Engineer
13 16 (5.46%) Senior Hadoop Engineer
Libraries, Frameworks & Software Standards
1 178 (60.75%) Kafka
2 99 (33.79%) Apache NiFi
3 35 (11.95%) Spark Streaming
4 33 (11.26%) Node.js
5 32 (10.92%) Web Services
6 19 (6.48%) Hibernate
6 19 (6.48%) Spring
7 16 (5.46%) JPA
7 16 (5.46%) SOAP
8 13 (4.44%) PySpark
8 13 (4.44%) RabbitMQ
9 12 (4.10%) .NET
9 12 (4.10%) REST
10 11 (3.75%) ActiveMQ
10 11 (3.75%) Spring Boot
10 11 (3.75%) Spring Cloud
11 10 (3.41%) NumPy
12 9 (3.07%) Java EE
12 9 (3.07%) Pandas
13 8 (2.73%) HTML
Miscellaneous
1 57 (19.45%) Analytical Skills
2 20 (6.83%) Algorithms
3 18 (6.14%) Management Information System
4 17 (5.80%) Data Structures
5 15 (5.12%) Social Media
6 14 (4.78%) Cloud Native
7 4 (1.37%) Linked Data
7 4 (1.37%) Linux Command Line
7 4 (1.37%) User Experience
8 3 (1.02%) Data Centre
8 3 (1.02%) PKI
8 3 (1.02%) Public Cloud
8 3 (1.02%) Semantic Web
9 2 (0.68%) FMCG
9 2 (0.68%) Greenfield Project
9 2 (0.68%) Virtual Team
10 1 (0.34%) Analytical Mindset
10 1 (0.34%) Wiki
Operating Systems
1 54 (18.43%) Linux
2 43 (14.68%) Unix
3 15 (5.12%) CentOS
3 15 (5.12%) Ubuntu
4 4 (1.37%) Mac OS X
5 3 (1.02%) Windows
Processes & Methodologies
1 152 (51.88%) Machine Learning
2 136 (46.42%) Data Science
3 126 (43.00%) Agile Software Development
4 124 (42.32%) Analytics
5 113 (38.57%) MapReduce
6 106 (36.18%) DevOps
7 72 (24.57%) ETL
8 70 (23.89%) Scrum
9 62 (21.16%) Data Modelling
10 61 (20.82%) Data Engineering
11 60 (20.48%) Business Intelligence
12 52 (17.75%) Kanban
13 48 (16.38%) Data Architecture
14 47 (16.04%) Data Analytics
15 46 (15.70%) Technology Roadmap
16 40 (13.65%) Open Source
17 39 (13.31%) Software Engineering
18 38 (12.97%) Continuous Integration
19 35 (11.95%) Visualisation
20 32 (10.92%) Artificial Intelligence
Programming Languages
1 223 (76.11%) Python
2 199 (67.92%) Scala
3 181 (61.77%) Java
4 127 (43.34%) SQL
5 32 (10.92%) PL/SQL
6 27 (9.22%) Perl
7 24 (8.19%) Groovy
7 24 (8.19%) JavaScript
8 20 (6.83%) R
9 18 (6.14%) C
10 16 (5.46%) T-SQL
11 15 (5.12%) PHP
12 12 (4.10%) C#
13 11 (3.75%) Clojure
14 7 (2.39%) MATLAB
15 6 (2.05%) C++
16 4 (1.37%) Ruby
17 1 (0.34%) Data Analysis Expressions (DAX)
17 1 (0.34%) SPARQL
17 1 (0.34%) TypeScript
Qualifications
1 48 (16.38%) Degree
2 17 (5.80%) Computer Science Degree
3 15 (5.12%) SC Cleared
3 15 (5.12%) Security Cleared
4 10 (3.41%) PhD
5 7 (2.39%) Master's Degree
6 1 (0.34%) DV Cleared
6 1 (0.34%) Numerate Degree
Quality Assurance & Compliance
1 16 (5.46%) QA
System Software
1 81 (27.65%) Apache Flume
2 80 (27.30%) Apache ZooKeeper
3 46 (15.70%) Docker
4 33 (11.26%) HDFS
5 3 (1.02%) Hyper-V
5 3 (1.02%) VMware Infrastructure
6 1 (0.34%) Cronacle
Systems Management
1 142 (48.46%) Oozie
2 85 (29.01%) Hadoop YARN
3 30 (10.24%) Opscode Chef
4 24 (8.19%) Nagios
5 21 (7.17%) Ambari
6 16 (5.46%) Terraform
7 15 (5.12%) Puppet
8 3 (1.02%) Kibana
8 3 (1.02%) Mesos
9 2 (0.68%) Kubernetes
10 1 (0.34%) Control-M
Vendors
1 162 (55.29%) Cloudera
2 79 (26.96%) Databricks
3 66 (22.53%) Hortonworks
3 66 (22.53%) MapR
4 39 (13.31%) Oracle
5 38 (12.97%) Tableau
6 36 (12.29%) Google
6 36 (12.29%) Microsoft
7 27 (9.22%) Informatica
8 21 (7.17%) Talend
9 13 (4.44%) IBM
10 8 (2.73%) Guidewire
10 8 (2.73%) Netezza
11 5 (1.71%) Alteryx
12 4 (1.37%) Cognizant
12 4 (1.37%) Dataiku
12 4 (1.37%) Salesforce.com
12 4 (1.37%) SAP
12 4 (1.37%) Teradata
13 3 (1.02%) Cognos