Period
to 20 November 2017

The following table provides summary statistics for contract job vacancies with a requirement for Apache Flume skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Flume over the 6 months to 20 November 2017 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Flume
UK
6 months to
20 Nov 2017
Same period 2016 Same period 2015
Rank 630 737 809
Rank change year-on-year +107 +72 +47
Contract jobs citing Apache Flume 252 151 77
As % of all contract IT jobs advertised in the UK 0.25% 0.15% 0.067%
As % of the System Software category 1.96% 1.18% 0.66%
Number of daily rates quoted 191 102 46
UK median daily rate £550 £550 £600
Median daily rate % change year-on-year - -8.33% -22.58%
10th Percentile £400 £425 £425
90th Percentile £675 £720 £725
UK excluding London median daily rate £500 £550 £450
% change year-on-year -9.09% +22.22% -10.00%
Number of hourly rates quoted 1 0 2
UK median hourly rate £35.00 - £33.55
UK excluding London median hourly rate £35.00 - £33.55

Apache Flume is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for system software skills.

All System Software Skills
UK
Contract vacancies with a requirement for system software skills 12857 12848 11682
As % of all contract IT jobs advertised in the UK 12.57% 12.35% 10.21%
Number of daily rates quoted 8345 8050 6665
UK median daily rate £425 £400 £365
Median daily rate % change year-on-year +6.25% +9.59% +8.15%
10th Percentile £158 £173 £158
90th Percentile £606 £575 £550
UK excluding London median daily rate £375 £350 £330
% change year-on-year +7.14% +6.06% +3.13%
Number of hourly rates quoted 722 876 1253
UK median hourly rate £16.50 £16.00 £16.00
Median hourly rate % change year-on-year +3.13% - +6.67%
10th Percentile £10.40 £10.50 £10.00
90th Percentile £46.88 £42.00 £38.75
UK excluding London median hourly rate £15.00 £15.00 £16.00
% change year-on-year - -6.25% +6.67%

Apache Flume
Job Vacancy Trend

Job postings citing Apache Flume as a percentage of all IT jobs advertised.

Job vacancy trend for Apache Flume in the UK

Apache Flume
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Apache Flume.

Contractor daily rate trend for Apache Flume in the UK

Apache Flume
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Apache Flume over the 6 months to 20 November 2017.

Contractor daily rate histogram for Apache Flume in the UK

Apache Flume
Top 11 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Flume within the UK over the 6 months to 20 November 2017. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +125 248 £550 - 24
London +34 149 £550 - 11
UK excluding London +92 103 £500 -9.09% 13
South East +29 50 £513 -10.87% 5
North of England +92 40 £464 -16.67% 3
Yorkshire +41 32 £461 -17.12% 3
East of England -11 9 £550 +30.95% 3
North West +28 8 £600 -
Scotland -12 5 - -
Northern Ireland -48 2 - -
Wales +11 1 - -

For the 6 months to 20 November 2017, IT contractor jobs citing Apache Flume also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for Apache Flume.

1 232 (92.06%) Hadoop
2 231 (91.67%) Big Data
3 216 (85.71%) Apache Hive
4 213 (84.52%) Apache Spark
5 180 (71.43%) Kafka
6 147 (58.33%) Sqoop
6 147 (58.33%) HDFS
7 135 (53.57%) MapReduce
7 135 (53.57%) Java
8 131 (51.98%) HBase
9 120 (47.62%) Oozie
10 119 (47.22%) Python
11 99 (39.29%) Impala
12 83 (32.94%) DevOps
13 75 (29.76%) Open Source
14 72 (28.57%) Hadoop YARN
15 71 (28.17%) Ambari
16 70 (27.78%) SQL
17 65 (25.79%) GitHub
18 64 (25.40%) Scala
19 62 (24.60%) Linux
20 61 (24.21%) Agile Software Development
21 60 (23.81%) Cloudera
21 60 (23.81%) Data Engineering
22 59 (23.41%) Analytics
22 59 (23.41%) PySpark
22 59 (23.41%) NoSQL
22 59 (23.41%) ETL
23 56 (22.22%) PostgreSQL
24 55 (21.83%) Shell Script

Apache Flume
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 213 (84.52%) Apache Spark
2 48 (19.05%) Apache Pig
3 31 (12.30%) Elasticsearch
4 28 (11.11%) Apache
5 12 (4.76%) OpenStack
6 7 (2.78%) Apache Solr
7 4 (1.59%) SAS
7 4 (1.59%) WebSphere
8 2 (0.79%) JBoss
8 2 (0.79%) Mule
8 2 (0.79%) Tomcat
9 1 (0.40%) Confluence
9 1 (0.40%) IBM HTTP Server
9 1 (0.40%) Oracle Workflow
9 1 (0.40%) WebSphere Application Server
9 1 (0.40%) WebSphere Portal
Applications
1 1 (0.40%) SPSS
1 1 (0.40%) Stata
Cloud Services
1 65 (25.79%) GitHub
2 35 (13.89%) Bluemix
2 35 (13.89%) IBM Cloud
3 34 (13.49%) Amazon AWS
4 11 (4.37%) Google Analytics
5 5 (1.98%) Cloud Computing
6 4 (1.59%) Slack
7 3 (1.19%) Amazon EMR
7 3 (1.19%) Amazon Kinesis
7 3 (1.19%) Amazon S3
7 3 (1.19%) IaaS
7 3 (1.19%) PaaS
8 2 (0.79%) Google Cloud Platform
8 2 (0.79%) Microsoft Azure
9 1 (0.40%) Data Lake Analytics
9 1 (0.40%) Google Tag Manager
9 1 (0.40%) SaaS
Communications & Networking
1 15 (5.95%) LAN
2 14 (5.56%) VPN
2 14 (5.56%) WAN
3 6 (2.38%) Firewall
3 6 (2.38%) Kerberos
3 6 (2.38%) SNMP
3 6 (2.38%) SSH
3 6 (2.38%) SSL
4 4 (1.59%) Network Security
5 2 (0.79%) HTTP
5 2 (0.79%) SNA
6 1 (0.40%) Internet
6 1 (0.40%) Multicast
Database & Business Intelligence
1 232 (92.06%) Hadoop
2 231 (91.67%) Big Data
3 216 (85.71%) Apache Hive
4 147 (58.33%) Sqoop
5 131 (51.98%) HBase
6 99 (39.29%) Impala
7 59 (23.41%) NoSQL
8 56 (22.22%) PostgreSQL
9 29 (11.51%) Data Warehouse
10 24 (9.52%) MongoDB
11 23 (9.13%) RDBMS
11 23 (9.13%) Relational Database
12 21 (8.33%) Data Lake
13 20 (7.94%) SQL Server
14 19 (7.54%) Apache Cassandra
15 17 (6.75%) IBM BigInsights
16 15 (5.95%) Oracle Database
17 14 (5.56%) Oracle ODI
18 11 (4.37%) SQL Server 2008
18 11 (4.37%) SQL Server 2012
Development Applications
1 46 (18.25%) Jenkins
2 32 (12.70%) Git (software)
3 16 (6.35%) Talend Open Studio
4 12 (4.76%) Team Foundation Server
5 10 (3.97%) JIRA
6 8 (3.17%) WebDriver
7 1 (0.40%) Atlassian Bamboo
7 1 (0.40%) Bitbucket
7 1 (0.40%) Cucumber
7 1 (0.40%) Hudson
7 1 (0.40%) PowerDesigner
7 1 (0.40%) SQL Server Management Studio (SSMS)
General
1 46 (18.25%) Finance
2 33 (13.10%) Banking
3 18 (7.14%) Telecoms
4 7 (2.78%) Retail
5 5 (1.98%) Marketing
6 4 (1.59%) Electronics
6 4 (1.59%) Manufacturing
7 3 (1.19%) Investment Banking
7 3 (1.19%) Publishing
8 2 (0.79%) Legal
9 1 (0.40%) Front Office
9 1 (0.40%) Games
9 1 (0.40%) Law
Job Titles
1 79 (31.35%) Data Engineer
2 59 (23.41%) Big Data Engineer
3 48 (19.05%) Developer
3 48 (19.05%) Hadoop Engineer
4 36 (14.29%) Architect
5 25 (9.92%) Data Architect
6 20 (7.94%) Big Data Architect
7 19 (7.54%) DevOps Engineer
8 18 (7.14%) Administrator
8 18 (7.14%) Big Data Developer
8 18 (7.14%) Hadoop Developer
9 17 (6.75%) Java Engineer
10 16 (6.35%) Hadoop Administrator
11 15 (5.95%) Senior Hadoop Engineer
12 14 (5.56%) Senior Java Engineer
13 11 (4.37%) Scala Developer
13 11 (4.37%) Senior Data Engineer
14 8 (3.17%) Solutions Architect
14 8 (3.17%) Technical Architect
15 7 (2.78%) Senior Developer
Libraries, Frameworks & Software Standards
1 180 (71.43%) Kafka
2 59 (23.41%) PySpark
3 49 (19.44%) Spark Streaming
4 24 (9.52%) Web Services
5 21 (8.33%) RESTful
6 20 (7.94%) SOAP
7 16 (6.35%) Sensu
8 14 (5.56%) XML
9 12 (4.76%) Elastic Stack
10 11 (4.37%) Apache Avro
11 9 (3.57%) Akka
12 8 (3.17%) jQuery
12 8 (3.17%) Play Framework
13 7 (2.78%) Ajax
13 7 (2.78%) J2EE
13 7 (2.78%) JSON
14 6 (2.38%) RabbitMQ
15 5 (1.98%) REST
15 5 (1.98%) scikit-learn
16 4 (1.59%) Cascading
Miscellaneous
1 34 (13.49%) Analytical Skills
2 15 (5.95%) Greenfield Project
3 8 (3.17%) Algorithms
4 7 (2.78%) Computer Science
5 6 (2.38%) Mainframe
6 4 (1.59%) Replication
7 3 (1.19%) Credit Derivative
7 3 (1.19%) Data Centre
7 3 (1.19%) Derivative
7 3 (1.19%) Distributed Denial-of-Service
7 3 (1.19%) Equities
7 3 (1.19%) Foreign Exchange (FX)
7 3 (1.19%) User Experience
8 2 (0.79%) Private Cloud
8 2 (0.79%) Reference Data
8 2 (0.79%) Social Network
9 1 (0.40%) Credit Risk
9 1 (0.40%) DataPower
9 1 (0.40%) Management Information System
9 1 (0.40%) Video\Live Streaming
Operating Systems
1 62 (24.60%) Linux
2 33 (13.10%) Unix
3 14 (5.56%) Ubuntu
4 8 (3.17%) Windows
5 4 (1.59%) Red Hat Enterprise Linux
6 3 (1.19%) Apple iOS
7 2 (0.79%) Android
7 2 (0.79%) Debian
8 1 (0.40%) AIX
8 1 (0.40%) CentOS
8 1 (0.40%) Solaris
Processes & Methodologies
1 135 (53.57%) MapReduce
2 83 (32.94%) DevOps
3 75 (29.76%) Open Source
4 61 (24.21%) Agile Software Development
5 60 (23.81%) Data Engineering
6 59 (23.41%) Analytics
6 59 (23.41%) ETL
7 39 (15.48%) Continuous Integration
8 38 (15.08%) Data Modelling
9 30 (11.90%) Data Analytics
10 28 (11.11%) Business Intelligence
11 25 (9.92%) Multithreading
12 23 (9.13%) Big Data Analytics
12 23 (9.13%) Configuration Management
13 21 (8.33%) BDD
14 18 (7.14%) Use Case
15 17 (6.75%) Workflow
16 16 (6.35%) Disaster Recovery
16 16 (6.35%) TDD
17 15 (5.95%) Information Security
Programming Languages
1 135 (53.57%) Java
2 119 (47.22%) Python
3 70 (27.78%) SQL
4 64 (25.40%) Scala
5 55 (21.83%) Shell Script
6 16 (6.35%) PL/SQL
7 13 (5.16%) Bash Shell
7 13 (5.16%) HiveQL
8 9 (3.57%) JavaScript
9 8 (3.17%) C#
10 5 (1.98%) C
10 5 (1.98%) Perl
11 2 (0.79%) COBOL
11 2 (0.79%) Pig Latin
12 1 (0.40%) MATLAB
12 1 (0.40%) R
Qualifications
1 25 (9.92%) Security Cleared
2 20 (7.94%) SC Cleared
3 5 (1.98%) DV Cleared
4 4 (1.59%) Degree
5 3 (1.19%) CISA
5 3 (1.19%) CISM
5 3 (1.19%) CISSP
6 1 (0.40%) Master's Degree
Quality Assurance & Compliance
1 6 (2.38%) QA
2 5 (1.98%) Data Quality
3 2 (0.79%) FedRAMP
3 2 (0.79%) PCI DSS
4 1 (0.40%) Basel III
4 1 (0.40%) Dodd-Frank
System Software
1 147 (58.33%) HDFS
2 23 (9.13%) Docker
3 4 (1.59%) Apache ZooKeeper
4 1 (0.40%) Active Directory
Systems Management
1 120 (47.62%) Oozie
2 72 (28.57%) Hadoop YARN
3 71 (28.17%) Ambari
4 30 (11.90%) Ansible
5 24 (9.52%) Kubernetes
6 17 (6.75%) Prometheus
7 14 (5.56%) Control-M
8 13 (5.16%) Puppet
9 11 (4.37%) Opscode Chef
10 10 (3.97%) Kibana
11 9 (3.57%) logstash
12 4 (1.59%) Mesos
Vendors
1 60 (23.81%) Cloudera
2 53 (21.03%) IBM
3 42 (16.67%) Oracle
3 42 (16.67%) Tableau
4 19 (7.54%) Hortonworks
5 16 (6.35%) Talend
6 15 (5.95%) Informatica
7 14 (5.56%) Google
7 14 (5.56%) Splunk
8 13 (5.16%) Red Hat
9 12 (4.76%) Salesforce.com
9 12 (4.76%) SAP
10 10 (3.97%) MapR
11 7 (2.78%) Teradata
12 5 (1.98%) Palantir
13 2 (0.79%) MuleSoft
13 2 (0.79%) SaltStack
14 1 (0.40%) Nokia
14 1 (0.40%) Sybase
14 1 (0.40%) Tealium