Period
to 17 January 2018

The following table provides summary statistics for contract job vacancies with a requirement for Apache Flume skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Flume over the 6 months to 17 January 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Flume
UK
6 months to
17 Jan 2018
Same period 2017 Same period 2016
Rank 643 722 775
Rank change year-on-year +79 +53 +30
Contract jobs citing Apache Flume 254 143 97
As % of all contract IT jobs advertised in the UK 0.25% 0.15% 0.091%
As % of the System Software category 1.98% 1.20% 0.91%
Number of daily rates quoted 198 103 56
UK median daily rate £575 £550 £600
Median daily rate % change year-on-year +4.55% -8.33% -14.29%
10th Percentile £400 £425 £438
90th Percentile £675 £742 £686
UK excluding London median daily rate £575 £538 £550
% change year-on-year +6.98% -2.27% -
Number of hourly rates quoted 0 0 2
UK median hourly rate - - £33.55
UK excluding London median hourly rate - - £33.55

Apache Flume is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for system software skills.

All System Software Skills
UK
Contract vacancies with a requirement for system software skills 12,807 11,907 10,685
As % of all contract IT jobs advertised in the UK 12.77% 12.23% 10.05%
Number of daily rates quoted 8,326 7,474 6,169
UK median daily rate £425 £401 £375
Median daily rate % change year-on-year +6.12% +6.80% +7.14%
10th Percentile £160 £165 £156
90th Percentile £615 £588 £550
UK excluding London median daily rate £375 £350 £338
% change year-on-year +7.14% +3.70% +3.85%
Number of hourly rates quoted 697 828 1,137
UK median hourly rate £16.41 £16.00 £15.50
Median hourly rate % change year-on-year +2.53% +3.23% -
10th Percentile £10.40 £10.50 £10.00
90th Percentile £45.00 £44.33 £40.00
UK excluding London median hourly rate £15.00 £15.00 £15.50
% change year-on-year - -3.23% -

Apache Flume
Job Vacancy Trend

Job postings citing Apache Flume as a percentage of all IT jobs advertised.

Job vacancy trend for Apache Flume in the UK

Apache Flume
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Apache Flume.

Contractor daily rate trend for Apache Flume in the UK

Apache Flume
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Apache Flume over the 6 months to 17 January 2018.

Contractor daily rate histogram for Apache Flume in the UK

Apache Flume
Top 11 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Flume within the UK over the 6 months to 17 January 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England +113 249 £575 +4.55% 37
London +39 166 £550 - 22
UK excluding London +79 85 £575 +6.98% 15
South East +38 72 £575 +2.22% 9
East of England -21 6 £630 +50.00% 2
North of England +52 5 £525 -4.55% 3
North West - 3 £600 - 1
Yorkshire +20 2 £444 -19.32% 2
Wales +5 1 - -
Scotland -18 1 - -
Northern Ireland -24 1 - -

For the 6 months to 17 January 2018, IT contractor jobs citing Apache Flume also mentioned the following skills in order of popularity. The figures indicate the number co-occurrences and its proportion to all contract ads with a requirement for Apache Flume.

1 240 (94.49%) Hadoop
2 228 (89.76%) Big Data
3 224 (88.19%) Apache Spark
4 221 (87.01%) Apache Hive
5 185 (72.83%) Kafka
6 180 (70.87%) HDFS
7 159 (62.60%) Oozie
8 143 (56.30%) Sqoop
9 141 (55.51%) HBase
10 138 (54.33%) Java
11 116 (45.67%) MapReduce
12 91 (35.83%) Python
13 88 (34.65%) Hadoop YARN
14 82 (32.28%) Ambari
14 82 (32.28%) Impala
15 79 (31.10%) Cloudera
16 77 (30.31%) Scala
17 76 (29.92%) Analytics
18 75 (29.53%) PostgreSQL
19 70 (27.56%) Linux
19 70 (27.56%) SQL
19 70 (27.56%) NoSQL
20 69 (27.17%) Data Engineering
21 63 (24.80%) Hortonworks
22 61 (24.02%) Finance
23 57 (22.44%) Open Source
24 56 (22.05%) DevOps
24 56 (22.05%) PySpark
25 54 (21.26%) Apache Pig
26 53 (20.87%) Jenkins

Apache Flume
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 224 (88.19%) Apache Spark
2 54 (21.26%) Apache Pig
3 33 (12.99%) Apache
4 28 (11.02%) Elasticsearch
5 17 (6.69%) Apache Solr
6 2 (0.79%) IPython
6 2 (0.79%) Jupyter
6 2 (0.79%) SAS
7 1 (0.39%) OpenStack
7 1 (0.39%) Oracle Workflow
Applications
1 2 (0.79%) SPSS
Cloud Services
1 40 (15.75%) Amazon AWS
2 39 (15.35%) GitHub
3 35 (13.78%) Bluemix
3 35 (13.78%) IBM Cloud
4 16 (6.30%) Google Tag Manager
5 11 (4.33%) Google Analytics
6 10 (3.94%) Microsoft Azure
7 8 (3.15%) Amazon EMR
8 5 (1.97%) Amazon S3
9 4 (1.57%) Amazon Kinesis
9 4 (1.57%) IaaS
9 4 (1.57%) PaaS
9 4 (1.57%) Slack
10 3 (1.18%) AWS Lambda
10 3 (1.18%) Cloud Computing
10 3 (1.18%) Serverless
11 1 (0.39%) Data Lake Analytics
11 1 (0.39%) Google Cloud Platform
Communications & Networking
1 17 (6.69%) Kerberos
2 15 (5.91%) SSL
3 2 (0.79%) HTTP
3 2 (0.79%) Internet
4 1 (0.39%) Firewall
4 1 (0.39%) LAN
4 1 (0.39%) Multicast
4 1 (0.39%) SNA
4 1 (0.39%) SNMP
4 1 (0.39%) SSH
4 1 (0.39%) VPN
4 1 (0.39%) WAN
Database & Business Intelligence
1 240 (94.49%) Hadoop
2 228 (89.76%) Big Data
3 221 (87.01%) Apache Hive
4 143 (56.30%) Sqoop
5 141 (55.51%) HBase
6 82 (32.28%) Impala
7 75 (29.53%) PostgreSQL
8 70 (27.56%) NoSQL
9 44 (17.32%) SQL Server
10 43 (16.93%) Apache Cassandra
11 40 (15.75%) Data Warehouse
12 38 (14.96%) Data Lake
13 36 (14.17%) MongoDB
14 33 (12.99%) Relational Database
15 27 (10.63%) RDBMS
16 15 (5.91%) Oracle Database
17 14 (5.51%) Oracle ODI
18 13 (5.12%) SAP Data Services
19 12 (4.72%) SAP BW
20 11 (4.33%) SQL Server 2008
Development Applications
1 53 (20.87%) Jenkins
2 27 (10.63%) Git (software)
3 9 (3.54%) Team Foundation Server
4 7 (2.76%) WebDriver
5 6 (2.36%) Visual Studio
5 6 (2.36%) Visual Studio Team System
6 5 (1.97%) Subversion
7 4 (1.57%) TeamCity
8 3 (1.18%) JUnit
9 2 (0.79%) GoCD
9 2 (0.79%) JIRA
9 2 (0.79%) Vagrant
10 1 (0.39%) Atlassian Bamboo
10 1 (0.39%) Eclipse
10 1 (0.39%) PowerDesigner
10 1 (0.39%) SQL Server Management Studio (SSMS)
General
1 61 (24.02%) Finance
2 31 (12.20%) Banking
3 14 (5.51%) Telecoms
4 10 (3.94%) Retail
5 8 (3.15%) Marketing
6 5 (1.97%) Investment Banking
7 3 (1.18%) Publishing
8 2 (0.79%) Advertising
8 2 (0.79%) Games
8 2 (0.79%) Legal
9 1 (0.39%) Electronics
9 1 (0.39%) French Language
9 1 (0.39%) Front Office
9 1 (0.39%) Law
9 1 (0.39%) Manufacturing
9 1 (0.39%) Retail Banking
Job Titles
1 80 (31.50%) Data Engineer
2 65 (25.59%) Big Data Engineer
3 47 (18.50%) Hadoop Engineer
4 44 (17.32%) Architect
5 41 (16.14%) Developer
6 32 (12.60%) Data Architect
7 24 (9.45%) Big Data Architect
7 24 (9.45%) Big Data Developer
8 17 (6.69%) Java Engineer
9 16 (6.30%) Administrator
9 16 (6.30%) Hadoop Administrator
10 15 (5.91%) Consultant
11 14 (5.51%) Senior Hadoop Engineer
11 14 (5.51%) Senior Java Engineer
12 12 (4.72%) Hadoop Developer
13 11 (4.33%) Hadoop Architect
14 10 (3.94%) Technical Architect
15 8 (3.15%) Scala Developer
16 7 (2.76%) Hadoop Consultant
17 6 (2.36%) Big Data Consultant
Libraries, Frameworks & Software Standards
1 185 (72.83%) Kafka
2 56 (22.05%) PySpark
3 36 (14.17%) Web Services
4 35 (13.78%) SOAP
5 34 (13.39%) RESTful
6 18 (7.09%) XML
7 17 (6.69%) Spark Streaming
8 16 (6.30%) Apache Avro
9 10 (3.94%) JSON
10 9 (3.54%) Akka
10 9 (3.54%) Elastic Stack
10 9 (3.54%) TensorFlow
11 7 (2.76%) J2EE
11 7 (2.76%) Play Framework
12 6 (2.36%) Ajax
12 6 (2.36%) CNTK
12 6 (2.36%) jQuery
12 6 (2.36%) MXNet
12 6 (2.36%) Theano
13 5 (1.97%) Velocity
Miscellaneous
1 28 (11.02%) Greenfield Project
2 26 (10.24%) Analytical Skills
3 13 (5.12%) Algorithms
4 11 (4.33%) Computer Science
5 7 (2.76%) Replication
6 3 (1.18%) Credit Derivative
6 3 (1.18%) Data Centre
6 3 (1.18%) Derivative
6 3 (1.18%) Equities
6 3 (1.18%) Foreign Exchange (FX)
6 3 (1.18%) User Experience
7 2 (0.79%) iPad
7 2 (0.79%) Media Streaming
7 2 (0.79%) Mobile App
7 2 (0.79%) MPEG
7 2 (0.79%) Over-the-Top Content
7 2 (0.79%) Reference Data
8 1 (0.39%) Mainframe
8 1 (0.39%) Management Information System
8 1 (0.39%) Video\Live Streaming
Operating Systems
1 70 (27.56%) Linux
2 19 (7.48%) Unix
3 16 (6.30%) CentOS
3 16 (6.30%) Red Hat Enterprise Linux
4 12 (4.72%) Ubuntu
5 3 (1.18%) Debian
6 2 (0.79%) Windows
Processes & Methodologies
1 116 (45.67%) MapReduce
2 76 (29.92%) Analytics
3 69 (27.17%) Data Engineering
4 57 (22.44%) Open Source
5 56 (22.05%) DevOps
6 50 (19.69%) Agile Software Development
7 37 (14.57%) ETL
8 31 (12.20%) Business Intelligence
9 30 (11.81%) Data Strategy
10 29 (11.42%) Data Modelling
11 25 (9.84%) Machine Learning
12 19 (7.48%) Multithreading
13 18 (7.09%) Data Analytics
13 18 (7.09%) Use Case
14 17 (6.69%) Scrum
15 16 (6.30%) Tag Management
15 16 (6.30%) Web Analytics
16 14 (5.51%) Data Architecture
16 14 (5.51%) Data Integration
17 13 (5.12%) BDD
Programming Languages
1 138 (54.33%) Java
2 91 (35.83%) Python
3 77 (30.31%) Scala
4 70 (27.56%) SQL
5 26 (10.24%) Shell Script
6 23 (9.06%) Bash Shell
7 15 (5.91%) PL/SQL
8 11 (4.33%) C
8 11 (4.33%) JavaScript
9 8 (3.15%) C#
10 7 (2.76%) HiveQL
10 7 (2.76%) Perl
11 3 (1.18%) R
12 2 (0.79%) Pig Latin
12 2 (0.79%) XPath
Qualifications
1 9 (3.54%) Degree
2 6 (2.36%) Master's Degree
3 5 (1.97%) Security Cleared
4 1 (0.39%) SC Cleared
Quality Assurance & Compliance
1 5 (1.97%) Data Quality
1 5 (1.97%) GDPR
2 4 (1.57%) QA
3 2 (0.79%) ISO/IEC 20000
3 2 (0.79%) Sarbanes-Oxley
4 1 (0.39%) Basel III
4 1 (0.39%) Dodd-Frank
System Software
1 180 (70.87%) HDFS
2 32 (12.60%) Docker
3 21 (8.27%) Apache ZooKeeper
4 12 (4.72%) Active Directory
Systems Management
1 159 (62.60%) Oozie
2 88 (34.65%) Hadoop YARN
3 82 (32.28%) Ambari
4 24 (9.45%) Kubernetes
5 13 (5.12%) Opscode Chef
5 13 (5.12%) Puppet
6 9 (3.54%) Ansible
6 9 (3.54%) Apache Slider
6 9 (3.54%) Control-M
7 6 (2.36%) Kibana
7 6 (2.36%) logstash
8 4 (1.57%) Mesos
9 2 (0.79%) Prometheus
Vendors
1 79 (31.10%) Cloudera
2 63 (24.80%) Hortonworks
3 51 (20.08%) Tableau
4 44 (17.32%) IBM
5 43 (16.93%) Oracle
6 30 (11.81%) MapR
7 28 (11.02%) Google
8 27 (10.63%) Salesforce.com
8 27 (10.63%) Talend
9 17 (6.69%) SAP
10 16 (6.30%) Tealium
11 12 (4.72%) Red Hat
12 10 (3.94%) Microsoft
13 6 (2.36%) Informatica
14 5 (1.97%) Alteryx
14 5 (1.97%) Splunk
14 5 (1.97%) Teradata
15 3 (1.18%) Cognos
15 3 (1.18%) Vertica
16 2 (0.79%) Sybase