Period
to 19 October 2018

The following table provides summary statistics for contract job vacancies with a requirement for Apache Flume skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Flume over the 6 months to 19 October 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Flume
UK
6 months to
19 Oct 2018
Same period 2017 Same period 2016
Rank 768 645 763
Rank change year-on-year -123 +118 +75
Contract jobs citing Apache Flume 118 240 143
As % of all contract IT jobs advertised in the UK 0.11% 0.24% 0.13%
As % of the System Software category 0.77% 1.98% 1.09%
Number of daily rates quoted 66 179 95
UK median daily rate £575 £550 £550
Median daily rate % change year-on-year +4.55% - -
10th Percentile £456 £376 £425
90th Percentile £675 £675 £675
UK excluding London median daily rate £550 £450 £550
% change year-on-year +22.22% -18.18% +22.22%
Number of hourly rates quoted 0 1 0
UK median hourly rate - £35.00 -
UK excluding London median hourly rate - £35.00 -

Apache Flume is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for system software skills.

All System Software Skills
UK
Contract vacancies with a requirement for system software skills 15,409 12,148 13,157
As % of all contract IT jobs advertised in the UK 14.95% 12.22% 12.36%
Number of daily rates quoted 10,030 7,827 8,254
UK median daily rate £450 £425 £400
Median daily rate % change year-on-year +5.88% +6.25% +13.56%
10th Percentile £180 £158 £175
90th Percentile £625 £600 £575
UK excluding London median daily rate £400 £375 £360
% change year-on-year +6.67% +4.17% +7.46%
Number of hourly rates quoted 896 677 895
UK median hourly rate £16.00 £16.66 £16.00
Median hourly rate % change year-on-year -3.96% +4.13% -
10th Percentile £10.50 £10.40 £10.50
90th Percentile £43.75 £47.25 £40.90
UK excluding London median hourly rate £15.50 £15.50 £15.46
% change year-on-year - +0.24% -1.83%

Apache Flume
Job Vacancy Trend

Job postings citing Apache Flume as a percentage of all IT jobs advertised.

Job vacancy trend for Apache Flume in the UK

Apache Flume
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Apache Flume.

Contractor daily rate trend for Apache Flume in the UK

Apache Flume
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Apache Flume over the 6 months to 19 October 2018.

Contractor daily rate histogram for Apache Flume in the UK

Apache Flume
Top 12 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Flume within the UK over the 6 months to 19 October 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -143 111 £575 +4.55% 23
London -60 78 £575 +4.55% 13
UK excluding London -90 34 £550 +22.22% 10
South East -40 19 £550 +37.33% 3
East of England 0 9 £519 -5.68% 2
North of England -57 4 £563 +21.75% 2
North East - 2 £519 -
North West -24 1 £575 -4.17% 1
Scotland -29 1 £425 -
Yorkshire -42 1 £575 +24.73% 1
East Midlands - 1 - - 3
Midlands - 1 - - 3

For the 6 months to 19 October 2018, IT contractor jobs citing Apache Flume also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Apache Flume.

1 103 (87.29%) Big Data
1 103 (87.29%) Kafka
2 99 (83.90%) Hadoop
3 80 (67.80%) Apache Spark
4 68 (57.63%) Python
5 63 (53.39%) HBase
6 61 (51.69%) Apache Hive
7 59 (50.00%) Apache Cassandra
8 53 (44.92%) Analytics
9 49 (41.53%) MongoDB
10 44 (37.29%) Java
11 43 (36.44%) NoSQL
12 42 (35.59%) HDFS
13 40 (33.90%) Amazon AWS
14 38 (32.20%) Linux
14 38 (32.20%) Impala
14 38 (32.20%) Data Science
15 37 (31.36%) Oozie
16 36 (30.51%) Agile Software Development
17 35 (29.66%) Scala
17 35 (29.66%) Sqoop
18 34 (28.81%) Finance
18 34 (28.81%) Data Warehouse
19 33 (27.97%) Business Intelligence
20 32 (27.12%) SQL Server
21 30 (25.42%) ETL
22 28 (23.73%) Hortonworks
23 27 (22.88%) Apache Pig
23 27 (22.88%) R
23 27 (22.88%) SQL

Apache Flume
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 80 (67.80%) Apache Spark
2 27 (22.88%) Apache Pig
3 24 (20.34%) Apache
4 15 (12.71%) SAS
5 13 (11.02%) Elasticsearch
6 10 (8.47%) Apache Solr
7 7 (5.93%) OpenStack
8 2 (1.69%) Cloud Foundry
8 2 (1.69%) Confluence
8 2 (1.69%) Oracle Coherence
8 2 (1.69%) Oracle SOA Suite
9 1 (0.85%) WebSphere
9 1 (0.85%) WebSphere Application Server
9 1 (0.85%) WebSphere Portal
Applications
1 1 (0.85%) Microsoft Excel
1 1 (0.85%) Microsoft Office
1 1 (0.85%) Microsoft PowerPoint
1 1 (0.85%) MS Visio
1 1 (0.85%) Shockwave
Business Applications
1 8 (6.78%) SAP Oil and Gas
2 3 (2.54%) SAP MM
2 3 (2.54%) SAP R/3
Cloud Services
1 40 (33.90%) Amazon AWS
2 23 (19.49%) Microsoft Azure
3 13 (11.02%) Amazon EMR
3 13 (11.02%) Amazon Kinesis
4 11 (9.32%) Google Cloud Platform
5 8 (6.78%) Amazon S3
6 7 (5.93%) Amazon CloudWatch
7 5 (4.24%) AWS Lambda
7 5 (4.24%) Serverless
8 3 (2.54%) GitHub
8 3 (2.54%) IBM Cloud
9 2 (1.69%) Amazon EC2
9 2 (1.69%) Cloud Computing
9 2 (1.69%) Google Analytics
10 1 (0.85%) AWS Elastic Beanstalk
Communications & Networking
1 5 (4.24%) Kerberos
2 4 (3.39%) Broadband
2 4 (3.39%) SSL
3 3 (2.54%) SNA
4 2 (1.69%) DNS
5 1 (0.85%) DVB
5 1 (0.85%) HTTP
Database & Business Intelligence
1 103 (87.29%) Big Data
2 99 (83.90%) Hadoop
3 63 (53.39%) HBase
4 61 (51.69%) Apache Hive
5 59 (50.00%) Apache Cassandra
6 49 (41.53%) MongoDB
7 43 (36.44%) NoSQL
8 38 (32.20%) Impala
9 35 (29.66%) Sqoop
10 34 (28.81%) Data Warehouse
11 32 (27.12%) SQL Server
12 21 (17.80%) Relational Database
13 16 (13.56%) Amazon Redshift
13 16 (13.56%) Data Lake
13 16 (13.56%) OLTP
13 16 (13.56%) PostgreSQL
14 14 (11.86%) Redis
15 12 (10.17%) Power BI
16 11 (9.32%) Data Mining
16 11 (9.32%) SQL Server Integration Services
Development Applications
1 14 (11.86%) Jenkins
2 11 (9.32%) Git (software)
3 10 (8.47%) JIRA
4 4 (3.39%) WebDriver
5 3 (2.54%) LSMW
5 3 (2.54%) Visual Studio
5 3 (2.54%) Visual Studio Team System
6 1 (0.85%) Bitbucket
6 1 (0.85%) Cucumber
6 1 (0.85%) ERwin
6 1 (0.85%) FitNesse
6 1 (0.85%) Geb
6 1 (0.85%) HP UFT
6 1 (0.85%) JUnit
6 1 (0.85%) Sahi
6 1 (0.85%) Selenium
6 1 (0.85%) Sonatype Nexus
6 1 (0.85%) WATIR
General
1 34 (28.81%) Finance
2 15 (12.71%) Retail
3 10 (8.47%) Banking
4 6 (5.08%) Telecoms
5 5 (4.24%) Games
6 4 (3.39%) Legal
7 3 (2.54%) Manufacturing
7 3 (2.54%) Marketing
Job Titles
1 36 (30.51%) Data Engineer
2 31 (26.27%) Architect
3 24 (20.34%) Big Data Engineer
3 24 (20.34%) Developer
4 21 (17.80%) Data Architect
5 20 (16.95%) Big Data Architect
6 13 (11.02%) Big Data Developer
7 11 (9.32%) Data Scientist
8 10 (8.47%) Technical Architect
9 8 (6.78%) Azure Engineer
10 7 (5.93%) SAP Engineer
10 7 (5.93%) Senior Data Engineer
11 6 (5.08%) Scala Developer
12 5 (4.24%) AWS Architect
12 5 (4.24%) Consultant
12 5 (4.24%) IP Engineer
12 5 (4.24%) IP Network Engineer
12 5 (4.24%) Network Engineer
13 4 (3.39%) Cloud Administrator
13 4 (3.39%) Hadoop Administrator
Libraries, Frameworks & Software Standards
1 103 (87.29%) Kafka
2 23 (19.49%) RabbitMQ
3 12 (10.17%) Apache Avro
3 12 (10.17%) Spark Streaming
4 11 (9.32%) Natural Language Processing
5 7 (5.93%) .NET
5 7 (5.93%) Akka
5 7 (5.93%) Elastic Stack
5 7 (5.93%) LAPP Stack
5 7 (5.93%) Sensu
6 5 (4.24%) PySpark
6 5 (4.24%) RESTful
7 4 (3.39%) AngularJS
7 4 (3.39%) Play Framework
7 4 (3.39%) Web Services
8 3 (2.54%) CNTK
8 3 (2.54%) MXNet
8 3 (2.54%) SAPUI5
8 3 (2.54%) TensorFlow
8 3 (2.54%) Theano
Miscellaneous
1 26 (22.03%) Analytical Skills
2 25 (21.19%) Algorithms
3 13 (11.02%) Computer Science
4 7 (5.93%) Data Centre
4 7 (5.93%) Data Structures
4 7 (5.93%) Public Cloud
5 4 (3.39%) Virtual Team
6 3 (2.54%) Cyber Defence
6 3 (2.54%) Management Information System
7 2 (1.69%) Fintech
7 2 (1.69%) Self-Motivation
7 2 (1.69%) Social Network
8 1 (0.85%) Clustering
8 1 (0.85%) DataPower
8 1 (0.85%) Enterprise Software
8 1 (0.85%) Hybrid Cloud
8 1 (0.85%) IBM Mainframe
8 1 (0.85%) Linux Command Line
8 1 (0.85%) Mainframe
8 1 (0.85%) RIA
Operating Systems
1 38 (32.20%) Linux
2 16 (13.56%) Unix
3 7 (5.93%) Red Hat Enterprise Linux
3 7 (5.93%) VMS
3 7 (5.93%) Windows
4 1 (0.85%) AIX
4 1 (0.85%) DC/OS
4 1 (0.85%) Solaris
Processes & Methodologies
1 53 (44.92%) Analytics
2 38 (32.20%) Data Science
3 36 (30.51%) Agile Software Development
4 33 (27.97%) Business Intelligence
5 30 (25.42%) ETL
6 25 (21.19%) Data Integration
6 25 (21.19%) Machine Learning
7 24 (20.34%) Visualisation
8 22 (18.64%) Data Ingestion
9 21 (17.80%) Data Modelling
9 21 (17.80%) Data Security
9 21 (17.80%) DevOps
9 21 (17.80%) Open Source
10 19 (16.10%) Data Engineering
11 17 (14.41%) MapReduce
12 16 (13.56%) Mentoring
13 13 (11.02%) Continuous Delivery
13 13 (11.02%) Data Governance
13 13 (11.02%) Problem-Solving
14 12 (10.17%) Statistics
Programming Languages
1 68 (57.63%) Python
2 44 (37.29%) Java
3 35 (29.66%) Scala
4 27 (22.88%) R
4 27 (22.88%) SQL
5 22 (18.64%) MATLAB
6 16 (13.56%) JavaScript
7 11 (9.32%) Bash Shell
8 10 (8.47%) C
9 9 (7.63%) Go
9 9 (7.63%) Shell Script
10 8 (6.78%) C#
11 7 (5.93%) AWK
11 7 (5.93%) Perl
12 3 (2.54%) C++
12 3 (2.54%) Clojure
12 3 (2.54%) Ruby
13 2 (1.69%) Erlang
13 2 (1.69%) Lua
14 1 (0.85%) Haskell
Qualifications
1 19 (16.10%) Degree
2 11 (9.32%) PhD
3 10 (8.47%) Computer Science Degree
4 1 (0.85%) CISSP
4 1 (0.85%) Master's Degree
4 1 (0.85%) Security Cleared
Quality Assurance & Compliance
1 21 (17.80%) QA
2 16 (13.56%) Data Quality
3 9 (7.63%) GDPR
System Software
1 42 (35.59%) HDFS
2 25 (21.19%) Apache ZooKeeper
3 9 (7.63%) Docker
4 7 (5.93%) Hyper-V
5 4 (3.39%) Active Directory
6 1 (0.85%) Cronacle
Systems Management
1 37 (31.36%) Oozie
2 20 (16.95%) Hadoop YARN
3 9 (7.63%) Mesos
4 8 (6.78%) Ambari
5 7 (5.93%) Grafana
5 7 (5.93%) Graphite
5 7 (5.93%) Nagios
5 7 (5.93%) StatsD
5 7 (5.93%) ZABBIX
6 5 (4.24%) Ansible
7 4 (3.39%) Apache Slider
7 4 (3.39%) Kibana
7 4 (3.39%) Terraform
8 3 (2.54%) Consul
8 3 (2.54%) Kubernetes
8 3 (2.54%) Opscode Chef
8 3 (2.54%) Packer
8 3 (2.54%) Puppet
8 3 (2.54%) Salt
9 1 (0.85%) Control-M
Vendors
1 28 (23.73%) Hortonworks
2 25 (21.19%) Oracle
3 22 (18.64%) Cloudera
4 19 (16.10%) Tableau
5 17 (14.41%) SAP
6 14 (11.86%) Talend
7 13 (11.02%) Informatica
8 12 (10.17%) Google
9 11 (9.32%) Alteryx
9 11 (9.32%) Splunk
10 9 (7.63%) MapR
10 9 (7.63%) Microsoft
11 7 (5.93%) New Relic
11 7 (5.93%) Vertica
12 5 (4.24%) IBM
13 3 (2.54%) Palantir
14 2 (1.69%) Salesforce.com
15 1 (0.85%) Atlassian
15 1 (0.85%) CA Agile Central
15 1 (0.85%) Red Hat