Job Vacancy Trend Daily Rate Trend Daily Rate Histogram Job Locations Skill Sets
Period
to 14 August 2018

The following table provides summary statistics for contract job vacancies with a requirement for Apache Flume skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Flume over the 6 months to 14 August 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Flume
UK
6 months to
14 Aug 2018		 Same period 2017 Same period 2016
Rank 736 618 782
Rank change year-on-year -118 +164 +62
Contract jobs citing Apache Flume 152 228 123
As % of all contract IT jobs advertised in the UK 0.15% 0.24% 0.11%
As % of the System Software category 1.04% 2.04% 0.93%
Number of daily rates quoted 78 147 68
UK median daily rate £550 £500 £511
Median daily rate % change year-on-year +10.00% -2.20% -7.05%
10th Percentile £415 £350 £425
90th Percentile £675 £638 £690
UK excluding London median daily rate £475 £401 £500
% change year-on-year +18.60% -19.90% -33.33%
Number of hourly rates quoted 0 1 0
UK median hourly rate - £35.00 -
UK excluding London median hourly rate - £35.00 -

Apache Flume is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for system software skills.

All System Software Skills
UK
Contract vacancies with a requirement for system software skills 14,653 11,192 13,260
As % of all contract IT jobs advertised in the UK 14.32% 11.71% 12.14%
Number of daily rates quoted 9,478 7,207 8,273
UK median daily rate £450 £425 £400
Median daily rate % change year-on-year +5.88% +6.25% +14.29%
10th Percentile £181 £163 £175
90th Percentile £625 £588 £575
UK excluding London median daily rate £400 £375 £365
% change year-on-year +6.67% +2.74% +8.15%
Number of hourly rates quoted 892 643 888
UK median hourly rate £16.36 £16.00 £16.00
Median hourly rate % change year-on-year +2.23% - -0.87%
10th Percentile £11.00 £10.38 £10.50
90th Percentile £44.73 £47.00 £41.00
UK excluding London median hourly rate £15.86 £15.00 £16.50
% change year-on-year +5.73% -9.09% +4.43%

Apache Flume
Job Vacancy Trend

Job postings citing Apache Flume as a percentage of all IT jobs advertised.

Job vacancy trend for Apache Flume in the UK

Apache Flume
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Apache Flume.

Contractor daily rate trend for Apache Flume in the UK

Apache Flume
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Apache Flume over the 6 months to 14 August 2018.

Contractor daily rate histogram for Apache Flume in the UK

Apache Flume
Top 12 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Flume within the UK over the 6 months to 14 August 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year		 Matching
Contract
IT Job Ads		 Median
Daily Rate
Past 6 Months		 Median Daily Rate
% Change
on Same Period
Last Year		 Live
Job
Vacancies
England -99 148 £550 +10.00% 11
London -41 93 £556 +1.14% 10
UK excluding London -81 55 £475 +18.60% 2
South East -55 25 £475 +18.68% 1
North of England -31 19 £475 +2.81%
Yorkshire -33 14 £440 -4.76%
East of England -4 8 £450 -18.18%
North West -14 4 £550 -
East Midlands +9 2 - -
Midlands -6 2 - -
Scotland -45 1 £425 - 1
North East - 1 £550 -

For the 6 months to 14 August 2018, IT contractor jobs citing Apache Flume also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Apache Flume.

1 131 (86.18%) Hadoop
2 128 (84.21%) Kafka
3 127 (83.55%) Big Data
4 110 (72.37%) Apache Spark
5 94 (61.84%) Apache Hive
6 82 (53.95%) Python
7 80 (52.63%) HBase
8 69 (45.39%) Amazon AWS
9 67 (44.08%) Analytics
10 58 (38.16%) Data Warehouse
11 57 (37.50%) Oozie
12 56 (36.84%) NoSQL
13 55 (36.18%) Apache Cassandra
14 54 (35.53%) Sqoop
14 54 (35.53%) Java
14 54 (35.53%) ETL
15 52 (34.21%) MongoDB
16 51 (33.55%) SQL
17 48 (31.58%) Data Science
18 46 (30.26%) HDFS
19 45 (29.61%) Linux
20 44 (28.95%) Finance
20 44 (28.95%) Scala
21 43 (28.29%) Agile Software Development
22 42 (27.63%) Business Intelligence
23 40 (26.32%) Apache Pig
23 40 (26.32%) DevOps
23 40 (26.32%) Impala
24 38 (25.00%) SQL Server
25 34 (22.37%) Data Integration

Apache Flume
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 110 (72.37%) Apache Spark
2 40 (26.32%) Apache Pig
3 33 (21.71%) Apache
4 22 (14.47%) Elasticsearch
5 17 (11.18%) SAS
6 12 (7.89%) Apache Solr
7 10 (6.58%) OpenStack
8 4 (2.63%) Confluence
9 2 (1.32%) Cloud Foundry
9 2 (1.32%) Oracle Coherence
9 2 (1.32%) Oracle SOA Suite
10 1 (0.66%) WebSphere
10 1 (0.66%) WebSphere Application Server
10 1 (0.66%) WebSphere Portal
Applications
1 1 (0.66%) Microsoft Excel
1 1 (0.66%) Microsoft Office
1 1 (0.66%) Microsoft PowerPoint
1 1 (0.66%) MS Visio
1 1 (0.66%) Shockwave
1 1 (0.66%) SPSS
Business Applications
1 5 (3.29%) SAP Oil and Gas
Cloud Services
1 69 (45.39%) Amazon AWS
2 22 (14.47%) Amazon Kinesis
3 20 (13.16%) Amazon EMR
4 19 (12.50%) Microsoft Azure
5 17 (11.18%) Amazon S3
6 15 (9.87%) Google Cloud Platform
7 12 (7.89%) AWS Lambda
7 12 (7.89%) Serverless
8 9 (5.92%) Amazon EC2
8 9 (5.92%) GitHub
8 9 (5.92%) Google Analytics
9 3 (1.97%) IBM Cloud
9 3 (1.97%) OpenShift
10 2 (1.32%) Amazon CloudWatch
10 2 (1.32%) Cloud Computing
Communications & Networking
1 8 (5.26%) Kerberos
1 8 (5.26%) SSL
2 4 (2.63%) SNA
3 2 (1.32%) HTTP
4 1 (0.66%) DVB
4 1 (0.66%) Internet
4 1 (0.66%) Multicast
Database & Business Intelligence
1 131 (86.18%) Hadoop
2 127 (83.55%) Big Data
3 94 (61.84%) Apache Hive
4 80 (52.63%) HBase
5 58 (38.16%) Data Warehouse
6 56 (36.84%) NoSQL
7 55 (36.18%) Apache Cassandra
8 54 (35.53%) Sqoop
9 52 (34.21%) MongoDB
10 40 (26.32%) Impala
11 38 (25.00%) SQL Server
12 32 (21.05%) PostgreSQL
13 30 (19.74%) Amazon Redshift
14 18 (11.84%) Data Lake
14 18 (11.84%) Relational Database
15 14 (9.21%) Flink
16 11 (7.24%) Data Mining
16 11 (7.24%) Power BI
16 11 (7.24%) Redis
16 11 (7.24%) SQL Server Integration Services
Development Applications
1 15 (9.87%) JIRA
2 10 (6.58%) Jenkins
3 7 (4.61%) Git (software)
4 3 (1.97%) WebDriver
5 2 (1.32%) Subversion
6 1 (0.66%) Bitbucket
6 1 (0.66%) ERwin
6 1 (0.66%) JUnit
6 1 (0.66%) Sonatype Nexus
6 1 (0.66%) Visual Studio
6 1 (0.66%) Visual Studio Team System
General
1 44 (28.95%) Finance
2 18 (11.84%) Banking
3 17 (11.18%) Retail
4 4 (2.63%) Games
5 2 (1.32%) Marketing
5 2 (1.32%) Telecoms
6 1 (0.66%) Legal
6 1 (0.66%) Manufacturing
6 1 (0.66%) Retail Banking
Job Titles
1 48 (31.58%) Data Engineer
2 35 (23.03%) Developer
3 34 (22.37%) Architect
4 27 (17.76%) Data Architect
5 23 (15.13%) Big Data Architect
5 23 (15.13%) Big Data Engineer
6 19 (12.50%) Big Data Developer
7 13 (8.55%) Data Scientist
8 12 (7.89%) AWS Engineer
8 12 (7.89%) Python Engineer
8 12 (7.89%) Senior Data Engineer
9 9 (5.92%) AWS Architect
9 9 (5.92%) Consultant
9 9 (5.92%) Technical Architect
10 7 (4.61%) Azure Engineer
10 7 (4.61%) Cloud Architect
11 6 (3.95%) Administrator
11 6 (3.95%) Hadoop Administrator
11 6 (3.95%) Principal Consultant
11 6 (3.95%) Scala Developer
Libraries, Frameworks & Software Standards
1 128 (84.21%) Kafka
2 19 (12.50%) RabbitMQ
3 17 (11.18%) Spark Streaming
4 14 (9.21%) Apache Avro
5 11 (7.24%) Natural Language Processing
6 10 (6.58%) LAPP Stack
7 8 (5.26%) Akka
7 8 (5.26%) PySpark
8 7 (4.61%) Web Services
9 5 (3.29%) .NET
9 5 (3.29%) Lucene
9 5 (3.29%) RESTful
10 4 (2.63%) AngularJS
10 4 (2.63%) Apache Tez
10 4 (2.63%) Elastic Stack
10 4 (2.63%) J2EE
11 3 (1.97%) Apache Drill
11 3 (1.97%) GraphX
11 3 (1.97%) Play Framework
11 3 (1.97%) TensorFlow
Miscellaneous
1 33 (21.71%) Algorithms
2 25 (16.45%) Analytical Skills
3 15 (9.87%) Computer Science
4 11 (7.24%) Data Structures
5 9 (5.92%) Fintech
6 4 (2.63%) Virtual Team
7 3 (1.97%) Management Information System
7 3 (1.97%) NHS
7 3 (1.97%) Social Network
8 2 (1.32%) Data Centre
8 2 (1.32%) Public Cloud
8 2 (1.32%) Self-Motivation
9 1 (0.66%) Clustering
9 1 (0.66%) DataPower
9 1 (0.66%) IBM Mainframe
9 1 (0.66%) Linux Command Line
9 1 (0.66%) Mainframe
9 1 (0.66%) MPEG
9 1 (0.66%) Reference Data
9 1 (0.66%) Replication
Operating Systems
1 45 (29.61%) Linux
2 15 (9.87%) Unix
3 11 (7.24%) Windows
4 10 (6.58%) VMS
5 9 (5.92%) Red Hat Enterprise Linux
6 1 (0.66%) AIX
6 1 (0.66%) DC/OS
6 1 (0.66%) Solaris
Processes & Methodologies
1 67 (44.08%) Analytics
2 54 (35.53%) ETL
3 48 (31.58%) Data Science
4 43 (28.29%) Agile Software Development
5 42 (27.63%) Business Intelligence
6 40 (26.32%) DevOps
7 34 (22.37%) Data Ingestion
7 34 (22.37%) Data Integration
8 31 (20.39%) Data Modelling
9 30 (19.74%) Open Source
10 29 (19.08%) Machine Learning
10 29 (19.08%) MapReduce
11 28 (18.42%) Data Engineering
12 24 (15.79%) Visualisation
13 20 (13.16%) Data Security
14 17 (11.18%) Data Governance
14 17 (11.18%) Mentoring
14 17 (11.18%) Performance Tuning
15 14 (9.21%) Statistics
16 13 (8.55%) Scrum
Programming Languages
1 82 (53.95%) Python
2 54 (35.53%) Java
3 51 (33.55%) SQL
4 44 (28.95%) Scala
5 31 (20.39%) R
6 21 (13.82%) MATLAB
7 18 (11.84%) JavaScript
8 15 (9.87%) C
8 15 (9.87%) Shell Script
9 12 (7.89%) Go
10 11 (7.24%) C#
11 4 (2.63%) Perl
12 3 (1.97%) AWK
12 3 (1.97%) Bash Shell
12 3 (1.97%) Clojure
12 3 (1.97%) Ruby
13 2 (1.32%) C++
13 2 (1.32%) Erlang
13 2 (1.32%) Lua
14 1 (0.66%) PL/SQL
Qualifications
1 22 (14.47%) Degree
2 13 (8.55%) PhD
3 11 (7.24%) Security Cleared
4 10 (6.58%) Computer Science Degree
5 7 (4.61%) SC Cleared
6 2 (1.32%) DV Cleared
6 2 (1.32%) Master's Degree
7 1 (0.66%) CISSP
Quality Assurance & Compliance
1 20 (13.16%) QA
2 19 (12.50%) Data Quality
3 10 (6.58%) GCP
4 9 (5.92%) GDPR
5 2 (1.32%) PMO
System Software
1 46 (30.26%) HDFS
2 25 (16.45%) Apache ZooKeeper
3 16 (10.53%) Docker
4 10 (6.58%) Hyper-V
5 7 (4.61%) Active Directory
6 1 (0.66%) etcd
6 1 (0.66%) Virtual Machines
Systems Management
1 57 (37.50%) Oozie
2 19 (12.50%) Hadoop YARN
3 13 (8.55%) Ansible
4 11 (7.24%) Ambari
4 11 (7.24%) Terraform
5 8 (5.26%) Puppet
6 7 (4.61%) Apache Slider
6 7 (4.61%) Consul
6 7 (4.61%) Kibana
7 6 (3.95%) Packer
8 5 (3.29%) Mesos
9 3 (1.97%) Kubernetes
9 3 (1.97%) Opscode Chef
10 2 (1.32%) Grafana
10 2 (1.32%) Graphite
10 2 (1.32%) Nagios
10 2 (1.32%) Salt
10 2 (1.32%) StatsD
10 2 (1.32%) ZABBIX
11 1 (0.66%) Marathon
Vendors
1 33 (21.71%) Hortonworks
2 24 (15.79%) Google
2 24 (15.79%) Oracle
2 24 (15.79%) Talend
3 22 (14.47%) Cloudera
3 22 (14.47%) Informatica
4 17 (11.18%) Tableau
5 14 (9.21%) Alteryx
5 14 (9.21%) SAP
6 11 (7.24%) Vertica
7 9 (5.92%) Microsoft
7 9 (5.92%) Salesforce.com
8 8 (5.26%) MapR
8 8 (5.26%) Splunk
9 5 (3.29%) IBM
10 4 (2.63%) Palantir
10 4 (2.63%) Red Hat
11 3 (1.97%) Atlassian
12 2 (1.32%) New Relic
13 1 (0.66%) CA Agile Central