Period
to 20 June 2018

The following table provides summary statistics for contract job vacancies with a requirement for Apache Flume skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Flume over the 6 months to 20 June 2018 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Flume
UK
6 months to
20 Jun 2018
Same period 2017 Same period 2016
Rank 679 684 804
Rank change year-on-year +5 +120 +3
Contract jobs citing Apache Flume 192 158 86
As % of all contract IT jobs advertised in the UK 0.19% 0.17% 0.081%
As % of the System Software category 1.41% 1.55% 0.69%
Number of daily rates quoted 113 108 41
UK median daily rate £550 £500 £500
Median daily rate % change year-on-year +10.00% - -9.09%
10th Percentile £425 £350 £425
90th Percentile £650 £675 £725
UK excluding London median daily rate £550 £401 £500
% change year-on-year +37.33% -19.90% -33.33%
Number of hourly rates quoted 0 0 0
UK median hourly rate - - -
UK excluding London median hourly rate - - -

Apache Flume is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for system software skills.

All System Software Skills
UK
Contract vacancies with a requirement for system software skills 13,657 10,221 12,403
As % of all contract IT jobs advertised in the UK 13.68% 11.23% 11.64%
Number of daily rates quoted 8,809 6,549 7,591
UK median daily rate £450 £420 £400
Median daily rate % change year-on-year +7.14% +5.00% +14.29%
10th Percentile £185 £163 £170
90th Percentile £625 £588 £575
UK excluding London median daily rate £400 £375 £365
% change year-on-year +6.67% +2.74% +7.53%
Number of hourly rates quoted 815 653 917
UK median hourly rate £16.00 £16.00 £16.00
10th Percentile £11.00 £10.13 £10.50
90th Percentile £45.36 £45.65 £42.00
UK excluding London median hourly rate £15.50 £15.00 £16.00
% change year-on-year +3.33% -6.25% +6.67%

Apache Flume
Job Vacancy Trend

Job postings citing Apache Flume as a percentage of all IT jobs advertised.

Job vacancy trend for Apache Flume in the UK

Apache Flume
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Apache Flume.

Contractor daily rate trend for Apache Flume in the UK

Apache Flume
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Apache Flume over the 6 months to 20 June 2018.

Contractor daily rate histogram for Apache Flume in the UK

Apache Flume
Top 12 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Flume within the UK over the 6 months to 20 June 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -1 188 £550 +10.00% 18
London -42 102 £550 +7.32% 11
UK excluding London +8 86 £550 +37.33% 8
South East -1 55 £575 +43.57% 4
North of England -5 21 £475 -
Yorkshire - 14 £440 -
East of England +8 6 £450 -18.18% 3
North West -9 6 £550 -
East Midlands -1 3 £600 -
Midlands -3 3 £600 -
Scotland -46 1 £425 - 1
North East - 1 £550 -

For the 6 months to 20 June 2018, IT contractor jobs citing Apache Flume also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Apache Flume.

1 173 (90.10%) Hadoop
2 166 (86.46%) Big Data
3 149 (77.60%) Apache Spark
4 148 (77.08%) Apache Hive
5 146 (76.04%) Kafka
6 110 (57.29%) HBase
7 92 (47.92%) Analytics
8 86 (44.79%) Python
9 83 (43.23%) Sqoop
10 79 (41.15%) Java
11 77 (40.10%) Oozie
11 77 (40.10%) HDFS
12 74 (38.54%) Scala
13 72 (37.50%) Amazon AWS
13 72 (37.50%) Apache Cassandra
13 72 (37.50%) SQL
14 71 (36.98%) Apache Pig
15 70 (36.46%) Hortonworks
16 68 (35.42%) Data Warehouse
16 68 (35.42%) NoSQL
17 64 (33.33%) Linux
18 63 (32.81%) ETL
19 62 (32.29%) Cloudera
20 55 (28.65%) Impala
20 55 (28.65%) Apache
21 54 (28.13%) MapReduce
22 53 (27.60%) SQL Server
22 53 (27.60%) Finance
22 53 (27.60%) PostgreSQL
22 53 (27.60%) Agile Software Development

Apache Flume
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 149 (77.60%) Apache Spark
2 71 (36.98%) Apache Pig
3 55 (28.65%) Apache
4 22 (11.46%) Apache Solr
4 22 (11.46%) Elasticsearch
5 14 (7.29%) SAS
6 9 (4.69%) OpenStack
7 2 (1.04%) Cloud Foundry
7 2 (1.04%) Confluence
7 2 (1.04%) Jupyter
7 2 (1.04%) Oracle Coherence
7 2 (1.04%) Oracle SOA Suite
8 1 (0.52%) IPython
8 1 (0.52%) Tomcat
Applications
1 4 (2.08%) SPSS
2 1 (0.52%) Microsoft Excel
2 1 (0.52%) Microsoft Office
2 1 (0.52%) Microsoft PowerPoint
2 1 (0.52%) MS Visio
2 1 (0.52%) Shockwave
Business Applications
1 1 (0.52%) SAP Oil and Gas
Cloud Services
1 72 (37.50%) Amazon AWS
2 23 (11.98%) Amazon Kinesis
3 22 (11.46%) Microsoft Azure
4 19 (9.90%) Amazon EMR
5 15 (7.81%) Amazon S3
6 14 (7.29%) AWS Lambda
6 14 (7.29%) Serverless
7 11 (5.73%) Google Cloud Platform
7 11 (5.73%) Google Tag Manager
8 10 (5.21%) Amazon EC2
8 10 (5.21%) Google Analytics
9 8 (4.17%) GitHub
10 3 (1.56%) OpenShift
11 2 (1.04%) Amazon CloudWatch
11 2 (1.04%) Cloud Computing
12 1 (0.52%) Bluemix
12 1 (0.52%) IBM Cloud
Communications & Networking
1 13 (6.77%) Kerberos
1 13 (6.77%) SSL
2 1 (0.52%) DVB
2 1 (0.52%) HTTP
2 1 (0.52%) Internet
2 1 (0.52%) Multicast
2 1 (0.52%) SNA
Database & Business Intelligence
1 173 (90.10%) Hadoop
2 166 (86.46%) Big Data
3 148 (77.08%) Apache Hive
4 110 (57.29%) HBase
5 83 (43.23%) Sqoop
6 72 (37.50%) Apache Cassandra
7 68 (35.42%) Data Warehouse
7 68 (35.42%) NoSQL
8 55 (28.65%) Impala
9 53 (27.60%) PostgreSQL
9 53 (27.60%) SQL Server
10 52 (27.08%) MongoDB
11 34 (17.71%) Amazon Redshift
12 30 (15.63%) Data Lake
13 24 (12.50%) Relational Database
14 19 (9.90%) Flink
15 14 (7.29%) MySQL
16 13 (6.77%) RDBMS
17 10 (5.21%) Redis
18 9 (4.69%) Pentaho
Development Applications
1 19 (9.90%) Jenkins
2 17 (8.85%) Git (software)
3 11 (5.73%) JIRA
4 8 (4.17%) TeamCity
5 7 (3.65%) JUnit
5 7 (3.65%) Subversion
6 6 (3.13%) Visual Studio
6 6 (3.13%) Visual Studio Team System
7 2 (1.04%) Maven
7 2 (1.04%) WebDriver
8 1 (0.52%) Atlassian Bamboo
8 1 (0.52%) GoCD
8 1 (0.52%) Sonatype Nexus
8 1 (0.52%) Vagrant
General
1 53 (27.60%) Finance
2 23 (11.98%) Banking
3 21 (10.94%) Retail
4 9 (4.69%) Marketing
5 4 (2.08%) Games
6 2 (1.04%) Manufacturing
6 2 (1.04%) Telecoms
7 1 (0.52%) Advertising
7 1 (0.52%) Retail Banking
Job Titles
1 55 (28.65%) Data Engineer
2 44 (22.92%) Developer
3 36 (18.75%) Architect
4 29 (15.10%) Data Architect
5 26 (13.54%) Big Data Developer
5 26 (13.54%) Big Data Engineer
6 22 (11.46%) Big Data Architect
7 20 (10.42%) Consultant
8 15 (7.81%) Hadoop Developer
9 14 (7.29%) AWS Engineer
10 12 (6.25%) Data Scientist
10 12 (6.25%) Python Engineer
11 11 (5.73%) AWS Architect
11 11 (5.73%) Senior Data Engineer
12 10 (5.21%) Cloud Architect
12 10 (5.21%) Hadoop Consultant
13 9 (4.69%) Administrator
13 9 (4.69%) Data Consultant
13 9 (4.69%) Hadoop Administrator
14 8 (4.17%) Principal Consultant
Libraries, Frameworks & Software Standards
1 146 (76.04%) Kafka
2 22 (11.46%) Web Services
3 19 (9.90%) TensorFlow
4 18 (9.38%) RabbitMQ
5 16 (8.33%) SOAP
5 16 (8.33%) Spark Streaming
6 15 (7.81%) RESTful
7 11 (5.73%) Apache Avro
8 10 (5.21%) Akka
9 9 (4.69%) LAPP Stack
10 7 (3.65%) Keras
10 7 (3.65%) MLlib
10 7 (3.65%) scikit-learn
11 6 (3.13%) CNTK
11 6 (3.13%) MXNet
11 6 (3.13%) Natural Language Processing
11 6 (3.13%) Theano
11 6 (3.13%) Velocity
12 5 (2.60%) PySpark
13 4 (2.08%) Apache Tez
Miscellaneous
1 26 (13.54%) Algorithms
2 20 (10.42%) Analytical Skills
3 19 (9.90%) Computer Science
4 11 (5.73%) Data Structures
4 11 (5.73%) Greenfield Project
5 10 (5.21%) Fintech
6 4 (2.08%) Replication
7 3 (1.56%) NHS
8 2 (1.04%) Data Centre
8 2 (1.04%) Management Information System
8 2 (1.04%) Mobile App
8 2 (1.04%) Public Cloud
8 2 (1.04%) Self-Motivation
8 2 (1.04%) Virtual Team
9 1 (0.52%) Clustering
9 1 (0.52%) Hybrid Cloud
9 1 (0.52%) MPEG
9 1 (0.52%) Reference Data
9 1 (0.52%) Social Network
Operating Systems
1 64 (33.33%) Linux
2 17 (8.85%) Red Hat Enterprise Linux
3 14 (7.29%) CentOS
4 11 (5.73%) Windows
5 9 (4.69%) Unix
5 9 (4.69%) VMS
6 2 (1.04%) Debian
6 2 (1.04%) Ubuntu
Processes & Methodologies
1 92 (47.92%) Analytics
2 63 (32.81%) ETL
3 54 (28.13%) MapReduce
4 53 (27.60%) Agile Software Development
5 44 (22.92%) Data Science
6 40 (20.83%) DevOps
7 38 (19.79%) Data Ingestion
7 38 (19.79%) Machine Learning
8 36 (18.75%) Business Intelligence
8 36 (18.75%) Data Engineering
9 35 (18.23%) Open Source
10 32 (16.67%) Data Modelling
11 29 (15.10%) Data Integration
12 26 (13.54%) E-Commerce
13 22 (11.46%) Data Architecture
14 21 (10.94%) Performance Tuning
15 20 (10.42%) Visualisation
16 19 (9.90%) Scrum
17 18 (9.38%) Continuous Integration
17 18 (9.38%) Data Governance
Programming Languages
1 86 (44.79%) Python
2 79 (41.15%) Java
3 74 (38.54%) Scala
4 72 (37.50%) SQL
5 25 (13.02%) R
6 23 (11.98%) JavaScript
7 20 (10.42%) C
8 19 (9.90%) Shell Script
9 17 (8.85%) Bash Shell
10 13 (6.77%) C#
11 11 (5.73%) Go
12 8 (4.17%) MATLAB
13 4 (2.08%) F#
13 4 (2.08%) Ruby
14 3 (1.56%) Perl
15 2 (1.04%) AWK
15 2 (1.04%) C++
15 2 (1.04%) Clojure
15 2 (1.04%) Erlang
15 2 (1.04%) Lua
Qualifications
1 21 (10.94%) Degree
2 12 (6.25%) PhD
2 12 (6.25%) Security Cleared
3 7 (3.65%) Master's Degree
3 7 (3.65%) SC Cleared
4 5 (2.60%) Computer Science Degree
5 4 (2.08%) DV Cleared
Quality Assurance & Compliance
1 15 (7.81%) Data Quality
2 11 (5.73%) QA
3 9 (4.69%) GCP
4 7 (3.65%) GDPR
5 4 (2.08%) ISO/IEC 20000
5 4 (2.08%) Sarbanes-Oxley
6 2 (1.04%) PMO
System Software
1 77 (40.10%) HDFS
2 33 (17.19%) Apache ZooKeeper
3 28 (14.58%) Docker
4 12 (6.25%) Active Directory
5 9 (4.69%) Hyper-V
6 2 (1.04%) Virtual Machines
7 1 (0.52%) etcd
Systems Management
1 77 (40.10%) Oozie
2 41 (21.35%) Hadoop YARN
3 19 (9.90%) Terraform
4 17 (8.85%) Ambari
5 13 (6.77%) Ansible
6 12 (6.25%) Apache Slider
6 12 (6.25%) Puppet
7 8 (4.17%) Consul
7 8 (4.17%) Kibana
8 7 (3.65%) Packer
9 5 (2.60%) Opscode Chef
10 3 (1.56%) Mesos
11 2 (1.04%) Grafana
11 2 (1.04%) Graphite
11 2 (1.04%) Kubernetes
11 2 (1.04%) Nagios
11 2 (1.04%) Salt
11 2 (1.04%) StatsD
11 2 (1.04%) ZABBIX
12 1 (0.52%) Prometheus
Vendors
1 70 (36.46%) Hortonworks
2 62 (32.29%) Cloudera
3 37 (19.27%) Talend
4 36 (18.75%) MapR
5 32 (16.67%) Google
6 21 (10.94%) Microsoft
6 21 (10.94%) Salesforce.com
7 17 (8.85%) Informatica
7 17 (8.85%) Oracle
8 16 (8.33%) Tableau
9 15 (7.81%) SAP
10 12 (6.25%) Alteryx
10 12 (6.25%) Vertica
11 11 (5.73%) Tealium
12 9 (4.69%) Splunk
13 5 (2.60%) Red Hat
14 4 (2.08%) Atlassian
15 3 (1.56%) Teradata
16 2 (1.04%) New Relic
17 1 (0.52%) Palantir