Period
to 25 May 2019

The following table provides summary statistics for contract job vacancies with a requirement for Apache Flume skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Flume over the 6 months to 25 May 2019 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Apache Flume
UK
6 months to
25 May 2019
Same period 2018 Same period 2017
Rank 702 681 682
Rank change year-on-year -21 +1 +110
Contract jobs citing Apache Flume 148 218 153
As % of all contract IT jobs advertised in the UK 0.16% 0.21% 0.17%
As % of the System Software category 1.04% 1.60% 1.51%
Number of daily rates quoted 99 130 100
UK median daily rate £525 £550 £500
Median daily rate % change year-on-year -4.55% +10.00% -4.76%
10th Percentile £463 £425 £356
90th Percentile £690 £639 £689
UK excluding London median daily rate £525 £563 £401
% change year-on-year -6.67% +40.45% -19.90%
Number of hourly rates quoted 0 0 0
UK median hourly rate - - -
UK excluding London median hourly rate - - -

Apache Flume is in the System Software category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for system software skills.

All System Software Skills
UK
Contract vacancies with a requirement for system software skills 14,163 13,611 10,154
As % of all contract IT jobs advertised in the UK 15.46% 13.41% 11.23%
Number of daily rates quoted 9,431 8,808 6,471
UK median daily rate £475 £450 £423
Median daily rate % change year-on-year +5.56% +6.51% +5.63%
10th Percentile £180 £185 £163
90th Percentile £638 £625 £588
UK excluding London median daily rate £425 £400 £375
% change year-on-year +6.25% +6.67% +4.17%
Number of hourly rates quoted 621 797 657
UK median hourly rate £16.50 £15.86 £16.00
Median hourly rate % change year-on-year +4.04% -0.88% +1.47%
10th Percentile £11.00 £10.75 £10.25
90th Percentile £47.50 £45.61 £47.00
UK excluding London median hourly rate £15.19 £15.00 £15.50
% change year-on-year +1.27% -3.23% -3.13%

Apache Flume
Job Vacancy Trend

Job postings citing Apache Flume as a percentage of all IT jobs advertised.

Job vacancy trend for Apache Flume in the UK

Apache Flume
Contractor Daily Rate Trend

This chart provides the 3-month moving average for daily rates quoted in contract jobs citing Apache Flume.

Contractor daily rate trend for Apache Flume in the UK

Apache Flume
Contractor Daily Rate Histogram

The daily rate distribution of IT jobs citing Apache Flume over the 6 months to 25 May 2019.

Contractor daily rate histogram for Apache Flume in the UK

Apache Flume
Top 12 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Flume within the UK over the 6 months to 25 May 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Job
Vacancies
England -25 141 £525 -4.55% 2
London +20 89 £525 -4.55%
UK excluding London -17 56 £525 -6.67% 2
South East -25 23 £525 -8.70%
North of England +19 18 £563 +18.42%
North East +21 11 £525 -4.55%
East of England +4 10 £515 +14.44% 1
North West +19 7 £588 +14.63%
Scotland +21 3 £425 -
East Midlands +22 1 £450 -25.00%
Midlands +8 1 £450 -25.00%
Northern Ireland - 1 - -

For the 6 months to 25 May 2019, IT contractor jobs citing Apache Flume also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads with a requirement for Apache Flume.

1 130 (87.84%) Hadoop
2 129 (87.16%) Big Data
3 126 (85.14%) Kafka
4 107 (72.30%) Apache Spark
5 102 (68.92%) Python
6 94 (63.51%) Apache Hive
7 70 (47.30%) Cloudera
8 69 (46.62%) Java
9 63 (42.57%) Data Warehouse
10 61 (41.22%) NoSQL
11 60 (40.54%) Linux
12 58 (39.19%) SQL
13 57 (38.51%) HBase
14 55 (37.16%) Data Modelling
15 53 (35.81%) Amazon AWS
16 52 (35.14%) Apache Cassandra
17 49 (33.11%) Agile Software Development
18 48 (32.43%) Sqoop
19 46 (31.08%) HDFS
20 44 (29.73%) Finance
21 43 (29.05%) Scala
22 40 (27.03%) MongoDB
22 40 (27.03%) ETL
22 40 (27.03%) Data Lake
23 39 (26.35%) Talend
24 38 (25.68%) MapReduce
25 36 (24.32%) MySQL
25 36 (24.32%) Impala
26 35 (23.65%) Analytics
27 33 (22.30%) Single Customer View

Apache Flume
Co-occurring IT Skills by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 107 (72.30%) Apache Spark
2 22 (14.86%) Apache Solr
3 19 (12.84%) SAS
4 16 (10.81%) Apache Pig
4 16 (10.81%) Elasticsearch
5 14 (9.46%) Apache
6 12 (8.11%) Confluence
7 11 (7.43%) Apache Airflow
7 11 (7.43%) Luigi
8 5 (3.38%) Cloud Foundry
9 2 (1.35%) WebSphere
9 2 (1.35%) WebSphere Application Server
9 2 (1.35%) WebSphere Portal
10 1 (0.68%) Tomcat
Applications
1 4 (2.70%) MS Visio
Business Applications
1 3 (2.03%) SAP Oil and Gas
Cloud Services
1 53 (35.81%) Amazon AWS
2 31 (20.95%) Google Cloud Platform
3 26 (17.57%) Amazon Kinesis
3 26 (17.57%) Amazon S3
4 25 (16.89%) Amazon EMR
5 24 (16.22%) Microsoft Azure
6 16 (10.81%) Serverless
7 13 (8.78%) Amazon EC2
7 13 (8.78%) Cloud Computing
8 12 (8.11%) PaaS
9 10 (6.76%) Amazon SQS
9 10 (6.76%) AWS CloudFormation
9 10 (6.76%) Power Platform
10 8 (5.41%) Amazon CloudWatch
11 3 (2.03%) Azure Data Factory
11 3 (2.03%) Data Lake Analytics
12 2 (1.35%) Apigee
12 2 (1.35%) GitHub
12 2 (1.35%) IaaS
13 1 (0.68%) Google Compute Engine
Communications & Networking
1 10 (6.76%) MQTT
2 7 (4.73%) TCP/IP
3 2 (1.35%) HTTP
4 1 (0.68%) Kerberos
Database & Business Intelligence
1 130 (87.84%) Hadoop
2 129 (87.16%) Big Data
3 94 (63.51%) Apache Hive
4 63 (42.57%) Data Warehouse
5 61 (41.22%) NoSQL
6 57 (38.51%) HBase
7 52 (35.14%) Apache Cassandra
8 48 (32.43%) Sqoop
9 40 (27.03%) Data Lake
9 40 (27.03%) MongoDB
10 36 (24.32%) Impala
10 36 (24.32%) MySQL
11 29 (19.59%) PostgreSQL
12 21 (14.19%) Amazon Redshift
13 17 (11.49%) Amazon Athena
14 13 (8.78%) Spark SQL
15 11 (7.43%) Amazon Aurora
15 11 (7.43%) Azkaban
15 11 (7.43%) Flink
15 11 (7.43%) Relational Database
Development Applications
1 27 (18.24%) Jenkins
2 19 (12.84%) JIRA
3 7 (4.73%) Atlassian Bamboo
3 7 (4.73%) Git (software)
3 7 (4.73%) Subversion
3 7 (4.73%) TeamCity
4 6 (4.05%) Gradle
4 6 (4.05%) Maven
5 5 (3.38%) ERwin
6 4 (2.70%) Cucumber
6 4 (2.70%) Selenium
6 4 (2.70%) SoapUI
6 4 (2.70%) Visual Studio
7 2 (1.35%) Bitbucket
8 1 (0.68%) SQL Server Management Studio (SSMS)
8 1 (0.68%) Team Foundation Server
8 1 (0.68%) Toad
General
1 44 (29.73%) Finance
2 10 (6.76%) Retail
3 6 (4.05%) Legal
4 5 (3.38%) Banking
4 5 (3.38%) Marketing
5 2 (1.35%) Financial Institution
5 2 (1.35%) Telecoms
6 1 (0.68%) Aerospace
6 1 (0.68%) Manufacturing
Job Titles
1 74 (50.00%) Data Engineer
2 50 (33.78%) Big Data Engineer
3 23 (15.54%) Architect
4 16 (10.81%) DevOps Engineer
5 15 (10.14%) Solutions Architect
6 10 (6.76%) Developer
6 10 (6.76%) Python Engineer
7 9 (6.08%) Big Data Architect
7 9 (6.08%) Cloud Architect
8 8 (5.41%) Consultant
9 7 (4.73%) Big Data Developer
9 7 (4.73%) Data Architect
9 7 (4.73%) Senior Data Engineer
10 6 (4.05%) Big Data Consultant
10 6 (4.05%) Data Consultant
10 6 (4.05%) Hadoop Developer
10 6 (4.05%) Hadoop Engineer
10 6 (4.05%) Technical Consultant
11 5 (3.38%) Analyst
11 5 (3.38%) Data Analyst
Libraries, Frameworks & Software Standards
1 126 (85.14%) Kafka
2 24 (16.22%) Spark Streaming
3 16 (10.81%) Elastic Stack
3 16 (10.81%) Web Services
4 10 (6.76%) Natural Language Processing
4 10 (6.76%) RESTful
5 9 (6.08%) Oracle GoldenGate
6 8 (5.41%) Apache Avro
6 8 (5.41%) MLlib
6 8 (5.41%) XML
7 6 (4.05%) JDBC
8 5 (3.38%) Apache Camel
8 5 (3.38%) REST
8 5 (3.38%) SOAP
9 4 (2.70%) J2EE
10 3 (2.03%) LAMP
10 3 (2.03%) RabbitMQ
11 2 (1.35%) JSON
11 2 (1.35%) Sensu
11 2 (1.35%) Spring
Miscellaneous
1 17 (11.49%) Analytical Skills
2 8 (5.41%) Data Centre
2 8 (5.41%) Self-Motivation
3 4 (2.70%) Algorithms
3 4 (2.70%) Data Structures
3 4 (2.70%) User Experience
4 3 (2.03%) Cloud Native
4 3 (2.03%) Management Information System
4 3 (2.03%) Public Cloud
5 2 (1.35%) DataPower
6 1 (0.68%) Client/Server
6 1 (0.68%) Virtual Team
Operating Systems
1 60 (40.54%) Linux
2 22 (14.86%) Unix
3 7 (4.73%) Solaris
4 6 (4.05%) Windows
5 4 (2.70%) Red Hat Enterprise Linux
6 2 (1.35%) AIX
7 1 (0.68%) CentOS
Processes & Methodologies
1 55 (37.16%) Data Modelling
2 49 (33.11%) Agile Software Development
3 40 (27.03%) ETL
4 38 (25.68%) MapReduce
5 35 (23.65%) Analytics
6 33 (22.30%) Single Customer View
7 30 (20.27%) DevOps
8 29 (19.59%) Microservices
9 25 (16.89%) Business Intelligence
9 25 (16.89%) Visualisation
10 24 (16.22%) TDD
11 23 (15.54%) Test Automation
12 22 (14.86%) Data Science
12 22 (14.86%) Data Visualisation
13 21 (14.19%) Data Ingestion
14 20 (13.51%) Data Engineering
14 20 (13.51%) Machine Learning
14 20 (13.51%) Open Source
15 19 (12.84%) Problem-Solving
16 18 (12.16%) Performance Tuning
Programming Languages
1 102 (68.92%) Python
2 69 (46.62%) Java
3 58 (39.19%) SQL
4 43 (29.05%) Scala
5 19 (12.84%) R
6 15 (10.14%) Go
7 14 (9.46%) Bash Shell
7 14 (9.46%) C
7 14 (9.46%) C++
8 13 (8.78%) MATLAB
9 11 (7.43%) Shell Script
10 8 (5.41%) Ruby
11 7 (4.73%) Perl
12 5 (3.38%) JavaScript
13 3 (2.03%) AWK
14 1 (0.68%) PL/SQL
14 1 (0.68%) XPath
Qualifications
1 8 (5.41%) PhD
2 7 (4.73%) Degree
3 4 (2.70%) Computer Science Degree
3 4 (2.70%) SC Cleared
3 4 (2.70%) Security Cleared
4 2 (1.35%) Master's Degree
5 1 (0.68%) ISEB
5 1 (0.68%) ISTQB
5 1 (0.68%) SAS Certification
Quality Assurance & Compliance
1 12 (8.11%) QA
2 9 (6.08%) Data Quality
3 4 (2.70%) GDPR
4 2 (1.35%) ISO/IEC 27001
System Software
1 46 (31.08%) HDFS
2 15 (10.14%) Docker
3 10 (6.76%) Apache ZooKeeper
4 1 (0.68%) Oracle RAC
Systems Management
1 32 (21.62%) Hadoop YARN
2 17 (11.49%) Kubernetes
3 16 (10.81%) Oozie
4 15 (10.14%) Ansible
5 10 (6.76%) Puppet
6 8 (5.41%) Mesos
7 7 (4.73%) Terraform
8 5 (3.38%) Marathon
9 3 (2.03%) Grafana
9 3 (2.03%) Graphite
9 3 (2.03%) Kibana
9 3 (2.03%) Nagios
9 3 (2.03%) Opscode Chef
9 3 (2.03%) Salt
9 3 (2.03%) StatsD
10 2 (1.35%) ZABBIX
11 1 (0.68%) BMC PATROL
11 1 (0.68%) Ganglia
11 1 (0.68%) logstash
11 1 (0.68%) NetBackup
Vendors
1 70 (47.30%) Cloudera
2 39 (26.35%) Talend
3 25 (16.89%) Google
4 24 (16.22%) Oracle
5 12 (8.11%) Informatica
5 12 (8.11%) Tableau
6 10 (6.76%) Hortonworks
6 10 (6.76%) SAP
7 9 (6.08%) Microsoft
8 8 (5.41%) New Relic
8 8 (5.41%) Splunk
9 6 (4.05%) Teradata
10 3 (2.03%) Alteryx
10 3 (2.03%) Databricks
11 2 (1.35%) IBM
11 2 (1.35%) Red Hat
12 1 (0.68%) BMC
12 1 (0.68%) Sybase