Period
to 16 February 2019

The following table provides summary statistics for permanent job vacancies advertised in the South West with a requirement for Data Lake skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Lake over the 6 months to 16 February 2019 with a comparison to the same period in the previous 2 years.

Data Lakes
England > South West
6 months to
16 Feb 2019
Same period 2018 Same period 2017
Rank 252 317 332
Rank change year-on-year +65 +15 -
Permanent jobs citing Data Lake 70 23 5
As % of all permanent IT jobs advertised in the South West 0.70% 0.23% 0.048%
As % of the Database & Business Intelligence category 2.41% 0.66% 0.16%
Number of salaries quoted 67 21 5
South West median annual salary £62,138 £55,000 £70,000
Median salary % change year-on-year +12.98% -21.43% -
10th Percentile £27,000 £32,175 £58,750
90th Percentile £83,750 £64,000 £76,250
England median annual salary £65,000 £63,750 £75,000
% change year-on-year +1.96% -15.00% -6.25%

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the South West with a requirement for database or business intelligence skills.

All Database and Business Intelligence Skills
South West
Permanent vacancies with a requirement for database or business intelligence skills 2,908 3,460 3,155
As % of all permanent IT jobs advertised in the South West 29.03% 33.85% 30.31%
Number of salaries quoted 2,484 2,914 2,704
South West median annual salary £45,000 £40,000 £42,500
Median salary % change year-on-year +12.50% -5.88% +7.81%
10th Percentile £28,575 £27,500 £27,500
90th Percentile £67,787 £60,000 £62,500
England median annual salary £52,500 £50,000 £47,500
% change year-on-year +5.00% +5.26% -

Data Lake
Job Vacancy Trend in the South West

Job postings citing Data Lake as a percentage of all IT jobs advertised in the South West.

Job vacancy trend for Data Lake in the South West

Data Lake
Salary Trend in the South West

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Lake in the South West.

Salary trend for Data Lake in the South West

Data Lake
Salary Histogram in the South West

The salary distribution of IT jobs citing Data Lake in the South West over the 6 months to 16 February 2019.

Salary histogram for Data Lake in the South West

Data Lake
Job Locations in the South West

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Lake within the South West region over the 6 months to 16 February 2019. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Wiltshire +30 45 £62,138 +1.87% 4
Bristol +23 11 £29,000 -49.57% 2
Gloucestershire +6 10 £57,500 +4.55%
Devon - 3 £66,000 -
Dorset +6 1 £52,500 +57.42%
Data Lake
England

For the 6 months to 16 February 2019, IT jobs citing Data Lake also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the South West region with a requirement for Data Lake.

1 57 (81.43%) Data Warehouse
2 44 (62.86%) Hadoop
3 43 (61.43%) Big Data
4 36 (51.43%) ETL
4 36 (51.43%) Teradata
5 33 (47.14%) Analytics
6 29 (41.43%) Data Engineering
7 28 (40.00%) Retail
8 27 (38.57%) Data Governance
8 27 (38.57%) Amazon AWS
8 27 (38.57%) Finance
8 27 (38.57%) Informatica
8 27 (38.57%) SQL
9 24 (34.29%) Stakeholder Management
10 23 (32.86%) Python
10 23 (32.86%) Netezza
10 23 (32.86%) Data Strategy
11 21 (30.00%) Line Management
11 21 (30.00%) Data Architecture
11 21 (30.00%) Continuous Improvement
11 21 (30.00%) SQL Server
11 21 (30.00%) DataStage
11 21 (30.00%) Ab Initio
12 20 (28.57%) Scala
12 20 (28.57%) Software Engineering
12 20 (28.57%) Apache Spark
13 18 (25.71%) Microsoft Azure
14 16 (22.86%) Google
14 16 (22.86%) BigQuery
14 16 (22.86%) Google Cloud Platform

Data Lake
Co-occurring IT Skills in the South West by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 20 (28.57%) Apache Spark
2 6 (8.57%) Apache
Cloud Services
1 27 (38.57%) Amazon AWS
2 18 (25.71%) Microsoft Azure
3 16 (22.86%) Google Cloud Platform
4 2 (2.86%) Azure Data Factory
4 2 (2.86%) Cloud Computing
5 1 (1.43%) AWS Data Pipeline
5 1 (1.43%) Dynamics 365
5 1 (1.43%) PaaS
Database & Business Intelligence
1 57 (81.43%) Data Warehouse
2 44 (62.86%) Hadoop
3 43 (61.43%) Big Data
4 21 (30.00%) DataStage
4 21 (30.00%) SQL Server
5 16 (22.86%) BigQuery
6 14 (20.00%) Amazon Redshift
6 14 (20.00%) Apache Hive
7 13 (18.57%) MySQL
7 13 (18.57%) Relational Database
7 13 (18.57%) SQL Server 2012
7 13 (18.57%) SQL Server 2014
8 12 (17.14%) Oracle Reports
8 12 (17.14%) RDBMS
8 12 (17.14%) SQL Server 2008
8 12 (17.14%) SQL Server Integration Services
9 9 (12.86%) SQL Server Analysis Services
10 8 (11.43%) Microsoft Analysis Services
11 6 (8.57%) Neo4j
12 4 (5.71%) MongoDB
Development Applications
1 7 (10.00%) Git (software)
2 6 (8.57%) Mercurial
3 3 (4.29%) ERwin
General
1 28 (40.00%) Retail
2 27 (38.57%) Finance
3 1 (1.43%) Advertising
3 1 (1.43%) Manufacturing
Job Titles
1 21 (30.00%) Data Engineer
2 20 (28.57%) Architect
3 17 (24.29%) Data Architect
4 12 (17.14%) Big Data Engineer
5 11 (15.71%) Senior Data Engineer
6 10 (14.29%) Cloud Architect
7 7 (10.00%) Informatica Engineer
8 6 (8.57%) Developer
9 5 (7.14%) Data Warehouse Developer
9 5 (7.14%) Lead Architect
10 4 (5.71%) Lead Data Architect
11 3 (4.29%) Cloud Engineer
11 3 (4.29%) Solutions Architect
12 2 (2.86%) Big Data Architect
12 2 (2.86%) Data Warehouse Manager
12 2 (2.86%) Data Warehouse Project Manager
12 2 (2.86%) Project Manager
12 2 (2.86%) Senior Architect
12 2 (2.86%) Senior Data Architect
13 1 (1.43%) Senior ETL Developer
Libraries, Frameworks & Software Standards
1 6 (8.57%) Apache Avro
1 6 (8.57%) JSON
1 6 (8.57%) Kafka
1 6 (8.57%) Natural Language Processing
1 6 (8.57%) Pandas
1 6 (8.57%) scikit-learn
1 6 (8.57%) SciPy
2 1 (1.43%) Web Services
2 1 (1.43%) XML
Miscellaneous
1 12 (17.14%) Clustering
2 6 (8.57%) Algorithms
3 4 (5.71%) Greenfield Project
4 2 (2.86%) Public Cloud
5 1 (1.43%) Driving Licence
5 1 (1.43%) Fintech
5 1 (1.43%) Management Information System
Operating Systems
1 13 (18.57%) Linux
2 12 (17.14%) CentOS
2 12 (17.14%) Red Hat Enterprise Linux
2 12 (17.14%) Ubuntu
3 6 (8.57%) Unix
4 1 (1.43%) Windows
Processes & Methodologies
1 36 (51.43%) ETL
2 33 (47.14%) Analytics
3 29 (41.43%) Data Engineering
4 27 (38.57%) Data Governance
5 24 (34.29%) Stakeholder Management
6 23 (32.86%) Data Strategy
7 21 (30.00%) Continuous Improvement
7 21 (30.00%) Data Architecture
7 21 (30.00%) Line Management
8 20 (28.57%) Software Engineering
9 13 (18.57%) Agile Software Development
10 12 (17.14%) Business Intelligence
10 12 (17.14%) Data Protection
10 12 (17.14%) ERD
10 12 (17.14%) High Availability
10 12 (17.14%) Load Balancing
10 12 (17.14%) Scrum
10 12 (17.14%) UML
10 12 (17.14%) Validation
10 12 (17.14%) Visualisation
Programming Languages
1 27 (38.57%) SQL
2 23 (32.86%) Python
3 20 (28.57%) Scala
4 15 (21.43%) R
5 8 (11.43%) Java
6 6 (8.57%) Clojure
6 6 (8.57%) Cypher
6 6 (8.57%) Shell Script
7 1 (1.43%) Ruby
Qualifications
1 1 (1.43%) MCSA
1 1 (1.43%) MCSE
1 1 (1.43%) Microsoft Certification
Quality Assurance & Compliance
1 12 (17.14%) ISO/IEC 27001
2 6 (8.57%) Data Quality
System Software
1 1 (1.43%) Docker
Systems Management
1 1 (1.43%) Kubernetes
Vendors
1 36 (51.43%) Teradata
2 27 (38.57%) Informatica
3 23 (32.86%) Netezza
4 21 (30.00%) Ab Initio
5 16 (22.86%) Google
6 14 (20.00%) Oracle
7 12 (17.14%) Red Hat
8 7 (10.00%) Cloudera
8 7 (10.00%) Hortonworks
8 7 (10.00%) MapR
9 3 (4.29%) Cognos
9 3 (4.29%) Talend
10 2 (2.86%) Greenplum
10 2 (2.86%) Microsoft