Period
to 13 December 2018

The following table provides summary statistics for permanent job vacancies advertised in London with a requirement for Data Engineering skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Engineering over the 6 months to 13 December 2018 with a comparison to the same period in the previous 2 years.

Data Engineering
England > London
6 months to
13 Dec 2018
Same period 2017 Same period 2016
Rank 428 612 694
Rank change year-on-year +184 +82 +114
Permanent jobs citing Data Engineering 400 239 151
As % of all permanent IT jobs advertised in London 0.60% 0.32% 0.20%
As % of the Processes & Methodologies category 0.65% 0.34% 0.22%
Number of salaries quoted 318 200 138
London median annual salary £70,000 £75,000 £70,000
Median salary % change year-on-year -6.67% +7.14% -
10th Percentile £47,850 £50,000 £50,950
90th Percentile £101,250 £115,000 £95,375
England median annual salary £67,500 £70,000 £70,000
% change year-on-year -3.57% - +3.70%

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in London with a requirement for process or methodology skills.

All Process and Methodology Skills
London
Permanent vacancies with a requirement for process or methodology skills 61,240 69,295 68,221
As % of all permanent IT jobs advertised in London 92.02% 93.31% 92.17%
Number of salaries quoted 49,534 53,968 58,492
London median annual salary £62,500 £60,000 £57,500
Median salary % change year-on-year +4.17% +4.35% +4.55%
10th Percentile £35,000 £35,000 £33,250
90th Percentile £95,000 £90,000 £88,750
England median annual salary £52,500 £50,000 £50,000
% change year-on-year +5.00% - +5.26%

Data Engineering
Job Vacancy Trend in London

Job postings citing Data Engineering as a percentage of all IT jobs advertised in London.

Job vacancy trend for Data Engineering in London

Data Engineering
Salary Trend in London

This chart provides the 3-month moving average for salaries quoted in permanent IT jobs citing Data Engineering in London.

Salary trend for Data Engineering in London

Data Engineering
Salary Histogram in London

The salary distribution of IT jobs citing Data Engineering in London over the 6 months to 13 December 2018.

Salary histogram for Data Engineering in London

Data Engineering
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineering within the London region over the 6 months to 13 December 2018. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
Central London +13 66 £67,500 -25.00% 21
West London +20 8 £80,000 -15.79% 10
North London +17 7 £80,000 +23.08%
East London +8 2 £68,750 -2.48% 2
Data Engineering
England

For the 6 months to 13 December 2018, IT jobs citing Data Engineering also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the London region with a requirement for Data Engineering.

1 254 (63.50%) Python
2 229 (57.25%) SQL
3 179 (44.75%) Big Data
4 178 (44.50%) Analytics
5 165 (41.25%) Data Science
6 158 (39.50%) Hadoop
7 153 (38.25%) ETL
8 140 (35.00%) Apache Spark
9 137 (34.25%) Machine Learning
10 136 (34.00%) Amazon AWS
11 132 (33.00%) Data Warehouse
12 114 (28.50%) Agile Software Development
13 112 (28.00%) Data Modelling
13 112 (28.00%) Java
14 110 (27.50%) Business Intelligence
15 105 (26.25%) Scala
16 103 (25.75%) Microsoft Azure
17 91 (22.75%) Linux
18 85 (21.25%) NoSQL
19 80 (20.00%) Kafka
20 77 (19.25%) Analytical Skills
21 71 (17.75%) Apache Hive
22 70 (17.50%) Finance
23 69 (17.25%) Artificial Intelligence
24 68 (17.00%) Relational Database
25 60 (15.00%) Software Engineering
25 60 (15.00%) Microsoft
26 56 (14.00%) Visualisation
26 56 (14.00%) Use Case
27 55 (13.75%) Computer Science

Data Engineering
Co-occurring IT Skills in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 140 (35.00%) Apache Spark
2 50 (12.50%) Apache
3 18 (4.50%) Apache Pig
4 12 (3.00%) SAS
5 10 (2.50%) Apache Airflow
5 10 (2.50%) CMS
5 10 (2.50%) Hyperledger
6 9 (2.25%) Apache Solr
6 9 (2.25%) Elasticsearch
7 6 (1.50%) Luigi
8 5 (1.25%) WebSphere
9 2 (0.50%) Jupyter
9 2 (0.50%) Tornado
10 1 (0.25%) Confluence
10 1 (0.25%) NServiceBus
10 1 (0.25%) SharePoint
Applications
1 22 (5.50%) MS Visio
2 8 (2.00%) SPSS
Business Applications
1 5 (1.25%) Magento
2 2 (0.50%) NetSuite
3 1 (0.25%) Odoo
Cloud Services
1 136 (34.00%) Amazon AWS
2 103 (25.75%) Microsoft Azure
3 53 (13.25%) Google Cloud Platform
4 37 (9.25%) Serverless
5 28 (7.00%) Azure Data Factory
6 19 (4.75%) AWS Lambda
7 17 (4.25%) Cloud Computing
8 16 (4.00%) Amazon EC2
9 14 (3.50%) Amazon S3
10 13 (3.25%) Azure Functions
11 10 (2.50%) Amazon EMR
11 10 (2.50%) Amazon Kinesis
12 8 (2.00%) Data Lake Analytics
12 8 (2.00%) PaaS
13 7 (1.75%) SaaS
14 6 (1.50%) Google Analytics
15 5 (1.25%) GitHub
16 4 (1.00%) AWS CloudFormation
16 4 (1.00%) Azure Machine Learning
16 4 (1.00%) Cortana Intelligence Suite
Communications & Networking
1 9 (2.25%) HTTP
2 1 (0.25%) 5G
2 1 (0.25%) SMS
Database & Business Intelligence
1 179 (44.75%) Big Data
2 158 (39.50%) Hadoop
3 132 (33.00%) Data Warehouse
4 85 (21.25%) NoSQL
5 71 (17.75%) Apache Hive
6 68 (17.00%) Relational Database
7 53 (13.25%) Power BI
8 51 (12.75%) HBase
9 46 (11.50%) Data Lake
10 44 (11.00%) Apache Cassandra
11 39 (9.75%) MongoDB
12 31 (7.75%) Amazon Redshift
12 31 (7.75%) SQL Server
13 27 (6.75%) PostgreSQL
14 24 (6.00%) SQL Server Integration Services
15 21 (5.25%) Data Mining
16 20 (5.00%) QlikView
17 18 (4.50%) Cosmos DB
17 18 (4.50%) Sqoop
18 15 (3.75%) Impala
Development Applications
1 28 (7.00%) Jenkins
2 27 (6.75%) Git (software)
3 13 (3.25%) TeamCity
4 12 (3.00%) tSQLt
5 11 (2.75%) Octopus Deploy
5 11 (2.75%) Visual Studio Team System
6 8 (2.00%) JUnit
6 8 (2.00%) SpecFlow
7 5 (1.25%) SonarQube
8 4 (1.00%) Maven
8 4 (1.00%) Team Foundation Server
8 4 (1.00%) Visual Studio
9 2 (0.50%) CircleCI
9 2 (0.50%) Eclipse
9 2 (0.50%) FindBugs
9 2 (0.50%) GitLab
9 2 (0.50%) IntelliJ
9 2 (0.50%) JIRA
9 2 (0.50%) Robot Framework
9 2 (0.50%) Selenium
General
1 70 (17.50%) Finance
2 42 (10.50%) Retail
3 30 (7.50%) Banking
4 21 (5.25%) Law
4 21 (5.25%) Marketing
4 21 (5.25%) Military
5 15 (3.75%) Advertising
6 11 (2.75%) Corporate Banking
6 11 (2.75%) Front Office
6 11 (2.75%) Investment Banking
7 10 (2.50%) Games
8 6 (1.50%) Telecoms
9 3 (0.75%) Automotive
9 3 (0.75%) French Language
9 3 (0.75%) Music Industry
9 3 (0.75%) Publishing
10 2 (0.50%) Digital Economy
11 1 (0.25%) German Language
11 1 (0.25%) Italian Language
11 1 (0.25%) Spanish Language
Job Titles
1 203 (50.75%) Data Engineer
2 41 (10.25%) Developer
2 41 (10.25%) Python Engineer
3 40 (10.00%) Big Data Engineer
4 30 (7.50%) Architect
5 29 (7.25%) Data Scientist
6 25 (6.25%) Analyst
7 24 (6.00%) Data Architect
8 22 (5.50%) Hadoop Engineer
9 20 (5.00%) Consultant
10 19 (4.75%) Senior Data Engineer
11 17 (4.25%) Machine Learning Scientist
11 17 (4.25%) Senior Data Scientist
12 14 (3.50%) Data Analyst
13 13 (3.25%) Data Manager
14 12 (3.00%) Azure Engineer
15 10 (2.50%) AWS Engineer
15 10 (2.50%) Lead Developer
16 9 (2.25%) Data Consultant
17 8 (2.00%) Python Developer
Libraries, Frameworks & Software Standards
1 80 (20.00%) Kafka
2 18 (4.50%) AngularJS
2 18 (4.50%) NumPy
3 17 (4.25%) Pandas
4 15 (3.75%) Natural Language Processing
4 15 (3.75%) REST
4 15 (3.75%) TensorFlow
5 14 (3.50%) Node.js
6 13 (3.25%) JSON
6 13 (3.25%) Middleware
6 13 (3.25%) React
7 12 (3.00%) Elastic Stack
7 12 (3.00%) Web Services
8 11 (2.75%) Akka
8 11 (2.75%) Apache Drill
8 11 (2.75%) scikit-learn
8 11 (2.75%) Velocity
9 10 (2.50%) Express
9 10 (2.50%) Spark Streaming
9 10 (2.50%) SparkR
Miscellaneous
1 77 (19.25%) Analytical Skills
2 40 (10.00%) Data Structures
3 26 (6.50%) Fintech
4 24 (6.00%) Algorithms
5 13 (3.25%) Derivative
5 13 (3.25%) Greenfield Project
6 11 (2.75%) Enterprise Software
6 11 (2.75%) Semantic Web
7 10 (2.50%) Equities
8 9 (2.25%) Linked Data
9 8 (2.00%) Foreign Exchange (FX)
10 7 (1.75%) Self-Motivation
10 7 (1.75%) User Experience
11 6 (1.50%) Linux Command Line
11 6 (1.50%) Reference Data
12 4 (1.00%) Management Information System
12 4 (1.00%) Tandem
12 4 (1.00%) Virtual Team
13 3 (0.75%) Data Centre
13 3 (0.75%) Marketing Technology
Operating Systems
1 91 (22.75%) Linux
2 33 (8.25%) Unix
3 29 (7.25%) Windows
4 1 (0.25%) Android
4 1 (0.25%) Apple iOS
4 1 (0.25%) Windows Server
Processes & Methodologies
1 178 (44.50%) Analytics
2 165 (41.25%) Data Science
3 153 (38.25%) ETL
4 137 (34.25%) Machine Learning
5 114 (28.50%) Agile Software Development
6 112 (28.00%) Data Modelling
7 110 (27.50%) Business Intelligence
8 69 (17.25%) Artificial Intelligence
9 60 (15.00%) Software Engineering
10 56 (14.00%) Use Case
10 56 (14.00%) Visualisation
11 55 (13.75%) Computer Science
12 52 (13.00%) DevOps
13 46 (11.50%) Data Architecture
14 44 (11.00%) Test Automation
15 42 (10.50%) Data Analytics
16 39 (9.75%) Data Analysis
16 39 (9.75%) Data Integration
16 39 (9.75%) E-Commerce
17 38 (9.50%) Data Management
Programming Languages
1 254 (63.50%) Python
2 229 (57.25%) SQL
3 112 (28.00%) Java
4 105 (26.25%) Scala
5 44 (11.00%) R
6 27 (6.75%) C#
7 26 (6.50%) Go
8 23 (5.75%) T-SQL
9 19 (4.75%) JavaScript
10 18 (4.50%) Bash Shell
11 16 (4.00%) PowerShell
12 13 (3.25%) Ruby
12 13 (3.25%) U-SQL
13 12 (3.00%) C
14 8 (2.00%) C++
14 8 (2.00%) PL/SQL
15 6 (1.50%) Java 8
16 5 (1.25%) MATLAB
16 5 (1.25%) Perl
17 4 (1.00%) PHP
Qualifications
1 49 (12.25%) Degree
2 26 (6.50%) Microsoft Certification
3 22 (5.50%) MCSA
4 19 (4.75%) Computer Science Degree
5 18 (4.50%) PhD
6 16 (4.00%) Master's Degree
7 4 (1.00%) MCAD
7 4 (1.00%) MCDBA
7 4 (1.00%) MCSD
8 3 (0.75%) Numerate Degree
9 2 (0.50%) AWS Certification
9 2 (0.50%) DV Cleared
9 2 (0.50%) SC Cleared
9 2 (0.50%) Security Cleared
10 1 (0.25%) ISEB
Quality Assurance & Compliance
1 39 (9.75%) Data Quality
2 14 (3.50%) QA
System Software
1 35 (8.75%) Docker
2 26 (6.50%) HDFS
3 18 (4.50%) Apache Flume
4 13 (3.25%) Apache ZooKeeper
5 2 (0.50%) Active Directory
Systems Management
1 29 (7.25%) Oozie
2 22 (5.50%) Kubernetes
3 15 (3.75%) Mesos
4 8 (2.00%) Ambari
4 8 (2.00%) Hadoop YARN
5 7 (1.75%) Ansible
5 7 (1.75%) Opscode Chef
6 4 (1.00%) Kibana
7 3 (0.75%) Terraform
8 2 (0.50%) logstash
8 2 (0.50%) Puppet
9 1 (0.25%) Consul
9 1 (0.25%) Grafana
9 1 (0.25%) Graylog
9 1 (0.25%) Packer
9 1 (0.25%) Prometheus
Vendors
1 60 (15.00%) Microsoft
2 54 (13.50%) Tableau
3 45 (11.25%) Google
4 39 (9.75%) Oracle
5 24 (6.00%) Cloudera
6 23 (5.75%) WorldPay
7 15 (3.75%) Hortonworks
7 15 (3.75%) MapR
8 11 (2.75%) Informatica
9 10 (2.50%) SAP
10 9 (2.25%) Salesforce.com
10 9 (2.25%) Sybase
11 7 (1.75%) Databricks
11 7 (1.75%) Netezza
12 6 (1.50%) Algorithmics
12 6 (1.50%) Facebook
12 6 (1.50%) Talend
13 5 (1.25%) hybris
13 5 (1.25%) RapidMiner
13 5 (1.25%) Teradata