Data Pipeline Jobs in London

Data Pipelines
England > London

The table below provides summary statistics for permanent job vacancies advertised in London requiring Data Pipeline skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited Data Pipeline over the 6 months leading up to 26 July 2024, comparing them to the same period in the previous two years.

6 months to
26 Jul 2024
Same period 2023 Same period 2022
Rank 160 226 165
Rank change year-on-year +66 -61 +33
Permanent jobs citing Data Pipeline 431 416 2,023
As % of all permanent jobs advertised in London 2.08% 1.53% 2.70%
As % of the Processes & Methodologies category 2.32% 1.62% 2.78%
Number of salaries quoted 215 323 609
10th Percentile £60,300 £54,000 £53,650
25th Percentile £65,000 £64,375 £62,500
Median annual salary (50th Percentile) £75,000 £75,000 £80,000
Median % change year-on-year - -6.25% +6.67%
75th Percentile £101,875 £95,000 £93,750
90th Percentile £120,000 £106,250 £107,500
England median annual salary £70,000 £70,000 £77,500
% change year-on-year - -9.68% +10.71%

All Process and Methodology Skills
London

Data Pipeline falls under the Processes and Methodologies category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring process or methodology skills in London.

Permanent vacancies with a requirement for process or methodology skills 18,545 25,706 72,795
As % of all permanent jobs advertised in London 89.42% 94.78% 97.04%
Number of salaries quoted 12,808 20,124 35,328
10th Percentile £39,500 £42,500 £42,500
25th Percentile £52,500 £55,000 £53,750
Median annual salary (50th Percentile) £72,500 £74,000 £70,000
Median % change year-on-year -2.03% +5.71% -
75th Percentile £95,000 £95,000 £91,732
90th Percentile £120,000 £116,250 £110,000
England median annual salary £55,000 £62,000 £60,000
% change year-on-year -11.29% +3.33% +4.35%

Data Pipeline
Job Vacancy Trend in London

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Pipeline in London

Data Pipeline
Salary Trend in London

3-month moving average salary quoted in jobs citing Data Pipeline in London.

Salary trend for Data Pipeline in London

Data Pipeline
Salary Histogram in London

Salary distribution for jobs citing Data Pipeline in London over the 6 months to 26 July 2024.

Salary histogram for Data Pipeline in London

Data Pipeline
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Pipeline within the London region over the 6 months to 26 July 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
Central London +59 95 £70,000 -12.50% 10
South London - 13 £65,000 - 1
West London -9 4 £80,000 +6.67% 4
Data Pipeline
England

Data Pipeline
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 47 (10.90%) Apache Spark
2 35 (8.12%) Apache Airflow
3 26 (6.03%) Apache
4 7 (1.62%) SAS
5 4 (0.93%) Confluence
6 2 (0.46%) Microsoft Exchange
6 2 (0.46%) SharePoint
7 1 (0.23%) Apache Pulsar
Applications
1 14 (3.25%) Microsoft Excel
2 9 (2.09%) Microsoft Office
3 2 (0.46%) Microsoft PowerPoint
3 2 (0.46%) MS Visio
Business Applications
1 2 (0.46%) Primavera
2 1 (0.23%) Shopify
Cloud Services
1 252 (58.47%) AWS
2 142 (32.95%) Azure
3 66 (15.31%) GCP
3 66 (15.31%) Power Platform
4 59 (13.69%) Azure Data Factory
5 39 (9.05%) Serverless
6 34 (7.89%) Amazon S3
7 33 (7.66%) Azure Synapse Analytics
8 30 (6.96%) Snowflake
9 27 (6.26%) dbt
10 24 (5.57%) AWS Lambda
11 23 (5.34%) Azure DevOps
12 19 (4.41%) AWS Step Functions
13 17 (3.94%) Amazon EMR
14 15 (3.48%) PowerApps
15 14 (3.25%) Google Gemini
16 13 (3.02%) Amazon SQS
16 13 (3.02%) Cloud Computing
16 13 (3.02%) GitHub
16 13 (3.02%) Power Automate
Communications & Networking
1 1 (0.23%) Firewall
Database & Business Intelligence
1 157 (36.43%) Tableau
2 94 (21.81%) Data Warehouse
3 65 (15.08%) Power BI
4 59 (13.69%) Data Lake
5 45 (10.44%) NoSQL
6 31 (7.19%) Big Data
7 30 (6.96%) Azure SQL Database
8 23 (5.34%) BigQuery
8 23 (5.34%) PostgreSQL
9 21 (4.87%) SQL Server
10 16 (3.71%) Amazon QuickSight
10 16 (3.71%) Relational Database
11 15 (3.48%) Amazon Athena
11 15 (3.48%) Amazon Redshift
11 15 (3.48%) Elasticsearch
11 15 (3.48%) Looker
12 13 (3.02%) Metadata
12 13 (3.02%) SQL Server Integration Services
13 12 (2.78%) Data Mining
13 12 (2.78%) MongoDB
Development Applications
1 153 (35.50%) Git
2 11 (2.55%) Jenkins
3 7 (1.62%) GitLab
4 5 (1.16%) JIRA
5 4 (0.93%) Bitbucket
6 3 (0.70%) Spinnaker
6 3 (0.70%) Visual Studio
7 2 (0.46%) CircleCI
7 2 (0.46%) Flyway
7 2 (0.46%) Liquibase
7 2 (0.46%) MLflow
8 1 (0.23%) Mockito
8 1 (0.23%) Octopus Deploy
8 1 (0.23%) SpecFlow
General
1 207 (48.03%) Social Skills
2 169 (39.21%) Analytical Skills
3 126 (29.23%) Presentation Skills
4 124 (28.77%) Retail
5 64 (14.85%) Finance
6 25 (5.80%) Inclusion and Diversity
7 18 (4.18%) Law
8 14 (3.25%) Front Office
9 11 (2.55%) Banking
10 8 (1.86%) Legal
11 5 (1.16%) Influencing Skills
12 4 (0.93%) Music Industry
12 4 (0.93%) Public Sector
12 4 (0.93%) Publishing
13 3 (0.70%) Documentation Skills
13 3 (0.70%) Games
13 3 (0.70%) Health Technology
13 3 (0.70%) Local Government
14 2 (0.46%) Automotive
14 2 (0.46%) Investment Banking
Job Titles
1 191 (44.32%) Senior
2 167 (38.75%) Data Engineer
3 128 (29.70%) Analyst
3 128 (29.70%) Data Analyst
4 94 (21.81%) Senior Analyst
5 93 (21.58%) Senior Data Analyst
6 59 (13.69%) Lead
7 46 (10.67%) Senior Data Engineer
8 29 (6.73%) Azure Engineer
9 28 (6.50%) Azure Data Engineer
10 26 (6.03%) Lead Data Analyst
11 22 (5.10%) Developer
11 22 (5.10%) Engineering Manager
11 22 (5.10%) Python Engineer
12 19 (4.41%) Python Data Engineer
12 19 (4.41%) Software Engineer
13 17 (3.94%) Lead Data Engineer
14 16 (3.71%) Architect
15 15 (3.48%) Data Manager
16 14 (3.25%) Senior Manager
Libraries, Frameworks & Software Standards
1 40 (9.28%) PySpark
2 39 (9.05%) Kafka
3 29 (6.73%) React
4 16 (3.71%) PyTorch
4 16 (3.71%) TensorFlow
5 15 (3.48%) .NET
5 15 (3.48%) Apache Beam
5 15 (3.48%) Pandas
6 12 (2.78%) .NET Core
7 11 (2.55%) .NET Framework
7 11 (2.55%) Unity DI Container
8 10 (2.32%) XML
9 8 (1.86%) Lambda Expressions
10 7 (1.62%) NumPy
10 7 (1.62%) REST
11 6 (1.39%) HTML
11 6 (1.39%) XGBoost
12 5 (1.16%) JSON
12 5 (1.16%) Shiny
12 5 (1.16%) Spark Streaming
Miscellaneous
1 28 (6.50%) Data Structures
2 26 (6.03%) Algorithms
3 18 (4.18%) Onboarding
4 16 (3.71%) Hedge funds
5 15 (3.48%) Self-Motivation
6 11 (2.55%) Blog
6 11 (2.55%) Private Cloud
7 8 (1.86%) Legacy Applications
8 7 (1.62%) Derivative
8 7 (1.62%) N-Tier
9 6 (1.39%) Virtual Team
10 5 (1.16%) Cloud Native
10 5 (1.16%) Semantic Web
11 4 (0.93%) IoT
11 4 (0.93%) Management Information System
12 3 (0.70%) Distributed Systems
12 3 (0.70%) Equities
12 3 (0.70%) Fixed Income
12 3 (0.70%) Greenfield Project
13 2 (0.46%) Client/Server
Operating Systems
1 15 (3.48%) Linux
2 11 (2.55%) Unix
3 1 (0.23%) Windows
3 1 (0.23%) Windows Server
Processes & Methodologies
1 247 (57.31%) Analytics
2 192 (44.55%) Problem-Solving
3 185 (42.92%) Visualisation
4 151 (35.03%) Mathematics
5 146 (33.87%) Data Analysis
6 140 (32.48%) Statistics
7 131 (30.39%) Actionable Insight
8 121 (28.07%) Storytelling
9 111 (25.75%) ETL
10 110 (25.52%) Root Cause Analysis
11 108 (25.06%) Data Engineering
12 107 (24.83%) Business Strategy
13 106 (24.59%) Stakeholder Engagement
14 105 (24.36%) Customer Intelligence
15 102 (23.67%) Data Science
16 98 (22.74%) Data Modelling
17 81 (18.79%) Agile
17 81 (18.79%) Business Intelligence
18 66 (15.31%) Machine Learning
19 59 (13.69%) Data Architecture
Programming Languages
1 332 (77.03%) SQL
2 329 (76.33%) Python
3 62 (14.39%) Java
4 27 (6.26%) Scala
5 24 (5.57%) TypeScript
6 18 (4.18%) JavaScript
7 15 (3.48%) C#
8 14 (3.25%) R
9 13 (3.02%) PowerShell
10 11 (2.55%) Kotlin
11 10 (2.32%) Clojure
12 9 (2.09%) T-SQL
13 7 (1.62%) MATLAB
14 5 (1.16%) Data Analysis Expressions
14 5 (1.16%) Shell Script
15 3 (0.70%) Bash
15 3 (0.70%) Go
15 3 (0.70%) Rust
16 2 (0.46%) Bicep
16 2 (0.46%) PL/SQL
Qualifications
1 197 (45.71%) Degree
2 123 (28.54%) DBS Check
3 28 (6.50%) Computer Science Degree
4 26 (6.03%) Master's Degree
5 11 (2.55%) PhD
6 10 (2.32%) Security Cleared
7 8 (1.86%) SC Cleared
8 6 (1.39%) Azure Certification
9 2 (0.46%) CIMA
9 2 (0.46%) DV Cleared
10 1 (0.23%) BPSS Clearance
10 1 (0.23%) Postgraduate
10 1 (0.23%) SnowPro
Quality Assurance & Compliance
1 71 (16.47%) Data Quality
2 12 (2.78%) QA
3 9 (2.09%) GDPR
4 5 (1.16%) Accessibility
5 2 (0.46%) ISO 20022
System Software
1 21 (4.87%) Docker
2 3 (0.70%) HDFS
Systems Management
1 37 (8.58%) Kubernetes
2 18 (4.18%) Terraform
3 6 (1.39%) Ansible
3 6 (1.39%) Argo
4 3 (0.70%) Kubeflow
5 1 (0.23%) Grafana
5 1 (0.23%) Prometheus
Vendors
1 173 (40.14%) Databricks
2 49 (11.37%) Microsoft
3 26 (6.03%) Google
4 12 (2.78%) OpenAI
4 12 (2.78%) Oracle
5 7 (1.62%) Bloomberg
6 5 (1.16%) Cloudera
7 4 (0.93%) Alteryx
8 3 (0.70%) Hortonworks
8 3 (0.70%) SAP
8 3 (0.70%) Splunk
9 2 (0.46%) RedGate
9 2 (0.46%) Salesforce
9 2 (0.46%) StreamSets
10 1 (0.23%) Ab Initio
10 1 (0.23%) Brio
10 1 (0.23%) Dynatrace
10 1 (0.23%) Facebook
10 1 (0.23%) MuleSoft
10 1 (0.23%) New Relic