Data Pipeline Jobs in London

Data Pipelines
England > London

The table below provides summary statistics for permanent job vacancies advertised in London requiring Data Pipeline skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited Data Pipeline over the 6 months leading up to 1 May 2025, comparing them to the same period in the previous two years.

6 months to
1 May 2025
Same period 2024 Same period 2023
Rank 160 172 221
Rank change year-on-year +12 +49 -50
Permanent jobs citing Data Pipeline 281 431 597
As % of all permanent jobs advertised in London 2.21% 1.82% 1.68%
As % of the Processes & Methodologies category 2.30% 2.00% 1.76%
Number of salaries quoted 151 263 438
10th Percentile £52,500 £52,500 £56,250
25th Percentile £60,000 £62,500 £63,750
Median annual salary (50th Percentile) £85,000 £75,000 £80,000
Median % change year-on-year +13.33% -6.25% +3.23%
75th Percentile £100,000 £100,000 £95,000
90th Percentile £125,000 £119,500 £106,625
England median annual salary £70,000 £67,500 £69,447
% change year-on-year +3.70% -2.80% -7.40%

All Process and Methodology Skills
London

Data Pipeline falls under the Processes and Methodologies category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring process or methodology skills in London.

Permanent vacancies with a requirement for process or methodology skills 12,232 21,572 33,876
As % of all permanent jobs advertised in London 96.04% 91.33% 95.39%
Number of salaries quoted 7,456 16,081 24,248
10th Percentile £42,500 £38,000 £43,750
25th Percentile £56,250 £52,475 £55,000
Median annual salary (50th Percentile) £75,000 £71,000 £75,000
Median % change year-on-year +5.63% -5.33% +7.14%
75th Percentile £100,000 £95,000 £95,000
90th Percentile £123,750 £115,000 £115,000
England median annual salary £57,500 £55,000 £62,500
% change year-on-year +4.55% -12.00% +4.17%

Data Pipeline
Job Vacancy Trend in London

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Pipeline in London

Data Pipeline
Salary Trend in London

3-month moving average salary quoted in jobs citing Data Pipeline in London.

Salary trend for Data Pipeline in London

Data Pipeline
Salary Histogram in London

Salary distribution for jobs citing Data Pipeline in London over the 6 months to 1 May 2025.

Salary histogram for Data Pipeline in London

Data Pipeline
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Pipeline within the London region over the 6 months to 1 May 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
Central London +22 68 £72,500 +3.57% 16
South London -1 3 £61,250 -5.77% 3
West London +43 1 £62,500 - 10
Data Pipeline
England

Data Pipeline
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 44 (15.66%) Apache Spark
2 33 (11.74%) Apache Airflow
3 10 (3.56%) Apache
4 6 (2.14%) Luigi
5 1 (0.36%) Jupyter
5 1 (0.36%) SAS
Applications
1 4 (1.42%) Microsoft Excel
2 1 (0.36%) Microsoft Office
Business Applications
1 4 (1.42%) NetSuite
2 1 (0.36%) Aladdin
2 1 (0.36%) Carpe Diem
2 1 (0.36%) Elite 3E
2 1 (0.36%) Endur
2 1 (0.36%) SAP FI
Cloud Services
1 119 (42.35%) Azure
2 77 (27.40%) AWS
3 44 (15.66%) Power Platform
4 43 (15.30%) Azure Data Factory
5 39 (13.88%) GCP
6 35 (12.46%) Azure Synapse Analytics
7 33 (11.74%) Serverless
8 31 (11.03%) dbt
9 23 (8.19%) Amazon S3
10 20 (7.12%) Snowflake
11 16 (5.69%) Azure DevOps
12 14 (4.98%) GitHub
13 13 (4.63%) Azure Functions
14 12 (4.27%) AWS Lambda
15 11 (3.91%) Cloud Computing
15 11 (3.91%) Microsoft Purview
16 10 (3.56%) Azure Logic Apps
16 10 (3.56%) SaaS
17 9 (3.20%) Amazon Kinesis
18 8 (2.85%) AWS Step Functions
Communications & Networking
1 13 (4.63%) HTTP
Database & Business Intelligence
1 64 (22.78%) Data Warehouse
2 46 (16.37%) Data Lake
3 44 (15.66%) Tableau
4 42 (14.95%) Power BI
5 40 (14.23%) NoSQL
6 38 (13.52%) SQL Server
7 28 (9.96%) Big Data
8 21 (7.47%) Relational Database
9 20 (7.12%) Amazon Redshift
9 20 (7.12%) BigQuery
10 18 (6.41%) Hadoop
11 15 (5.34%) Metadata
11 15 (5.34%) SQL Server Integration Services
12 13 (4.63%) Apache Hive
13 11 (3.91%) Delta Lake
13 11 (3.91%) Looker
13 11 (3.91%) PostgreSQL
14 8 (2.85%) Amazon QuickSight
14 8 (2.85%) Neo4j
14 8 (2.85%) Spark SQL
Development Applications
1 69 (24.56%) Git
2 8 (2.85%) CircleCI
2 8 (2.85%) Jenkins
3 5 (1.78%) JIRA
4 4 (1.42%) JMeter
4 4 (1.42%) Locust
4 4 (1.42%) Postman
4 4 (1.42%) Robot Framework
4 4 (1.42%) Selenium
5 3 (1.07%) MLflow
5 3 (1.07%) Visual Studio
6 2 (0.71%) Artifactory
6 2 (0.71%) GitLab
6 2 (0.71%) Oracle Forms
7 1 (0.36%) Atlassian Bamboo
7 1 (0.36%) kappa
7 1 (0.36%) Octopus Deploy
7 1 (0.36%) SpecFlow
General
1 99 (35.23%) Social Skills
2 87 (30.96%) Finance
3 83 (29.54%) Analytical Skills
4 37 (13.17%) Retail
5 21 (7.47%) Banking
6 19 (6.76%) Marketing
7 16 (5.69%) Manufacturing
7 16 (5.69%) Public Sector
8 14 (4.98%) Law
9 13 (4.63%) Electronics
9 13 (4.63%) Inclusion and Diversity
10 12 (4.27%) Front Office
10 12 (4.27%) Presentation Skills
11 7 (2.49%) Retail Banking
12 6 (2.14%) Agriculture
13 5 (1.78%) Legal
13 5 (1.78%) Telecoms
14 4 (1.42%) Games
15 3 (1.07%) Billing
15 3 (1.07%) Investment Banking
Job Titles
1 110 (39.15%) Data Engineer
2 90 (32.03%) Senior
3 40 (14.23%) Senior Data Engineer
4 38 (13.52%) Analyst
5 37 (13.17%) Lead
6 36 (12.81%) Developer
7 30 (10.68%) Data Analyst
8 28 (9.96%) Senior Analyst
9 26 (9.25%) Senior Data Analyst
10 23 (8.19%) Azure Engineer
11 18 (6.41%) Azure Data Engineer
12 14 (4.98%) Python Developer
12 14 (4.98%) Python Engineer
13 13 (4.63%) Architect
14 12 (4.27%) Lead Data Engineer
15 10 (3.56%) Python Data Engineer
16 9 (3.20%) Senior Developer
16 9 (3.20%) Software Engineer
17 8 (2.85%) Reliability Engineer
17 8 (2.85%) Systems Engineer
Libraries, Frameworks & Software Standards
1 38 (13.52%) PySpark
2 29 (10.32%) Kafka
3 18 (6.41%) JSON
3 18 (6.41%) Pandas
4 17 (6.05%) React
5 14 (4.98%) GraphQL
6 13 (4.63%) Flask
6 13 (4.63%) REST
7 10 (3.56%) pytest
7 10 (3.56%) RESTful
8 8 (2.85%) AngularJS
8 8 (2.85%) Redux
8 8 (2.85%) Spark Streaming
8 8 (2.85%) YAML
9 7 (2.49%) .NET
9 7 (2.49%) NumPy
9 7 (2.49%) Plotly
10 6 (2.14%) scikit-learn
11 5 (1.78%) Scrapy
11 5 (1.78%) TensorFlow
Miscellaneous
1 27 (9.61%) Product Ownership
2 20 (7.12%) Data Structures
3 15 (5.34%) Cloud Native
4 10 (3.56%) Distributed Applications
5 9 (3.20%) Distributed Systems
5 9 (3.20%) Greenfield Project
6 8 (2.85%) Linux Command Line
6 8 (2.85%) Robotics
6 8 (2.85%) SCADA
7 7 (2.49%) Distributed Computing
8 6 (2.14%) Algorithms
8 6 (2.14%) FMCG
8 6 (2.14%) Legacy Systems
9 5 (1.78%) Management Information System
10 4 (1.42%) Hedge funds
11 2 (0.71%) Data Protection Act
11 2 (0.71%) Derivative
11 2 (0.71%) Low-Code
11 2 (0.71%) Reference Data
11 2 (0.71%) Video\Live Streaming
Operating Systems
1 11 (3.91%) Linux
2 4 (1.42%) Windows
3 3 (1.07%) VMS
Processes & Methodologies
1 145 (51.60%) Analytics
2 129 (45.91%) ETL
3 107 (38.08%) Data Engineering
3 107 (38.08%) Problem-Solving
4 90 (32.03%) CI/CD
5 88 (31.32%) Visualisation
6 80 (28.47%) Data Modelling
7 59 (21.00%) Machine Learning
8 56 (19.93%) Data Science
9 55 (19.57%) DevOps
10 50 (17.79%) Data Governance
11 48 (17.08%) Agile
12 45 (16.01%) Data Visualisation
13 44 (15.66%) Mentoring
14 43 (15.30%) Artificial Intelligence
15 42 (14.95%) Computer Science
16 41 (14.59%) Business Intelligence
17 39 (13.88%) Decision-Making
17 39 (13.88%) Root Cause Analysis
18 37 (13.17%) Software Engineering
Programming Languages
1 213 (75.80%) Python
2 205 (72.95%) SQL
3 24 (8.54%) Java
4 19 (6.76%) Scala
5 15 (5.34%) R
6 13 (4.63%) Bash
7 12 (4.27%) C#
7 12 (4.27%) JavaScript
8 9 (3.20%) PowerShell
9 8 (2.85%) C
9 8 (2.85%) Data Analysis Expressions
9 8 (2.85%) SPARQL
9 8 (2.85%) T-SQL
10 6 (2.14%) Bicep
11 5 (1.78%) Shell Script
12 3 (1.07%) C++
12 3 (1.07%) Cypher
12 3 (1.07%) Go
13 2 (0.71%) Rust
14 1 (0.36%) Kusto Query Language
Qualifications
1 65 (23.13%) Degree
2 32 (11.39%) Computer Science Degree
2 32 (11.39%) Security Cleared
3 29 (10.32%) SC Cleared
4 27 (9.61%) DBS Check
5 17 (6.05%) Master's Degree
6 14 (4.98%) Numerate Degree
7 11 (3.91%) PhD
8 9 (3.20%) Azure Certification
9 8 (2.85%) DV Cleared
10 4 (1.42%) AWS Certification
10 4 (1.42%) ISTQB
11 2 (0.71%) SnowPro
12 1 (0.36%) AWS Certified Solutions Architect
12 1 (0.36%) ITIL Certification
12 1 (0.36%) Microsoft Certification
Quality Assurance & Compliance
1 44 (15.66%) Data Quality
2 9 (3.20%) QA
3 8 (2.85%) Accessibility
3 8 (2.85%) SLA
4 3 (1.07%) GDPR
5 1 (0.36%) EU AI Act
5 1 (0.36%) ISO/IEC 27001
5 1 (0.36%) NCSC
5 1 (0.36%) NIST
5 1 (0.36%) SOC 2
System Software
1 44 (15.66%) Docker
2 5 (1.78%) Apache Flume
3 3 (1.07%) Virtual Machines
4 2 (0.71%) Active Directory
Systems Management
1 40 (14.23%) Kubernetes
2 33 (11.74%) Terraform
3 6 (2.14%) Grafana
3 6 (2.14%) Prometheus
4 5 (1.78%) Oozie
5 3 (1.07%) Packer
6 2 (0.71%) ITRS Geneos
6 2 (0.71%) Nagios
7 1 (0.36%) Ansible
7 1 (0.36%) Argo
Vendors
1 95 (33.81%) Databricks
2 40 (14.23%) Microsoft
3 18 (6.41%) Google
4 8 (2.85%) Palantir
5 6 (2.14%) Oracle
5 6 (2.14%) SAP
6 5 (1.78%) Cloudera
6 5 (1.78%) Foundry
7 4 (1.42%) Adobe
7 4 (1.42%) TikTok
8 3 (1.07%) Amplitude
8 3 (1.07%) Salesforce
8 3 (1.07%) Snowplow
8 3 (1.07%) Talend
9 2 (0.71%) SolarWinds
9 2 (0.71%) Teradata
10 1 (0.36%) Charles River
10 1 (0.36%) Informatica
10 1 (0.36%) OpenLink
10 1 (0.36%) SimCorp