Data Pipeline Jobs in London

Data Pipelines
England > London

The table below provides summary statistics for permanent job vacancies advertised in London requiring Data Pipeline skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited Data Pipeline over the 6 months leading up to 6 July 2025, comparing them to the same period in the previous two years.

6 months to
6 Jul 2025
Same period 2024 Same period 2023
Rank 142 162 233
Rank change year-on-year +20 +71 -60
Permanent jobs citing Data Pipeline 329 482 465
As % of all permanent jobs advertised in London 2.51% 2.00% 1.54%
As % of the Processes & Methodologies category 2.63% 2.23% 1.62%
Number of salaries quoted 177 262 341
10th Percentile £50,250 £55,000 £53,750
25th Percentile £62,500 £63,750 £65,000
Median annual salary (50th Percentile) £85,000 £75,000 £77,500
Median % change year-on-year +13.33% -3.23% -3.13%
75th Percentile £100,000 £100,000 £95,000
90th Percentile £136,000 £120,000 £107,500
England median annual salary £70,000 £70,000 £70,000
% change year-on-year - - -7.89%

All Process and Methodology Skills
London

Data Pipeline falls under the Processes and Methodologies category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring process or methodology skills in London.

Permanent vacancies with a requirement for process or methodology skills 12,509 21,569 28,688
As % of all permanent jobs advertised in London 95.38% 89.36% 94.81%
Number of salaries quoted 7,346 15,602 21,548
10th Percentile £41,250 £37,500 £42,500
25th Percentile £55,000 £51,250 £55,000
Median annual salary (50th Percentile) £75,000 £70,000 £75,000
Median % change year-on-year +7.14% -6.67% +7.14%
75th Percentile £100,000 £95,000 £95,000
90th Percentile £122,500 £117,500 £116,250
England median annual salary £57,000 £55,000 £62,500
% change year-on-year +3.64% -12.00% +4.17%

Data Pipeline
Job Vacancy Trend in London

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Pipeline in London

Data Pipeline
Salary Trend in London

3-month moving average salary quoted in jobs citing Data Pipeline in London.

Salary trend for Data Pipeline in London

Data Pipeline
Salary Histogram in London

Salary distribution for jobs citing Data Pipeline in London over the 6 months to 6 July 2025.

Salary histogram for Data Pipeline in London

Data Pipeline
Job Locations in London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Pipeline within the London region over the 6 months to 6 July 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
Central London +4 55 £72,500 +3.57% 269
South London -15 2 - - 4
West London +18 1 £62,500 - 24
Data Pipeline
England

Data Pipeline
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 55 (16.72%) Apache Spark
2 36 (10.94%) Apache Airflow
3 16 (4.86%) Apache
4 6 (1.82%) Luigi
5 1 (0.30%) Confluence
5 1 (0.30%) SharePoint
Applications
1 3 (0.91%) Microsoft Excel
Business Applications
1 4 (1.22%) SAP S/4HANA
2 3 (0.91%) NetSuite
3 2 (0.61%) Carpe Diem
3 2 (0.61%) Elite 3E
3 2 (0.61%) Oracle EBS
3 2 (0.61%) Oracle ERP
4 1 (0.30%) Aladdin
4 1 (0.30%) Endur
4 1 (0.30%) SAP FI
Cloud Services
1 157 (47.72%) Azure
2 114 (34.65%) AWS
3 57 (17.33%) Power Platform
4 49 (14.89%) GCP
5 43 (13.07%) Azure Data Factory
6 40 (12.16%) Serverless
7 35 (10.64%) Amazon S3
7 35 (10.64%) Snowflake
8 34 (10.33%) dbt
9 31 (9.42%) Azure Synapse Analytics
10 26 (7.90%) GitHub
11 24 (7.29%) Azure DevOps
12 20 (6.08%) AWS Lambda
12 20 (6.08%) Azure Functions
13 18 (5.47%) Azure Logic Apps
14 13 (3.95%) Cloud Computing
15 12 (3.65%) Amazon EC2
15 12 (3.65%) Amazon Kinesis
16 11 (3.34%) Microsoft Purview
17 10 (3.04%) GitHub Actions
Communications & Networking
1 5 (1.52%) HTTP
Database & Business Intelligence
1 69 (20.97%) Data Warehouse
2 53 (16.11%) Power BI
3 40 (12.16%) NoSQL
4 37 (11.25%) Data Lake
5 35 (10.64%) Big Data
6 33 (10.03%) SQL Server
7 31 (9.42%) Tableau
8 27 (8.21%) Amazon Redshift
9 25 (7.60%) Hadoop
10 24 (7.29%) Metadata
10 24 (7.29%) Relational Database
11 19 (5.78%) Amazon Athena
12 18 (5.47%) BigQuery
13 15 (4.56%) Delta Lake
14 13 (3.95%) PostgreSQL
15 12 (3.65%) Apache Iceberg
15 12 (3.65%) Looker
15 12 (3.65%) SQL Server Integration Services
16 9 (2.74%) Amazon RDS
16 9 (2.74%) Spark SQL
Development Applications
1 56 (17.02%) Git
2 15 (4.56%) Jenkins
3 8 (2.43%) CircleCI
4 5 (1.52%) MLflow
5 4 (1.22%) JIRA
5 4 (1.22%) JMeter
5 4 (1.22%) Locust
5 4 (1.22%) Postman
5 4 (1.22%) Robot Framework
5 4 (1.22%) Selenium
5 4 (1.22%) Spinnaker
5 4 (1.22%) Terragrunt
6 3 (0.91%) Visual Studio
7 2 (0.61%) Artifactory
8 1 (0.30%) GitLab
8 1 (0.30%) kappa
8 1 (0.30%) Octopus Deploy
8 1 (0.30%) SpecFlow
General
1 126 (38.30%) Finance
2 113 (34.35%) Social Skills
3 86 (26.14%) Analytical Skills
4 52 (15.81%) Law
5 36 (10.94%) Marketing
6 32 (9.73%) Inclusion and Diversity
7 30 (9.12%) Banking
8 27 (8.21%) Retail
9 23 (6.99%) Public Sector
10 14 (4.26%) Presentation Skills
11 12 (3.65%) Front Office
11 12 (3.65%) Manufacturing
12 7 (2.13%) Retail Banking
13 6 (1.82%) Agriculture
13 6 (1.82%) Games
14 5 (1.52%) Advertising
14 5 (1.52%) Electronics
14 5 (1.52%) Investment Banking
14 5 (1.52%) Telecoms
15 4 (1.22%) Music Industry
Job Titles
1 133 (40.43%) Data Engineer
2 101 (30.70%) Senior
3 55 (16.72%) Senior Data Engineer
4 50 (15.20%) Lead
5 39 (11.85%) Developer
6 36 (10.94%) Analyst
7 28 (8.51%) Azure Engineer
8 19 (5.78%) Python Developer
9 18 (5.47%) Data Analyst
9 18 (5.47%) Senior Analyst
10 17 (5.17%) Azure Data Engineer
11 16 (4.86%) Python Engineer
12 14 (4.26%) Architect
12 14 (4.26%) Senior Data Analyst
13 12 (3.65%) AWS Engineer
14 11 (3.34%) React Developer
14 11 (3.34%) Software Engineer
15 10 (3.04%) Applications Support
15 10 (3.04%) Senior Developer
15 10 (3.04%) Support Analyst
Libraries, Frameworks & Software Standards
1 57 (17.33%) PySpark
2 46 (13.98%) Kafka
3 26 (7.90%) Pandas
4 18 (5.47%) React
5 15 (4.56%) RESTful
6 13 (3.95%) AngularJS
6 13 (3.95%) pytest
7 12 (3.65%) Spark Streaming
8 10 (3.04%) Flask
8 10 (3.04%) GraphQL
8 10 (3.04%) JSON
9 9 (2.74%) REST
9 9 (2.74%) YAML
10 8 (2.43%) .NET
10 8 (2.43%) Plotly
10 8 (2.43%) TensorFlow
11 7 (2.13%) NumPy
11 7 (2.13%) PyTorch
11 7 (2.13%) scikit-learn
12 6 (1.82%) Django
Miscellaneous
1 28 (8.51%) Product Ownership
2 27 (8.21%) Data Structures
3 23 (6.99%) Cloud Native
4 17 (5.17%) FMCG
5 16 (4.86%) Distributed Systems
6 13 (3.95%) Legacy Systems
7 12 (3.65%) Greenfield Project
8 10 (3.04%) Distributed Applications
9 9 (2.74%) Algorithms
9 9 (2.74%) Linux Command Line
10 8 (2.43%) Hedge funds
11 4 (1.22%) Low-Code
11 4 (1.22%) Management Information System
11 4 (1.22%) Mobile Banking
11 4 (1.22%) Public Cloud
12 3 (0.91%) Data Protection Act
12 3 (0.91%) Distributed Computing
12 3 (0.91%) Hybrid Cloud
12 3 (0.91%) Reference Data
13 2 (0.61%) Reinsurance
Operating Systems
1 12 (3.65%) Linux
2 4 (1.22%) Windows
3 3 (0.91%) VMS
Processes & Methodologies
1 157 (47.72%) ETL
2 146 (44.38%) Analytics
3 145 (44.07%) Data Engineering
4 138 (41.95%) CI/CD
5 117 (35.56%) Data Modelling
6 114 (34.65%) Problem-Solving
7 107 (32.52%) DevOps
8 98 (29.79%) Data Science
9 89 (27.05%) Machine Learning
10 81 (24.62%) Visualisation
11 75 (22.80%) Data Governance
12 74 (22.49%) Agile
13 69 (20.97%) Decision-Making
14 64 (19.45%) Artificial Intelligence
15 56 (17.02%) Computer Science
15 56 (17.02%) Mentoring
16 52 (15.81%) Business Intelligence
17 50 (15.20%) Data Transformation
18 48 (14.59%) Software Engineering
19 47 (14.29%) Data Visualisation
Programming Languages
1 247 (75.08%) Python
2 226 (68.69%) SQL
3 33 (10.03%) Java
4 22 (6.69%) Scala
5 15 (4.56%) JavaScript
6 14 (4.26%) Bash
6 14 (4.26%) C#
7 10 (3.04%) T-SQL
8 9 (2.74%) Data Analysis Expressions
8 9 (2.74%) PowerShell
9 8 (2.43%) R
9 8 (2.43%) SPARQL
10 7 (2.13%) Bicep
11 5 (1.52%) Shell Script
12 4 (1.22%) C++
12 4 (1.22%) TypeScript
13 3 (0.91%) Cypher
14 1 (0.30%) Go
14 1 (0.30%) Kusto Query Language
14 1 (0.30%) VBA
Qualifications
1 75 (22.80%) Degree
2 35 (10.64%) Computer Science Degree
3 30 (9.12%) Security Cleared
4 26 (7.90%) SC Cleared
5 20 (6.08%) Master's Degree
6 14 (4.26%) PhD
7 13 (3.95%) DBS Check
8 10 (3.04%) Azure Certification
9 8 (2.43%) DV Cleared
10 6 (1.82%) AWS Certification
11 5 (1.52%) Numerate Degree
12 4 (1.22%) AWS Certified Developer
12 4 (1.22%) AWS Certified Solutions Architect
12 4 (1.22%) ISTQB
13 3 (0.91%) Microsoft Certification
14 2 (0.61%) SnowPro
15 1 (0.30%) ITIL Certification
Quality Assurance & Compliance
1 71 (21.58%) Data Quality
2 23 (6.99%) QA
3 5 (1.52%) GDPR
4 4 (1.22%) Accessibility
5 2 (0.61%) ISO/IEC 27001
5 2 (0.61%) SOC 2
6 1 (0.30%) Cyber Essentials
6 1 (0.30%) Cyber Essentials PLUS
6 1 (0.30%) EU AI Act
6 1 (0.30%) HIPAA
6 1 (0.30%) NIST
System Software
1 53 (16.11%) Docker
2 5 (1.52%) Apache Flume
3 3 (0.91%) Virtual Machines
4 2 (0.61%) Active Directory
Systems Management
1 55 (16.72%) Terraform
2 52 (15.81%) Kubernetes
3 12 (3.65%) Prometheus
4 9 (2.74%) Grafana
5 5 (1.52%) Ansible
5 5 (1.52%) Oozie
6 3 (0.91%) Packer
7 2 (0.61%) ITRS Geneos
7 2 (0.61%) Kubeflow
7 2 (0.61%) Nagios
Vendors
1 103 (31.31%) Databricks
2 52 (15.81%) Microsoft
3 13 (3.95%) Google
4 11 (3.34%) Palantir
5 10 (3.04%) SAP
6 8 (2.43%) Splunk
7 5 (1.52%) Cloudera
7 5 (1.52%) Foundry
8 4 (1.22%) Adobe
8 4 (1.22%) Oracle
8 4 (1.22%) Talend
8 4 (1.22%) TikTok
9 3 (0.91%) Amplitude
9 3 (0.91%) Salesforce
9 3 (0.91%) Snowplow
10 2 (0.61%) Darktrace
10 2 (0.61%) Informatica
10 2 (0.61%) Intapp
10 2 (0.61%) SolarWinds
11 1 (0.30%) Refinitiv