Data Pipeline Jobs

Data Pipelines
UK

The table below provides summary statistics for permanent job vacancies requiring Data Pipeline skills. It includes a benchmarking guide to the annual salaries offered in vacancies that cited Data Pipeline over the 6 months leading up to 20 July 2025, comparing them to the same period in the previous two years.

6 months to
20 Jul 2025
Same period 2024 Same period 2023
Rank 265 251 278
Rank change year-on-year -14 +27 -65
Permanent jobs citing Data Pipeline 659 1,084 1,055
As % of all permanent jobs advertised in the UK 1.09% 1.10% 1.26%
As % of the Processes & Methodologies category 1.21% 1.34% 1.33%
Number of salaries quoted 401 536 689
10th Percentile £45,750 £45,625 £47,500
25th Percentile £53,750 £55,105 £56,250
Median annual salary (50th Percentile) £70,000 £70,000 £70,000
Median % change year-on-year - - -6.67%
75th Percentile £91,000 £88,063 £87,419
90th Percentile £108,000 £103,875 £100,000
UK excluding London median annual salary £61,250 £65,000 £65,000
% change year-on-year -5.77% - -7.14%

All Process and Methodology Skills
UK

Data Pipeline falls under the Processes and Methodologies category. For comparison with the information above, the following table provides summary statistics for all permanent job vacancies requiring process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 54,360 81,092 79,587
As % of all permanent jobs advertised in the UK 89.67% 82.43% 95.42%
Number of salaries quoted 28,612 54,662 51,305
10th Percentile £27,500 £30,000 £33,750
25th Percentile £37,733 £40,000 £45,000
Median annual salary (50th Percentile) £55,000 £55,000 £60,249
Median % change year-on-year - -8.71% +0.42%
75th Percentile £75,000 £72,702 £80,000
90th Percentile £95,000 £92,750 £100,000
UK excluding London median annual salary £50,000 £50,000 £55,000
% change year-on-year - -9.09% +4.76%

Data Pipeline
Job Vacancy Trend

Job postings citing Data Pipeline as a proportion of all IT jobs advertised.

Job vacancy trend for Data Pipeline in the UK

Data Pipeline
Salary Trend

3-month moving average salary quoted in jobs citing Data Pipeline.

Salary trend for Data Pipeline in the UK

Data Pipeline
Salary Histogram

Salary distribution for jobs citing Data Pipeline over the 6 months to 20 July 2025.

Salary histogram for Data Pipeline in the UK

Data Pipeline
Top 18 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Pipeline within the UK over the 6 months to 20 July 2025. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England -17 614 £70,000 - 728
London +29 336 £85,000 +13.33% 454
UK excluding London -46 292 £61,250 -5.77% 349
Work from Home -71 190 £70,000 - 373
North of England -49 85 £64,000 +6.67% 107
South East +27 79 £71,500 +2.14% 108
Midlands +40 67 £59,000 -9.23% 44
Yorkshire +41 45 £67,500 -3.57% 38
West Midlands +52 39 £62,500 -8.58% 28
North West -70 32 £57,500 +0.88% 58
East Midlands +19 28 £45,500 -11.65% 15
South West +52 21 £57,500 -8.00% 35
East of England +6 19 £50,000 -18.37% 26
Scotland -4 15 £57,500 -14.18% 21
North East +18 8 £47,750 -36.33% 11
Northern Ireland +39 5 £55,000 -8.33% 8
Wales +11 3 £60,000 +31.68% 6
Isle of Man - 1 - -

Data Pipeline
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 98 (14.87%) Apache Spark
2 67 (10.17%) Apache Airflow
3 41 (6.22%) Apache
4 9 (1.37%) Appian
5 7 (1.06%) Luigi
6 6 (0.91%) SAS
7 2 (0.30%) Confluence
7 2 (0.30%) SharePoint
Applications
1 19 (2.88%) Microsoft Excel
2 2 (0.30%) MS Visio
3 1 (0.15%) Microsoft Office
3 1 (0.15%) Spreadsheet
Business Applications
1 6 (0.91%) SAP S/4HANA
2 3 (0.46%) NetSuite
3 2 (0.30%) Carpe Diem
3 2 (0.30%) Elite 3E
3 2 (0.30%) Oracle EBS
3 2 (0.30%) Oracle ERP
4 1 (0.15%) Aladdin
4 1 (0.15%) Dynamics NAV
4 1 (0.15%) Endur
4 1 (0.15%) Loan IQ
4 1 (0.15%) Payment Gateway
4 1 (0.15%) SAP FI
Cloud Services
1 379 (57.51%) Azure
2 274 (41.58%) AWS
3 159 (24.13%) Power Platform
4 130 (19.73%) GCP
5 121 (18.36%) Snowflake
6 103 (15.63%) Azure Data Factory
7 72 (10.93%) Azure Synapse Analytics
8 64 (9.71%) Serverless
9 59 (8.95%) Amazon S3
10 48 (7.28%) dbt
11 42 (6.37%) AWS Lambda
11 42 (6.37%) GitHub
12 40 (6.07%) Azure DevOps
13 25 (3.79%) Azure Logic Apps
14 23 (3.49%) Power Automate
15 22 (3.34%) Azure Functions
16 21 (3.19%) Amazon EC2
16 21 (3.19%) SaaS
17 18 (2.73%) Microsoft Purview
18 14 (2.12%) GitHub Actions
Communications & Networking
1 5 (0.76%) HTTP
2 3 (0.46%) DHCP
2 3 (0.46%) DNS
2 3 (0.46%) PuTTY
3 1 (0.15%) Internet
Database & Business Intelligence
1 205 (31.11%) Data Warehouse
2 144 (21.85%) Power BI
3 113 (17.15%) Data Lake
4 82 (12.44%) SQL Server
5 74 (11.23%) NoSQL
6 70 (10.62%) Big Data
7 63 (9.56%) Metadata
8 53 (8.04%) Tableau
9 51 (7.74%) Amazon Redshift
10 40 (6.07%) Hadoop
10 40 (6.07%) SQL Server Integration Services
11 37 (5.61%) BigQuery
12 36 (5.46%) Relational Database
13 33 (5.01%) SQL Server Reporting Services
14 30 (4.55%) Azure SQL Database
14 30 (4.55%) PostgreSQL
15 26 (3.95%) Amazon Athena
16 19 (2.88%) MySQL
17 18 (2.73%) Delta Lake
18 17 (2.58%) SQL Server Analysis Services
Development Applications
1 73 (11.08%) Git
2 21 (3.19%) Jenkins
3 14 (2.12%) Selenium
4 12 (1.82%) Robot Framework
5 10 (1.52%) MLflow
6 9 (1.37%) JIRA
6 9 (1.37%) Visual Studio
7 8 (1.21%) CircleCI
7 8 (1.21%) Snyk
7 8 (1.21%) SQL Server Management Studio (SSMS)
8 4 (0.61%) JMeter
8 4 (0.61%) Locust
8 4 (0.61%) Postman
8 4 (0.61%) Spinnaker
8 4 (0.61%) Terragrunt
9 3 (0.46%) ERwin
10 2 (0.30%) Artifactory
10 2 (0.30%) ER Studio
10 2 (0.30%) GitLab
10 2 (0.30%) PowerDesigner
General
1 228 (34.60%) Social Skills
2 169 (25.64%) Finance
3 140 (21.24%) Analytical Skills
4 104 (15.78%) Law
5 60 (9.10%) Marketing
6 56 (8.50%) Retail
7 51 (7.74%) Inclusion and Diversity
8 47 (7.13%) Public Sector
9 44 (6.68%) Banking
10 20 (3.03%) Manufacturing
11 16 (2.43%) Advertising
11 16 (2.43%) Presentation Skills
12 14 (2.12%) Front Office
13 13 (1.97%) Retail Banking
14 8 (1.21%) Electronics
14 8 (1.21%) Local Government
15 7 (1.06%) Pharmaceutical
16 6 (0.91%) Agriculture
16 6 (0.91%) Games
16 6 (0.91%) Telecoms
Job Titles
1 263 (39.91%) Data Engineer
2 201 (30.50%) Senior
3 113 (17.15%) Lead
4 101 (15.33%) Senior Data Engineer
5 68 (10.32%) Developer
6 64 (9.71%) Analyst
7 60 (9.10%) Architect
8 37 (5.61%) Data Architect
9 33 (5.01%) Azure Engineer
10 25 (3.79%) Data Analyst
11 23 (3.49%) Python Engineer
12 21 (3.19%) Azure Data Engineer
12 21 (3.19%) Python Developer
12 21 (3.19%) Software Engineer
13 19 (2.88%) SQL Analyst
14 18 (2.73%) AWS Engineer
15 16 (2.43%) Senior Analyst
16 15 (2.28%) Data Manager
17 14 (2.12%) React Developer
17 14 (2.12%) SQL Developer
Libraries, Frameworks & Software Standards
1 83 (12.59%) Kafka
1 83 (12.59%) PySpark
2 41 (6.22%) Pandas
3 27 (4.10%) React
4 20 (3.03%) PyTorch
4 20 (3.03%) RESTful
4 20 (3.03%) TensorFlow
5 19 (2.88%) REST
6 16 (2.43%) AngularJS
6 16 (2.43%) scikit-learn
7 14 (2.12%) pytest
8 13 (1.97%) GraphQL
9 12 (1.82%) Apache NiFi
9 12 (1.82%) NumPy
9 12 (1.82%) Spark Streaming
10 11 (1.67%) JSON
10 11 (1.67%) Plotly
10 11 (1.67%) Web Services
11 10 (1.52%) .NET
11 10 (1.52%) Flask
Miscellaneous
1 54 (8.19%) Cloud Native
2 41 (6.22%) Data Structures
3 36 (5.46%) Product Ownership
4 23 (3.49%) Distributed Systems
4 23 (3.49%) Legacy Systems
5 19 (2.88%) FMCG
6 17 (2.58%) Low-Code
7 16 (2.43%) Algorithms
8 14 (2.12%) Greenfield Project
9 13 (1.97%) Management Information System
10 12 (1.82%) Hedge funds
11 10 (1.52%) Distributed Applications
11 10 (1.52%) Onboarding
12 9 (1.37%) Linux Command Line
12 9 (1.37%) Replication
13 6 (0.91%) Reinsurance
14 5 (0.76%) Distributed Computing
14 5 (0.76%) Public Cloud
15 4 (0.61%) Distributed Architecture
15 4 (0.61%) Educational Technology
Operating Systems
1 13 (1.97%) Linux
2 4 (0.61%) Windows
3 3 (0.46%) Unix
3 3 (0.46%) VMS
Processes & Methodologies
1 326 (49.47%) ETL
2 310 (47.04%) Analytics
2 310 (47.04%) Data Engineering
3 266 (40.36%) Data Modelling
4 221 (33.54%) Problem-Solving
5 202 (30.65%) CI/CD
6 176 (26.71%) Business Intelligence
7 172 (26.10%) Data Governance
8 161 (24.43%) DevOps
9 153 (23.22%) Data Science
10 148 (22.46%) Machine Learning
11 142 (21.55%) Visualisation
12 137 (20.79%) Agile
13 130 (19.73%) Artificial Intelligence
14 123 (18.66%) Data Architecture
15 120 (18.21%) Decision-Making
16 108 (16.39%) Mentoring
17 106 (16.08%) Data Transformation
18 93 (14.11%) Software Engineering
19 91 (13.81%) Data Management
Programming Languages
1 456 (69.20%) Python
2 446 (67.68%) SQL
3 77 (11.68%) Java
4 39 (5.92%) Scala
5 34 (5.16%) C#
6 27 (4.10%) Data Analysis Expressions
7 26 (3.95%) Bash
7 26 (3.95%) JavaScript
7 26 (3.95%) T-SQL
8 24 (3.64%) R
9 17 (2.58%) PowerShell
10 12 (1.82%) TypeScript
11 10 (1.52%) Bicep
12 9 (1.37%) C++
12 9 (1.37%) SPARQL
13 7 (1.06%) Shell Script
14 6 (0.91%) PL/SQL
15 4 (0.61%) Cypher
15 4 (0.61%) Go
16 3 (0.46%) PROC SQL
Qualifications
1 143 (21.70%) Degree
2 54 (8.19%) Computer Science Degree
3 46 (6.98%) Security Cleared
4 36 (5.46%) Master's Degree
5 35 (5.31%) SC Cleared
6 18 (2.73%) PhD
7 16 (2.43%) Azure Certification
7 16 (2.43%) DBS Check
8 14 (2.12%) DV Cleared
9 11 (1.67%) AWS Certification
10 9 (1.37%) ITIL Certification
11 7 (1.06%) Microsoft Certification
12 5 (0.76%) AWS Certified Solutions Architect
12 5 (0.76%) Numerate Degree
13 4 (0.61%) AWS Certified Developer
13 4 (0.61%) ISTQB
14 3 (0.46%) PMI Certification
14 3 (0.46%) PMP
15 2 (0.30%) Tableau Certification
16 1 (0.15%) SnowPro
Quality Assurance & Compliance
1 167 (25.34%) Data Quality
2 62 (9.41%) QA
3 39 (5.92%) Accessibility
4 29 (4.40%) GDPR
5 3 (0.46%) Actionable Recommendations
5 3 (0.46%) ISO/IEC 27001
5 3 (0.46%) PCI DSS
6 2 (0.30%) Basel II
6 2 (0.30%) Basel III
6 2 (0.30%) Cyber Essentials
6 2 (0.30%) Dodd-Frank
6 2 (0.30%) HIPAA
6 2 (0.30%) IFRS
6 2 (0.30%) IFRS 9
6 2 (0.30%) SNOMED CT
6 2 (0.30%) SOC 2
7 1 (0.15%) California Consumer Privacy Act
7 1 (0.15%) Cyber Essentials PLUS
7 1 (0.15%) EU AI Act
7 1 (0.15%) NIST
System Software
1 73 (11.08%) Docker
2 8 (1.21%) Apache Flume
3 5 (0.76%) HDFS
3 5 (0.76%) VMware Infrastructure
4 4 (0.61%) Virtual Machines
5 2 (0.30%) Active Directory
Systems Management
1 77 (11.68%) Terraform
2 70 (10.62%) Kubernetes
3 18 (2.73%) Prometheus
4 15 (2.28%) Grafana
5 13 (1.97%) Ansible
6 8 (1.21%) Oozie
7 6 (0.91%) Kibana
7 6 (0.91%) Kubeflow
8 3 (0.46%) Control-M
8 3 (0.46%) logstash
8 3 (0.46%) Packer
9 2 (0.30%) ITRS Geneos
9 2 (0.30%) Nagios
Vendors
1 177 (26.86%) Databricks
2 119 (18.06%) Microsoft
3 37 (5.61%) Google
4 23 (3.49%) Oracle
5 22 (3.34%) SAP
6 16 (2.43%) Palantir
7 11 (1.67%) Splunk
8 8 (1.21%) Apple
8 8 (1.21%) BiZZdesign
8 8 (1.21%) Black Duck
8 8 (1.21%) UiPath
8 8 (1.21%) VMware
9 7 (1.06%) Informatica
10 6 (0.91%) Foundry
10 6 (0.91%) Salesforce
10 6 (0.91%) Talend
11 5 (0.76%) Cloudera
11 5 (0.76%) StreamSets
12 4 (0.61%) Alteryx
12 4 (0.61%) TikTok