Data Pipeline Jobs in the UK excluding London

Data Pipelines
UK > UK excluding London

The following table provides summary statistics for permanent job vacancies advertised in the UK excluding London with a requirement for Data Pipeline skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Pipeline over the 6 months to 18 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
18 May 2024
Same period 2023 Same period 2022
Rank 264 288 297
Rank change year-on-year +24 +9 +125
Permanent jobs citing Data Pipeline 752 655 847
As % of all permanent jobs advertised in the UK excluding London 1.05% 1.11% 1.18%
As % of the Processes & Methodologies category 1.26% 1.16% 1.25%
Number of salaries quoted 370 294 404
10th Percentile £35,000 £41,250 £42,500
25th Percentile £42,500 £47,000 £50,000
Median annual salary (50th Percentile) £60,000 £60,000 £65,000
Median % change year-on-year - -7.69% +8.33%
75th Percentile £73,625 £77,715 £87,500
90th Percentile £87,500 £85,875 -
UK median annual salary £67,500 £69,447 £75,000
% change year-on-year -2.80% -7.40% +15.38%

All Process and Methodology Skills
UK excluding London

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in the UK excluding London with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 59,837 56,365 67,584
As % of all permanent jobs advertised in the UK excluding London 83.55% 95.59% 94.14%
Number of salaries quoted 41,306 29,082 41,028
10th Percentile £27,250 £30,500 £30,000
25th Percentile £36,250 £40,000 £38,750
Median annual salary (50th Percentile) £50,000 £55,000 £52,500
Median % change year-on-year -9.09% +4.76% +9.38%
75th Percentile £65,000 £70,000 £67,500
90th Percentile £77,500 £82,500 £80,000
UK median annual salary £55,000 £61,180 £60,000
% change year-on-year -10.10% +1.97% +9.09%

Data Pipeline
Job Vacancy Trend in the UK excluding London

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in the UK excluding London.

Job vacancy trend for Data Pipeline in the UK excluding London

Data Pipeline
Salary Trend in the UK excluding London

3-month moving average salary quoted in jobs citing Data Pipeline in the UK excluding London.

Salary trend for Data Pipeline in the UK excluding London

Data Pipeline
Salary Histogram in the UK excluding London

Salary distribution for jobs citing Data Pipeline in the UK excluding London over the 6 months to 18 May 2024.

Salary histogram for Data Pipeline in the UK excluding London

Data Pipeline
Job Locations in the UK excluding London

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Pipeline within the UK excluding London region over the 6 months to 18 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
North of England +19 231 £50,750 -15.42% 42
Scotland +38 187 £67,000 +5.10% 16
North West +65 145 £47,500 -5.00% 19
Midlands +24 111 £52,250 -9.13% 25
South East +24 105 £67,500 +15.40% 68
South West -65 71 £67,500 -1.46% 22
West Midlands +15 59 £60,000 - 21
East Midlands +24 52 £40,000 -27.27% 4
Yorkshire -43 45 £57,500 -14.27% 19
North East +31 41 £52,500 +34.62% 4
East of England +20 29 £58,750 -7.84% 9
Wales +13 19 £46,131 -14.97% 7
Northern Ireland +10 3 £60,000 -7.69% 9
Data Pipeline
UK

Data Pipeline
Co-occurring Skills and Capabilities in the UK excluding London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 67 (8.91%) Apache Spark
2 44 (5.85%) Apache
3 16 (2.13%) Apache Airflow
4 2 (0.27%) SharePoint
5 1 (0.13%) Apache Synapse
5 1 (0.13%) Confluence
5 1 (0.13%) Luigi
5 1 (0.13%) SAS
Applications
1 7 (0.93%) Microsoft Excel
Business Applications
1 1 (0.13%) Salesforce CRM
1 1 (0.13%) SAP S/4HANA
Cloud Services
1 251 (33.38%) Azure
2 234 (31.12%) GCP
3 213 (28.32%) AWS
4 131 (17.42%) Power Platform
5 110 (14.63%) Snowflake
6 102 (13.56%) Azure Data Factory
7 55 (7.31%) Matillion
8 49 (6.52%) Cloud Computing
9 39 (5.19%) Azure Synapse Analytics
10 36 (4.79%) Serverless
11 30 (3.99%) Azure Cosmos DB
12 26 (3.46%) dbt
13 22 (2.93%) Azure DevOps
14 20 (2.66%) Amazon S3
15 17 (2.26%) GitHub
16 15 (1.99%) AWS Lambda
17 14 (1.86%) Fivetran
18 12 (1.60%) SaaS
19 10 (1.33%) Google Kubernetes Engine
19 10 (1.33%) PaaS
Communications & Networking
1 65 (8.64%) Kerberos
2 18 (2.39%) DSL
3 7 (0.93%) Firewall
4 2 (0.27%) Intrusion Detection
4 2 (0.27%) VPN
5 1 (0.13%) 3GPP
5 1 (0.13%) 5G
Database & Business Intelligence
1 233 (30.98%) Data Warehouse
2 193 (25.66%) BigQuery
3 167 (22.21%) Data Lake
4 165 (21.94%) Looker
5 128 (17.02%) Power BI
6 97 (12.90%) Metadata
7 89 (11.84%) SQL Server
8 83 (11.04%) Big Data
9 63 (8.38%) NoSQL
10 58 (7.71%) Tableau
11 55 (7.31%) SQL Server Integration Services
12 35 (4.65%) Azure SQL Data Warehouse
12 35 (4.65%) Star Schema
13 34 (4.52%) Amazon Redshift
14 31 (4.12%) Elasticsearch
15 23 (3.06%) Hadoop
16 21 (2.79%) Azure SQL Database
16 21 (2.79%) PostgreSQL
17 20 (2.66%) MongoDB
17 20 (2.66%) Relational Database
Development Applications
1 119 (15.82%) Git
2 88 (11.70%) Jenkins
3 66 (8.78%) Bitbucket
4 65 (8.64%) Artifactory
5 40 (5.32%) GitLab
6 7 (0.93%) Oracle Forms
6 7 (0.93%) Spinnaker
7 6 (0.80%) RStudio
8 5 (0.66%) GDB
9 3 (0.40%) Octopus Deploy
10 2 (0.27%) TeamCity
10 2 (0.27%) Visual Studio
10 2 (0.27%) Visual Studio Team System
11 1 (0.13%) Cucumber
11 1 (0.13%) ERwin
11 1 (0.13%) JIRA
11 1 (0.13%) Selenium
General
1 261 (34.71%) Analytical Skills
2 233 (30.98%) Finance
3 171 (22.74%) Inclusion and Diversity
4 153 (20.35%) Law
5 131 (17.42%) Social Skills
6 113 (15.03%) Marketing
7 61 (8.11%) Banking
8 48 (6.38%) Presentation Skills
9 46 (6.12%) Legal
10 43 (5.72%) Retail
11 27 (3.59%) Public Sector
12 19 (2.53%) Financial Institution
12 19 (2.53%) Investment Banking
13 12 (1.60%) Billing
13 12 (1.60%) Games
14 8 (1.06%) Back Office
15 7 (0.93%) Telecoms
16 4 (0.53%) Advertising
16 4 (0.53%) Agriculture
16 4 (0.53%) Tech for Good
Job Titles
1 422 (56.12%) Data Engineer
2 160 (21.28%) Platform Engineer
3 159 (21.14%) Principal Engineer
4 158 (21.01%) Principal Data Engineer
5 125 (16.62%) Senior
6 121 (16.09%) Software Engineer
7 114 (15.16%) Lead
8 66 (8.78%) Lead Software Engineer
9 59 (7.85%) Developer
10 47 (6.25%) Senior Software Engineer
11 45 (5.98%) Senior Data Engineer
12 39 (5.19%) Architect
12 39 (5.19%) AWS Engineer
12 39 (5.19%) Data Architect
12 39 (5.19%) Software Engineering Director
13 37 (4.92%) Analyst
14 34 (4.52%) AWS Software Engineer
14 34 (4.52%) Lead Data Engineer
15 27 (3.59%) Data Analyst
16 22 (2.93%) Data Manager
Libraries, Frameworks & Software Standards
1 71 (9.44%) RESTful
2 70 (9.31%) JSON
2 70 (9.31%) XML
3 68 (9.04%) Web Services
4 65 (8.64%) JSON-LD
4 65 (8.64%) LDAP
4 65 (8.64%) OpenID
4 65 (8.64%) SAML
5 44 (5.85%) Kafka
6 23 (3.06%) Pandas
7 21 (2.79%) Apache NiFi
8 18 (2.39%) PySpark
9 13 (1.73%) XGBoost
10 10 (1.33%) REST
11 8 (1.06%) Apache Beam
12 6 (0.80%) Flask
12 6 (0.80%) PyTorch
12 6 (0.80%) TensorFlow
13 5 (0.66%) Django
13 5 (0.66%) FastAPI
Miscellaneous
1 194 (25.80%) Self-Motivation
2 93 (12.37%) Management Information System
3 72 (9.57%) Data Structures
4 65 (8.64%) Enterprise Cloud
4 65 (8.64%) Reference Data
5 55 (7.31%) Algorithms
6 52 (6.91%) Cloud Native
7 50 (6.65%) Onboarding
8 46 (6.12%) Product Ownership
9 27 (3.59%) Public Cloud
10 23 (3.06%) Taxonomies
11 10 (1.33%) IoT
12 8 (1.06%) Renewable Energy
13 7 (0.93%) Enterprise Software
14 6 (0.80%) Analytical Mindset
14 6 (0.80%) Client/Server
14 6 (0.80%) Data Centre
15 5 (0.66%) Replication
16 4 (0.53%) Clustering
16 4 (0.53%) PMI
Operating Systems
1 17 (2.26%) Linux
2 7 (0.93%) Unix
3 1 (0.13%) Windows
Processes & Methodologies
1 425 (56.52%) Agile
2 350 (46.54%) Data Engineering
3 295 (39.23%) ETL
3 295 (39.23%) Problem-Solving
4 285 (37.90%) Data Modelling
5 279 (37.10%) Data Science
6 253 (33.64%) CI/CD
7 246 (32.71%) Analytics
8 210 (27.93%) DevOps
9 207 (27.53%) Mentoring
10 189 (25.13%) Machine Learning
11 185 (24.60%) Platform Engineering
12 184 (24.47%) Software Engineering
13 175 (23.27%) Visualisation
14 167 (22.21%) Business Intelligence
15 165 (21.94%) DataOps
16 159 (21.14%) Data Analysis
17 151 (20.08%) Change Management
18 142 (18.88%) Data Transformation
19 136 (18.09%) SDLC
Programming Languages
1 400 (53.19%) SQL
2 333 (44.28%) Python
3 85 (11.30%) Java
4 72 (9.57%) Go
5 65 (8.64%) Prolog
5 65 (8.64%) SPARQL
6 60 (7.98%) Scala
7 52 (6.91%) T-SQL
8 21 (2.79%) PL/SQL
9 16 (2.13%) C#
10 13 (1.73%) R
11 8 (1.06%) Data Analysis Expressions
12 7 (0.93%) JavaScript
12 7 (0.93%) Kotlin
13 4 (0.53%) C
14 3 (0.40%) PowerShell
15 1 (0.13%) Kusto Query Language
15 1 (0.13%) TypeScript
Qualifications
1 74 (9.84%) Degree
2 56 (7.45%) DBS Check
3 31 (4.12%) Computer Science Degree
4 19 (2.53%) Security Cleared
5 18 (2.39%) Master's Degree
6 13 (1.73%) Azure Certification
6 13 (1.73%) DV Cleared
7 12 (1.60%) SC Cleared
8 8 (1.06%) Microsoft Certification
9 4 (0.53%) PMI Certification
10 3 (0.40%) AWS Certification
10 3 (0.40%) AWS Certified Solutions Architect
11 1 (0.13%) Numerate Degree
Quality Assurance & Compliance
1 172 (22.87%) GDPR
2 107 (14.23%) Data Quality
3 19 (2.53%) SLA
4 6 (0.80%) QA
5 5 (0.66%) Accessibility
6 3 (0.40%) ISO/IEC 27001
7 1 (0.13%) California Consumer Privacy Act
7 1 (0.13%) HIPAA
7 1 (0.13%) NCSC
System Software
1 67 (8.91%) Active Directory
2 13 (1.73%) Docker
3 2 (0.27%) Virtual Machines
4 1 (0.13%) HDFS
Systems Management
1 47 (6.25%) Kubernetes
2 19 (2.53%) Terraform
3 3 (0.40%) Ansible
Vendors
1 196 (26.06%) Databricks
2 186 (24.73%) Google
3 92 (12.23%) Microsoft
4 31 (4.12%) Oracle
5 26 (3.46%) Alteryx
6 18 (2.39%) Cognos
6 18 (2.39%) Sybase
7 13 (1.73%) Informatica
8 8 (1.06%) Teradata
9 7 (0.93%) Confluent
9 7 (0.93%) YouTube
10 6 (0.80%) Dataiku
10 6 (0.80%) F5
11 5 (0.66%) SAP
11 5 (0.66%) Talend
12 3 (0.40%) SnapLogic
12 3 (0.40%) Twitter
13 2 (0.27%) Sage
13 2 (0.27%) Salesforce
13 2 (0.27%) Splunk