Data Pipeline Jobs in England

Data Pipelines
UK > England

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Data Pipeline skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Pipeline over the 6 months to 24 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
24 Apr 2024
Same period 2023 Same period 2022
Rank 241 271 222
Rank change year-on-year +30 -49 +89
Permanent jobs citing Data Pipeline 1,011 1,261 2,413
As % of all permanent jobs advertised in England 1.19% 1.34% 1.85%
As % of the Processes & Methodologies category 1.39% 1.40% 1.93%
Number of salaries quoted 630 758 999
10th Percentile £37,000 £47,000 £47,500
25th Percentile £50,021 £57,046 £57,500
Median annual salary (50th Percentile) £67,500 £69,447 £75,000
Median % change year-on-year -2.80% -7.40% +15.38%
75th Percentile £84,688 £87,500 £87,500
90th Percentile £107,500 £100,000 £97,750
UK median annual salary £67,500 £69,447 £75,000
% change year-on-year -2.80% -7.40% +15.38%

All Process and Methodology Skills
England

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 72,854 89,915 124,939
As % of all permanent jobs advertised in England 85.97% 95.66% 95.64%
Number of salaries quoted 53,893 52,961 73,929
10th Percentile £29,000 £34,250 £33,299
25th Percentile £39,750 £46,000 £44,186
Median annual salary (50th Percentile) £55,000 £62,500 £60,000
Median % change year-on-year -12.00% +4.17% +9.09%
75th Percentile £73,750 £82,500 £80,000
90th Percentile £93,750 £101,250 £97,500
UK median annual salary £55,000 £62,000 £60,000
% change year-on-year -11.29% +3.33% +9.09%

Data Pipeline
Job Vacancy Trend in England

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Pipeline in England

Data Pipeline
Salary Trend in England

3-month moving average salary quoted in jobs citing Data Pipeline in England.

Salary trend for Data Pipeline in England

Data Pipeline
Salary Histogram in England

Salary distribution for jobs citing Data Pipeline in England over the 6 months to 24 April 2024.

Salary histogram for Data Pipeline in England

Data Pipeline
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Pipeline within the England region over the 6 months to 24 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
London +33 418 £75,000 -6.25% 202
North of England +30 242 £52,500 -14.19% 35
North West +80 147 £50,000 - 21
South East +50 121 £67,500 +12.50% 28
Midlands +20 98 £51,500 -14.17% 28
South West -45 80 £67,500 +12.50% 12
West Midlands +19 58 £60,000 - 18
Yorkshire -43 51 £66,000 -1.60% 10
North East +44 44 £50,000 -22.78% 4
East Midlands +11 40 £47,500 -13.64% 10
East of England +47 32 £62,500 -3.85% 16
Data Pipeline
UK

Data Pipeline
Co-occurring Skills and Capabilities in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 122 (12.07%) Apache Spark
2 84 (8.31%) Apache
3 74 (7.32%) Apache Airflow
4 6 (0.59%) SharePoint
5 5 (0.49%) SAS
6 3 (0.30%) Microsoft Exchange
7 2 (0.20%) Luigi
8 1 (0.099%) Apache Synapse
8 1 (0.099%) Confluence
Applications
1 19 (1.88%) Microsoft Excel
2 8 (0.79%) Microsoft Office
3 3 (0.30%) Microsoft PowerPoint
3 3 (0.30%) MS Visio
Business Applications
1 4 (0.40%) Primavera
2 1 (0.099%) Salesforce CRM
2 1 (0.099%) SAP S/4HANA
2 1 (0.099%) Shopify
Cloud Services
1 404 (39.96%) Azure
2 337 (33.33%) AWS
3 329 (32.54%) GCP
4 197 (19.49%) Power Platform
5 144 (14.24%) Snowflake
6 138 (13.65%) Azure Data Factory
7 85 (8.41%) Serverless
8 68 (6.73%) Amazon S3
9 63 (6.23%) dbt
10 58 (5.74%) Matillion
11 55 (5.44%) Azure Synapse Analytics
12 52 (5.14%) GitHub
13 39 (3.86%) AWS Lambda
14 37 (3.66%) Azure Cosmos DB
15 34 (3.36%) Azure DevOps
16 26 (2.57%) GitHub Actions
17 21 (2.08%) Amazon EMR
18 19 (1.88%) PowerApps
19 18 (1.78%) PaaS
19 18 (1.78%) SaaS
Communications & Networking
1 10 (0.99%) Firewall
2 2 (0.20%) Intrusion Detection
2 2 (0.20%) VPN
3 1 (0.099%) 3GPP
3 1 (0.099%) 5G
3 1 (0.099%) PPP
3 1 (0.099%) SMS
Database & Business Intelligence
1 330 (32.64%) Data Warehouse
2 217 (21.46%) Data Lake
3 216 (21.36%) BigQuery
4 194 (19.19%) Power BI
5 176 (17.41%) Looker
6 140 (13.85%) Tableau
7 121 (11.97%) SQL Server
8 108 (10.68%) Big Data
9 78 (7.72%) NoSQL
10 67 (6.63%) Amazon Redshift
11 65 (6.43%) SQL Server Integration Services
12 62 (6.13%) Metadata
13 56 (5.54%) PostgreSQL
14 47 (4.65%) Hadoop
15 46 (4.55%) Elasticsearch
16 42 (4.15%) Star Schema
17 41 (4.06%) Relational Database
18 39 (3.86%) Azure SQL Data Warehouse
19 37 (3.66%) Azure SQL Database
20 32 (3.17%) Amazon Athena
Development Applications
1 144 (14.24%) Git
2 60 (5.93%) Jenkins
3 45 (4.45%) GitLab
4 14 (1.38%) Spinnaker
5 8 (0.79%) CircleCI
5 8 (0.79%) Oracle Forms
6 6 (0.59%) Bitbucket
6 6 (0.59%) RStudio
7 5 (0.49%) GDB
7 5 (0.49%) JIRA
8 4 (0.40%) Octopus Deploy
8 4 (0.40%) TeamCity
8 4 (0.40%) Visual Studio Team System
9 3 (0.30%) Visual Studio
10 2 (0.20%) Cucumber
10 2 (0.20%) Selenium
10 2 (0.20%) SQL Server Management Studio (SSMS)
10 2 (0.20%) webpack
11 1 (0.099%) ERwin
11 1 (0.099%) SpecFlow
General
1 356 (35.21%) Analytical Skills
2 275 (27.20%) Social Skills
3 159 (15.73%) Finance
4 113 (11.18%) Retail
5 87 (8.61%) Presentation Skills
6 75 (7.42%) Banking
7 41 (4.06%) Inclusion and Diversity
8 37 (3.66%) Public Sector
9 19 (1.88%) Marketing
10 16 (1.58%) Games
11 14 (1.38%) Influencing Skills
12 12 (1.19%) Billing
13 11 (1.09%) Law
13 11 (1.09%) Retail Banking
14 9 (0.89%) Front Office
14 9 (0.89%) Health Technology
15 8 (0.79%) Back Office
16 7 (0.69%) Telecoms
17 6 (0.59%) Legal
18 5 (0.49%) Publishing
Job Titles
1 584 (57.76%) Data Engineer
2 236 (23.34%) Senior
3 160 (15.83%) Platform Engineer
4 155 (15.33%) Principal Engineer
5 153 (15.13%) Principal Data Engineer
6 123 (12.17%) Senior Data Engineer
7 107 (10.58%) Lead
8 100 (9.89%) Analyst
9 89 (8.80%) Data Analyst
10 72 (7.12%) Developer
11 60 (5.93%) Architect
12 55 (5.44%) Data Architect
13 42 (4.15%) Senior Analyst
14 40 (3.96%) Lead Data Engineer
15 38 (3.76%) Data Manager
15 38 (3.76%) Engineering Manager
15 38 (3.76%) Senior Data Analyst
16 35 (3.46%) Python Engineer
17 34 (3.36%) Azure Engineer
18 33 (3.26%) Python Data Engineer
Libraries, Frameworks & Software Standards
1 92 (9.10%) Kafka
2 62 (6.13%) PySpark
3 44 (4.35%) Pandas
4 37 (3.66%) Apache Beam
5 19 (1.88%) PyTorch
5 19 (1.88%) TensorFlow
5 19 (1.88%) XGBoost
6 17 (1.68%) .NET
7 15 (1.48%) React
8 14 (1.38%) REST
9 12 (1.19%) Flask
10 10 (0.99%) .NET Core
10 10 (0.99%) JSON
10 10 (0.99%) NumPy
10 10 (0.99%) Spark Streaming
11 9 (0.89%) RESTful
11 9 (0.89%) XML
12 8 (0.79%) Apache Avro
13 7 (0.69%) Spring
14 6 (0.59%) SQLAlchemy
Miscellaneous
1 194 (19.19%) Self-Motivation
2 89 (8.80%) Data Structures
3 36 (3.56%) Algorithms
4 27 (2.67%) Cloud Native
5 22 (2.18%) Onboarding
6 20 (1.98%) Greenfield Project
7 18 (1.78%) IoT
8 17 (1.68%) Management Information System
9 16 (1.58%) Public Cloud
10 15 (1.48%) Distributed Systems
11 14 (1.38%) Product Ownership
12 12 (1.19%) Enterprise Software
13 9 (0.89%) Client/Server
14 8 (0.79%) Analytical Mindset
14 8 (0.79%) Data Centre
14 8 (0.79%) Distributed Applications
15 7 (0.69%) Hedge funds
15 7 (0.69%) Reinsurance
15 7 (0.69%) Virtual Team
16 5 (0.49%) Renewable Energy
Operating Systems
1 32 (3.17%) Linux
2 18 (1.78%) Unix
3 2 (0.20%) Windows
4 1 (0.099%) Android
4 1 (0.099%) Apple iOS
4 1 (0.099%) Windows Server
Processes & Methodologies
1 473 (46.79%) Data Engineering
2 395 (39.07%) Agile
2 395 (39.07%) Data Science
3 392 (38.77%) ETL
4 387 (38.28%) Analytics
5 356 (35.21%) Problem-Solving
6 288 (28.49%) Data Modelling
7 273 (27.00%) DevOps
8 251 (24.83%) Visualisation
9 229 (22.65%) Mentoring
10 228 (22.55%) Business Intelligence
11 194 (19.19%) Machine Learning
12 191 (18.89%) Platform Engineering
13 177 (17.51%) CI/CD
14 166 (16.42%) Data Analysis
15 163 (16.12%) DataOps
16 148 (14.64%) Data Integration
17 146 (14.44%) Change Management
18 138 (13.65%) Data Visualisation
19 121 (11.97%) Artificial Intelligence
Programming Languages
1 616 (60.93%) SQL
2 547 (54.10%) Python
3 117 (11.57%) Java
4 73 (7.22%) Scala
5 57 (5.64%) T-SQL
6 36 (3.56%) C#
7 26 (2.57%) R
8 19 (1.88%) Data Analysis Expressions
9 17 (1.68%) JavaScript
10 13 (1.29%) Go
10 13 (1.29%) TypeScript
11 9 (0.89%) C
11 9 (0.89%) Kotlin
11 9 (0.89%) PowerShell
12 5 (0.49%) MATLAB
13 3 (0.30%) Clojure
13 3 (0.30%) PL/SQL
14 2 (0.20%) C++
15 1 (0.099%) F#
15 1 (0.099%) VB
Qualifications
1 210 (20.77%) Degree
2 98 (9.69%) DBS Check
3 64 (6.33%) Computer Science Degree
4 46 (4.55%) Master's Degree
5 24 (2.37%) Security Cleared
6 15 (1.48%) Azure Certification
6 15 (1.48%) Microsoft Certification
6 15 (1.48%) SC Cleared
7 13 (1.29%) DV Cleared
8 12 (1.19%) PhD
9 4 (0.40%) AWS Certification
9 4 (0.40%) BPSS Clearance
9 4 (0.40%) CIMA
9 4 (0.40%) PMI Certification
10 3 (0.30%) AWS Certified Solutions Architect
11 1 (0.099%) HND
Quality Assurance & Compliance
1 173 (17.11%) GDPR
2 140 (13.85%) Data Quality
3 17 (1.68%) QA
4 12 (1.19%) Accessibility
5 4 (0.40%) Solvency II
6 3 (0.30%) ISO/IEC 27001
7 2 (0.20%) HIPAA
8 1 (0.099%) California Consumer Privacy Act
8 1 (0.099%) GMP
8 1 (0.099%) NCSC
System Software
1 53 (5.24%) Docker
2 9 (0.89%) HDFS
Systems Management
1 73 (7.22%) Kubernetes
2 59 (5.84%) Terraform
3 8 (0.79%) Argo
4 7 (0.69%) Ansible
5 5 (0.49%) Kubeflow
6 1 (0.099%) Grafana
Vendors
1 228 (22.55%) Databricks
2 217 (21.46%) Google
3 136 (13.45%) Microsoft
4 29 (2.87%) Oracle
5 19 (1.88%) Informatica
6 15 (1.48%) SAP
7 12 (1.19%) Confluent
7 12 (1.19%) OpenAI
8 11 (1.09%) Alteryx
8 11 (1.09%) Cloudera
9 10 (0.99%) Teradata
9 10 (0.99%) YouTube
10 6 (0.59%) Dataiku
10 6 (0.59%) F5
10 6 (0.59%) Talend
11 3 (0.30%) IBM
11 3 (0.30%) MuleSoft
11 3 (0.30%) SnapLogic
11 3 (0.30%) Splunk
11 3 (0.30%) Twitter