Data Pipeline Jobs in England

Data Pipelines
UK > England

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Data Pipeline skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Pipeline over the 6 months to 8 June 2024 with a comparison to the same period in the previous 2 years.

6 months to
8 Jun 2024
Same period 2023 Same period 2022
Rank 243 281 209
Rank change year-on-year +38 -72 +87
Permanent jobs citing Data Pipeline 1,076 1,051 2,812
As % of all permanent jobs advertised in England 1.15% 1.27% 1.95%
As % of the Processes & Methodologies category 1.38% 1.33% 2.04%
Number of salaries quoted 639 635 958
10th Percentile £37,000 £46,250 £47,500
25th Percentile £51,250 £56,250 £57,500
Median annual salary (50th Percentile) £67,500 £70,000 £75,000
Median % change year-on-year -3.57% -6.67% +7.14%
75th Percentile £85,625 £87,500 £87,500
90th Percentile £105,500 £100,000 £100,000
UK median annual salary £67,500 £69,447 £75,000
% change year-on-year -2.80% -7.40% +11.11%

All Process and Methodology Skills
England

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 77,844 79,154 138,151
As % of all permanent jobs advertised in England 82.92% 95.46% 95.95%
Number of salaries quoted 55,725 48,396 74,307
10th Percentile £29,250 £34,324 £33,259
25th Percentile £40,000 £45,875 £44,186
Median annual salary (50th Percentile) £55,000 £62,500 £60,000
Median % change year-on-year -12.00% +4.17% +9.09%
75th Percentile £72,500 £82,500 £80,000
90th Percentile £92,500 £102,500 £97,500
UK median annual salary £55,000 £60,800 £60,000
% change year-on-year -9.54% +1.33% +9.09%

Data Pipeline
Job Vacancy Trend in England

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Pipeline in England

Data Pipeline
Salary Trend in England

3-month moving average salary quoted in jobs citing Data Pipeline in England.

Salary trend for Data Pipeline in England

Data Pipeline
Salary Histogram in England

Salary distribution for jobs citing Data Pipeline in England over the 6 months to 8 June 2024.

Salary histogram for Data Pipeline in England

Data Pipeline
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Pipeline within the England region over the 6 months to 8 June 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
London +69 502 £75,000 -6.25% 176
North of England +11 233 £52,500 -19.23% 54
North West +48 146 £50,000 -10.80% 33
South East +31 112 £67,500 +15.40% 22
Midlands -5 111 £52,000 -9.57% 30
South West -70 73 £67,500 -1.69% 12
West Midlands +1 59 £60,000 +2.13% 22
East Midlands -1 52 £40,000 -27.27% 6
Yorkshire -24 47 £70,000 +0.80% 16
North East +21 40 £52,500 +34.62% 5
East of England +5 29 £57,500 -9.80% 8
Data Pipeline
UK

Data Pipeline
Co-occurring Skills and Capabilities in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 121 (11.25%) Apache Spark
2 71 (6.60%) Apache Airflow
3 69 (6.41%) Apache
4 11 (1.02%) SAS
5 6 (0.56%) Confluence
6 5 (0.46%) Luigi
6 5 (0.46%) SharePoint
7 3 (0.28%) Microsoft Exchange
8 1 (0.093%) Apache Pulsar
Applications
1 19 (1.77%) Microsoft Excel
2 9 (0.84%) Microsoft Office
3 3 (0.28%) Microsoft PowerPoint
3 3 (0.28%) MS Visio
4 1 (0.093%) Revit
Business Applications
1 4 (0.37%) Primavera
2 1 (0.093%) Salesforce CRM
2 1 (0.093%) SAP S/4HANA
2 1 (0.093%) Shopify
Cloud Services
1 420 (39.03%) Azure
2 418 (38.85%) AWS
3 323 (30.02%) GCP
4 186 (17.29%) Power Platform
5 144 (13.38%) Azure Data Factory
5 144 (13.38%) Snowflake
6 82 (7.62%) Serverless
7 71 (6.60%) Azure Synapse Analytics
8 63 (5.86%) Amazon S3
9 60 (5.58%) dbt
10 56 (5.20%) Matillion
11 39 (3.62%) AWS Lambda
12 37 (3.44%) GitHub
13 36 (3.35%) Azure Cosmos DB
14 34 (3.16%) Azure DevOps
15 27 (2.51%) Amazon EMR
16 20 (1.86%) AWS Step Functions
17 18 (1.67%) Fivetran
18 16 (1.49%) Cloud Computing
18 16 (1.49%) SaaS
Communications & Networking
1 4 (0.37%) Firewall
2 2 (0.19%) Intrusion Detection
2 2 (0.19%) VPN
3 1 (0.093%) 3GPP
3 1 (0.093%) 5G
3 1 (0.093%) PPP
Database & Business Intelligence
1 327 (30.39%) Data Warehouse
2 207 (19.24%) Data Lake
3 206 (19.14%) BigQuery
4 194 (18.03%) Tableau
5 182 (16.91%) Power BI
6 166 (15.43%) Looker
7 128 (11.90%) SQL Server
8 109 (10.13%) Big Data
9 79 (7.34%) NoSQL
10 67 (6.23%) SQL Server Integration Services
11 65 (6.04%) Amazon Redshift
12 56 (5.20%) Metadata
13 51 (4.74%) Elasticsearch
14 50 (4.65%) PostgreSQL
15 46 (4.28%) Azure SQL Database
16 45 (4.18%) Hadoop
17 40 (3.72%) Star Schema
18 38 (3.53%) Azure SQL Data Warehouse
19 36 (3.35%) Relational Database
20 29 (2.70%) Amazon Athena
Development Applications
1 215 (19.98%) Git
2 47 (4.37%) GitLab
3 35 (3.25%) Jenkins
4 12 (1.12%) Spinnaker
5 9 (0.84%) JIRA
6 8 (0.74%) Oracle Forms
7 6 (0.56%) CircleCI
7 6 (0.56%) RStudio
8 5 (0.46%) Bitbucket
8 5 (0.46%) GDB
9 4 (0.37%) Octopus Deploy
9 4 (0.37%) Visual Studio
10 2 (0.19%) webpack
11 1 (0.093%) ERwin
11 1 (0.093%) MLflow
11 1 (0.093%) Mockito
11 1 (0.093%) SpecFlow
11 1 (0.093%) TeamCity
11 1 (0.093%) Visual Studio Team System
General
1 415 (38.57%) Analytical Skills
2 350 (32.53%) Social Skills
3 164 (15.24%) Retail
4 151 (14.03%) Finance
5 148 (13.75%) Presentation Skills
6 50 (4.65%) Inclusion and Diversity
7 48 (4.46%) Banking
8 38 (3.53%) Public Sector
9 22 (2.04%) Law
10 15 (1.39%) Games
11 14 (1.30%) Front Office
12 13 (1.21%) Billing
12 13 (1.21%) Marketing
13 11 (1.02%) Influencing Skills
14 9 (0.84%) Back Office
15 8 (0.74%) Telecoms
16 7 (0.65%) Health Technology
16 7 (0.65%) Legal
17 6 (0.56%) Publishing
17 6 (0.56%) Retail Banking
Job Titles
1 592 (55.02%) Data Engineer
2 309 (28.72%) Senior
3 160 (14.87%) Principal Engineer
4 159 (14.78%) Principal Data Engineer
5 158 (14.68%) Platform Engineer
6 156 (14.50%) Analyst
7 149 (13.85%) Data Analyst
8 122 (11.34%) Senior Data Engineer
9 105 (9.76%) Lead
10 104 (9.67%) Senior Analyst
11 103 (9.57%) Senior Data Analyst
12 78 (7.25%) Developer
13 67 (6.23%) Architect
14 61 (5.67%) Data Architect
15 47 (4.37%) Lead Data Engineer
16 43 (4.00%) Engineering Manager
17 39 (3.62%) Azure Engineer
18 37 (3.44%) Python Engineer
19 36 (3.35%) Data Manager
20 34 (3.16%) Azure Data Engineer
Libraries, Frameworks & Software Standards
1 78 (7.25%) PySpark
2 70 (6.51%) Kafka
3 41 (3.81%) Pandas
4 31 (2.88%) Apache Beam
4 31 (2.88%) React
5 21 (1.95%) PyTorch
5 21 (1.95%) TensorFlow
6 20 (1.86%) .NET
7 15 (1.39%) .NET Core
7 15 (1.39%) REST
8 14 (1.30%) XGBoost
9 11 (1.02%) .NET Framework
9 11 (1.02%) Unity DI Container
9 11 (1.02%) XML
10 10 (0.93%) NumPy
10 10 (0.93%) Spark Streaming
11 9 (0.84%) Flask
11 9 (0.84%) JSON
11 9 (0.84%) Lambda Expressions
12 7 (0.65%) RESTful
Miscellaneous
1 195 (18.12%) Self-Motivation
2 96 (8.92%) Data Structures
3 38 (3.53%) Algorithms
4 30 (2.79%) Cloud Native
5 24 (2.23%) Onboarding
6 17 (1.58%) IoT
6 17 (1.58%) Management Information System
7 16 (1.49%) Hedge funds
8 13 (1.21%) Greenfield Project
9 12 (1.12%) Reinsurance
10 11 (1.02%) Blog
10 11 (1.02%) Private Cloud
10 11 (1.02%) Product Ownership
11 9 (0.84%) Client/Server
11 9 (0.84%) Distributed Systems
12 8 (0.74%) Data Centre
12 8 (0.74%) Enterprise Software
12 8 (0.74%) Legacy Applications
12 8 (0.74%) Renewable Energy
13 7 (0.65%) Analytical Mindset
Operating Systems
1 38 (3.53%) Linux
2 20 (1.86%) Unix
3 2 (0.19%) Android
3 2 (0.19%) Windows
4 1 (0.093%) Apple iOS
4 1 (0.093%) Windows Server
Processes & Methodologies
1 489 (45.45%) Data Engineering
2 461 (42.84%) Analytics
3 439 (40.80%) Problem-Solving
4 387 (35.97%) Data Science
5 381 (35.41%) Agile
6 368 (34.20%) ETL
7 309 (28.72%) Visualisation
8 283 (26.30%) Data Modelling
9 244 (22.68%) DevOps
10 240 (22.30%) Mentoring
11 225 (20.91%) Data Analysis
12 217 (20.17%) Business Intelligence
13 198 (18.40%) Platform Engineering
14 180 (16.73%) Mathematics
15 175 (16.26%) CI/CD
16 174 (16.17%) Machine Learning
17 166 (15.43%) DataOps
18 164 (15.24%) Statistics
19 151 (14.03%) Actionable Insight
20 149 (13.85%) Change Management
Programming Languages
1 703 (65.33%) SQL
2 630 (58.55%) Python
3 134 (12.45%) Java
4 81 (7.53%) Scala
5 51 (4.74%) T-SQL
6 35 (3.25%) C#
7 29 (2.70%) R
8 28 (2.60%) TypeScript
9 24 (2.23%) JavaScript
10 17 (1.58%) Data Analysis Expressions
11 16 (1.49%) Go
11 16 (1.49%) Kotlin
12 9 (0.84%) C
12 9 (0.84%) Clojure
13 7 (0.65%) MATLAB
14 6 (0.56%) PowerShell
15 3 (0.28%) Rust
16 2 (0.19%) Bash
16 2 (0.19%) Kusto Query Language
16 2 (0.19%) PL/SQL
Qualifications
1 283 (26.30%) Degree
2 174 (16.17%) DBS Check
3 75 (6.97%) Computer Science Degree
4 46 (4.28%) Master's Degree
5 35 (3.25%) Security Cleared
6 27 (2.51%) SC Cleared
7 19 (1.77%) DV Cleared
8 13 (1.21%) Microsoft Certification
9 12 (1.12%) Azure Certification
10 10 (0.93%) PhD
11 4 (0.37%) CIMA
11 4 (0.37%) PMI Certification
12 3 (0.28%) AWS Certification
12 3 (0.28%) AWS Certified Solutions Architect
12 3 (0.28%) BPSS Clearance
13 2 (0.19%) SnowPro
14 1 (0.093%) Numerate Degree
14 1 (0.093%) Postgraduate
Quality Assurance & Compliance
1 172 (15.99%) Data Quality
2 164 (15.24%) GDPR
3 17 (1.58%) QA
4 12 (1.12%) Accessibility
5 4 (0.37%) Solvency II
6 3 (0.28%) ISO/IEC 27001
7 1 (0.093%) California Consumer Privacy Act
7 1 (0.093%) HIPAA
7 1 (0.093%) NCSC
System Software
1 46 (4.28%) Docker
2 8 (0.74%) HDFS
3 4 (0.37%) Active Directory
3 4 (0.37%) Virtual Machines
Systems Management
1 75 (6.97%) Kubernetes
2 47 (4.37%) Terraform
3 13 (1.21%) Ansible
4 7 (0.65%) Argo
5 4 (0.37%) Kubeflow
6 1 (0.093%) Grafana
6 1 (0.093%) Prometheus
Vendors
1 294 (27.32%) Databricks
2 207 (19.24%) Google
3 130 (12.08%) Microsoft
4 29 (2.70%) Oracle
5 21 (1.95%) Informatica
6 12 (1.12%) Alteryx
6 12 (1.12%) OpenAI
7 11 (1.02%) Cloudera
8 10 (0.93%) SAP
8 10 (0.93%) Teradata
8 10 (0.93%) YouTube
9 7 (0.65%) Bloomberg
10 6 (0.56%) Dataiku
10 6 (0.56%) F5
11 5 (0.46%) Talend
12 4 (0.37%) Hortonworks
13 3 (0.28%) Confluent
13 3 (0.28%) Salesforce
13 3 (0.28%) SnapLogic
13 3 (0.28%) Splunk