Data Pipeline Jobs in England

Data Pipelines
UK > England

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Data Pipeline skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Pipeline over the 6 months to 18 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
18 May 2024
Same period 2023 Same period 2022
Rank 239 273 215
Rank change year-on-year +34 -58 +82
Permanent jobs citing Data Pipeline 1,055 1,163 2,623
As % of all permanent jobs advertised in England 1.22% 1.32% 1.94%
As % of the Processes & Methodologies category 1.43% 1.38% 2.02%
Number of salaries quoted 628 673 963
10th Percentile £36,925 £46,250 £47,500
25th Percentile £50,000 £56,250 £57,500
Median annual salary (50th Percentile) £67,500 £70,000 £75,000
Median % change year-on-year -3.57% -6.67% +11.11%
75th Percentile £85,000 £87,500 £87,500
90th Percentile £107,500 £100,000 £100,000
UK median annual salary £67,500 £69,447 £75,000
% change year-on-year -2.80% -7.40% +15.38%

All Process and Methodology Skills
England

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 73,598 84,339 129,671
As % of all permanent jobs advertised in England 85.11% 95.60% 95.82%
Number of salaries quoted 53,968 50,108 73,057
10th Percentile £29,000 £34,324 £33,500
25th Percentile £40,000 £46,000 £44,000
Median annual salary (50th Percentile) £55,000 £62,500 £60,000
Median % change year-on-year -12.00% +4.17% +9.09%
75th Percentile £73,250 £82,500 £80,000
90th Percentile £93,750 £102,500 £97,500
UK median annual salary £55,000 £61,180 £60,000
% change year-on-year -10.10% +1.97% +9.09%

Data Pipeline
Job Vacancy Trend in England

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Pipeline in England

Data Pipeline
Salary Trend in England

3-month moving average salary quoted in jobs citing Data Pipeline in England.

Salary trend for Data Pipeline in England

Data Pipeline
Salary Histogram in England

Salary distribution for jobs citing Data Pipeline in England over the 6 months to 18 May 2024.

Salary histogram for Data Pipeline in England

Data Pipeline
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Pipeline within the England region over the 6 months to 18 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
London +69 490 £75,000 -6.25% 246
North of England +19 231 £50,750 -15.42% 42
North West +65 145 £47,500 -5.00% 19
Midlands +24 111 £52,250 -9.13% 25
South East +24 105 £67,500 +15.40% 68
South West -65 71 £67,500 -1.46% 22
West Midlands +15 59 £60,000 - 21
East Midlands +24 52 £40,000 -27.27% 4
Yorkshire -43 45 £57,500 -14.27% 19
North East +31 41 £52,500 +34.62% 4
East of England +20 29 £58,750 -7.84% 9
Data Pipeline
UK

Data Pipeline
Co-occurring Skills and Capabilities in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 116 (11.00%) Apache Spark
2 77 (7.30%) Apache Airflow
3 70 (6.64%) Apache
4 10 (0.95%) SAS
5 5 (0.47%) SharePoint
6 3 (0.28%) Confluence
6 3 (0.28%) Luigi
6 3 (0.28%) Microsoft Exchange
7 1 (0.095%) Apache Synapse
Applications
1 19 (1.80%) Microsoft Excel
2 8 (0.76%) Microsoft Office
3 3 (0.28%) Microsoft PowerPoint
3 3 (0.28%) MS Visio
Business Applications
1 4 (0.38%) Primavera
2 1 (0.095%) Salesforce CRM
2 1 (0.095%) SAP S/4HANA
2 1 (0.095%) Shopify
Cloud Services
1 411 (38.96%) AWS
1 411 (38.96%) Azure
2 320 (30.33%) GCP
3 186 (17.63%) Power Platform
4 143 (13.55%) Snowflake
5 141 (13.36%) Azure Data Factory
6 84 (7.96%) Serverless
7 64 (6.07%) Azure Synapse Analytics
8 63 (5.97%) Amazon S3
9 62 (5.88%) dbt
10 56 (5.31%) Matillion
11 41 (3.89%) GitHub
12 40 (3.79%) AWS Lambda
13 36 (3.41%) Azure Cosmos DB
14 30 (2.84%) Azure DevOps
15 25 (2.37%) Amazon EMR
16 21 (1.99%) AWS Step Functions
17 17 (1.61%) Fivetran
18 16 (1.52%) PowerApps
18 16 (1.52%) SaaS
Communications & Networking
1 8 (0.76%) Firewall
2 2 (0.19%) Intrusion Detection
2 2 (0.19%) VPN
3 1 (0.095%) 3GPP
3 1 (0.095%) 5G
3 1 (0.095%) PPP
Database & Business Intelligence
1 329 (31.18%) Data Warehouse
2 206 (19.53%) BigQuery
2 206 (19.53%) Data Lake
3 191 (18.10%) Tableau
4 182 (17.25%) Power BI
5 164 (15.55%) Looker
6 124 (11.75%) SQL Server
7 100 (9.48%) Big Data
8 75 (7.11%) NoSQL
9 63 (5.97%) Amazon Redshift
10 62 (5.88%) SQL Server Integration Services
11 57 (5.40%) Metadata
12 50 (4.74%) PostgreSQL
13 48 (4.55%) Elasticsearch
14 44 (4.17%) Hadoop
15 41 (3.89%) Azure SQL Database
15 41 (3.89%) Star Schema
16 39 (3.70%) Azure SQL Data Warehouse
17 35 (3.32%) Relational Database
18 28 (2.65%) Amazon Athena
Development Applications
1 212 (20.09%) Git
2 48 (4.55%) GitLab
3 42 (3.98%) Jenkins
4 14 (1.33%) Spinnaker
5 8 (0.76%) CircleCI
5 8 (0.76%) Oracle Forms
6 7 (0.66%) JIRA
7 6 (0.57%) Bitbucket
7 6 (0.57%) RStudio
8 5 (0.47%) GDB
9 4 (0.38%) Octopus Deploy
10 3 (0.28%) Visual Studio
11 2 (0.19%) TeamCity
11 2 (0.19%) Visual Studio Team System
11 2 (0.19%) webpack
12 1 (0.095%) Cucumber
12 1 (0.095%) ERwin
12 1 (0.095%) Mockito
12 1 (0.095%) Selenium
12 1 (0.095%) SpecFlow
General
1 409 (38.77%) Analytical Skills
2 339 (32.13%) Social Skills
3 159 (15.07%) Retail
4 147 (13.93%) Finance
5 144 (13.65%) Presentation Skills
6 53 (5.02%) Banking
7 52 (4.93%) Inclusion and Diversity
8 36 (3.41%) Public Sector
9 21 (1.99%) Law
10 15 (1.42%) Games
10 15 (1.42%) Marketing
11 14 (1.33%) Billing
12 12 (1.14%) Front Office
12 12 (1.14%) Influencing Skills
13 10 (0.95%) Back Office
13 10 (0.95%) Retail Banking
14 9 (0.85%) Health Technology
14 9 (0.85%) Telecoms
15 6 (0.57%) Publishing
16 5 (0.47%) Legal
Job Titles
1 587 (55.64%) Data Engineer
2 297 (28.15%) Senior
3 159 (15.07%) Platform Engineer
4 157 (14.88%) Principal Engineer
5 155 (14.69%) Principal Data Engineer
6 154 (14.60%) Analyst
7 144 (13.65%) Data Analyst
8 118 (11.18%) Senior Data Engineer
9 104 (9.86%) Lead
10 100 (9.48%) Senior Analyst
11 98 (9.29%) Senior Data Analyst
12 75 (7.11%) Developer
13 57 (5.40%) Architect
14 52 (4.93%) Data Architect
15 44 (4.17%) Lead Data Engineer
16 43 (4.08%) Engineering Manager
17 38 (3.60%) Data Manager
18 37 (3.51%) Python Engineer
19 36 (3.41%) Azure Engineer
20 35 (3.32%) Python Data Engineer
Libraries, Frameworks & Software Standards
1 73 (6.92%) PySpark
2 72 (6.82%) Kafka
3 39 (3.70%) Pandas
4 33 (3.13%) Apache Beam
5 26 (2.46%) React
6 21 (1.99%) .NET
7 20 (1.90%) PyTorch
7 20 (1.90%) TensorFlow
8 17 (1.61%) XGBoost
9 15 (1.42%) REST
10 14 (1.33%) .NET Core
11 11 (1.04%) Flask
12 10 (0.95%) .NET Framework
12 10 (0.95%) Spark Streaming
12 10 (0.95%) Unity DI Container
13 9 (0.85%) Lambda Expressions
13 9 (0.85%) NumPy
14 8 (0.76%) Apache Avro
14 8 (0.76%) JSON
14 8 (0.76%) XML
Miscellaneous
1 194 (18.39%) Self-Motivation
2 92 (8.72%) Data Structures
3 35 (3.32%) Algorithms
4 32 (3.03%) Cloud Native
5 25 (2.37%) Onboarding
6 17 (1.61%) Greenfield Project
6 17 (1.61%) Management Information System
7 16 (1.52%) IoT
8 14 (1.33%) Hedge funds
9 12 (1.14%) Distributed Systems
10 10 (0.95%) Blog
10 10 (0.95%) Enterprise Software
10 10 (0.95%) Private Cloud
11 9 (0.85%) Client/Server
11 9 (0.85%) Product Ownership
11 9 (0.85%) Public Cloud
12 8 (0.76%) Analytical Mindset
12 8 (0.76%) Distributed Applications
12 8 (0.76%) Reinsurance
12 8 (0.76%) Renewable Energy
Operating Systems
1 39 (3.70%) Linux
2 20 (1.90%) Unix
3 2 (0.19%) Windows
4 1 (0.095%) Android
4 1 (0.095%) Apple iOS
4 1 (0.095%) Windows Server
Processes & Methodologies
1 476 (45.12%) Data Engineering
2 441 (41.80%) Analytics
3 425 (40.28%) Problem-Solving
4 388 (36.78%) Data Science
5 378 (35.83%) Agile
6 371 (35.17%) ETL
7 303 (28.72%) Visualisation
8 287 (27.20%) Data Modelling
9 249 (23.60%) DevOps
10 233 (22.09%) Mentoring
11 221 (20.95%) Data Analysis
12 216 (20.47%) Business Intelligence
13 197 (18.67%) Platform Engineering
14 176 (16.68%) Mathematics
15 170 (16.11%) CI/CD
15 170 (16.11%) Machine Learning
16 166 (15.73%) DataOps
17 163 (15.45%) Statistics
18 148 (14.03%) Change Management
19 144 (13.65%) Actionable Insight
Programming Languages
1 696 (65.97%) SQL
2 623 (59.05%) Python
3 135 (12.80%) Java
4 75 (7.11%) Scala
5 54 (5.12%) T-SQL
6 38 (3.60%) C#
7 30 (2.84%) R
8 23 (2.18%) TypeScript
9 22 (2.09%) JavaScript
10 17 (1.61%) Data Analysis Expressions
11 15 (1.42%) Go
11 15 (1.42%) Kotlin
12 9 (0.85%) C
13 8 (0.76%) PowerShell
14 7 (0.66%) Clojure
14 7 (0.66%) MATLAB
15 3 (0.28%) PL/SQL
16 2 (0.19%) Bash
16 2 (0.19%) C++
16 2 (0.19%) Rust
Qualifications
1 274 (25.97%) Degree
2 166 (15.73%) DBS Check
3 67 (6.35%) Computer Science Degree
4 44 (4.17%) Master's Degree
5 27 (2.56%) Security Cleared
6 19 (1.80%) SC Cleared
7 15 (1.42%) DV Cleared
8 14 (1.33%) Azure Certification
8 14 (1.33%) Microsoft Certification
9 12 (1.14%) PhD
10 4 (0.38%) CIMA
10 4 (0.38%) PMI Certification
11 3 (0.28%) AWS Certification
11 3 (0.28%) AWS Certified Solutions Architect
11 3 (0.28%) BPSS Clearance
12 1 (0.095%) Numerate Degree
12 1 (0.095%) Postgraduate
Quality Assurance & Compliance
1 165 (15.64%) GDPR
2 157 (14.88%) Data Quality
3 21 (1.99%) QA
4 11 (1.04%) Accessibility
5 4 (0.38%) Solvency II
6 3 (0.28%) ISO/IEC 27001
7 1 (0.095%) California Consumer Privacy Act
7 1 (0.095%) HIPAA
7 1 (0.095%) NCSC
System Software
1 48 (4.55%) Docker
2 9 (0.85%) HDFS
3 2 (0.19%) Active Directory
3 2 (0.19%) Virtual Machines
Systems Management
1 78 (7.39%) Kubernetes
2 49 (4.64%) Terraform
3 10 (0.95%) Ansible
4 8 (0.76%) Argo
5 5 (0.47%) Kubeflow
6 1 (0.095%) Grafana
6 1 (0.095%) Prometheus
Vendors
1 290 (27.49%) Databricks
2 203 (19.24%) Google
3 130 (12.32%) Microsoft
4 31 (2.94%) Oracle
5 18 (1.71%) Informatica
6 12 (1.14%) OpenAI
7 11 (1.04%) Alteryx
7 11 (1.04%) Cloudera
8 10 (0.95%) SAP
8 10 (0.95%) Teradata
8 10 (0.95%) YouTube
9 7 (0.66%) Confluent
10 6 (0.57%) Bloomberg
10 6 (0.57%) Dataiku
10 6 (0.57%) F5
11 5 (0.47%) Talend
12 3 (0.28%) Salesforce
12 3 (0.28%) SnapLogic
12 3 (0.28%) Splunk
12 3 (0.28%) Twitter