Data Pipeline Jobs in England

Data Pipelines
UK > England

The following table provides summary statistics for permanent job vacancies advertised in England with a requirement for Data Pipeline skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Pipeline over the 6 months to 29 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
29 Apr 2024
Same period 2023 Same period 2022
Rank 236 268 217
Rank change year-on-year +32 -51 +85
Permanent jobs citing Data Pipeline 1,021 1,225 2,483
As % of all permanent jobs advertised in England 1.20% 1.32% 1.88%
As % of the Processes & Methodologies category 1.40% 1.38% 1.97%
Number of salaries quoted 633 739 1,002
10th Percentile £37,000 £46,850 £47,500
25th Percentile £50,000 £56,250 £57,500
Median annual salary (50th Percentile) £67,500 £69,447 £75,000
Median % change year-on-year -2.80% -7.40% +15.38%
75th Percentile £85,000 £87,500 £87,500
90th Percentile £107,500 £100,000 £100,000
UK median annual salary £67,500 £69,447 £75,000
% change year-on-year -2.80% -7.40% +15.38%

All Process and Methodology Skills
England

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in England with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 73,041 88,556 126,288
As % of all permanent jobs advertised in England 85.85% 95.64% 95.68%
Number of salaries quoted 53,922 52,314 73,827
10th Percentile £29,000 £34,250 £33,500
25th Percentile £40,000 £46,000 £44,250
Median annual salary (50th Percentile) £55,000 £62,500 £60,000
Median % change year-on-year -12.00% +4.17% +9.09%
75th Percentile £73,750 £82,500 £80,000
90th Percentile £93,750 £101,250 £97,500
UK median annual salary £55,000 £61,500 £60,000
% change year-on-year -10.57% +2.50% +9.09%

Data Pipeline
Job Vacancy Trend in England

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Pipeline in England

Data Pipeline
Salary Trend in England

3-month moving average salary quoted in jobs citing Data Pipeline in England.

Salary trend for Data Pipeline in England

Data Pipeline
Salary Histogram in England

Salary distribution for jobs citing Data Pipeline in England over the 6 months to 29 April 2024.

Salary histogram for Data Pipeline in England

Data Pipeline
Job Locations in England

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Pipeline within the England region over the 6 months to 29 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
London +45 430 £75,000 -6.25% 182
North of England +11 240 £51,500 -15.82% 33
North West +78 146 £50,000 - 19
South East +44 122 £67,500 +12.50% 23
Midlands +33 101 £51,500 -14.17% 26
South West -48 76 £67,500 +12.50% 14
West Midlands +19 58 £60,000 - 17
Yorkshire -40 49 £62,000 -7.56% 10
North East +37 45 £51,250 -20.85% 4
East Midlands +17 43 £47,500 -13.64% 9
East of England +34 32 £62,500 -1.96% 13
Data Pipeline
UK

Data Pipeline
Co-occurring Skills and Capabilities in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 114 (11.17%) Apache Spark
2 76 (7.44%) Apache
3 74 (7.25%) Apache Airflow
4 6 (0.59%) SAS
4 6 (0.59%) SharePoint
5 3 (0.29%) Microsoft Exchange
6 2 (0.20%) Confluence
6 2 (0.20%) Luigi
7 1 (0.098%) Apache Synapse
Applications
1 19 (1.86%) Microsoft Excel
2 8 (0.78%) Microsoft Office
3 3 (0.29%) Microsoft PowerPoint
3 3 (0.29%) MS Visio
Business Applications
1 4 (0.39%) Primavera
2 1 (0.098%) Salesforce CRM
2 1 (0.098%) SAP S/4HANA
2 1 (0.098%) Shopify
Cloud Services
1 408 (39.96%) Azure
2 353 (34.57%) AWS
3 323 (31.64%) GCP
4 189 (18.51%) Power Platform
5 145 (14.20%) Snowflake
6 141 (13.81%) Azure Data Factory
7 86 (8.42%) Serverless
8 67 (6.56%) Amazon S3
9 63 (6.17%) dbt
10 57 (5.58%) Azure Synapse Analytics
10 57 (5.58%) Matillion
11 42 (4.11%) GitHub
12 40 (3.92%) AWS Lambda
13 37 (3.62%) Azure Cosmos DB
14 35 (3.43%) Azure DevOps
15 21 (2.06%) Amazon EMR
16 19 (1.86%) PowerApps
17 18 (1.76%) GitHub Actions
17 18 (1.76%) PaaS
18 17 (1.67%) SaaS
Communications & Networking
1 8 (0.78%) Firewall
2 2 (0.20%) Intrusion Detection
2 2 (0.20%) VPN
3 1 (0.098%) 3GPP
3 1 (0.098%) 5G
3 1 (0.098%) PPP
3 1 (0.098%) SMS
Database & Business Intelligence
1 332 (32.52%) Data Warehouse
2 211 (20.67%) BigQuery
2 211 (20.67%) Data Lake
3 186 (18.22%) Power BI
4 168 (16.45%) Looker
5 146 (14.30%) Tableau
6 122 (11.95%) SQL Server
7 102 (9.99%) Big Data
8 72 (7.05%) NoSQL
9 65 (6.37%) Amazon Redshift
9 65 (6.37%) SQL Server Integration Services
10 62 (6.07%) Metadata
11 47 (4.60%) Hadoop
11 47 (4.60%) PostgreSQL
12 46 (4.51%) Elasticsearch
13 42 (4.11%) Star Schema
14 39 (3.82%) Azure SQL Data Warehouse
15 38 (3.72%) Azure SQL Database
16 33 (3.23%) Relational Database
17 30 (2.94%) Amazon Athena
Development Applications
1 160 (15.67%) Git
2 50 (4.90%) Jenkins
3 48 (4.70%) GitLab
4 13 (1.27%) Spinnaker
5 8 (0.78%) CircleCI
5 8 (0.78%) Oracle Forms
6 6 (0.59%) Bitbucket
6 6 (0.59%) RStudio
7 5 (0.49%) GDB
7 5 (0.49%) JIRA
8 4 (0.39%) Octopus Deploy
8 4 (0.39%) TeamCity
8 4 (0.39%) Visual Studio Team System
9 3 (0.29%) Visual Studio
10 2 (0.20%) Cucumber
10 2 (0.20%) Selenium
10 2 (0.20%) SQL Server Management Studio (SSMS)
10 2 (0.20%) webpack
11 1 (0.098%) ERwin
11 1 (0.098%) SpecFlow
General
1 363 (35.55%) Analytical Skills
2 290 (28.40%) Social Skills
3 146 (14.30%) Finance
4 117 (11.46%) Retail
5 101 (9.89%) Presentation Skills
6 64 (6.27%) Banking
7 43 (4.21%) Inclusion and Diversity
8 37 (3.62%) Public Sector
9 19 (1.86%) Marketing
10 16 (1.57%) Games
11 13 (1.27%) Law
12 12 (1.18%) Billing
12 12 (1.18%) Influencing Skills
13 11 (1.08%) Front Office
13 11 (1.08%) Retail Banking
14 9 (0.88%) Health Technology
15 8 (0.78%) Back Office
16 7 (0.69%) Legal
16 7 (0.69%) Telecoms
17 6 (0.59%) Publishing
Job Titles
1 593 (58.08%) Data Engineer
2 259 (25.37%) Senior
3 160 (15.67%) Platform Engineer
4 155 (15.18%) Principal Engineer
5 153 (14.99%) Principal Data Engineer
6 129 (12.63%) Senior Data Engineer
7 114 (11.17%) Analyst
8 105 (10.28%) Lead
9 103 (10.09%) Data Analyst
10 72 (7.05%) Developer
11 59 (5.78%) Architect
12 56 (5.48%) Senior Analyst
13 54 (5.29%) Data Architect
14 52 (5.09%) Senior Data Analyst
15 43 (4.21%) Lead Data Engineer
16 40 (3.92%) Engineering Manager
17 39 (3.82%) Data Manager
18 35 (3.43%) Azure Engineer
19 34 (3.33%) Python Engineer
20 33 (3.23%) Python Data Engineer
Libraries, Frameworks & Software Standards
1 82 (8.03%) Kafka
2 66 (6.46%) PySpark
3 44 (4.31%) Pandas
4 37 (3.62%) Apache Beam
5 19 (1.86%) PyTorch
5 19 (1.86%) TensorFlow
6 18 (1.76%) .NET
6 18 (1.76%) React
6 18 (1.76%) XGBoost
7 14 (1.37%) REST
8 12 (1.18%) Flask
9 11 (1.08%) .NET Core
10 10 (0.98%) JSON
10 10 (0.98%) NumPy
10 10 (0.98%) Spark Streaming
11 9 (0.88%) XML
12 8 (0.78%) Apache Avro
12 8 (0.78%) RESTful
13 7 (0.69%) Spring
14 6 (0.59%) .NET Framework
Miscellaneous
1 194 (19.00%) Self-Motivation
2 90 (8.81%) Data Structures
3 36 (3.53%) Algorithms
4 29 (2.84%) Cloud Native
5 22 (2.15%) Onboarding
6 20 (1.96%) Greenfield Project
7 18 (1.76%) IoT
8 16 (1.57%) Management Information System
9 14 (1.37%) Distributed Systems
9 14 (1.37%) Product Ownership
10 13 (1.27%) Public Cloud
11 10 (0.98%) Enterprise Software
12 9 (0.88%) Client/Server
12 9 (0.88%) Hedge funds
13 8 (0.78%) Analytical Mindset
13 8 (0.78%) Data Centre
13 8 (0.78%) Distributed Applications
14 7 (0.69%) Reinsurance
14 7 (0.69%) Virtual Team
15 6 (0.59%) Private Cloud
Operating Systems
1 32 (3.13%) Linux
2 18 (1.76%) Unix
3 2 (0.20%) Windows
4 1 (0.098%) Android
4 1 (0.098%) Apple iOS
4 1 (0.098%) Windows Server
Processes & Methodologies
1 472 (46.23%) Data Engineering
2 400 (39.18%) Analytics
3 393 (38.49%) Data Science
4 386 (37.81%) Agile
4 386 (37.81%) ETL
5 371 (36.34%) Problem-Solving
6 291 (28.50%) Data Modelling
7 276 (27.03%) DevOps
8 256 (25.07%) Visualisation
9 232 (22.72%) Mentoring
10 224 (21.94%) Business Intelligence
11 194 (19.00%) Platform Engineering
12 184 (18.02%) Machine Learning
13 178 (17.43%) Data Analysis
14 170 (16.65%) CI/CD
15 163 (15.96%) DataOps
16 146 (14.30%) Change Management
17 138 (13.52%) Data Integration
18 131 (12.83%) Data Visualisation
19 124 (12.14%) Mathematics
Programming Languages
1 635 (62.19%) SQL
2 565 (55.34%) Python
3 118 (11.56%) Java
4 74 (7.25%) Scala
5 56 (5.48%) T-SQL
6 37 (3.62%) C#
7 26 (2.55%) R
8 19 (1.86%) Data Analysis Expressions
8 19 (1.86%) JavaScript
9 15 (1.47%) TypeScript
10 13 (1.27%) Go
11 10 (0.98%) Kotlin
12 9 (0.88%) C
12 9 (0.88%) PowerShell
13 5 (0.49%) MATLAB
14 4 (0.39%) Clojure
15 3 (0.29%) PL/SQL
16 2 (0.20%) C++
17 1 (0.098%) F#
17 1 (0.098%) VB
Qualifications
1 223 (21.84%) Degree
2 113 (11.07%) DBS Check
3 64 (6.27%) Computer Science Degree
4 46 (4.51%) Master's Degree
5 25 (2.45%) Security Cleared
6 16 (1.57%) SC Cleared
7 15 (1.47%) Azure Certification
7 15 (1.47%) Microsoft Certification
8 14 (1.37%) DV Cleared
9 12 (1.18%) PhD
10 4 (0.39%) BPSS Clearance
10 4 (0.39%) CIMA
10 4 (0.39%) PMI Certification
11 3 (0.29%) AWS Certification
11 3 (0.29%) AWS Certified Solutions Architect
12 1 (0.098%) HND
Quality Assurance & Compliance
1 172 (16.85%) GDPR
2 144 (14.10%) Data Quality
3 18 (1.76%) QA
4 12 (1.18%) Accessibility
5 4 (0.39%) Solvency II
6 3 (0.29%) ISO/IEC 27001
7 2 (0.20%) HIPAA
8 1 (0.098%) California Consumer Privacy Act
8 1 (0.098%) GMP
8 1 (0.098%) NCSC
System Software
1 52 (5.09%) Docker
2 9 (0.88%) HDFS
Systems Management
1 74 (7.25%) Kubernetes
2 53 (5.19%) Terraform
3 10 (0.98%) Ansible
4 8 (0.78%) Argo
5 5 (0.49%) Kubeflow
Vendors
1 245 (24.00%) Databricks
2 210 (20.57%) Google
3 136 (13.32%) Microsoft
4 29 (2.84%) Oracle
5 19 (1.86%) Informatica
6 13 (1.27%) SAP
7 12 (1.18%) OpenAI
8 11 (1.08%) Alteryx
8 11 (1.08%) Cloudera
9 10 (0.98%) Teradata
9 10 (0.98%) YouTube
10 9 (0.88%) Confluent
11 6 (0.59%) Dataiku
11 6 (0.59%) F5
11 6 (0.59%) Talend
12 3 (0.29%) MuleSoft
12 3 (0.29%) SnapLogic
12 3 (0.29%) Twitter
13 2 (0.20%) Hortonworks
13 2 (0.20%) Splunk