Period
to 20 October 2021

The following table provides summary statistics for permanent job vacancies advertised in Yorkshire with a requirement for Data Pipeline skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Pipeline over the 6 months to 20 October 2021 with a comparison to the same period in the previous 2 years.

Data Pipelines
England > Yorkshire
6 months to
20 Oct 2021
Same period 2020 Same period 2019
Rank 221 154 269
Rank change year-on-year -67 +115 +17
Permanent jobs citing Data Pipeline 47 6 22
As % of all permanent jobs advertised in Yorkshire 0.70% 0.22% 0.32%
As % of the Processes & Methodologies category 0.74% 0.23% 0.35%
Number of salaries quoted 32 5 20
10th Percentile £32,500 " £38,631
25th Percentile £43,750 £40,000 £47,961
Median annual salary (50th Percentile) £66,250 £45,000 £51,250
Median % change year-on-year +47.22% -12.20% +5.13%
75th Percentile £90,000 £50,000 £70,000
90th Percentile " " £71,375
England median annual salary £70,000 £65,000 £70,000
% change year-on-year +7.69% -7.14% +7.69%

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies advertised in Yorkshire with a requirement for process or methodology skills.

All Process and Methodology Skills
Yorkshire
Permanent vacancies with a requirement for process or methodology skills 6,333 2,568 6,366
As % of all permanent IT jobs advertised in Yorkshire 94.12% 93.79% 91.68%
Number of salaries quoted 4,811 2,251 5,137
10th Percentile £31,250 £31,250 £26,250
25th Percentile £37,500 £37,500 £33,000
Median annual salary (50th Percentile) £50,000 £47,250 £45,000
Median % change year-on-year +5.82% +5.00% +5.88%
75th Percentile £63,750 £57,500 £55,000
90th Percentile £75,000 £65,000 £65,000
England median annual salary £58,000 £55,000 £52,500
% change year-on-year +5.45% +4.76% -

Data Pipeline
Job Vacancy Trend in Yorkshire

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in Yorkshire.

Job vacancy trend for Data Pipeline in Yorkshire

Data Pipeline
Salary Trend in Yorkshire

3-month moving average salary quoted in jobs citing Data Pipeline in Yorkshire.

Salary trend for Data Pipeline in Yorkshire

Data Pipeline
Salary Histogram in Yorkshire

Salary distribution for jobs citing Data Pipeline in Yorkshire over the 6 months to 20 October 2021.

Salary histogram for Data Pipeline in Yorkshire

Data Pipeline
Job Locations in Yorkshire

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Pipeline within the Yorkshire region over the 6 months to 20 October 2021. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Job
Vacancies
West Yorkshire -50 42 £75,000 +66.67% 5
North Yorkshire -9 3 £52,500 +16.67%
South Yorkshire - 2 £35,000 - 1
Data Pipeline
England

For the 6 months to 20 October 2021, IT jobs citing Data Pipeline also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all permanent job ads across the Yorkshire region with a requirement for Data Pipeline.

1 36 (76.60%) Azure
2 29 (61.70%) Databricks
3 24 (51.06%) Metadata
3 24 (51.06%) Python
4 23 (48.94%) Data Modelling
5 21 (44.68%) AWS
6 20 (42.55%) Apache Spark
6 20 (42.55%) Data Engineering
7 19 (40.43%) Analytics
7 19 (40.43%) SQL
8 17 (36.17%) Metadata Management
8 17 (36.17%) Kafka
9 16 (34.04%) NoSQL
10 15 (31.91%) Hadoop
10 15 (31.91%) Data Analysis
11 14 (29.79%) Agile Software Development
11 14 (29.79%) Big Data
11 14 (29.79%) Data Governance
12 13 (27.66%) Amazon Redshift
12 13 (27.66%) Apache Cassandra
12 13 (27.66%) Azure Data Factory
13 12 (25.53%) Data Quality
14 11 (23.40%) Informatica
14 11 (23.40%) TOGAF
14 11 (23.40%) Data Architecture
14 11 (23.40%) DAMA
14 11 (23.40%) Azure Synapse Analytics
15 10 (21.28%) Data Lake
15 10 (21.28%) Spark Streaming
16 9 (19.15%) Social Skills

Data Pipeline
Co-occurring IT Skills in Yorkshire by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 20 (42.55%) Apache Spark
2 9 (19.15%) Apache
3 8 (17.02%) Apache Airflow
4 6 (12.77%) Luigi
4 6 (12.77%) Tomcat
Cloud Services
1 36 (76.60%) Azure
2 21 (44.68%) AWS
3 13 (27.66%) Azure Data Factory
4 11 (23.40%) Azure Synapse Analytics
5 8 (17.02%) Amazon EC2
5 8 (17.02%) Amazon EMR
6 5 (10.64%) Amazon Kinesis
6 5 (10.64%) Serverless
7 4 (8.51%) AWS Lambda
7 4 (8.51%) GCP
8 3 (6.38%) Power Platform
9 2 (4.26%) Amazon S3
9 2 (4.26%) AWS CloudFormation
9 2 (4.26%) AWS Step Functions
9 2 (4.26%) Azure Active Directory
9 2 (4.26%) Azure Key Vault
9 2 (4.26%) Cloud Computing
9 2 (4.26%) Virtual Private Cloud
10 1 (2.13%) PaaS
10 1 (2.13%) SaaS
Communications & Networking
1 4 (8.51%) Cisco ASA
2 2 (4.26%) Firewall
3 1 (2.13%) FTP
Database & Business Intelligence
1 24 (51.06%) Metadata
2 16 (34.04%) NoSQL
3 15 (31.91%) Hadoop
4 14 (29.79%) Big Data
5 13 (27.66%) Amazon Redshift
5 13 (27.66%) Apache Cassandra
6 10 (21.28%) Data Lake
7 9 (19.15%) Amazon Athena
8 7 (14.89%) Relational Database
9 6 (12.77%) Amazon RDS
9 6 (12.77%) Azkaban
9 6 (12.77%) Data Warehouse
9 6 (12.77%) Metadata Repository
9 6 (12.77%) MySQL
9 6 (12.77%) PostgreSQL
10 5 (10.64%) HBase
11 4 (8.51%) MongoDB
11 4 (8.51%) SQL Server
12 3 (6.38%) Power BI
12 3 (6.38%) SQL Server Analysis Services
Development Applications
1 6 (12.77%) JIRA
2 4 (8.51%) Jenkins
2 4 (8.51%) Visual Studio
3 2 (4.26%) kappa
General
1 9 (19.15%) Social Skills
2 8 (17.02%) Analytical Skills
3 6 (12.77%) Public Sector
4 2 (4.26%) Legal
4 2 (4.26%) Marketing
Job Titles
1 26 (55.32%) Data Engineer
2 12 (25.53%) Architect
2 12 (25.53%) Data Architect
2 12 (25.53%) Senior Data Engineer
3 9 (19.15%) Azure Architect
4 6 (12.77%) Analyst
4 6 (12.77%) Data Analyst
5 4 (8.51%) Cloud Engineer
6 2 (4.26%) Azure DevOps
6 2 (4.26%) Data Migration Engineer
6 2 (4.26%) Data Migration Lead
6 2 (4.26%) Migration Engineer
6 2 (4.26%) Platform Engineer
6 2 (4.26%) Principal Engineer
6 2 (4.26%) Research Engineer
6 2 (4.26%) Senior Cloud Engineer
7 1 (2.13%) Azure DevOps Engineer
7 1 (2.13%) Azure Engineer
7 1 (2.13%) IoT Architect
7 1 (2.13%) Lead DevOps
Libraries, Frameworks & Software Standards
1 17 (36.17%) Kafka
2 10 (21.28%) Spark Streaming
3 4 (8.51%) ARM Templates
3 4 (8.51%) LAMP
3 4 (8.51%) LAPP Stack
3 4 (8.51%) PySpark
4 2 (4.26%) Lambda Expressions
4 2 (4.26%) NumPy
4 2 (4.26%) Pandas
4 2 (4.26%) SAML
5 1 (2.13%) .NET
5 1 (2.13%) JSON
5 1 (2.13%) Web Services
5 1 (2.13%) XML
Miscellaneous
1 8 (17.02%) Management Information System
2 7 (14.89%) Data Structures
3 6 (12.77%) NHS
4 2 (4.26%) Greenfield Project
5 1 (2.13%) Analytical Mindset
5 1 (2.13%) Enterprise Software
5 1 (2.13%) Reference Data
5 1 (2.13%) Virtual Team
Operating Systems
1 8 (17.02%) Linux
Processes & Methodologies
1 23 (48.94%) Data Modelling
2 20 (42.55%) Data Engineering
3 19 (40.43%) Analytics
4 17 (36.17%) Metadata Management
5 15 (31.91%) Data Analysis
6 14 (29.79%) Agile Software Development
6 14 (29.79%) Data Governance
7 11 (23.40%) DAMA
7 11 (23.40%) Data Architecture
7 11 (23.40%) TOGAF
8 9 (19.15%) Business Intelligence
9 8 (17.02%) ETL
9 8 (17.02%) Visualisation
10 7 (14.89%) Data Science
10 7 (14.89%) Data Transformation
10 7 (14.89%) Data Visualisation
11 6 (12.77%) Data Development
11 6 (12.77%) DataOps
11 6 (12.77%) Re-Platforming
11 6 (12.77%) Workload Management
Programming Languages
1 24 (51.06%) Python
2 19 (40.43%) SQL
3 5 (10.64%) Java
3 5 (10.64%) PowerShell
3 5 (10.64%) Scala
4 4 (8.51%) C++
5 3 (6.38%) R
6 2 (4.26%) MATLAB
6 2 (4.26%) T-SQL
7 1 (2.13%) C#
Qualifications
1 6 (12.77%) Degree
Quality Assurance & Compliance
1 12 (25.53%) Data Quality
2 4 (8.51%) QA
System Software
1 2 (4.26%) Active Directory
2 1 (2.13%) Docker
Systems Management
1 5 (10.64%) Kubernetes
1 5 (10.64%) Terraform
2 4 (8.51%) Opscode Chef
2 4 (8.51%) Puppet
3 2 (4.26%) Active Directory Federation Services
3 2 (4.26%) FortiGate
Vendors
1 29 (61.70%) Databricks
2 11 (23.40%) Informatica
3 8 (17.02%) Microsoft
4 5 (10.64%) Remedy
5 4 (8.51%) CheckPoint
5 4 (8.51%) Cisco
6 2 (4.26%) Google
7 1 (2.13%) Sony