Data Pipeline Jobs with Work from Home Options

Data Pipelines
UK > Work from Home

The table below provides summary statistics for permanent job vacancies with an option to work from home (WFH) and a requirement for Data Pipeline skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Pipeline over the 6 months to 8 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
8 May 2024
Same period 2023 Same period 2022
Rank 218 202 200
Rank change year-on-year -16 -2 +90
Permanent jobs citing Data Pipeline 510 706 1,431
As % of all permanent jobs with a WFH option 1.51% 1.70% 2.08%
As % of the Processes & Methodologies category 1.65% 1.77% 2.15%
Number of salaries quoted 353 430 628
10th Percentile £35,000 £47,000 £49,000
25th Percentile £46,250 £56,052 £60,000
Median annual salary (50th Percentile) £67,500 £67,500 £80,000
Median % change year-on-year - -15.63% +23.08%
75th Percentile £85,000 £85,000 £87,500
90th Percentile £107,500 £98,875 £100,000
UK median annual salary £67,500 £69,447 £75,000
% change year-on-year -2.80% -7.40% +15.38%

All Process and Methodology Skills
Work from Home

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a WFH option and a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 30,965 39,955 66,612
As % of all permanent jobs with a WFH option 91.45% 96.10% 96.96%
Number of salaries quoted 23,443 27,739 41,261
10th Percentile £33,750 £37,500 £36,250
25th Percentile £42,500 £47,500 £45,750
Median annual salary (50th Percentile) £57,500 £62,500 £60,000
Median % change year-on-year -8.00% +4.17% +9.09%
75th Percentile £75,000 £82,500 £80,000
90th Percentile £95,000 £100,000 £95,000
UK median annual salary £55,000 £61,180 £60,000
% change year-on-year -10.10% +1.97% +9.09%

Data Pipeline
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Data Pipeline as a proportion of all IT jobs advertised.

Data Pipeline trend for jobs with a WFH option

Data Pipeline
Salary Trend for Jobs with a WFH Option

3-month moving average salary quoted in job vacancies with a work from home option citing Data Pipeline.

Data Pipeline salary trend for jobs with a WFH option

Data Pipeline
Salary Histogram for Jobs with a WFH Option

Salary distribution for jobs with a work from home option citing Data Pipeline over the 6 months to 8 May 2024.

Data Pipeline salary histogram for jobs with a WFH option

Data Pipeline
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 66 (12.94%) Apache Spark
2 36 (7.06%) Apache
2 36 (7.06%) Apache Airflow
3 2 (0.39%) SharePoint
4 1 (0.20%) Luigi
Applications
1 10 (1.96%) Microsoft Excel
Business Applications
1 4 (0.78%) Primavera
2 1 (0.20%) Salesforce CRM
2 1 (0.20%) SAP S/4HANA
2 1 (0.20%) Shopify
Cloud Services
1 236 (46.27%) AWS
2 214 (41.96%) Azure
3 96 (18.82%) Snowflake
4 95 (18.63%) Power Platform
5 80 (15.69%) GCP
6 75 (14.71%) Azure Data Factory
7 50 (9.80%) Matillion
8 45 (8.82%) Azure Synapse Analytics
9 37 (7.25%) Serverless
10 33 (6.47%) dbt
11 30 (5.88%) Azure Cosmos DB
12 25 (4.90%) Amazon S3
13 12 (2.35%) Azure DevOps
14 11 (2.16%) AWS Lambda
15 10 (1.96%) Amazon EMR
15 10 (1.96%) GitHub
15 10 (1.96%) Google Kubernetes Engine
15 10 (1.96%) SaaS
16 9 (1.76%) PowerApps
16 9 (1.76%) Prefect
Communications & Networking
1 7 (1.37%) Firewall
2 2 (0.39%) Network Security
2 2 (0.39%) VPN
Database & Business Intelligence
1 177 (34.71%) Data Warehouse
2 144 (28.24%) Data Lake
3 132 (25.88%) Tableau
4 95 (18.63%) Power BI
5 89 (17.45%) SQL Server
6 53 (10.39%) Big Data
7 41 (8.04%) NoSQL
8 40 (7.84%) BigQuery
9 36 (7.06%) Metadata
10 35 (6.86%) Star Schema
11 33 (6.47%) PostgreSQL
12 32 (6.27%) Elasticsearch
13 31 (6.08%) SQL Server Integration Services
14 23 (4.51%) Amazon Redshift
14 23 (4.51%) Relational Database
15 22 (4.31%) Hadoop
16 19 (3.73%) Delta Lake
16 19 (3.73%) Enterprise Data Warehouse
17 16 (3.14%) MySQL
18 15 (2.94%) Amazon Athena
Development Applications
1 138 (27.06%) Git
2 37 (7.25%) GitLab
3 25 (4.90%) Jenkins
4 10 (1.96%) Spinnaker
5 6 (1.18%) Oracle Forms
6 5 (0.98%) GDB
7 4 (0.78%) Bitbucket
8 3 (0.59%) Octopus Deploy
9 2 (0.39%) CircleCI
9 2 (0.39%) JIRA
9 2 (0.39%) Visual Studio
10 1 (0.20%) Mockito
General
1 214 (41.96%) Social Skills
2 189 (37.06%) Analytical Skills
3 122 (23.92%) Retail
4 114 (22.35%) Presentation Skills
5 94 (18.43%) Finance
6 44 (8.63%) Banking
7 14 (2.75%) Billing
7 14 (2.75%) Games
8 11 (2.16%) Inclusion and Diversity
9 10 (1.96%) Back Office
9 10 (1.96%) Telecoms
10 9 (1.76%) Influencing Skills
10 9 (1.76%) Marketing
11 8 (1.57%) Public Sector
12 5 (0.98%) Legal
13 4 (0.78%) Agriculture
13 4 (0.78%) Music Industry
13 4 (0.78%) Wearables
14 3 (0.59%) Law
14 3 (0.59%) Retail Banking
Job Titles
1 218 (42.75%) Data Engineer
2 175 (34.31%) Senior
3 122 (23.92%) Analyst
4 119 (23.33%) Data Analyst
5 76 (14.90%) Senior Analyst
5 76 (14.90%) Senior Data Analyst
6 71 (13.92%) Senior Data Engineer
7 70 (13.73%) Lead
8 40 (7.84%) Developer
9 32 (6.27%) Architect
9 32 (6.27%) Lead Data Analyst
10 29 (5.69%) Data Manager
10 29 (5.69%) Engineering Manager
11 28 (5.49%) Data Architect
11 28 (5.49%) Python Data Engineer
11 28 (5.49%) Python Engineer
12 24 (4.71%) Lead Data Engineer
13 20 (3.92%) Azure Engineer
14 18 (3.53%) Azure Data Engineer
14 18 (3.53%) Business Intelligence Manager
Libraries, Frameworks & Software Standards
1 33 (6.47%) Kafka
2 30 (5.88%) PySpark
3 23 (4.51%) Pandas
4 14 (2.75%) Apache Beam
5 12 (2.35%) XGBoost
6 7 (1.37%) .NET
7 6 (1.18%) Flask
7 6 (1.18%) React
7 6 (1.18%) Spring
8 5 (0.98%) Django
8 5 (0.98%) FastAPI
8 5 (0.98%) Web Services
9 4 (0.78%) .NET Core
9 4 (0.78%) ASP.NET
9 4 (0.78%) ASP.NET Core
9 4 (0.78%) Entity Framework
9 4 (0.78%) Hibernate
9 4 (0.78%) REST
9 4 (0.78%) RESTful
9 4 (0.78%) Spring MVC
Miscellaneous
1 68 (13.33%) Data Structures
2 37 (7.25%) Self-Motivation
3 21 (4.12%) Cloud Native
4 15 (2.94%) Algorithms
5 13 (2.55%) Enterprise Software
5 13 (2.55%) IoT
6 10 (1.96%) Management Information System
7 9 (1.76%) Client/Server
7 9 (1.76%) Product Ownership
8 7 (1.37%) Renewable Energy
9 6 (1.18%) Onboarding
10 4 (0.78%) Analytical Mindset
10 4 (0.78%) Credit Risk
10 4 (0.78%) Distributed Computing
10 4 (0.78%) PMI
10 4 (0.78%) Public Cloud
11 3 (0.59%) Driving Licence
11 3 (0.59%) Team-Oriented Environment
11 3 (0.59%) Video Conferencing
11 3 (0.59%) Virtual Team
Operating Systems
1 21 (4.12%) Linux
2 11 (2.16%) Unix
3 1 (0.20%) Windows
Processes & Methodologies
1 276 (54.12%) Analytics
2 193 (37.84%) ETL
3 192 (37.65%) Data Engineering
4 178 (34.90%) Problem-Solving
5 176 (34.51%) Visualisation
6 166 (32.55%) Data Analysis
6 166 (32.55%) Data Modelling
7 149 (29.22%) Agile
8 138 (27.06%) Data Science
9 120 (23.53%) Mathematics
10 119 (23.33%) Business Intelligence
11 113 (22.16%) Statistics
12 111 (21.76%) Actionable Insight
13 109 (21.37%) CI/CD
13 109 (21.37%) Root Cause Analysis
13 109 (21.37%) Storytelling
14 108 (21.18%) Business Strategy
14 108 (21.18%) Customer Intelligence
15 106 (20.78%) Stakeholder Engagement
16 101 (19.80%) Machine Learning
Programming Languages
1 392 (76.86%) SQL
2 345 (67.65%) Python
3 61 (11.96%) Java
4 33 (6.47%) T-SQL
5 27 (5.29%) Scala
6 17 (3.33%) C#
7 16 (3.14%) Kotlin
8 13 (2.55%) Go
9 6 (1.18%) Clojure
9 6 (1.18%) TypeScript
10 4 (0.78%) Data Analysis Expressions
10 4 (0.78%) JavaScript
10 4 (0.78%) R
11 3 (0.59%) C
12 1 (0.20%) Google Apps Script
12 1 (0.20%) PowerShell
12 1 (0.20%) Rust
Qualifications
1 168 (32.94%) Degree
2 143 (28.04%) DBS Check
3 29 (5.69%) Computer Science Degree
4 17 (3.33%) Security Cleared
5 16 (3.14%) Master's Degree
6 13 (2.55%) SC Cleared
7 7 (1.37%) DV Cleared
8 4 (0.78%) CIMA
8 4 (0.78%) PMI Certification
9 3 (0.59%) AWS Certification
9 3 (0.59%) AWS Certified Solutions Architect
10 2 (0.39%) Azure Certification
10 2 (0.39%) Microsoft Certification
11 1 (0.20%) PhD
11 1 (0.20%) Postgraduate
Quality Assurance & Compliance
1 102 (20.00%) Data Quality
2 22 (4.31%) GDPR
3 5 (0.98%) QA
4 4 (0.78%) Solvency II
5 3 (0.59%) ISO/IEC 27001
6 2 (0.39%) Accessibility
7 1 (0.20%) California Consumer Privacy Act
7 1 (0.20%) GMP
7 1 (0.20%) HIPAA
System Software
1 23 (4.51%) Docker
Systems Management
1 62 (12.16%) Kubernetes
2 31 (6.08%) Terraform
3 5 (0.98%) Ansible
4 3 (0.59%) Argo
Vendors
1 194 (38.04%) Databricks
2 78 (15.29%) Microsoft
3 32 (6.27%) Google
4 19 (3.73%) Oracle
5 10 (1.96%) SAP
6 8 (1.57%) Teradata
7 7 (1.37%) Confluent
8 6 (1.18%) Talend
9 3 (0.59%) SnapLogic
10 2 (0.39%) Ab Initio
10 2 (0.39%) Cloudera
10 2 (0.39%) Hortonworks
10 2 (0.39%) Sage
11 1 (0.20%) CrowdStrike
11 1 (0.20%) Informatica
11 1 (0.20%) Salesforce