Data Pipeline Contracts with Work from Home Options

Data Pipelines
UK > Work from Home

The table below provides summary statistics for contract job vacancies with an option to work from home (WFH) and a requirement for Data Pipeline skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Pipeline over the 6 months to 17 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
17 May 2024
Same period 2023 Same period 2022
Rank 187 239 222
Rank change year-on-year +52 -17 +2
Contract jobs citing Data Pipeline 166 246 553
As % of all contract jobs with a WFH option 1.12% 1.00% 1.26%
As % of the Processes & Methodologies category 1.28% 1.11% 1.38%
Number of daily rates quoted 137 175 380
10th Percentile £401 £413 £456
25th Percentile £475 £475 £513
Median daily rate (50th Percentile) £525 £550 £600
Median % change year-on-year -4.55% -8.33% +4.35%
75th Percentile £638 £650 £713
90th Percentile £775 £730 £813
UK median daily rate £525 £550 £600
% change year-on-year -4.55% -8.33% +9.09%
Number of hourly rates quoted 2 2 2
10th Percentile £48.70 £78.75 £30.95
25th Percentile £51.63 £80.63 £38.91
Median hourly rate £58.00 £85.00 £52.51
Median % change year-on-year -31.76% +61.87% +18.00%
75th Percentile £64.13 £88.13 £65.79
90th Percentile £66.90 £89.25 £73.57
UK median hourly rate £62.50 £70.25 £32.00
% change year-on-year -11.03% +119.53% -21.95%

All Process and Methodology Skills
Work from Home

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a WFH option and a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 13,003 22,075 40,116
As % of all contract jobs with a WFH option 87.92% 89.68% 91.10%
Number of daily rates quoted 8,720 15,632 29,130
10th Percentile £325 £363 £361
25th Percentile £425 £450 £432
Median daily rate (50th Percentile) £525 £543 £525
Median % change year-on-year -3.31% +3.43% +7.69%
75th Percentile £638 £650 £631
90th Percentile £750 £750 £725
UK median daily rate £525 £550 £530
% change year-on-year -4.55% +3.77% +8.16%
Number of hourly rates quoted 566 503 534
10th Percentile £14.94 £18.63 £14.08
25th Percentile £24.44 £26.68 £20.43
Median hourly rate £43.00 £52.50 £38.83
Median % change year-on-year -18.10% +35.21% +61.78%
75th Percentile £60.00 £68.75 £57.50
90th Percentile £75.00 £80.00 £71.75
UK median hourly rate £36.05 £35.65 £25.68
% change year-on-year +1.11% +38.82% +5.90%

Data Pipeline
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Data Pipeline as a proportion of all IT jobs advertised.

Data Pipeline trend for jobs with a WFH option

Data Pipeline
Daily Rate Trend for Jobs with a WFH Option

3-month moving average daily rate quoted in job vacancies with a work from home option citing Data Pipeline.

Data Pipeline daily rate for jobs with a WFH option

Data Pipeline
Daily Rate Histogram for Jobs with a WFH Option

Daily rate distribution for jobs with a work from home option citing Data Pipeline over the 6 months to 17 May 2024.

Data Pipeline daily rate histogram for jobs with a WFH option

Data Pipeline
Hourly Rate Trend for Jobs with a WFH Option

3-month moving average hourly rate quoted in job vacancies with a work from home option citing Data Pipeline.

Data Pipeline hourly rate for jobs with a WFH option

Data Pipeline
Hourly Rate Histogram for Jobs with a WFH Option

Hourly rate distribution for jobs with a work from home option citing Data Pipeline over the 6 months to 17 May 2024.

Data Pipeline hourly rate histogram for jobs with a WFH option

Data Pipeline
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 24 (14.46%) Apache Spark
2 15 (9.04%) Apache Airflow
3 9 (5.42%) Apache
4 4 (2.41%) Luigi
5 3 (1.81%) Confluence
Business Applications
1 1 (0.60%) Dynamics CRM
Cloud Services
1 87 (52.41%) Azure
2 59 (35.54%) AWS
3 26 (15.66%) Azure Data Factory
4 20 (12.05%) Serverless
5 19 (11.45%) GCP
5 19 (11.45%) Snowflake
6 17 (10.24%) dbt
7 16 (9.64%) AWS Lambda
8 14 (8.43%) Azure Synapse Analytics
9 12 (7.23%) Power Platform
10 11 (6.63%) Amazon S3
11 8 (4.82%) Amazon EMR
11 8 (4.82%) Azure Logic Apps
11 8 (4.82%) GitHub
12 6 (3.61%) Amazon Kinesis
13 5 (3.01%) Amazon EventBridge
13 5 (3.01%) AWS Step Functions
13 5 (3.01%) Azure DevOps
13 5 (3.01%) Fivetran
13 5 (3.01%) GitHub Actions
Communications & Networking
1 1 (0.60%) HTTP
1 1 (0.60%) SSL
Database & Business Intelligence
1 56 (33.73%) Data Warehouse
2 36 (21.69%) Data Lake
3 30 (18.07%) Big Data
4 17 (10.24%) Amazon Redshift
5 12 (7.23%) BigQuery
5 12 (7.23%) Power BI
5 12 (7.23%) SQL Server
6 9 (5.42%) Amazon Athena
6 9 (5.42%) Azure SQL Database
7 7 (4.22%) Delta Lake
8 6 (3.61%) PostgreSQL
9 5 (3.01%) NoSQL
9 5 (3.01%) Tableau
10 4 (2.41%) Relational Database
10 4 (2.41%) Snowflake Schema
10 4 (2.41%) SQL Server Integration Services
11 3 (1.81%) Flink
12 2 (1.20%) Azure SQL Data Warehouse
12 2 (1.20%) Metadata
12 2 (1.20%) Parquet
Development Applications
1 19 (11.45%) Git
2 11 (6.63%) JIRA
3 6 (3.61%) MLflow
4 5 (3.01%) JMeter
4 5 (3.01%) TestRail
5 4 (2.41%) GitLab
5 4 (2.41%) Jenkins
6 3 (1.81%) Postman
7 2 (1.20%) Bugzilla
7 2 (1.20%) JUnit
7 2 (1.20%) Selenium
7 2 (1.20%) TestNG
8 1 (0.60%) Bitbucket
8 1 (0.60%) Deequ
General
1 50 (30.12%) Social Skills
2 24 (14.46%) Finance
3 15 (9.04%) Banking
4 14 (8.43%) Analytical Skills
5 12 (7.23%) Public Sector
6 7 (4.22%) Front Office
6 7 (4.22%) Investment Banking
7 4 (2.41%) Presentation Skills
8 3 (1.81%) Marketing
9 2 (1.20%) Czech Language
9 2 (1.20%) Health Technology
9 2 (1.20%) Manufacturing
10 1 (0.60%) Advertising
10 1 (0.60%) Billing
10 1 (0.60%) Law
10 1 (0.60%) Publishing
10 1 (0.60%) Retail
Job Titles
1 99 (59.64%) Data Engineer
2 26 (15.66%) Azure Engineer
3 23 (13.86%) Azure Data Engineer
4 21 (12.65%) Lead
5 20 (12.05%) AWS Engineer
6 17 (10.24%) Architect
7 16 (9.64%) Senior
8 15 (9.04%) Lead Data Engineer
9 13 (7.83%) AWS Data Engineer
10 11 (6.63%) Senior Data Engineer
11 10 (6.02%) Analyst
11 10 (6.02%) Data Architect
12 8 (4.82%) Cloud Platform Engineer
12 8 (4.82%) Platform Engineer
12 8 (4.82%) Python Engineer
13 7 (4.22%) AWS Platform Engineer
13 7 (4.22%) Data Scientist
13 7 (4.22%) Developer
14 6 (3.61%) Snowflake Data Engineer
15 5 (3.01%) Python Data Engineer
Libraries, Frameworks & Software Standards
1 32 (19.28%) PySpark
2 10 (6.02%) Kafka
3 8 (4.82%) Pandas
4 4 (2.41%) REST
5 3 (1.81%) .NET
5 3 (1.81%) Spark Streaming
5 3 (1.81%) Web Services
6 2 (1.20%) Apache Avro
6 2 (1.20%) ARM Templates
6 2 (1.20%) JSON
6 2 (1.20%) JSON Schema
6 2 (1.20%) NumPy
6 2 (1.20%) OpenAPI
6 2 (1.20%) scikit-learn
7 1 (0.60%) Flask
7 1 (0.60%) RabbitMQ
7 1 (0.60%) SciPy
7 1 (0.60%) SOAP
7 1 (0.60%) SQLAlchemy
7 1 (0.60%) YAML
Miscellaneous
1 10 (6.02%) Algorithms
2 9 (5.42%) Distributed Systems
3 8 (4.82%) Greenfield Project
4 7 (4.22%) Derivative
5 4 (2.41%) Data Structures
6 3 (1.81%) Distributed Computing
6 3 (1.81%) Hedge funds
6 3 (1.81%) NHS
6 3 (1.81%) Renewable Energy
6 3 (1.81%) Social Media
7 2 (1.20%) Grid Computing
8 1 (0.60%) Enterprise Software
8 1 (0.60%) Legacy Systems
8 1 (0.60%) Low-Code
8 1 (0.60%) Product Ownership
8 1 (0.60%) Virtual Team
8 1 (0.60%) Wiki
Operating Systems
1 9 (5.42%) Linux
2 1 (0.60%) Mac OS
2 1 (0.60%) Unix
Processes & Methodologies
1 71 (42.77%) Analytics
1 71 (42.77%) ETL
2 58 (34.94%) Data Engineering
3 55 (33.13%) Data Modelling
4 42 (25.30%) Agile
5 39 (23.49%) DevOps
6 36 (21.69%) CI/CD
7 32 (19.28%) Problem-Solving
8 31 (18.67%) Data Science
9 28 (16.87%) Business Intelligence
10 24 (14.46%) Data Integration
11 21 (12.65%) Computer Science
12 20 (12.05%) Machine Learning
13 17 (10.24%) Data Ingestion
14 16 (9.64%) Test Automation
15 14 (8.43%) Continuous Integration
15 14 (8.43%) Data Transformation
16 13 (7.83%) Data Architecture
16 13 (7.83%) MLOps
16 13 (7.83%) Visualisation
Programming Languages
1 106 (63.86%) Python
2 81 (48.80%) SQL
3 28 (16.87%) Scala
4 26 (15.66%) Java
5 8 (4.82%) C#
6 5 (3.01%) Bicep
6 5 (3.01%) T-SQL
7 4 (2.41%) C++
8 3 (1.81%) Bash
9 2 (1.20%) JavaScript
9 2 (1.20%) PL/SQL
9 2 (1.20%) PowerShell
9 2 (1.20%) TypeScript
10 1 (0.60%) Go
10 1 (0.60%) MATLAB
10 1 (0.60%) Perl
10 1 (0.60%) R
10 1 (0.60%) Rust
10 1 (0.60%) Shell Script
Qualifications
1 23 (13.86%) Security Cleared
2 18 (10.84%) SC Cleared
3 16 (9.64%) Degree
4 15 (9.04%) Computer Science Degree
5 7 (4.22%) Master's Degree
6 6 (3.61%) Azure Certification
7 3 (1.81%) BPSS Clearance
8 2 (1.20%) AWS Certification
8 2 (1.20%) Microsoft Certification
9 1 (0.60%) (ISC)2 CCSP
9 1 (0.60%) AWS Certified Solutions Architect
9 1 (0.60%) Cisco Certification
9 1 (0.60%) CISSP
9 1 (0.60%) CSSLP
Quality Assurance & Compliance
1 25 (15.06%) Data Quality
2 5 (3.01%) QA
3 4 (2.41%) NCSC
4 2 (1.20%) Accessibility
5 1 (0.60%) GDPR
5 1 (0.60%) JSP 440
5 1 (0.60%) NIST
System Software
1 20 (12.05%) Docker
Systems Management
1 19 (11.45%) Terraform
2 12 (7.23%) Kubernetes
3 2 (1.20%) Ansible
4 1 (0.60%) Argo
Vendors
1 50 (30.12%) Databricks
2 20 (12.05%) Microsoft
3 6 (3.61%) Ab Initio
3 6 (3.61%) Google
4 5 (3.01%) Informatica
5 4 (2.41%) Facebook
5 4 (2.41%) Oracle
5 4 (2.41%) Twitter
6 3 (1.81%) Instagram
6 3 (1.81%) YouTube
7 2 (1.20%) Cloudera
7 2 (1.20%) Dynatrace
7 2 (1.20%) Foundry
7 2 (1.20%) JD Edwards
7 2 (1.20%) OpenAI
7 2 (1.20%) Palantir
7 2 (1.20%) QAD
8 1 (0.60%) Atlassian
8 1 (0.60%) Brio
8 1 (0.60%) Sage