Data Pipeline Contracts with Work from Home Options

Data Pipelines
UK > Work from Home

The table below provides summary statistics for contract job vacancies with an option to work from home (WFH) and a requirement for Data Pipeline skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Pipeline over the 6 months to 22 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
22 May 2024
Same period 2023 Same period 2022
Rank 189 237 216
Rank change year-on-year +48 -21 +10
Contract jobs citing Data Pipeline 166 248 551
As % of all contract jobs with a WFH option 1.13% 1.01% 1.25%
As % of the Processes & Methodologies category 1.29% 1.13% 1.37%
Number of daily rates quoted 139 177 379
10th Percentile £388 £413 £450
25th Percentile £472 £463 £513
Median daily rate (50th Percentile) £525 £550 £600
Median % change year-on-year -4.55% -8.33% +4.35%
75th Percentile £641 £650 £713
90th Percentile £779 £730 £813
UK median daily rate £525 £550 £600
% change year-on-year -4.55% -8.33% +9.09%
Number of hourly rates quoted 2 2 1
10th Percentile £48.70 £78.75 -
25th Percentile £51.63 £80.63 -
Median hourly rate £58.00 £85.00 £78.75
Median % change year-on-year -31.76% +7.94% +76.97%
75th Percentile £64.13 £88.13 -
90th Percentile £66.90 £89.25 -
UK median hourly rate £62.50 £75.50 £33.75
% change year-on-year -17.22% +123.70% -17.68%

All Process and Methodology Skills
Work from Home

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a WFH option and a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 12,871 21,938 40,174
As % of all contract jobs with a WFH option 87.92% 89.66% 91.07%
Number of daily rates quoted 8,680 15,535 29,175
10th Percentile £325 £363 £363
25th Percentile £425 £450 £433
Median daily rate (50th Percentile) £525 £543 £525
Median % change year-on-year -3.31% +3.43% +7.14%
75th Percentile £638 £650 £634
90th Percentile £750 £750 £725
UK median daily rate £525 £550 £533
% change year-on-year -4.55% +3.29% +7.58%
Number of hourly rates quoted 566 510 537
10th Percentile £14.66 £18.63 £14.50
25th Percentile £24.44 £27.48 £20.75
Median hourly rate £43.00 £52.50 £39.50
Median % change year-on-year -18.10% +32.91% +64.58%
75th Percentile £60.00 £68.75 £57.50
90th Percentile £75.00 £79.27 £71.00
UK median hourly rate £36.05 £37.00 £25.68
% change year-on-year -2.58% +44.08% +7.00%

Data Pipeline
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Data Pipeline as a proportion of all IT jobs advertised.

Data Pipeline trend for jobs with a WFH option

Data Pipeline
Daily Rate Trend for Jobs with a WFH Option

3-month moving average daily rate quoted in job vacancies with a work from home option citing Data Pipeline.

Data Pipeline daily rate for jobs with a WFH option

Data Pipeline
Daily Rate Histogram for Jobs with a WFH Option

Daily rate distribution for jobs with a work from home option citing Data Pipeline over the 6 months to 22 May 2024.

Data Pipeline daily rate histogram for jobs with a WFH option

Data Pipeline
Hourly Rate Trend for Jobs with a WFH Option

3-month moving average hourly rate quoted in job vacancies with a work from home option citing Data Pipeline.

Data Pipeline hourly rate for jobs with a WFH option

Data Pipeline
Hourly Rate Histogram for Jobs with a WFH Option

Hourly rate distribution for jobs with a work from home option citing Data Pipeline over the 6 months to 22 May 2024.

Data Pipeline hourly rate histogram for jobs with a WFH option

Data Pipeline
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 25 (15.06%) Apache Spark
2 15 (9.04%) Apache Airflow
3 10 (6.02%) Apache
4 4 (2.41%) Luigi
5 3 (1.81%) Confluence
6 1 (0.60%) SharePoint
Applications
1 1 (0.60%) Microsoft Excel
1 1 (0.60%) Microsoft Office
Business Applications
1 1 (0.60%) Dynamics CRM
Cloud Services
1 86 (51.81%) Azure
2 58 (34.94%) AWS
3 26 (15.66%) Azure Data Factory
4 20 (12.05%) Serverless
5 19 (11.45%) Snowflake
6 18 (10.84%) GCP
7 16 (9.64%) AWS Lambda
7 16 (9.64%) dbt
8 14 (8.43%) Azure Synapse Analytics
9 12 (7.23%) Power Platform
10 11 (6.63%) Amazon S3
11 8 (4.82%) Amazon EMR
11 8 (4.82%) Azure Logic Apps
12 7 (4.22%) GitHub
13 6 (3.61%) Amazon Kinesis
13 6 (3.61%) AWS Step Functions
14 5 (3.01%) Amazon EventBridge
14 5 (3.01%) Azure DevOps
14 5 (3.01%) Fivetran
14 5 (3.01%) GitHub Actions
Database & Business Intelligence
1 59 (35.54%) Data Warehouse
2 35 (21.08%) Data Lake
3 29 (17.47%) Big Data
4 17 (10.24%) Amazon Redshift
5 12 (7.23%) BigQuery
5 12 (7.23%) Power BI
6 11 (6.63%) SQL Server
7 9 (5.42%) Amazon Athena
7 9 (5.42%) Azure SQL Database
8 7 (4.22%) PostgreSQL
9 6 (3.61%) Delta Lake
9 6 (3.61%) NoSQL
10 5 (3.01%) Relational Database
10 5 (3.01%) Tableau
11 4 (2.41%) Snowflake Schema
11 4 (2.41%) SQL Server Integration Services
12 3 (1.81%) Flink
12 3 (1.81%) Hadoop
13 2 (1.20%) Azure SQL Data Warehouse
13 2 (1.20%) Parquet
Development Applications
1 18 (10.84%) Git
2 10 (6.02%) JIRA
3 6 (3.61%) MLflow
4 5 (3.01%) JMeter
4 5 (3.01%) TestRail
5 4 (2.41%) GitLab
5 4 (2.41%) Jenkins
6 3 (1.81%) Postman
7 2 (1.20%) Bugzilla
7 2 (1.20%) JUnit
7 2 (1.20%) Selenium
7 2 (1.20%) TestNG
8 1 (0.60%) Bitbucket
8 1 (0.60%) Deequ
General
1 50 (30.12%) Social Skills
2 25 (15.06%) Finance
3 16 (9.64%) Banking
4 14 (8.43%) Analytical Skills
5 12 (7.23%) Public Sector
6 7 (4.22%) Front Office
6 7 (4.22%) Investment Banking
7 3 (1.81%) Marketing
7 3 (1.81%) Presentation Skills
8 2 (1.20%) Czech Language
8 2 (1.20%) Financial Institution
8 2 (1.20%) Health Technology
8 2 (1.20%) Manufacturing
9 1 (0.60%) Advertising
9 1 (0.60%) Billing
9 1 (0.60%) Law
9 1 (0.60%) Publishing
9 1 (0.60%) Retail
Job Titles
1 100 (60.24%) Data Engineer
2 26 (15.66%) Azure Engineer
3 23 (13.86%) Azure Data Engineer
4 21 (12.65%) AWS Engineer
4 21 (12.65%) Lead
5 17 (10.24%) Senior
6 16 (9.64%) Architect
7 15 (9.04%) Lead Data Engineer
8 14 (8.43%) AWS Data Engineer
9 12 (7.23%) Senior Data Engineer
10 11 (6.63%) Analyst
11 9 (5.42%) Data Architect
11 9 (5.42%) Snowflake Engineer
12 8 (4.82%) Cloud Platform Engineer
12 8 (4.82%) Platform Engineer
13 7 (4.22%) AWS Platform Engineer
13 7 (4.22%) Data Scientist
13 7 (4.22%) Developer
13 7 (4.22%) Python Engineer
14 6 (3.61%) Snowflake Data Engineer
Libraries, Frameworks & Software Standards
1 32 (19.28%) PySpark
2 11 (6.63%) Kafka
3 7 (4.22%) Pandas
4 4 (2.41%) REST
5 3 (1.81%) .NET
5 3 (1.81%) Spark Streaming
5 3 (1.81%) Web Services
6 2 (1.20%) Apache Avro
6 2 (1.20%) ARM Templates
6 2 (1.20%) JSON
6 2 (1.20%) JSON Schema
6 2 (1.20%) NumPy
6 2 (1.20%) OpenAPI
6 2 (1.20%) scikit-learn
7 1 (0.60%) Great Expectations
7 1 (0.60%) Middleware
7 1 (0.60%) RabbitMQ
7 1 (0.60%) SciPy
7 1 (0.60%) SOAP
7 1 (0.60%) YAML
Miscellaneous
1 10 (6.02%) Algorithms
2 9 (5.42%) Distributed Systems
3 8 (4.82%) Greenfield Project
4 7 (4.22%) Derivative
5 4 (2.41%) Data Structures
6 3 (1.81%) Distributed Computing
6 3 (1.81%) Hedge funds
6 3 (1.81%) NHS
6 3 (1.81%) Renewable Energy
6 3 (1.81%) Social Media
7 2 (1.20%) Grid Computing
8 1 (0.60%) Credit Risk
8 1 (0.60%) Enterprise Software
8 1 (0.60%) Legacy Systems
8 1 (0.60%) Low-Code
8 1 (0.60%) Product Ownership
8 1 (0.60%) Virtual Team
8 1 (0.60%) Wiki
Operating Systems
1 9 (5.42%) Linux
2 1 (0.60%) Unix
Processes & Methodologies
1 73 (43.98%) ETL
2 69 (41.57%) Analytics
3 59 (35.54%) Data Engineering
4 55 (33.13%) Data Modelling
5 41 (24.70%) Agile
6 40 (24.10%) DevOps
7 36 (21.69%) CI/CD
8 32 (19.28%) Problem-Solving
9 31 (18.67%) Data Science
10 28 (16.87%) Business Intelligence
11 24 (14.46%) Data Integration
12 21 (12.65%) Computer Science
13 19 (11.45%) Machine Learning
14 17 (10.24%) Data Ingestion
15 16 (9.64%) Test Automation
16 14 (8.43%) Continuous Integration
17 13 (7.83%) Data Architecture
17 13 (7.83%) Data Transformation
17 13 (7.83%) Stakeholder Management
17 13 (7.83%) Visualisation
Programming Languages
1 108 (65.06%) Python
2 83 (50.00%) SQL
3 28 (16.87%) Scala
4 27 (16.27%) Java
5 8 (4.82%) C#
6 5 (3.01%) Bicep
6 5 (3.01%) T-SQL
7 4 (2.41%) C++
8 3 (1.81%) Bash
8 3 (1.81%) JavaScript
9 2 (1.20%) Go
9 2 (1.20%) PL/SQL
9 2 (1.20%) PowerShell
9 2 (1.20%) TypeScript
10 1 (0.60%) MATLAB
10 1 (0.60%) Perl
10 1 (0.60%) R
10 1 (0.60%) Rust
10 1 (0.60%) Shell Script
10 1 (0.60%) VB
Qualifications
1 22 (13.25%) Security Cleared
2 17 (10.24%) SC Cleared
3 16 (9.64%) Degree
4 15 (9.04%) Computer Science Degree
5 7 (4.22%) Master's Degree
6 6 (3.61%) Azure Certification
7 3 (1.81%) BPSS Clearance
8 2 (1.20%) AWS Certification
8 2 (1.20%) Microsoft Certification
9 1 (0.60%) (ISC)2 CCSP
9 1 (0.60%) AWS Certified Solutions Architect
9 1 (0.60%) CISA
9 1 (0.60%) Cisco Certification
9 1 (0.60%) CISSP
9 1 (0.60%) CRISC
9 1 (0.60%) CSSLP
Quality Assurance & Compliance
1 25 (15.06%) Data Quality
2 5 (3.01%) QA
3 3 (1.81%) Accessibility
3 3 (1.81%) NCSC
4 1 (0.60%) GDPR
4 1 (0.60%) NIST
System Software
1 21 (12.65%) Docker
Systems Management
1 19 (11.45%) Terraform
2 14 (8.43%) Kubernetes
3 2 (1.20%) Ansible
4 1 (0.60%) Argo
Vendors
1 51 (30.72%) Databricks
2 20 (12.05%) Microsoft
3 6 (3.61%) Ab Initio
3 6 (3.61%) Google
4 5 (3.01%) Informatica
5 4 (2.41%) Facebook
5 4 (2.41%) Oracle
5 4 (2.41%) Twitter
6 3 (1.81%) Instagram
6 3 (1.81%) YouTube
7 2 (1.20%) Dynatrace
7 2 (1.20%) Foundry
7 2 (1.20%) JD Edwards
7 2 (1.20%) OpenAI
7 2 (1.20%) Palantir
7 2 (1.20%) QAD
8 1 (0.60%) Brio
8 1 (0.60%) IBM
8 1 (0.60%) Sage
8 1 (0.60%) Workday