Data Pipeline Contracts in England

Data Pipelines
UK > England

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Data Pipeline skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Pipeline over the 6 months to 28 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
28 Apr 2024
Same period 2023 Same period 2022
Rank 187 276 282
Rank change year-on-year +89 +6 -24
Contract jobs citing Data Pipeline 467 474 702
As % of all contract jobs advertised in England 1.26% 0.94% 0.99%
As % of the Processes & Methodologies category 1.46% 1.04% 1.09%
Number of daily rates quoted 351 318 463
10th Percentile £381 £425 £457
25th Percentile £450 £494 £513
Median daily rate (50th Percentile) £550 £550 £600
Median % change year-on-year - -8.33% +11.11%
75th Percentile £650 £650 £714
90th Percentile £738 £742 £813
UK median daily rate £525 £550 £600
% change year-on-year -4.55% -8.33% +9.09%
Number of hourly rates quoted 8 6 7
10th Percentile £25.94 £50.63 £22.38
25th Percentile £42.00 £65.00 £26.69
Median hourly rate £62.50 £70.25 £32.00
Median % change year-on-year -11.03% +119.53% -30.43%
75th Percentile £66.38 £80.81 £57.75
90th Percentile £67.35 £86.25 £83.61
UK median hourly rate £62.50 £70.25 £32.00
% change year-on-year -11.03% +119.53% -30.43%

All Process and Methodology Skills
England

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 31,992 45,544 64,506
As % of all contract IT jobs advertised in England 86.53% 90.24% 90.76%
Number of daily rates quoted 20,975 31,977 45,770
10th Percentile £300 £325 £331
25th Percentile £413 £445 £425
Median daily rate (50th Percentile) £525 £550 £538
Median % change year-on-year -4.55% +2.33% +9.69%
75th Percentile £650 £675 £650
90th Percentile £750 £765 £749
UK median daily rate £525 £550 £525
% change year-on-year -4.55% +4.76% +8.25%
Number of hourly rates quoted 2,229 1,592 1,769
10th Percentile £12.86 £10.87 £12.50
25th Percentile £16.00 £16.25 £15.25
Median hourly rate £35.50 £37.50 £24.35
Median % change year-on-year -5.33% +54.00% +1.46%
75th Percentile £60.00 £65.00 £49.25
90th Percentile £72.50 £75.00 £63.60
UK median hourly rate £35.00 £37.30 £25.00
% change year-on-year -6.17% +49.20% -

Data Pipeline
Job Vacancy Trend in England

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Pipeline in England

Data Pipeline
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Data Pipeline in England.

Daily rate trend for Data Pipeline in England

Data Pipeline
Daily Rate Histogram in England

Daily rate distribution for jobs citing Data Pipeline in England over the 6 months to 28 April 2024.

Daily rate histogram for Data Pipeline in England

Data Pipeline
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Data Pipeline in England.

Hourly rate trend for Data Pipeline in England

Data Pipeline
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Data Pipeline in England over the 6 months to 28 April 2024.

Hourly rate histogram for Data Pipeline in England

Data Pipeline
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Pipeline within the England region over the 6 months to 28 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
London +79 308 £575 +1.77% 181
North of England +38 52 £500 +2.56% 33
Midlands +49 42 £550 +0.92% 26
West Midlands +48 37 £550 +0.92% 17
North West +14 28 £500 +5.26% 19
Yorkshire +38 24 £563 -13.46% 10
South East -13 17 £650 +20.93% 23
East of England +21 14 £513 -2.38% 13
South West +11 10 £550 -2.22% 15
East Midlands - 5 £425 - 9
Data Pipeline
UK

Data Pipeline
Co-occurring Skills and Capabilities in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 69 (14.78%) Apache Spark
2 62 (13.28%) Apache
3 49 (10.49%) Apache Airflow
4 5 (1.07%) Luigi
5 3 (0.64%) Confluence
6 1 (0.21%) ArcGIS
6 1 (0.21%) Jupyter
Applications
1 7 (1.50%) Microsoft Excel
2 2 (0.43%) Microsoft Office
2 2 (0.43%) Microsoft PowerPoint
2 2 (0.43%) Microsoft Project
2 2 (0.43%) MS Visio
3 1 (0.21%) Sketch
3 1 (0.21%) Spreadsheet
Business Applications
1 2 (0.43%) Dynamics CRM
Cloud Services
1 197 (42.18%) AWS
2 182 (38.97%) Azure
3 69 (14.78%) Serverless
4 60 (12.85%) AWS Lambda
4 60 (12.85%) Azure Data Factory
5 57 (12.21%) GCP
6 54 (11.56%) Amazon S3
7 34 (7.28%) Snowflake
8 31 (6.64%) Power Platform
9 30 (6.42%) Amazon Kinesis
9 30 (6.42%) Azure Synapse Analytics
10 26 (5.57%) Amazon EMR
11 24 (5.14%) Azure DevOps
11 24 (5.14%) GitHub
12 22 (4.71%) AWS Step Functions
13 21 (4.50%) Amazon EC2
14 20 (4.28%) dbt
15 13 (2.78%) Amazon MSK
16 11 (2.36%) Cloud Computing
17 10 (2.14%) Dagster
Communications & Networking
1 14 (3.00%) Intrusion Detection
1 14 (3.00%) Network Security
2 5 (1.07%) FTP
3 2 (0.43%) SAN
4 1 (0.21%) Firewall
4 1 (0.21%) HTTP
4 1 (0.21%) SSL
Database & Business Intelligence
1 115 (24.63%) Data Warehouse
2 105 (22.48%) Big Data
3 81 (17.34%) Data Lake
4 53 (11.35%) Amazon Redshift
5 44 (9.42%) NoSQL
6 31 (6.64%) Power BI
7 30 (6.42%) Relational Database
8 29 (6.21%) SQL Server
9 28 (6.00%) BigQuery
10 26 (5.57%) Flink
11 22 (4.71%) DynamoDB
12 19 (4.07%) Amazon Athena
12 19 (4.07%) Parquet
13 18 (3.85%) Hadoop
14 16 (3.43%) Amazon RDS
14 16 (3.43%) PostgreSQL
15 14 (3.00%) Tableau
16 13 (2.78%) Azure SQL Database
17 11 (2.36%) Apache Hive
17 11 (2.36%) Metadata
Development Applications
1 51 (10.92%) Git
2 19 (4.07%) JIRA
3 9 (1.93%) Jenkins
4 7 (1.50%) GitLab
4 7 (1.50%) Mercurial
4 7 (1.50%) MLflow
5 4 (0.86%) ERwin
6 3 (0.64%) Deequ
6 3 (0.64%) Poetry
7 2 (0.43%) Bitbucket
7 2 (0.43%) ER Studio
7 2 (0.43%) Maven
7 2 (0.43%) Travis CI
8 1 (0.21%) GoCD
8 1 (0.21%) JMeter
8 1 (0.21%) kappa
8 1 (0.21%) Postman
8 1 (0.21%) TestRail
8 1 (0.21%) webpack
General
1 109 (23.34%) Social Skills
2 81 (17.34%) Analytical Skills
3 63 (13.49%) Finance
4 33 (7.07%) Public Sector
5 21 (4.50%) Banking
6 15 (3.21%) Presentation Skills
7 14 (3.00%) Front Office
8 9 (1.93%) Pharmaceutical
9 7 (1.50%) Investment Banking
9 7 (1.50%) Manufacturing
9 7 (1.50%) Multimedia
9 7 (1.50%) Retail
10 5 (1.07%) Inclusion and Diversity
11 4 (0.86%) Marketing
12 3 (0.64%) Back Office
12 3 (0.64%) Games
13 2 (0.43%) Czech Language
13 2 (0.43%) Health Technology
13 2 (0.43%) Influencing Skills
13 2 (0.43%) Police
Job Titles
1 248 (53.10%) Data Engineer
2 70 (14.99%) Senior
3 56 (11.99%) Developer
4 46 (9.85%) Azure Engineer
5 45 (9.64%) Azure Data Engineer
6 42 (8.99%) Architect
7 37 (7.92%) Senior Data Engineer
8 30 (6.42%) AWS Engineer
9 27 (5.78%) AWS Data Engineer
9 27 (5.78%) Lead
10 24 (5.14%) Python Developer
11 22 (4.71%) Data Scientist
12 18 (3.85%) Data Architect
12 18 (3.85%) Lead Data Engineer
13 16 (3.43%) Analyst
14 15 (3.21%) Python Engineer
15 13 (2.78%) Senior Developer
16 12 (2.57%) Cloud Engineer
16 12 (2.57%) Python Data Engineer
17 10 (2.14%) GCP Engineer
Libraries, Frameworks & Software Standards
1 60 (12.85%) Kafka
2 47 (10.06%) PySpark
3 43 (9.21%) Pandas
4 29 (6.21%) NumPy
5 25 (5.35%) JSON
6 22 (4.71%) SciPy
7 17 (3.64%) Apache Avro
8 15 (3.21%) Apache NiFi
9 12 (2.57%) scikit-learn
10 11 (2.36%) REST
11 9 (1.93%) Elastic Stack
11 9 (1.93%) React
11 9 (1.93%) TensorFlow
12 8 (1.71%) Flask
13 6 (1.28%) .NET
13 6 (1.28%) GraphQL
13 6 (1.28%) Great Expectations
13 6 (1.28%) Lambda Expressions
13 6 (1.28%) XML
13 6 (1.28%) YAML
Miscellaneous
1 29 (6.21%) Algorithms
2 19 (4.07%) Derivative
2 19 (4.07%) Management Information System
3 16 (3.43%) Distributed Applications
4 15 (3.21%) Cyber Defence
5 13 (2.78%) Distributed Systems
6 12 (2.57%) Data Structures
6 12 (2.57%) Greenfield Project
6 12 (2.57%) Linux Command Line
7 10 (2.14%) Onboarding
8 9 (1.93%) Cloud Native
8 9 (1.93%) Distributed Computing
9 7 (1.50%) Self-Motivation
10 5 (1.07%) Analytical Mindset
10 5 (1.07%) Renewable Energy
10 5 (1.07%) Social Media
11 4 (0.86%) Hedge funds
11 4 (0.86%) Security Posture
12 3 (0.64%) Legacy Systems
12 3 (0.64%) Virtual Reality
Operating Systems
1 34 (7.28%) Linux
2 30 (6.42%) Windows
3 15 (3.21%) Unix
4 12 (2.57%) Android
4 12 (2.57%) Apple iOS
5 8 (1.71%) Ubuntu
6 1 (0.21%) Mac OS
6 1 (0.21%) Windows Server
Processes & Methodologies
1 182 (38.97%) ETL
2 164 (35.12%) Data Modelling
3 141 (30.19%) Analytics
4 130 (27.84%) Data Engineering
5 96 (20.56%) CI/CD
6 84 (17.99%) Problem-Solving
7 80 (17.13%) DevOps
8 79 (16.92%) Data Science
9 72 (15.42%) Data Integration
10 67 (14.35%) Agile
11 61 (13.06%) Business Intelligence
11 61 (13.06%) Machine Learning
12 51 (10.92%) Data Ingestion
13 45 (9.64%) Computer Science
13 45 (9.64%) Data Management
14 44 (9.42%) Data Governance
14 44 (9.42%) Visualisation
15 41 (8.78%) Test Automation
16 39 (8.35%) Data Transformation
17 37 (7.92%) Software Engineering
Programming Languages
1 293 (62.74%) Python
2 253 (54.18%) SQL
3 62 (13.28%) Java
4 44 (9.42%) Scala
5 24 (5.14%) C#
6 19 (4.07%) C++
6 19 (4.07%) JavaScript
7 14 (3.00%) R
7 14 (3.00%) T-SQL
8 12 (2.57%) Rust
9 7 (1.50%) Bicep
9 7 (1.50%) TypeScript
10 5 (1.07%) Bash
10 5 (1.07%) PowerShell
11 4 (0.86%) Perl
11 4 (0.86%) Shell Script
12 3 (0.64%) Data Analysis Expressions
12 3 (0.64%) MATLAB
12 3 (0.64%) PL/SQL
13 2 (0.43%) Go
Qualifications
1 99 (21.20%) Security Cleared
2 80 (17.13%) SC Cleared
3 48 (10.28%) Degree
4 33 (7.07%) Computer Science Degree
5 19 (4.07%) DV Cleared
6 9 (1.93%) AWS Certification
7 8 (1.71%) Master's Degree
8 7 (1.50%) Azure Certification
9 5 (1.07%) BPSS Clearance
9 5 (1.07%) CISSP
10 3 (0.64%) AWS Certified Solutions Architect
10 3 (0.64%) Microsoft Certification
11 2 (0.43%) AWS Certified Developer
11 2 (0.43%) AWS Certified DevOps Engineer
11 2 (0.43%) PhD
12 1 (0.21%) CTC Cleared
Quality Assurance & Compliance
1 83 (17.77%) Data Quality
2 14 (3.00%) Actionable Recommendations
3 10 (2.14%) QA
4 4 (0.86%) GDPR
5 2 (0.43%) Accessibility
5 2 (0.43%) PCI DSS
6 1 (0.21%) California Consumer Privacy Act
6 1 (0.21%) JSP 440
6 1 (0.21%) NCSC
System Software
1 31 (6.64%) Docker
2 8 (1.71%) Active Directory
2 8 (1.71%) HDFS
2 8 (1.71%) iptables
3 2 (0.43%) VMware Infrastructure
4 1 (0.21%) Apache ZooKeeper
4 1 (0.21%) Virtual Machines
Systems Management
1 39 (8.35%) Terraform
2 25 (5.35%) Kubernetes
3 8 (1.71%) Kibana
3 8 (1.71%) logstash
4 4 (0.86%) Argo
5 2 (0.43%) Ansible
5 2 (0.43%) Hadoop YARN
6 1 (0.21%) Control-M
6 1 (0.21%) Kubeflow
6 1 (0.21%) Progress Chef
Vendors
1 90 (19.27%) Databricks
2 30 (6.42%) Microsoft
3 22 (4.71%) Google
4 19 (4.07%) Informatica
4 19 (4.07%) Oracle
5 11 (2.36%) Red Hat
5 11 (2.36%) SAP
5 11 (2.36%) Talend
6 9 (1.93%) Cloudera
7 8 (1.71%) Palantir
8 6 (1.28%) Foundry
9 4 (0.86%) IFS
10 3 (0.64%) Dataiku
11 2 (0.43%) Dynatrace
11 2 (0.43%) JD Edwards
11 2 (0.43%) OpenAI
11 2 (0.43%) Sage
11 2 (0.43%) Salesforce
11 2 (0.43%) ServiceNow
11 2 (0.43%) Workday