Data Pipeline Contracts in England

Data Pipelines
UK > England

The following table provides summary statistics for contract job vacancies advertised in England with a requirement for Data Pipeline skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Pipeline over the 6 months to 17 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
17 May 2024
Same period 2023 Same period 2022
Rank 181 287 282
Rank change year-on-year +106 -5 -36
Contract jobs citing Data Pipeline 465 438 682
As % of all contract jobs advertised in England 1.28% 0.91% 0.97%
As % of the Processes & Methodologies category 1.48% 1.01% 1.07%
Number of daily rates quoted 344 301 448
10th Percentile £363 £425 £450
25th Percentile £450 £500 £513
Median daily rate (50th Percentile) £550 £550 £600
Median % change year-on-year - -8.33% +11.11%
75th Percentile £650 £688 £714
90th Percentile £738 £750 £813
UK median daily rate £525 £550 £600
% change year-on-year -4.55% -8.33% +9.09%
Number of hourly rates quoted 7 6 7
10th Percentile £25.34 £50.63 £26.00
25th Percentile £37.25 £65.00 £27.00
Median hourly rate £62.50 £70.25 £32.00
Median % change year-on-year -11.03% +119.53% -21.95%
75th Percentile £66.25 £80.81 £57.75
90th Percentile £67.25 £86.25 £83.61
UK median hourly rate £62.50 £70.25 £32.00
% change year-on-year -11.03% +119.53% -21.95%

All Process and Methodology Skills
England

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in England with a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 31,491 43,355 63,906
As % of all contract IT jobs advertised in England 86.40% 90.10% 90.87%
Number of daily rates quoted 20,622 30,435 45,445
10th Percentile £300 £325 £331
25th Percentile £413 £450 £430
Median daily rate (50th Percentile) £525 £550 £540
Median % change year-on-year -4.55% +1.85% +8.00%
75th Percentile £650 £675 £650
90th Percentile £750 £765 £750
UK median daily rate £525 £550 £530
% change year-on-year -4.55% +3.77% +8.16%
Number of hourly rates quoted 2,249 1,535 1,743
10th Percentile £12.92 £10.63 £12.50
25th Percentile £15.95 £16.13 £15.25
Median hourly rate £36.50 £36.25 £25.00
Median % change year-on-year +0.69% +45.00% +7.94%
75th Percentile £60.00 £65.00 £49.25
90th Percentile £72.50 £75.00 £65.00
UK median hourly rate £36.05 £35.65 £25.68
% change year-on-year +1.11% +38.82% +5.90%

Data Pipeline
Job Vacancy Trend in England

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in England.

Job vacancy trend for Data Pipeline in England

Data Pipeline
Contractor Daily Rate Trend in England

3-month moving average daily rate quoted in jobs citing Data Pipeline in England.

Daily rate trend for Data Pipeline in England

Data Pipeline
Daily Rate Histogram in England

Daily rate distribution for jobs citing Data Pipeline in England over the 6 months to 17 May 2024.

Daily rate histogram for Data Pipeline in England

Data Pipeline
Contractor Hourly Rate Trend in England

3-month moving average hourly rates quoted in jobs citing Data Pipeline in England.

Hourly rate trend for Data Pipeline in England

Data Pipeline
Hourly Rate Histogram in England

Hourly rate distribution of jobs citing Data Pipeline in England over the 6 months to 17 May 2024.

Hourly rate histogram for Data Pipeline in England

Data Pipeline
Contract Job Locations in England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Pipeline within the England region over the 6 months to 17 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
London +70 311 £575 +1.77% 239
North of England +43 51 £500 -6.98% 43
Midlands +50 43 £550 - 23
West Midlands +40 36 £550 +0.92% 19
North West +13 27 £500 +2.56% 19
Yorkshire +33 24 £563 -13.46% 20
South East -14 19 £475 -9.52% 71
South West -4 12 £550 -18.52% 22
East of England +16 8 £538 +2.38% 9
East Midlands +18 7 £413 -38.89% 4
Data Pipeline
UK

Data Pipeline
Co-occurring Skills and Capabilities in England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 74 (15.91%) Apache Spark
2 59 (12.69%) Apache
3 46 (9.89%) Apache Airflow
4 4 (0.86%) Luigi
5 2 (0.43%) Confluence
6 1 (0.22%) ArcGIS
6 1 (0.22%) Jupyter
Applications
1 10 (2.15%) Microsoft Excel
2 4 (0.86%) Microsoft Office
2 4 (0.86%) Microsoft PowerPoint
2 4 (0.86%) Microsoft Project
2 4 (0.86%) MS Visio
3 2 (0.43%) Sketch
Business Applications
1 2 (0.43%) Dynamics CRM
Cloud Services
1 191 (41.08%) Azure
2 183 (39.35%) AWS
3 67 (14.41%) Serverless
4 64 (13.76%) Azure Data Factory
5 57 (12.26%) GCP
6 56 (12.04%) AWS Lambda
7 51 (10.97%) Amazon S3
8 37 (7.96%) Power Platform
9 35 (7.53%) Azure Synapse Analytics
10 34 (7.31%) Snowflake
11 25 (5.38%) Amazon Kinesis
12 24 (5.16%) Amazon EMR
13 23 (4.95%) Amazon EC2
13 23 (4.95%) Azure DevOps
14 22 (4.73%) AWS Step Functions
14 22 (4.73%) GitHub
15 19 (4.09%) dbt
16 13 (2.80%) Amazon MSK
16 13 (2.80%) Azure Logic Apps
17 11 (2.37%) Cloud Computing
Communications & Networking
1 14 (3.01%) Intrusion Detection
1 14 (3.01%) Network Security
2 5 (1.08%) FTP
3 2 (0.43%) SAN
4 1 (0.22%) Firewall
4 1 (0.22%) HTTP
4 1 (0.22%) SSL
Database & Business Intelligence
1 126 (27.10%) Data Warehouse
2 104 (22.37%) Big Data
3 86 (18.49%) Data Lake
4 45 (9.68%) Amazon Redshift
5 41 (8.82%) NoSQL
6 37 (7.96%) Power BI
7 33 (7.10%) Relational Database
8 30 (6.45%) BigQuery
9 29 (6.24%) SQL Server
10 24 (5.16%) Flink
10 24 (5.16%) Parquet
11 19 (4.09%) Azure SQL Database
12 18 (3.87%) Amazon Athena
13 17 (3.66%) DynamoDB
13 17 (3.66%) Tableau
14 15 (3.23%) Amazon RDS
14 15 (3.23%) Hadoop
15 12 (2.58%) Delta Lake
15 12 (2.58%) Metadata
16 11 (2.37%) SQL Server Integration Services
Development Applications
1 44 (9.46%) Git
2 17 (3.66%) JIRA
3 9 (1.94%) Jenkins
4 7 (1.51%) GitLab
5 6 (1.29%) MLflow
6 4 (0.86%) Deequ
6 4 (0.86%) ERwin
6 4 (0.86%) Mercurial
7 3 (0.65%) JMeter
7 3 (0.65%) TestRail
8 2 (0.43%) Bitbucket
8 2 (0.43%) Bugzilla
8 2 (0.43%) ER Studio
8 2 (0.43%) JUnit
8 2 (0.43%) Selenium
8 2 (0.43%) TestNG
8 2 (0.43%) Travis CI
9 1 (0.22%) GoCD
9 1 (0.22%) kappa
9 1 (0.22%) webpack
General
1 111 (23.87%) Social Skills
2 81 (17.42%) Analytical Skills
3 67 (14.41%) Finance
4 34 (7.31%) Public Sector
5 22 (4.73%) Banking
6 15 (3.23%) Presentation Skills
7 14 (3.01%) Front Office
8 10 (2.15%) Pharmaceutical
9 7 (1.51%) Manufacturing
10 6 (1.29%) Investment Banking
10 6 (1.29%) Retail
11 5 (1.08%) Marketing
12 4 (0.86%) Inclusion and Diversity
12 4 (0.86%) Multimedia
13 3 (0.65%) Back Office
13 3 (0.65%) Games
14 2 (0.43%) Czech Language
14 2 (0.43%) Health Technology
14 2 (0.43%) Influencing Skills
14 2 (0.43%) Police
Job Titles
1 246 (52.90%) Data Engineer
2 71 (15.27%) Senior
3 58 (12.47%) Developer
4 53 (11.40%) Azure Engineer
5 52 (11.18%) Azure Data Engineer
6 42 (9.03%) Architect
7 41 (8.82%) Senior Data Engineer
8 31 (6.67%) AWS Engineer
9 28 (6.02%) Lead
10 26 (5.59%) AWS Data Engineer
11 22 (4.73%) Python Developer
12 20 (4.30%) Data Scientist
13 18 (3.87%) Lead Data Engineer
14 17 (3.66%) Analyst
15 15 (3.23%) Data Architect
16 12 (2.58%) Python Engineer
17 11 (2.37%) Cloud Engineer
17 11 (2.37%) Data Analyst
17 11 (2.37%) Senior Developer
18 10 (2.15%) Quantitative Developer
Libraries, Frameworks & Software Standards
1 59 (12.69%) PySpark
2 58 (12.47%) Kafka
3 35 (7.53%) Pandas
4 26 (5.59%) JSON
5 23 (4.95%) NumPy
6 20 (4.30%) Apache Avro
7 17 (3.66%) SciPy
8 15 (3.23%) Apache NiFi
9 10 (2.15%) scikit-learn
10 9 (1.94%) REST
10 9 (1.94%) TensorFlow
11 8 (1.72%) Elastic Stack
12 7 (1.51%) Flask
12 7 (1.51%) React
13 6 (1.29%) ARM Templates
13 6 (1.29%) FastAPI
13 6 (1.29%) XML
14 5 (1.08%) .NET
14 5 (1.08%) Great Expectations
14 5 (1.08%) YAML
Miscellaneous
1 27 (5.81%) Algorithms
2 21 (4.52%) Management Information System
3 18 (3.87%) Derivative
4 16 (3.44%) Data Structures
4 16 (3.44%) Distributed Applications
5 15 (3.23%) Cyber Defence
5 15 (3.23%) Distributed Systems
6 11 (2.37%) Greenfield Project
7 10 (2.15%) Linux Command Line
8 9 (1.94%) Onboarding
8 9 (1.94%) Self-Motivation
9 8 (1.72%) Distributed Computing
10 6 (1.29%) Hedge funds
11 5 (1.08%) Analytical Mindset
11 5 (1.08%) Cloud Native
11 5 (1.08%) Renewable Energy
12 4 (0.86%) Legacy Systems
12 4 (0.86%) Security Posture
12 4 (0.86%) Social Media
12 4 (0.86%) Virtual Team
Operating Systems
1 35 (7.53%) Linux
2 27 (5.81%) Windows
3 14 (3.01%) Unix
4 12 (2.58%) Android
4 12 (2.58%) Apple iOS
5 8 (1.72%) Ubuntu
6 1 (0.22%) Mac OS
6 1 (0.22%) Windows Server
Processes & Methodologies
1 192 (41.29%) ETL
2 164 (35.27%) Data Modelling
3 154 (33.12%) Analytics
4 143 (30.75%) Data Engineering
5 105 (22.58%) CI/CD
6 86 (18.49%) Problem-Solving
7 82 (17.63%) DevOps
8 77 (16.56%) Agile
9 71 (15.27%) Data Integration
9 71 (15.27%) Data Science
10 67 (14.41%) Business Intelligence
11 57 (12.26%) Machine Learning
12 53 (11.40%) Data Ingestion
13 47 (10.11%) Data Management
14 46 (9.89%) Computer Science
14 46 (9.89%) Data Governance
14 46 (9.89%) Visualisation
15 41 (8.82%) Data Transformation
16 40 (8.60%) Test Automation
17 39 (8.39%) Continuous Integration
Programming Languages
1 288 (61.94%) Python
2 257 (55.27%) SQL
3 64 (13.76%) Java
4 47 (10.11%) Scala
5 20 (4.30%) C#
5 20 (4.30%) C++
6 17 (3.66%) JavaScript
6 17 (3.66%) T-SQL
7 12 (2.58%) Rust
8 11 (2.37%) R
9 7 (1.51%) Bash
9 7 (1.51%) TypeScript
10 6 (1.29%) Bicep
11 4 (0.86%) Go
11 4 (0.86%) Perl
11 4 (0.86%) PowerShell
12 3 (0.65%) Data Analysis Expressions
12 3 (0.65%) MATLAB
12 3 (0.65%) Shell Script
13 2 (0.43%) PHP
Qualifications
1 94 (20.22%) Security Cleared
2 75 (16.13%) SC Cleared
3 48 (10.32%) Degree
4 35 (7.53%) Computer Science Degree
5 18 (3.87%) DV Cleared
6 9 (1.94%) AWS Certification
7 8 (1.72%) Azure Certification
8 7 (1.51%) Master's Degree
9 6 (1.29%) CISSP
10 5 (1.08%) BPSS Clearance
11 3 (0.65%) AWS Certified Solutions Architect
11 3 (0.65%) Microsoft Certification
12 2 (0.43%) AWS Certified Developer
12 2 (0.43%) AWS Certified DevOps Engineer
12 2 (0.43%) PhD
13 1 (0.22%) (ISC)2 CCSP
13 1 (0.22%) Cisco Certification
13 1 (0.22%) CSSLP
13 1 (0.22%) CTC Cleared
Quality Assurance & Compliance
1 85 (18.28%) Data Quality
2 14 (3.01%) Actionable Recommendations
3 11 (2.37%) QA
4 6 (1.29%) GDPR
5 2 (0.43%) Accessibility
5 2 (0.43%) PCI DSS
6 1 (0.22%) California Consumer Privacy Act
6 1 (0.22%) JSP 440
6 1 (0.22%) NCSC
6 1 (0.22%) NIST
System Software
1 29 (6.24%) Docker
2 8 (1.72%) Active Directory
2 8 (1.72%) iptables
3 7 (1.51%) HDFS
4 2 (0.43%) VMware Infrastructure
5 1 (0.22%) Virtual Machines
Systems Management
1 38 (8.17%) Terraform
2 25 (5.38%) Kubernetes
3 8 (1.72%) Kibana
3 8 (1.72%) logstash
4 5 (1.08%) Ansible
5 4 (0.86%) Argo
6 1 (0.22%) Control-M
6 1 (0.22%) Hadoop YARN
6 1 (0.22%) Kubeflow
6 1 (0.22%) Progress Chef
Vendors
1 99 (21.29%) Databricks
2 32 (6.88%) Microsoft
3 25 (5.38%) Google
4 16 (3.44%) Informatica
5 13 (2.80%) Oracle
6 11 (2.37%) Red Hat
7 10 (2.15%) SAP
8 8 (1.72%) Palantir
9 6 (1.29%) Cloudera
9 6 (1.29%) Foundry
9 6 (1.29%) Talend
10 4 (0.86%) IFS
11 3 (0.65%) Sage
11 3 (0.65%) Splunk
11 3 (0.65%) TIBCO
12 2 (0.43%) Ab Initio
12 2 (0.43%) IBM
12 2 (0.43%) JD Edwards
12 2 (0.43%) QAD
12 2 (0.43%) VMware