Period
to

The following table provides summary statistics for contract job vacancies advertised in the East of England with a requirement for Data Pipeline skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Pipeline over the 6 months to 15 August 2022 with a comparison to the same period in the previous 2 years.

Note that daily and hourly rates are treated separately in these statistics. When calculating contractor rate percentiles, daily rates are never derived from quoted hourly rates or vice versa.

Data Pipelines
England > East of England
6 months to
15 Aug 2022
Same period 2021 Same period 2020
Rank 118 124 96
Rank change year-on-year +6 -28 +84
Contract jobs citing Data Pipeline 16 7 10
As % of all contract jobs advertised in the East of England 0.64% 0.31% 0.65%
As % of the Processes & Methodologies category 0.75% 0.36% 0.78%
Number of daily rates quoted 9 6 5
10th Percentile £513 £354 -
25th Percentile £525 £402 £525
Median daily rate (50th Percentile) £636 £479 £575
Median % change year-on-year +32.85% -16.74% +21.05%
75th Percentile £738 £604 £588
90th Percentile £748 £694 £622
England median daily rate £600 £550 £550
% change year-on-year +9.09% - -
Number of hourly rates quoted 1 0 0
10th Percentile - - -
25th Percentile £52.50 - -
Median hourly rate £55.00 - -
75th Percentile £57.50 - -
90th Percentile - - -
England median hourly rate £35.50 £32.31 £48.25
% change year-on-year +9.86% -33.03% -2.52%

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the East of England with a requirement for process or methodology skills.

All Process and Methodology Skills
East of England
Contract vacancies with a requirement for process or methodology skills 2,123 1,926 1,278
As % of all contract IT jobs advertised in the East of England 84.58% 85.71% 83.42%
Number of daily rates quoted 1,348 1,135 791
10th Percentile £235 £156 £250
25th Percentile £399 £300 £350
Median daily rate (50th Percentile) £500 £425 £450
Median % change year-on-year +17.65% -5.56% -
75th Percentile £600 £538 £531
90th Percentile £675 £613 £600
England median daily rate £550 £500 £488
% change year-on-year +10.00% +2.56% +2.63%
Number of hourly rates quoted 318 224 74
10th Percentile £13.25 £12.25 £13.18
25th Percentile £15.25 £12.72 £15.13
Median hourly rate £26.99 £16.13 £25.35
Median % change year-on-year +67.38% -36.39% +44.86%
75th Percentile £56.00 £33.94 £48.00
90th Percentile £65.00 £53.90 £59.08
England median hourly rate £31.85 £23.00 £25.17
% change year-on-year +38.48% -8.60% +9.41%

Data Pipeline
Job Vacancy Trend in the East of England

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in the East of England.

Job vacancy trend for Data Pipeline in the East of England

Data Pipeline
Contractor Daily Rate Trend in the East of England

3-month moving average daily rate quoted in jobs citing Data Pipeline in the East of England.

Daily rate trend for Data Pipeline in the East of England

Data Pipeline
Daily Rate Histogram in the East of England

Daily rate distribution for jobs citing Data Pipeline in the East of England over the 6 months to 15 August 2022.

Daily rate histogram for Data Pipeline in the East of England

Data Pipeline
Contract Job Locations in the East of England

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Pipeline within the East of England region over the 6 months to 15 August 2022. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Cambridgeshire -14 6 £725 +31.22% 7
Hertfordshire +1 3 £593 +52.05% 1
Bedfordshire -10 3 - - 2
Suffolk -6 2 £548 +69.50%
Norfolk - 2 £725 -
Data Pipeline
England

For the 6 months to 15 August 2022, IT contractor jobs citing Data Pipeline also mentioned the following skills in order of popularity. The figures indicate the absolute number co-occurrences and as a proportion of all contract job ads across the East of England region with a requirement for Data Pipeline.

1 8 (50.00%) SQL
1 8 (50.00%) Django
2 7 (43.75%) Python
2 7 (43.75%) Data Modelling
2 7 (43.75%) Analytics
3 6 (37.50%) Big Data
3 6 (37.50%) Apache Airflow
3 6 (37.50%) AWS
3 6 (37.50%) CI/CD
4 5 (31.25%) Containerisation
4 5 (31.25%) Data Management
4 5 (31.25%) Business Intelligence
4 5 (31.25%) Apache
4 5 (31.25%) Data Science
4 5 (31.25%) Kubernetes
4 5 (31.25%) DevOps
4 5 (31.25%) Apache Spark
5 4 (25.00%) Flask
5 4 (25.00%) Power BI
5 4 (25.00%) Data Engineering
5 4 (25.00%) Microservices
5 4 (25.00%) Data Lake
5 4 (25.00%) Microsoft
5 4 (25.00%) ETL
5 4 (25.00%) Data Warehouse
5 4 (25.00%) Finance
5 4 (25.00%) Software Engineering
5 4 (25.00%) PostgreSQL
5 4 (25.00%) Artificial Intelligence
5 4 (25.00%) Visualisation

Data Pipeline
Co-occurring IT Skills in the East of England by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same job type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 6 (37.50%) Apache Airflow
2 5 (31.25%) Apache
2 5 (31.25%) Apache Spark
3 1 (6.25%) SAS
Applications
1 1 (6.25%) SPSS
Cloud Services
1 6 (37.50%) AWS
2 4 (25.00%) Azure
2 4 (25.00%) Power Platform
3 3 (18.75%) Amazon Kinesis
3 3 (18.75%) Amazon SageMaker
4 2 (12.50%) Serverless
5 1 (6.25%) Azure Data Factory
5 1 (6.25%) Azure Machine Learning
5 1 (6.25%) dbt
5 1 (6.25%) GitHub
5 1 (6.25%) Snowflake
Database & Business Intelligence
1 6 (37.50%) Big Data
2 4 (25.00%) Apache Hive
2 4 (25.00%) Data Lake
2 4 (25.00%) Data Warehouse
2 4 (25.00%) PostgreSQL
2 4 (25.00%) Power BI
3 3 (18.75%) Apache Arrow
3 3 (18.75%) Flink
3 3 (18.75%) Looker
3 3 (18.75%) OLTP
3 3 (18.75%) Relational Database
3 3 (18.75%) Tableau
4 2 (12.50%) Amazon Redshift
4 2 (12.50%) Azure SQL Data Warehouse
4 2 (12.50%) Azure SQL Database
4 2 (12.50%) RDBMS
5 1 (6.25%) Hadoop
5 1 (6.25%) MongoDB
5 1 (6.25%) NoSQL
5 1 (6.25%) Parquet
Development Applications
1 3 (18.75%) MLflow
1 3 (18.75%) RStudio
2 2 (12.50%) GitLab
2 2 (12.50%) JIRA
3 1 (6.25%) Bugzilla
3 1 (6.25%) Git (software)
3 1 (6.25%) git-flow
General
1 4 (25.00%) Finance
2 2 (12.50%) Analytical Skills
3 1 (6.25%) Publishing
3 1 (6.25%) Social Skills
Job Titles
1 5 (31.25%) Data Engineer
2 4 (25.00%) Software Engineer
3 3 (18.75%) Architect
3 3 (18.75%) Senior Data Engineer
4 2 (12.50%) Data Architect
4 2 (12.50%) Data Strategist
4 2 (12.50%) Lead Architect
4 2 (12.50%) Lead Data Architect
5 1 (6.25%) AWS Data Engineer
5 1 (6.25%) AWS Engineer
5 1 (6.25%) Developer
5 1 (6.25%) Operations Engineer
5 1 (6.25%) Platform Architect
5 1 (6.25%) Python Developer
5 1 (6.25%) Technical Leader
Libraries, Frameworks & Software Standards
1 8 (50.00%) Django
2 4 (25.00%) Flask
3 3 (18.75%) Kafka
3 3 (18.75%) RabbitMQ
3 3 (18.75%) Shiny
3 3 (18.75%) Spark Streaming
3 3 (18.75%) Spring
4 2 (12.50%) PySpark
5 1 (6.25%) Dask
5 1 (6.25%) FastAPI
5 1 (6.25%) NumPy
5 1 (6.25%) Pandas
5 1 (6.25%) REST
5 1 (6.25%) RESTful
Miscellaneous
1 2 (12.50%) Data Centre
2 1 (6.25%) Algorithms
2 1 (6.25%) Data Structures
2 1 (6.25%) Legacy Systems
2 1 (6.25%) Life Science
2 1 (6.25%) Reference Data
2 1 (6.25%) User Experience
Processes & Methodologies
1 7 (43.75%) Analytics
1 7 (43.75%) Data Modelling
2 6 (37.50%) CI/CD
3 5 (31.25%) Business Intelligence
3 5 (31.25%) Containerisation
3 5 (31.25%) Data Management
3 5 (31.25%) Data Science
3 5 (31.25%) DevOps
4 4 (25.00%) Artificial Intelligence
4 4 (25.00%) Data Engineering
4 4 (25.00%) ETL
4 4 (25.00%) Microservices
4 4 (25.00%) Software Engineering
4 4 (25.00%) Thought Leadership
4 4 (25.00%) Visualisation
5 3 (18.75%) BDD
5 3 (18.75%) Configuration Management
5 3 (18.75%) Risk Register
5 3 (18.75%) TDD
5 3 (18.75%) Use Case
Programming Languages
1 8 (50.00%) SQL
2 7 (43.75%) Python
3 4 (25.00%) R
4 3 (18.75%) T-SQL
5 1 (6.25%) MATLAB
Qualifications
1 2 (12.50%) AWS Certification
2 1 (6.25%) Degree
2 1 (6.25%) Master's Degree
Quality Assurance & Compliance
1 3 (18.75%) GDPR
1 3 (18.75%) QA
2 1 (6.25%) Data Quality
System Software
1 1 (6.25%) Docker
Systems Management
1 5 (31.25%) Kubernetes
2 3 (18.75%) Control-M
Vendors
1 4 (25.00%) Microsoft
2 3 (18.75%) MapR
3 1 (6.25%) Perforce