Data Pipeline Contracts in the City of London

Data Pipelines
Central London > City of London

The following table provides summary statistics for contract job vacancies advertised in the City of London with a requirement for Data Pipeline skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Pipeline over the 6 months to 28 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
28 Apr 2024
Same period 2023 Same period 2022
Rank 84 127 123
Rank change year-on-year +43 -4 -14
Contract jobs citing Data Pipeline 42 50 71
As % of all contract jobs advertised in the City of London 1.91% 1.37% 1.67%
As % of the Processes & Methodologies category 2.11% 1.49% 1.83%
Number of daily rates quoted 26 34 45
10th Percentile £413 £441 £525
25th Percentile £453 £477 £563
Median daily rate (50th Percentile) £525 £550 £675
Median % change year-on-year -4.55% -18.52% +12.50%
75th Percentile £644 £672 £813
90th Percentile £728 £735 -
Central London median daily rate £550 £550 £700
% change year-on-year - -21.43% +16.67%
Number of hourly rates quoted 1 0 0
10th Percentile - - -
25th Percentile £46.75 - -
Median hourly rate £48.50 - -
75th Percentile £50.25 - -
90th Percentile - - -
Central London median hourly rate £48.50 - -

All Process and Methodology Skills
City of London

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in the City of London with a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 1,993 3,347 3,888
As % of all contract IT jobs advertised in the City of London 90.51% 91.82% 91.72%
Number of daily rates quoted 1,405 2,259 2,945
10th Percentile £359 £355 £385
25th Percentile £450 £475 £475
Median daily rate (50th Percentile) £565 £600 £575
Median % change year-on-year -5.83% +4.35% +9.52%
75th Percentile £688 £730 £675
90th Percentile £800 £825 £775
Central London median daily rate £550 £600 £570
% change year-on-year -8.33% +5.26% +8.57%
Number of hourly rates quoted 13 24 41
10th Percentile £19.13 £15.33 £18.50
25th Percentile £20.22 £18.03 £24.25
Median hourly rate £25.00 £35.00 £40.50
Median % change year-on-year -28.57% -13.58% +125.31%
75th Percentile £40.00 £58.75 £51.75
90th Percentile £48.57 £88.30 £62.50
Central London median hourly rate £27.81 £35.00 £40.50
% change year-on-year -20.54% -13.58% +102.50%

Data Pipeline
Job Vacancy Trend in the City of London

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in the City of London.

Job vacancy trend for Data Pipeline in the City of London

Data Pipeline
Contractor Daily Rate Trend in the City of London

3-month moving average daily rate quoted in jobs citing Data Pipeline in the City of London.

Daily rate trend for Data Pipeline in the City of London

Data Pipeline
Daily Rate Histogram in the City of London

Daily rate distribution for jobs citing Data Pipeline in the City of London over the 6 months to 28 April 2024.

Daily rate histogram for Data Pipeline in the City of London

Data Pipeline
Contractor Hourly Rate Trend in the City of London

3-month moving average hourly rates quoted in jobs citing Data Pipeline in the City of London.

Hourly rate trend for Data Pipeline in the City of London

Data Pipeline
Contract Job Locations in the City of London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Pipeline within the City of London region over the 6 months to 28 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
London Bridge - 1 £700 -
Data Pipeline
Central London

Data Pipeline
Co-occurring Skills and Capabilities in the City of London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 3 (7.14%) Apache
1 3 (7.14%) Apache Spark
2 2 (4.76%) Luigi
3 1 (2.38%) Apache Airflow
Applications
1 1 (2.38%) Microsoft Excel
Cloud Services
1 23 (54.76%) AWS
2 18 (42.86%) Azure
3 8 (19.05%) AWS Lambda
3 8 (19.05%) Serverless
4 6 (14.29%) AWS Step Functions
4 6 (14.29%) Azure Data Factory
5 5 (11.90%) Amazon S3
6 4 (9.52%) Amazon MSK
6 4 (9.52%) GCP
6 4 (9.52%) GitHub
6 4 (9.52%) Power Platform
7 3 (7.14%) dbt
8 2 (4.76%) Amazon CloudWatch
8 2 (4.76%) Amazon EventBridge
8 2 (4.76%) Amazon Kinesis
8 2 (4.76%) Azure DevOps
8 2 (4.76%) WhatsApp
9 1 (2.38%) AWS CodePipeline
9 1 (2.38%) AWS Fargate
9 1 (2.38%) Dynamics 365
Communications & Networking
1 1 (2.38%) Firewall
Database & Business Intelligence
1 9 (21.43%) Data Warehouse
1 9 (21.43%) NoSQL
2 8 (19.05%) Amazon Redshift
3 6 (14.29%) Data Lake
3 6 (14.29%) DynamoDB
3 6 (14.29%) Parquet
4 5 (11.90%) Amazon RDS
4 5 (11.90%) Big Data
5 4 (9.52%) Power BI
6 3 (7.14%) Azure SQL Database
6 3 (7.14%) PostgreSQL
6 3 (7.14%) SQL Server
7 2 (4.76%) BigQuery
7 2 (4.76%) Enterprise Data Warehouse
7 2 (4.76%) Metadata
8 1 (2.38%) Amazon Athena
8 1 (2.38%) Data Mart
8 1 (2.38%) Delta Lake
8 1 (2.38%) MySQL
8 1 (2.38%) Spark SQL
Development Applications
1 2 (4.76%) Git
1 2 (4.76%) GitLab
2 1 (2.38%) GoCD
2 1 (2.38%) JIRA
General
1 14 (33.33%) Finance
2 12 (28.57%) Social Skills
3 4 (9.52%) Public Sector
4 3 (7.14%) Analytical Skills
5 2 (4.76%) Banking
6 1 (2.38%) Investment Banking
6 1 (2.38%) Pharmaceutical
6 1 (2.38%) Retail
Job Titles
1 22 (52.38%) Data Engineer
2 13 (30.95%) Developer
3 6 (14.29%) Senior
3 6 (14.29%) Software Developer
4 5 (11.90%) Senior Developer
5 4 (9.52%) Azure Data Engineer
5 4 (9.52%) Azure Engineer
6 3 (7.14%) Python Developer
7 2 (4.76%) Analyst
7 2 (4.76%) AWS Data Engineer
7 2 (4.76%) AWS Engineer
7 2 (4.76%) Big Data Engineer
7 2 (4.76%) Lead
7 2 (4.76%) Lead Data Engineer
7 2 (4.76%) Quantitative Developer
7 2 (4.76%) Senior Python Developer
7 2 (4.76%) Senior Quantitative Developer
8 1 (2.38%) Dynamics 365 Project Manager
8 1 (2.38%) Lead Big Data Engineer
8 1 (2.38%) Principal Data Engineer
Libraries, Frameworks & Software Standards
1 6 (14.29%) JSON
1 6 (14.29%) Kafka
2 5 (11.90%) Apache Avro
2 5 (11.90%) Pandas
3 3 (7.14%) NumPy
3 3 (7.14%) SciPy
4 2 (4.76%) PySpark
4 2 (4.76%) RESTful
5 1 (2.38%) .NET
5 1 (2.38%) GraphQL
5 1 (2.38%) JSON Schema
5 1 (2.38%) Middleware
5 1 (2.38%) Node.js
5 1 (2.38%) REST
5 1 (2.38%) SOAP
5 1 (2.38%) YAML
Miscellaneous
1 4 (9.52%) Derivative
2 3 (7.14%) Cloud Native
3 2 (4.76%) Algorithms
3 2 (4.76%) Greenfield Project
4 1 (2.38%) Data Structures
4 1 (2.38%) Life Science
4 1 (2.38%) Linux Command Line
4 1 (2.38%) Onboarding
4 1 (2.38%) Self-Motivation
Operating Systems
1 3 (7.14%) Linux
2 1 (2.38%) Windows
2 1 (2.38%) Windows Server
Processes & Methodologies
1 20 (47.62%) ETL
2 14 (33.33%) Data Modelling
3 12 (28.57%) Data Engineering
4 9 (21.43%) Problem-Solving
5 8 (19.05%) CI/CD
5 8 (19.05%) Performance Optimisation
6 7 (16.67%) Data Ingestion
6 7 (16.67%) DevOps
7 6 (14.29%) Agile
7 6 (14.29%) Analytics
8 5 (11.90%) Data Science
8 5 (11.90%) Test Automation
9 4 (9.52%) Business Transformation
9 4 (9.52%) Continuous Integration
9 4 (9.52%) Data Integration
9 4 (9.52%) Knowledge Transfer
9 4 (9.52%) Quantitative Trading
9 4 (9.52%) SDLC
10 3 (7.14%) Mathematics
10 3 (7.14%) Migration
Programming Languages
1 27 (64.29%) Python
2 26 (61.90%) SQL
3 6 (14.29%) Java
4 3 (7.14%) C++
4 3 (7.14%) Rust
5 2 (4.76%) Bicep
5 2 (4.76%) C#
5 2 (4.76%) Scala
5 2 (4.76%) T-SQL
6 1 (2.38%) Data Analysis Expressions
6 1 (2.38%) Go
6 1 (2.38%) JavaScript
6 1 (2.38%) PowerShell
6 1 (2.38%) TypeScript
6 1 (2.38%) VBA
Qualifications
1 7 (16.67%) SC Cleared
1 7 (16.67%) Security Cleared
2 1 (2.38%) AWS Certification
2 1 (2.38%) BPSS Clearance
2 1 (2.38%) Degree
Quality Assurance & Compliance
1 5 (11.90%) Data Quality
2 1 (2.38%) Accessibility
2 1 (2.38%) QA
System Software
1 3 (7.14%) Docker
2 1 (2.38%) HDFS
2 1 (2.38%) Virtual Machines
Systems Management
1 2 (4.76%) Terraform
Vendors
1 7 (16.67%) Databricks
2 3 (7.14%) Microsoft
3 2 (4.76%) Google
4 1 (2.38%) Brio
4 1 (2.38%) IBM
4 1 (2.38%) Oracle
4 1 (2.38%) SnapLogic
4 1 (2.38%) Workday