Data Pipeline Contracts in London

Data Pipelines
England > London

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Pipeline skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Pipeline over the 6 months to 27 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
27 Apr 2024
Same period 2023 Same period 2022
Rank 140 212 231
Rank change year-on-year +72 +19 -33
Contract jobs citing Data Pipeline 308 328 496
As % of all contract jobs advertised in London 1.74% 1.21% 1.27%
As % of the Processes & Methodologies category 1.97% 1.33% 1.38%
Number of daily rates quoted 241 222 352
10th Percentile £413 £450 £475
25th Percentile £463 £500 £539
Median daily rate (50th Percentile) £575 £565 £628
Median % change year-on-year +1.77% -9.96% +14.09%
75th Percentile £675 £675 £738
90th Percentile £750 £773 £813
England median daily rate £550 £550 £600
% change year-on-year - -8.33% +13.91%
Number of hourly rates quoted 1 4 5
10th Percentile - - £29.05
25th Percentile £46.75 £65.00 £31.00
Median hourly rate £48.50 £72.50 £35.50
Median % change year-on-year -33.10% +104.23% -25.26%
75th Percentile £50.25 £84.38 £78.75
90th Percentile - £87.75 £86.04
England median hourly rate £62.50 £70.25 £32.00
% change year-on-year -11.03% +119.53% -30.43%

All Process and Methodology Skills
London

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 15,674 24,676 35,915
As % of all contract IT jobs advertised in London 88.50% 91.13% 92.26%
Number of daily rates quoted 11,226 17,739 26,174
10th Percentile £338 £375 £390
25th Percentile £450 £475 £475
Median daily rate (50th Percentile) £550 £590 £575
Median % change year-on-year -6.78% +2.61% +9.52%
75th Percentile £675 £700 £688
90th Percentile £800 £800 £775
England median daily rate £525 £550 £538
% change year-on-year -4.55% +2.33% +9.69%
Number of hourly rates quoted 325 281 423
10th Percentile £16.00 £18.63 £17.25
25th Percentile £20.00 £22.63 £23.91
Median hourly rate £28.50 £39.00 £36.00
Median % change year-on-year -26.92% +8.33% +10.77%
75th Percentile £46.86 £63.75 £50.68
90th Percentile £66.30 £78.50 £67.50
England median hourly rate £35.50 £37.50 £24.35
% change year-on-year -5.33% +54.00% +1.46%

Data Pipeline
Job Vacancy Trend in London

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Pipeline in London

Data Pipeline
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Data Pipeline in London.

Daily rate trend for Data Pipeline in London

Data Pipeline
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Pipeline in London over the 6 months to 27 April 2024.

Daily rate histogram for Data Pipeline in London

Data Pipeline
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Data Pipeline in London.

Hourly rate trend for Data Pipeline in London

Data Pipeline
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Pipeline within the London region over the 6 months to 27 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London +33 47 £550 - 16
South London - 6 £450 -
West London +9 4 £525 -8.70%
East London -4 1 £750 +50.00% 3
Data Pipeline
England

Data Pipeline
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 45 (14.61%) Apache Spark
2 41 (13.31%) Apache
3 35 (11.36%) Apache Airflow
4 4 (1.30%) Luigi
5 3 (0.97%) Confluence
6 1 (0.32%) ArcGIS
Applications
1 3 (0.97%) Microsoft Excel
Business Applications
1 2 (0.65%) Dynamics CRM
Cloud Services
1 153 (49.68%) AWS
2 136 (44.16%) Azure
3 54 (17.53%) Serverless
4 45 (14.61%) AWS Lambda
5 41 (13.31%) GCP
6 40 (12.99%) Azure Data Factory
7 38 (12.34%) Amazon S3
8 29 (9.42%) Amazon Kinesis
9 24 (7.79%) Azure DevOps
10 23 (7.47%) Azure Synapse Analytics
11 21 (6.82%) GitHub
12 20 (6.49%) Snowflake
13 17 (5.52%) Amazon EMR
14 16 (5.19%) AWS Step Functions
14 16 (5.19%) dbt
15 15 (4.87%) Power Platform
16 13 (4.22%) Amazon EC2
17 12 (3.90%) Amazon MSK
18 10 (3.25%) Dagster
19 9 (2.92%) Azure Logic Apps
Communications & Networking
1 1 (0.32%) Firewall
Database & Business Intelligence
1 77 (25.00%) Data Warehouse
2 68 (22.08%) Big Data
3 53 (17.21%) Data Lake
4 40 (12.99%) Amazon Redshift
5 36 (11.69%) NoSQL
6 21 (6.82%) DynamoDB
7 19 (6.17%) Relational Database
8 18 (5.84%) Flink
9 17 (5.52%) BigQuery
9 17 (5.52%) Parquet
10 16 (5.19%) SQL Server
11 15 (4.87%) PostgreSQL
11 15 (4.87%) Power BI
12 14 (4.55%) Amazon RDS
13 12 (3.90%) Azure SQL Database
14 10 (3.25%) Amazon Athena
15 7 (2.27%) Delta Lake
16 6 (1.95%) Hadoop
16 6 (1.95%) Spark SQL
17 5 (1.62%) Metadata
Development Applications
1 30 (9.74%) Git
2 9 (2.92%) JIRA
3 7 (2.27%) GitLab
3 7 (2.27%) MLflow
4 6 (1.95%) Jenkins
5 3 (0.97%) Deequ
5 3 (0.97%) Poetry
6 2 (0.65%) ER Studio
6 2 (0.65%) ERwin
6 2 (0.65%) Travis CI
7 1 (0.32%) GoCD
7 1 (0.32%) kappa
7 1 (0.32%) webpack
General
1 80 (25.97%) Social Skills
2 52 (16.88%) Finance
3 47 (15.26%) Analytical Skills
4 21 (6.82%) Public Sector
5 16 (5.19%) Banking
6 14 (4.55%) Front Office
7 12 (3.90%) Presentation Skills
8 6 (1.95%) Investment Banking
9 5 (1.62%) Inclusion and Diversity
10 4 (1.30%) Retail
11 2 (0.65%) Czech Language
11 2 (0.65%) Influencing Skills
11 2 (0.65%) Marketing
11 2 (0.65%) Pharmaceutical
12 1 (0.32%) Games
12 1 (0.32%) Local Government
12 1 (0.32%) Organisational Skills
Job Titles
1 167 (54.22%) Data Engineer
2 55 (17.86%) Senior
3 37 (12.01%) Developer
4 34 (11.04%) Azure Engineer
5 33 (10.71%) Azure Data Engineer
6 31 (10.06%) Architect
7 26 (8.44%) Senior Data Engineer
8 25 (8.12%) AWS Engineer
9 22 (7.14%) AWS Data Engineer
9 22 (7.14%) Lead
10 19 (6.17%) Data Scientist
11 16 (5.19%) Data Architect
12 15 (4.87%) Lead Data Engineer
13 14 (4.55%) Python Developer
14 13 (4.22%) Senior Developer
15 12 (3.90%) Python Engineer
16 10 (3.25%) Python Data Engineer
16 10 (3.25%) Quantitative Developer
17 8 (2.60%) GCP Engineer
17 8 (2.60%) Senior Python Developer
Libraries, Frameworks & Software Standards
1 49 (15.91%) Kafka
2 36 (11.69%) PySpark
3 33 (10.71%) Pandas
4 20 (6.49%) NumPy
5 18 (5.84%) JSON
6 16 (5.19%) Apache Avro
7 15 (4.87%) SciPy
8 12 (3.90%) scikit-learn
9 9 (2.92%) REST
10 8 (2.60%) TensorFlow
11 6 (1.95%) GraphQL
11 6 (1.95%) Great Expectations
11 6 (1.95%) Lambda Expressions
12 5 (1.62%) YAML
13 4 (1.30%) .NET
13 4 (1.30%) ARM Templates
13 4 (1.30%) JSON Schema
13 4 (1.30%) RESTful
13 4 (1.30%) Seaborn
13 4 (1.30%) SOAP
Miscellaneous
1 25 (8.12%) Algorithms
2 19 (6.17%) Derivative
3 11 (3.57%) Greenfield Project
4 10 (3.25%) Data Structures
5 8 (2.60%) Cloud Native
5 8 (2.60%) Distributed Systems
6 5 (1.62%) Analytical Mindset
6 5 (1.62%) Distributed Computing
6 5 (1.62%) Management Information System
6 5 (1.62%) Renewable Energy
7 4 (1.30%) Hedge funds
7 4 (1.30%) Linux Command Line
7 4 (1.30%) Security Posture
8 3 (0.97%) Grid Computing
8 3 (0.97%) Hybrid Cloud
8 3 (0.97%) Legacy Systems
8 3 (0.97%) Self-Motivation
8 3 (0.97%) Wiki
9 2 (0.65%) Life Science
9 2 (0.65%) Onboarding
Operating Systems
1 11 (3.57%) Linux
2 2 (0.65%) Unix
3 1 (0.32%) Windows
3 1 (0.32%) Windows Server
Processes & Methodologies
1 123 (39.94%) ETL
2 101 (32.79%) Data Modelling
3 91 (29.55%) Analytics
4 75 (24.35%) Data Engineering
5 71 (23.05%) CI/CD
6 66 (21.43%) DevOps
7 60 (19.48%) Problem-Solving
8 59 (19.16%) Data Science
9 52 (16.88%) Agile
10 41 (13.31%) Data Integration
10 41 (13.31%) Machine Learning
11 36 (11.69%) Data Ingestion
12 32 (10.39%) Computer Science
13 28 (9.09%) Business Intelligence
14 27 (8.77%) Data Transformation
15 26 (8.44%) Test Automation
16 25 (8.12%) Visualisation
17 23 (7.47%) Infrastructure as Code
18 22 (7.14%) Continuous Integration
18 22 (7.14%) Mathematics
Programming Languages
1 212 (68.83%) Python
2 182 (59.09%) SQL
3 34 (11.04%) Java
4 32 (10.39%) Scala
5 17 (5.52%) C++
6 12 (3.90%) C#
6 12 (3.90%) Rust
7 11 (3.57%) JavaScript
8 7 (2.27%) Bicep
8 7 (2.27%) TypeScript
9 6 (1.95%) T-SQL
10 5 (1.62%) Bash
11 4 (1.30%) PowerShell
12 3 (0.97%) Shell Script
13 2 (0.65%) Go
13 2 (0.65%) Lua
13 2 (0.65%) Perl
13 2 (0.65%) PHP
13 2 (0.65%) R
14 1 (0.32%) Data Analysis Expressions
Qualifications
1 66 (21.43%) Security Cleared
2 65 (21.10%) SC Cleared
3 34 (11.04%) Degree
4 21 (6.82%) Computer Science Degree
5 7 (2.27%) Azure Certification
6 6 (1.95%) Master's Degree
7 5 (1.62%) AWS Certification
7 5 (1.62%) CISSP
8 3 (0.97%) Microsoft Certification
9 2 (0.65%) BPSS Clearance
9 2 (0.65%) DV Cleared
10 1 (0.32%) AWS Certified Solutions Architect
Quality Assurance & Compliance
1 49 (15.91%) Data Quality
2 4 (1.30%) QA
3 1 (0.32%) Accessibility
3 1 (0.32%) GDPR
System Software
1 19 (6.17%) Docker
2 3 (0.97%) HDFS
3 1 (0.32%) Virtual Machines
Systems Management
1 32 (10.39%) Terraform
2 14 (4.55%) Kubernetes
3 4 (1.30%) Argo
4 2 (0.65%) Ansible
5 1 (0.32%) Kubeflow
5 1 (0.32%) Progress Chef
Vendors
1 70 (22.73%) Databricks
2 20 (6.49%) Microsoft
3 15 (4.87%) Oracle
4 13 (4.22%) Google
5 8 (2.60%) Informatica
6 7 (2.27%) Palantir
7 6 (1.95%) Foundry
8 5 (1.62%) Cloudera
9 3 (0.97%) Dataiku
9 3 (0.97%) SAP
10 2 (0.65%) Dynatrace
10 2 (0.65%) OpenAI
10 2 (0.65%) Talend
10 2 (0.65%) Workday
11 1 (0.32%) Brio
11 1 (0.32%) DataRobot
11 1 (0.32%) IBM
11 1 (0.32%) ServiceNow
11 1 (0.32%) SnapLogic
11 1 (0.32%) TIBCO