Data Pipeline Contracts in London

Data Pipelines
England > London

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Pipeline skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Pipeline over the 6 months to 7 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
7 May 2024
Same period 2023 Same period 2022
Rank 141 216 232
Rank change year-on-year +75 +16 -33
Contract jobs citing Data Pipeline 311 318 491
As % of all contract jobs advertised in London 1.77% 1.21% 1.27%
As % of the Processes & Methodologies category 2.00% 1.33% 1.38%
Number of daily rates quoted 241 216 344
10th Percentile £413 £450 £475
25th Percentile £463 £500 £539
Median daily rate (50th Percentile) £575 £563 £630
Median % change year-on-year +2.22% -10.71% +14.55%
75th Percentile £675 £688 £738
90th Percentile £750 £775 £825
England median daily rate £550 £550 £600
% change year-on-year - -8.33% +12.15%
Number of hourly rates quoted 1 4 6
10th Percentile - - £27.00
25th Percentile £46.75 £65.00 £28.56
Median hourly rate £48.50 £72.50 £33.75
Median % change year-on-year -33.10% +114.81% -39.19%
75th Percentile £50.25 £84.38 £68.25
90th Percentile - £87.75 £84.83
England median hourly rate £62.50 £70.25 £32.00
% change year-on-year -11.03% +119.53% -28.09%

All Process and Methodology Skills
London

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 15,587 23,906 35,666
As % of all contract IT jobs advertised in London 88.68% 90.95% 92.32%
Number of daily rates quoted 11,195 17,189 26,035
10th Percentile £340 £375 £389
25th Percentile £450 £475 £475
Median daily rate (50th Percentile) £550 £590 £575
Median % change year-on-year -6.78% +2.61% +9.52%
75th Percentile £680 £700 £688
90th Percentile £800 £800 £775
England median daily rate £525 £550 £538
% change year-on-year -4.55% +2.33% +7.50%
Number of hourly rates quoted 314 270 421
10th Percentile £15.96 £18.45 £17.25
25th Percentile £20.00 £22.50 £23.91
Median hourly rate £28.00 £39.00 £36.50
Median % change year-on-year -28.21% +6.85% +11.11%
75th Percentile £48.75 £64.19 £51.00
90th Percentile £65.93 £80.23 £68.75
England median hourly rate £36.50 £37.34 £24.30
% change year-on-year -2.25% +53.69% +3.38%

Data Pipeline
Job Vacancy Trend in London

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Pipeline in London

Data Pipeline
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Data Pipeline in London.

Daily rate trend for Data Pipeline in London

Data Pipeline
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Pipeline in London over the 6 months to 7 May 2024.

Daily rate histogram for Data Pipeline in London

Data Pipeline
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Data Pipeline in London.

Hourly rate trend for Data Pipeline in London

Data Pipeline
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Pipeline within the London region over the 6 months to 7 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London +35 46 £575 +4.55% 19
South London - 6 £450 -
West London +7 3 £525 -8.70% 2
East London -2 1 £750 +50.00% 2
Data Pipeline
England

Data Pipeline
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 51 (16.40%) Apache Spark
2 41 (13.18%) Apache
3 33 (10.61%) Apache Airflow
4 4 (1.29%) Luigi
5 2 (0.64%) Confluence
6 1 (0.32%) ArcGIS
Applications
1 4 (1.29%) Microsoft Excel
Business Applications
1 2 (0.64%) Dynamics CRM
Cloud Services
1 148 (47.59%) AWS
2 143 (45.98%) Azure
3 55 (17.68%) Serverless
4 45 (14.47%) Azure Data Factory
5 44 (14.15%) AWS Lambda
6 42 (13.50%) GCP
7 35 (11.25%) Amazon S3
8 28 (9.00%) Azure Synapse Analytics
9 27 (8.68%) Amazon Kinesis
10 24 (7.72%) Azure DevOps
11 20 (6.43%) GitHub
11 20 (6.43%) Power Platform
12 19 (6.11%) Snowflake
13 17 (5.47%) Amazon EMR
13 17 (5.47%) AWS Step Functions
14 15 (4.82%) Amazon EC2
15 14 (4.50%) dbt
16 12 (3.86%) Amazon MSK
17 11 (3.54%) Azure Logic Apps
18 9 (2.89%) Dagster
Communications & Networking
1 1 (0.32%) Firewall
Database & Business Intelligence
1 82 (26.37%) Data Warehouse
2 72 (23.15%) Big Data
3 59 (18.97%) Data Lake
4 37 (11.90%) NoSQL
5 35 (11.25%) Amazon Redshift
6 22 (7.07%) Parquet
7 21 (6.75%) Relational Database
8 20 (6.43%) Power BI
9 18 (5.79%) BigQuery
9 18 (5.79%) DynamoDB
10 17 (5.47%) Flink
10 17 (5.47%) SQL Server
11 16 (5.14%) Azure SQL Database
12 13 (4.18%) Amazon RDS
12 13 (4.18%) PostgreSQL
13 9 (2.89%) Amazon Athena
13 9 (2.89%) Delta Lake
14 7 (2.25%) Tableau
15 6 (1.93%) Data Mining
15 6 (1.93%) Spark SQL
Development Applications
1 27 (8.68%) Git
2 8 (2.57%) JIRA
3 7 (2.25%) GitLab
4 6 (1.93%) Jenkins
4 6 (1.93%) MLflow
5 4 (1.29%) Deequ
6 2 (0.64%) Bugzilla
6 2 (0.64%) ER Studio
6 2 (0.64%) ERwin
6 2 (0.64%) JMeter
6 2 (0.64%) JUnit
6 2 (0.64%) Poetry
6 2 (0.64%) Selenium
6 2 (0.64%) TestNG
6 2 (0.64%) TestRail
6 2 (0.64%) Travis CI
7 1 (0.32%) GoCD
7 1 (0.32%) kappa
7 1 (0.32%) webpack
General
1 81 (26.05%) Social Skills
2 52 (16.72%) Finance
3 47 (15.11%) Analytical Skills
4 21 (6.75%) Public Sector
5 18 (5.79%) Banking
6 14 (4.50%) Front Office
7 11 (3.54%) Presentation Skills
8 6 (1.93%) Investment Banking
9 5 (1.61%) Inclusion and Diversity
10 4 (1.29%) Retail
11 3 (0.96%) Marketing
12 2 (0.64%) Czech Language
12 2 (0.64%) Influencing Skills
12 2 (0.64%) Pharmaceutical
13 1 (0.32%) Games
13 1 (0.32%) Local Government
13 1 (0.32%) Organisational Skills
Job Titles
1 169 (54.34%) Data Engineer
2 55 (17.68%) Senior
3 38 (12.22%) Azure Engineer
3 38 (12.22%) Developer
4 37 (11.90%) Azure Data Engineer
5 32 (10.29%) Architect
6 27 (8.68%) Senior Data Engineer
7 25 (8.04%) AWS Engineer
8 21 (6.75%) AWS Data Engineer
9 20 (6.43%) Lead
10 18 (5.79%) Data Scientist
11 15 (4.82%) Data Architect
11 15 (4.82%) Lead Data Engineer
11 15 (4.82%) Python Developer
12 12 (3.86%) Senior Developer
13 11 (3.54%) Python Engineer
14 10 (3.22%) Quantitative Developer
15 9 (2.89%) Analyst
15 9 (2.89%) Python Data Engineer
16 8 (2.57%) GCP Engineer
Libraries, Frameworks & Software Standards
1 50 (16.08%) Kafka
2 44 (14.15%) PySpark
3 30 (9.65%) Pandas
4 19 (6.11%) Apache Avro
4 19 (6.11%) JSON
4 19 (6.11%) NumPy
5 14 (4.50%) SciPy
6 11 (3.54%) scikit-learn
7 8 (2.57%) REST
7 8 (2.57%) TensorFlow
8 6 (1.93%) Great Expectations
9 5 (1.61%) ARM Templates
9 5 (1.61%) GraphQL
9 5 (1.61%) JSON Schema
9 5 (1.61%) YAML
10 4 (1.29%) Lambda Expressions
10 4 (1.29%) RESTful
10 4 (1.29%) SOAP
10 4 (1.29%) Spark Streaming
10 4 (1.29%) Web Services
Miscellaneous
1 24 (7.72%) Algorithms
2 18 (5.79%) Derivative
3 13 (4.18%) Data Structures
4 11 (3.54%) Greenfield Project
5 9 (2.89%) Distributed Systems
6 7 (2.25%) Management Information System
7 6 (1.93%) Cloud Native
7 6 (1.93%) Hedge funds
8 5 (1.61%) Analytical Mindset
8 5 (1.61%) Renewable Energy
9 4 (1.29%) Distributed Computing
9 4 (1.29%) Legacy Systems
9 4 (1.29%) Security Posture
9 4 (1.29%) Self-Motivation
10 3 (0.96%) Grid Computing
10 3 (0.96%) Linux Command Line
10 3 (0.96%) Wiki
11 2 (0.64%) Hybrid Cloud
11 2 (0.64%) Life Science
11 2 (0.64%) Onboarding
Operating Systems
1 12 (3.86%) Linux
2 2 (0.64%) Unix
3 1 (0.32%) Windows
3 1 (0.32%) Windows Server
Processes & Methodologies
1 126 (40.51%) ETL
2 100 (32.15%) Analytics
2 100 (32.15%) Data Modelling
3 80 (25.72%) Data Engineering
4 75 (24.12%) CI/CD
5 67 (21.54%) DevOps
6 59 (18.97%) Problem-Solving
7 58 (18.65%) Agile
7 58 (18.65%) Data Science
8 42 (13.50%) Data Integration
9 39 (12.54%) Machine Learning
10 37 (11.90%) Data Ingestion
11 36 (11.58%) Computer Science
12 32 (10.29%) Business Intelligence
13 30 (9.65%) Continuous Integration
13 30 (9.65%) Test Automation
14 29 (9.32%) Data Transformation
15 26 (8.36%) Visualisation
16 24 (7.72%) Infrastructure as Code
17 22 (7.07%) Software Engineering
Programming Languages
1 217 (69.77%) Python
2 189 (60.77%) SQL
3 39 (12.54%) Java
4 37 (11.90%) Scala
5 18 (5.79%) C++
6 12 (3.86%) C#
6 12 (3.86%) Rust
7 11 (3.54%) JavaScript
8 9 (2.89%) T-SQL
9 7 (2.25%) Bash
9 7 (2.25%) Bicep
9 7 (2.25%) TypeScript
10 4 (1.29%) PowerShell
11 3 (0.96%) Shell Script
12 2 (0.64%) Data Analysis Expressions
12 2 (0.64%) Go
12 2 (0.64%) Lua
12 2 (0.64%) Perl
12 2 (0.64%) PHP
12 2 (0.64%) VBA
Qualifications
1 65 (20.90%) Security Cleared
2 64 (20.58%) SC Cleared
3 37 (11.90%) Degree
4 25 (8.04%) Computer Science Degree
5 7 (2.25%) Azure Certification
6 6 (1.93%) Master's Degree
7 5 (1.61%) AWS Certification
7 5 (1.61%) CISSP
8 3 (0.96%) Microsoft Certification
9 2 (0.64%) BPSS Clearance
9 2 (0.64%) DV Cleared
10 1 (0.32%) AWS Certified Solutions Architect
Quality Assurance & Compliance
1 53 (17.04%) Data Quality
2 5 (1.61%) QA
3 2 (0.64%) GDPR
4 1 (0.32%) Accessibility
System Software
1 19 (6.11%) Docker
2 3 (0.96%) HDFS
3 1 (0.32%) Virtual Machines
Systems Management
1 33 (10.61%) Terraform
2 14 (4.50%) Kubernetes
3 4 (1.29%) Argo
4 3 (0.96%) Ansible
5 1 (0.32%) Kubeflow
5 1 (0.32%) Progress Chef
Vendors
1 77 (24.76%) Databricks
2 21 (6.75%) Microsoft
3 14 (4.50%) Google
4 13 (4.18%) Oracle
5 7 (2.25%) Informatica
5 7 (2.25%) Palantir
6 6 (1.93%) Foundry
7 3 (0.96%) Cloudera
7 3 (0.96%) Dataiku
8 2 (0.64%) Alteryx
8 2 (0.64%) Dynatrace
8 2 (0.64%) OpenAI
8 2 (0.64%) SAP
8 2 (0.64%) Talend
8 2 (0.64%) Workday
9 1 (0.32%) IBM
9 1 (0.32%) ServiceNow
9 1 (0.32%) SnapLogic
9 1 (0.32%) Splunk
9 1 (0.32%) TIBCO