Data Pipeline Contracts in London

Data Pipelines
England > London

The following table provides summary statistics for contract job vacancies advertised in London with a requirement for Data Pipeline skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Pipeline over the 6 months to 16 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
16 May 2024
Same period 2023 Same period 2022
Rank 142 219 230
Rank change year-on-year +77 +11 -34
Contract jobs citing Data Pipeline 311 311 477
As % of all contract jobs advertised in London 1.78% 1.20% 1.24%
As % of the Processes & Methodologies category 2.01% 1.32% 1.34%
Number of daily rates quoted 237 211 337
10th Percentile £400 £450 £469
25th Percentile £463 £500 £538
Median daily rate (50th Percentile) £560 £565 £625
Median % change year-on-year -0.88% -9.60% +13.64%
75th Percentile £663 £691 £738
90th Percentile £750 £775 £825
England median daily rate £550 £550 £600
% change year-on-year - -8.33% +11.11%
Number of hourly rates quoted 1 4 6
10th Percentile - - £27.00
25th Percentile £46.75 £65.00 £28.56
Median hourly rate £48.50 £72.50 £33.75
Median % change year-on-year -33.10% +114.81% -24.16%
75th Percentile £50.25 £84.38 £68.25
90th Percentile - £87.75 £84.83
England median hourly rate £62.50 £70.25 £32.00
% change year-on-year -11.03% +119.53% -21.95%

All Process and Methodology Skills
London

Data Pipeline is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies advertised in London with a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 15,475 23,527 35,605
As % of all contract IT jobs advertised in London 88.65% 90.92% 92.33%
Number of daily rates quoted 11,094 16,975 26,024
10th Percentile £343 £375 £388
25th Percentile £450 £475 £475
Median daily rate (50th Percentile) £550 £593 £575
Median % change year-on-year -7.17% +3.04% +9.52%
75th Percentile £688 £700 £688
90th Percentile £800 £800 £775
England median daily rate £525 £550 £540
% change year-on-year -4.55% +1.85% +8.00%
Number of hourly rates quoted 307 269 415
10th Percentile £15.77 £18.40 £17.55
25th Percentile £20.00 £22.49 £24.25
Median hourly rate £27.84 £37.34 £37.50
Median % change year-on-year -25.44% -0.43% +14.77%
75th Percentile £48.75 £64.25 £51.61
90th Percentile £66.85 £82.30 £68.75
England median hourly rate £36.50 £36.00 £25.00
% change year-on-year +1.39% +44.00% +7.71%

Data Pipeline
Job Vacancy Trend in London

Job postings citing Data Pipeline as a proportion of all IT jobs advertised in London.

Job vacancy trend for Data Pipeline in London

Data Pipeline
Contractor Daily Rate Trend in London

3-month moving average daily rate quoted in jobs citing Data Pipeline in London.

Daily rate trend for Data Pipeline in London

Data Pipeline
Daily Rate Histogram in London

Daily rate distribution for jobs citing Data Pipeline in London over the 6 months to 16 May 2024.

Daily rate histogram for Data Pipeline in London

Data Pipeline
Contractor Hourly Rate Trend in London

3-month moving average hourly rates quoted in jobs citing Data Pipeline in London.

Hourly rate trend for Data Pipeline in London

Data Pipeline
Contract Job Locations in London

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Pipeline within the London region over the 6 months to 16 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
Central London +31 45 £563 +0.45% 17
South London - 6 £450 - 1
West London +10 3 £525 -8.70% 2
East London -4 1 £750 +50.00% 3
Data Pipeline
England

Data Pipeline
Co-occurring Skills and Capabilities in London by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 53 (17.04%) Apache Spark
2 41 (13.18%) Apache
3 35 (11.25%) Apache Airflow
4 4 (1.29%) Luigi
5 2 (0.64%) Confluence
6 1 (0.32%) ArcGIS
Applications
1 4 (1.29%) Microsoft Excel
Business Applications
1 2 (0.64%) Dynamics CRM
Cloud Services
1 143 (45.98%) AWS
2 142 (45.66%) Azure
3 54 (17.36%) Serverless
4 43 (13.83%) AWS Lambda
5 41 (13.18%) Azure Data Factory
5 41 (13.18%) GCP
6 37 (11.90%) Amazon S3
7 27 (8.68%) Azure Synapse Analytics
8 24 (7.72%) Amazon Kinesis
9 23 (7.40%) Azure DevOps
10 20 (6.43%) Power Platform
11 19 (6.11%) GitHub
11 19 (6.11%) Snowflake
12 17 (5.47%) AWS Step Functions
13 16 (5.14%) Amazon EC2
13 16 (5.14%) Amazon EMR
14 14 (4.50%) dbt
15 12 (3.86%) Amazon MSK
15 12 (3.86%) Azure Logic Apps
16 8 (2.57%) Dagster
Communications & Networking
1 1 (0.32%) Firewall
Database & Business Intelligence
1 88 (28.30%) Data Warehouse
2 70 (22.51%) Big Data
3 59 (18.97%) Data Lake
4 35 (11.25%) NoSQL
5 32 (10.29%) Amazon Redshift
6 22 (7.07%) Parquet
7 21 (6.75%) Relational Database
8 20 (6.43%) Power BI
9 19 (6.11%) BigQuery
10 17 (5.47%) Azure SQL Database
11 16 (5.14%) DynamoDB
11 16 (5.14%) Flink
12 15 (4.82%) SQL Server
13 13 (4.18%) Amazon RDS
14 11 (3.54%) Delta Lake
15 10 (3.22%) Amazon Athena
16 9 (2.89%) PostgreSQL
17 7 (2.25%) Tableau
18 6 (1.93%) Metadata
18 6 (1.93%) Spark SQL
Development Applications
1 28 (9.00%) Git
2 8 (2.57%) Jenkins
2 8 (2.57%) JIRA
3 7 (2.25%) GitLab
4 6 (1.93%) MLflow
5 4 (1.29%) Deequ
6 2 (0.64%) Bugzilla
6 2 (0.64%) ER Studio
6 2 (0.64%) ERwin
6 2 (0.64%) JMeter
6 2 (0.64%) JUnit
6 2 (0.64%) Selenium
6 2 (0.64%) TestNG
6 2 (0.64%) TestRail
6 2 (0.64%) Travis CI
7 1 (0.32%) GoCD
7 1 (0.32%) kappa
7 1 (0.32%) Poetry
7 1 (0.32%) webpack
General
1 82 (26.37%) Social Skills
2 54 (17.36%) Finance
3 48 (15.43%) Analytical Skills
4 22 (7.07%) Public Sector
5 18 (5.79%) Banking
6 14 (4.50%) Front Office
7 11 (3.54%) Presentation Skills
8 6 (1.93%) Investment Banking
9 5 (1.61%) Inclusion and Diversity
10 4 (1.29%) Retail
11 3 (0.96%) Marketing
12 2 (0.64%) Czech Language
12 2 (0.64%) Influencing Skills
12 2 (0.64%) Pharmaceutical
13 1 (0.32%) Games
13 1 (0.32%) Local Government
13 1 (0.32%) Organisational Skills
Job Titles
1 167 (53.70%) Data Engineer
2 54 (17.36%) Senior
3 40 (12.86%) Developer
4 39 (12.54%) Azure Engineer
5 38 (12.22%) Azure Data Engineer
6 31 (9.97%) Architect
7 29 (9.32%) Senior Data Engineer
8 26 (8.36%) AWS Engineer
9 21 (6.75%) AWS Data Engineer
9 21 (6.75%) Lead
10 17 (5.47%) Data Scientist
11 15 (4.82%) Lead Data Engineer
12 14 (4.50%) Python Developer
13 13 (4.18%) Data Architect
14 11 (3.54%) Senior Developer
15 10 (3.22%) Analyst
15 10 (3.22%) Python Engineer
15 10 (3.22%) Quantitative Developer
16 8 (2.57%) GCP Engineer
16 8 (2.57%) Python Data Engineer
Libraries, Frameworks & Software Standards
1 48 (15.43%) Kafka
2 47 (15.11%) PySpark
3 29 (9.32%) Pandas
4 19 (6.11%) Apache Avro
4 19 (6.11%) JSON
5 18 (5.79%) NumPy
6 13 (4.18%) SciPy
7 10 (3.22%) scikit-learn
8 8 (2.57%) TensorFlow
9 7 (2.25%) REST
10 5 (1.61%) ARM Templates
10 5 (1.61%) Great Expectations
10 5 (1.61%) JSON Schema
11 4 (1.29%) GraphQL
11 4 (1.29%) RESTful
11 4 (1.29%) Spark Streaming
11 4 (1.29%) Web Services
11 4 (1.29%) YAML
12 3 (0.96%) .NET
12 3 (0.96%) Middleware
Miscellaneous
1 23 (7.40%) Algorithms
2 18 (5.79%) Derivative
3 13 (4.18%) Data Structures
4 10 (3.22%) Distributed Systems
4 10 (3.22%) Greenfield Project
5 7 (2.25%) Management Information System
6 6 (1.93%) Hedge funds
7 5 (1.61%) Analytical Mindset
7 5 (1.61%) Renewable Energy
7 5 (1.61%) Self-Motivation
8 4 (1.29%) Cloud Native
8 4 (1.29%) Distributed Computing
8 4 (1.29%) Legacy Systems
8 4 (1.29%) Security Posture
9 3 (0.96%) Grid Computing
9 3 (0.96%) Virtual Team
10 2 (0.64%) Life Science
10 2 (0.64%) Linux Command Line
10 2 (0.64%) Onboarding
10 2 (0.64%) Solar Panel
Operating Systems
1 13 (4.18%) Linux
2 2 (0.64%) Unix
3 1 (0.32%) Windows
3 1 (0.32%) Windows Server
Processes & Methodologies
1 133 (42.77%) ETL
2 104 (33.44%) Data Modelling
3 101 (32.48%) Analytics
4 84 (27.01%) Data Engineering
5 79 (25.40%) CI/CD
6 66 (21.22%) DevOps
7 63 (20.26%) Agile
7 63 (20.26%) Problem-Solving
8 53 (17.04%) Data Science
9 44 (14.15%) Data Integration
10 39 (12.54%) Data Ingestion
10 39 (12.54%) Machine Learning
11 35 (11.25%) Computer Science
12 34 (10.93%) Business Intelligence
12 34 (10.93%) Continuous Integration
13 32 (10.29%) Data Transformation
14 29 (9.32%) Test Automation
15 25 (8.04%) Visualisation
16 23 (7.40%) Infrastructure as Code
17 22 (7.07%) Data Governance
Programming Languages
1 213 (68.49%) Python
2 189 (60.77%) SQL
3 39 (12.54%) Java
4 38 (12.22%) Scala
5 18 (5.79%) C++
6 12 (3.86%) Rust
7 11 (3.54%) C#
7 11 (3.54%) JavaScript
8 9 (2.89%) T-SQL
9 7 (2.25%) Bash
9 7 (2.25%) TypeScript
10 6 (1.93%) Bicep
11 4 (1.29%) Go
12 3 (0.96%) PowerShell
12 3 (0.96%) Shell Script
13 2 (0.64%) Data Analysis Expressions
13 2 (0.64%) Lua
13 2 (0.64%) Perl
13 2 (0.64%) PHP
13 2 (0.64%) VBA
Qualifications
1 63 (20.26%) Security Cleared
2 62 (19.94%) SC Cleared
3 36 (11.58%) Degree
4 25 (8.04%) Computer Science Degree
5 8 (2.57%) Azure Certification
6 6 (1.93%) CISSP
7 5 (1.61%) AWS Certification
7 5 (1.61%) Master's Degree
8 3 (0.96%) Microsoft Certification
9 2 (0.64%) BPSS Clearance
10 1 (0.32%) (ISC)2 CCSP
10 1 (0.32%) AWS Certified Solutions Architect
10 1 (0.32%) Cisco Certification
10 1 (0.32%) CSSLP
10 1 (0.32%) DV Cleared
Quality Assurance & Compliance
1 56 (18.01%) Data Quality
2 5 (1.61%) QA
3 3 (0.96%) GDPR
4 1 (0.32%) Accessibility
4 1 (0.32%) NIST
System Software
1 18 (5.79%) Docker
2 3 (0.96%) HDFS
3 1 (0.32%) Virtual Machines
Systems Management
1 32 (10.29%) Terraform
2 15 (4.82%) Kubernetes
3 5 (1.61%) Ansible
4 4 (1.29%) Argo
5 1 (0.32%) Kubeflow
5 1 (0.32%) Progress Chef
Vendors
1 76 (24.44%) Databricks
2 21 (6.75%) Microsoft
3 16 (5.14%) Google
4 11 (3.54%) Oracle
5 7 (2.25%) Informatica
5 7 (2.25%) Palantir
6 6 (1.93%) Foundry
7 3 (0.96%) Cloudera
7 3 (0.96%) Dataiku
7 3 (0.96%) Splunk
7 3 (0.96%) TIBCO
8 2 (0.64%) Ab Initio
8 2 (0.64%) Alteryx
8 2 (0.64%) Dynatrace
8 2 (0.64%) IBM
8 2 (0.64%) OpenAI
8 2 (0.64%) SAP
8 2 (0.64%) Workday
9 1 (0.32%) DataRobot
9 1 (0.32%) SnapLogic