Data Ingestion Contracts

Data Ingestion
UK

The following table provides summary statistics for contract job vacancies with a requirement for Data Ingestion skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Ingestion over the 6 months to 15 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
15 May 2024
Same period 2023 Same period 2022
Rank 420 567 567
Rank change year-on-year +147 0 -140
Contract jobs citing Data Ingestion 154 134 298
As % of all contract jobs advertised in the UK 0.36% 0.23% 0.34%
As % of the Processes & Methodologies category 0.42% 0.26% 0.38%
Number of daily rates quoted 113 103 187
10th Percentile £401 £471 £461
25th Percentile £425 £504 £513
Median daily rate (50th Percentile) £525 £600 £600
Median % change year-on-year -12.50% - +14.29%
75th Percentile £615 £650 £744
90th Percentile £739 £738 £808
UK excluding London median daily rate £610 £600 £625
% change year-on-year +1.67% -4.00% +31.58%
Number of hourly rates quoted 1 2 0
10th Percentile - £78.75 -
25th Percentile £66.25 £80.63 -
Median hourly rate £67.50 £85.00 -
Median % change year-on-year -20.59% - -
75th Percentile £68.75 £88.13 -
90th Percentile - £89.25 -
UK excluding London median hourly rate £67.50 - -

All Process and Methodology Skills
UK

Data Ingestion is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 36,687 51,295 79,236
As % of all contract IT jobs advertised in the UK 86.22% 89.83% 90.60%
Number of daily rates quoted 23,611 35,552 55,630
10th Percentile £300 £325 £343
25th Percentile £413 £438 £430
Median daily rate (50th Percentile) £525 £550 £530
Median % change year-on-year -4.55% +3.77% +8.16%
75th Percentile £638 £650 £638
90th Percentile £750 £750 £738
UK excluding London median daily rate £500 £500 £476
% change year-on-year - +5.04% +8.51%
Number of hourly rates quoted 2,428 1,693 1,906
10th Percentile £12.75 £10.77 £12.50
25th Percentile £16.00 £16.13 £15.63
Median hourly rate £36.05 £36.00 £25.68
Median % change year-on-year +0.13% +40.19% +4.82%
75th Percentile £60.00 £65.00 £49.52
90th Percentile £72.50 £75.00 £65.00
UK excluding London median hourly rate £37.50 £35.00 £20.00
% change year-on-year +7.14% +75.00% -6.98%

Data Ingestion
Job Vacancy Trend

Job postings citing Data Ingestion as a proportion of all IT jobs advertised.

Job vacancy trend for Data Ingestion in the UK

Data Ingestion
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Ingestion.

Daily rate trend for Data Ingestion in the UK

Data Ingestion
Daily Rate Histogram

Daily rate distribution for jobs citing Data Ingestion over the 6 months to 15 May 2024.

Daily rate histogram for Data Ingestion in the UK

Data Ingestion
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Ingestion.

Hourly rate trend for Data Ingestion in the UK

Data Ingestion
Top 13 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Ingestion within the UK over the 6 months to 15 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England +126 144 £525 -12.25% 55
London +147 114 £500 -13.04% 38
Work from Home +116 52 £528 -12.08% 21
UK excluding London +39 29 £610 +1.67% 24
North of England +33 18 £593 +7.73% 5
North West +22 9 £525 -4.55% 2
Yorkshire - 9 £610 - 2
South East +22 5 £738 +34.09% 6
Scotland +48 2 - - 3
Midlands +28 2 £468 -25.20% 3
East Midlands +16 2 £468 -28.08%
South West +14 1 £533 -16.47% 2
East of England -6 1 £550 -8.33% 1

Data Ingestion
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 10 (6.49%) Apache Spark
2 7 (4.55%) Apache
2 7 (4.55%) Apache Airflow
3 4 (2.60%) Confluence
4 2 (1.30%) ArcGIS
5 1 (0.65%) Apache Pulsar
5 1 (0.65%) SharePoint
Applications
1 1 (0.65%) Microsoft Excel
1 1 (0.65%) Microsoft Office
1 1 (0.65%) Microsoft PowerPoint
1 1 (0.65%) Spreadsheet
Business Applications
1 11 (7.14%) Dynamics CRM
2 2 (1.30%) Adobe Campaign
2 2 (1.30%) Unica
Cloud Services
1 51 (33.12%) AWS
2 45 (29.22%) GCP
3 41 (26.62%) Azure
4 29 (18.83%) Serverless
5 26 (16.88%) AWS Lambda
6 22 (14.29%) AWS Step Functions
7 20 (12.99%) Amazon MSK
7 20 (12.99%) dbt
8 19 (12.34%) Power Platform
9 16 (10.39%) Amazon S3
10 11 (7.14%) Snowflake
11 9 (5.84%) Azure Data Factory
12 8 (5.19%) Azure DevOps
13 7 (4.55%) Vertex AI
14 6 (3.90%) Adobe Analytics
14 6 (3.90%) Cloud Computing
14 6 (3.90%) GitHub
14 6 (3.90%) Google Analytics
15 5 (3.25%) Azure Machine Learning
15 5 (3.25%) Azure Synapse Analytics
Communications & Networking
1 1 (0.65%) Network Security
Database & Business Intelligence
1 51 (33.12%) Data Warehouse
2 27 (17.53%) Amazon Redshift
3 21 (13.64%) Big Data
3 21 (13.64%) DynamoDB
4 20 (12.99%) Amazon RDS
4 20 (12.99%) Parquet
5 19 (12.34%) Data Lake
5 19 (12.34%) Power BI
6 18 (11.69%) BigQuery
7 10 (6.49%) Tableau
8 7 (4.55%) Azure SQL Database
8 7 (4.55%) Flink
8 7 (4.55%) Relational Database
8 7 (4.55%) SQL Server
9 6 (3.90%) Looker
9 6 (3.90%) Metadata
9 6 (3.90%) NoSQL
10 5 (3.25%) Hadoop
10 5 (3.25%) OLAP
10 5 (3.25%) OLTP
Development Applications
1 12 (7.79%) MLflow
2 5 (3.25%) Postman
3 4 (2.60%) Git
4 3 (1.95%) ERwin
4 3 (1.95%) Jenkins
4 3 (1.95%) JIRA
5 2 (1.30%) ER Studio
5 2 (1.30%) kappa
6 1 (0.65%) NUnit
General
1 34 (22.08%) Social Skills
2 24 (15.58%) Analytical Skills
3 17 (11.04%) Finance
4 15 (9.74%) Public Sector
5 13 (8.44%) Banking
6 10 (6.49%) Marketing
7 9 (5.84%) Retail
8 6 (3.90%) Advertising
8 6 (3.90%) Front Office
8 6 (3.90%) Investment Banking
9 5 (3.25%) Documentation Skills
10 3 (1.95%) Financial Institution
10 3 (1.95%) Pharmaceutical
10 3 (1.95%) Presentation Skills
11 2 (1.30%) Organisational Skills
12 1 (0.65%) Law
Job Titles
1 55 (35.71%) Data Engineer
2 38 (24.68%) Developer
3 29 (18.83%) Senior
4 20 (12.99%) Architect
5 18 (11.69%) Data Architect
6 17 (11.04%) Senior Developer
7 11 (7.14%) Consultant
7 11 (7.14%) Microsoft Developer
8 10 (6.49%) Python Developer
9 9 (5.84%) Lead
9 9 (5.84%) Lead Data Engineer
10 7 (4.55%) Senior Microsoft Developer
11 6 (3.90%) Machine Learning Engineer
12 5 (3.25%) Azure Architect
12 5 (3.25%) Azure Data Architect
12 5 (3.25%) Cloud Architect
12 5 (3.25%) Data Modeller
12 5 (3.25%) ETL Architect
12 5 (3.25%) Senior Data Engineer
12 5 (3.25%) Solutions Architect
Libraries, Frameworks & Software Standards
1 25 (16.23%) JSON
2 19 (12.34%) Apache Avro
3 16 (10.39%) Kafka
4 7 (4.55%) CSS
4 7 (4.55%) FastAPI
4 7 (4.55%) HTML
5 6 (3.90%) Flask
5 6 (3.90%) jQuery
5 6 (3.90%) Node.js
5 6 (3.90%) NumPy
5 6 (3.90%) Pandas
5 6 (3.90%) scikit-learn
5 6 (3.90%) TensorFlow
6 5 (3.25%) DOM
6 5 (3.25%) PySpark
6 5 (3.25%) React
6 5 (3.25%) Swagger
7 4 (2.60%) .NET
7 4 (2.60%) Apache NiFi
8 3 (1.95%) SOAP
Miscellaneous
1 7 (4.55%) Marketing Technology
1 7 (4.55%) Onboarding
2 6 (3.90%) Derivative
2 6 (3.90%) Product Ownership
3 5 (3.25%) Management Information System
4 4 (2.60%) Algorithms
5 3 (1.95%) Data Centre
5 3 (1.95%) Distributed Computing
5 3 (1.95%) Insider Threat
5 3 (1.95%) Renewable Energy
6 2 (1.30%) Data Structures
6 2 (1.30%) Greenfield Project
7 1 (0.65%) Cloud Native
7 1 (0.65%) Cyber Threat
7 1 (0.65%) Mobile App
7 1 (0.65%) Security Operations Centre
7 1 (0.65%) Self-Motivation
7 1 (0.65%) Smart Meter
Operating Systems
1 8 (5.19%) Unix
2 5 (3.25%) Linux
Processes & Methodologies
1 67 (43.51%) Data Modelling
2 66 (42.86%) ETL
3 56 (36.36%) Data Pipeline
4 43 (27.92%) Agile
5 41 (26.62%) Analytics
6 32 (20.78%) CI/CD
7 30 (19.48%) Machine Learning
8 29 (18.83%) DevOps
9 27 (17.53%) Data Governance
10 25 (16.23%) Data Engineering
10 25 (16.23%) Problem-Solving
11 22 (14.29%) Business Transformation
11 22 (14.29%) Data Integration
12 21 (13.64%) Visualisation
13 19 (12.34%) Artificial Intelligence
13 19 (12.34%) Business Intelligence
13 19 (12.34%) Data Science
14 17 (11.04%) Computer Science
15 16 (10.39%) Roadmaps
16 15 (9.74%) Unit Testing
Programming Languages
1 81 (52.60%) Python
2 63 (40.91%) SQL
3 18 (11.69%) JavaScript
4 15 (9.74%) Scala
5 13 (8.44%) Java
6 9 (5.84%) TypeScript
7 8 (5.19%) Go
8 6 (3.90%) C#
9 4 (2.60%) Perl
10 3 (1.95%) Bicep
10 3 (1.95%) Search Processing Language
10 3 (1.95%) Shell Script
10 3 (1.95%) T-SQL
11 2 (1.30%) Lua
11 2 (1.30%) PHP
11 2 (1.30%) PowerShell
Qualifications
1 37 (24.03%) Security Cleared
2 35 (22.73%) SC Cleared
3 21 (13.64%) Degree
4 14 (9.09%) Computer Science Degree
5 13 (8.44%) Master's Degree
6 2 (1.30%) BPSS Clearance
7 1 (0.65%) Azure Certification
7 1 (0.65%) PhD
7 1 (0.65%) Postgraduate
Quality Assurance & Compliance
1 36 (23.38%) Data Quality
2 16 (10.39%) QA
3 3 (1.95%) Accessibility
4 1 (0.65%) GDPR
4 1 (0.65%) NIST
System Software
1 7 (4.55%) Docker
2 1 (0.65%) Apache Flume
2 1 (0.65%) Virtual Machines
Systems Management
1 8 (5.19%) Kubernetes
2 6 (3.90%) Kubeflow
3 5 (3.25%) Terraform
4 1 (0.65%) Kibana
4 1 (0.65%) Matomo
Vendors
1 30 (19.48%) Google
2 19 (12.34%) Databricks
3 13 (8.44%) Microsoft
4 9 (5.84%) Adobe
5 6 (3.90%) Foundry
5 6 (3.90%) Monetate
5 6 (3.90%) Optimizely
5 6 (3.90%) Palantir
6 5 (3.25%) Ensighten
6 5 (3.25%) Omniture
6 5 (3.25%) Tealium
7 3 (1.95%) Splunk
8 2 (1.30%) Cloudera
8 2 (1.30%) ESRI
8 2 (1.30%) Informatica
8 2 (1.30%) Proofpoint
8 2 (1.30%) Workday
9 1 (0.65%) IBM
9 1 (0.65%) SAP
9 1 (0.65%) Talend