Data Ingestion Contracts

Data Ingestion
UK

The following table provides summary statistics for contract job vacancies with a requirement for Data Ingestion skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Ingestion over the 6 months to 23 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
23 May 2024
Same period 2023 Same period 2022
Rank 414 552 582
Rank change year-on-year +138 +30 -144
Contract jobs citing Data Ingestion 157 138 285
As % of all contract jobs advertised in the UK 0.37% 0.24% 0.33%
As % of the Processes & Methodologies category 0.43% 0.27% 0.36%
Number of daily rates quoted 115 108 177
10th Percentile £400 £474 £461
25th Percentile £425 £506 £513
Median daily rate (50th Percentile) £525 £600 £625
Median % change year-on-year -12.50% -4.00% +17.92%
75th Percentile £614 £650 £750
90th Percentile £734 £738 £826
UK excluding London median daily rate £610 £600 £650
% change year-on-year +1.67% -7.69% +36.84%
Number of hourly rates quoted 1 2 0
10th Percentile - £78.75 -
25th Percentile £66.25 £80.63 -
Median hourly rate £67.50 £85.00 -
Median % change year-on-year -20.59% - -
75th Percentile £68.75 £88.13 -
90th Percentile - £89.25 -
UK excluding London median hourly rate £67.50 - -

All Process and Methodology Skills
UK

Data Ingestion is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 36,537 50,741 79,365
As % of all contract IT jobs advertised in the UK 85.91% 89.71% 90.64%
Number of daily rates quoted 23,555 35,132 55,704
10th Percentile £300 £325 £345
25th Percentile £413 £439 £431
Median daily rate (50th Percentile) £525 £550 £535
Median % change year-on-year -4.55% +2.80% +8.08%
75th Percentile £638 £650 £638
90th Percentile £750 £750 £738
UK excluding London median daily rate £500 £500 £483
% change year-on-year - +3.63% +9.66%
Number of hourly rates quoted 2,471 1,680 1,899
10th Percentile £12.75 £10.63 £12.50
25th Percentile £16.00 £15.74 £15.50
Median hourly rate £36.00 £36.00 £25.68
Median % change year-on-year - +40.19% +7.00%
75th Percentile £60.00 £65.00 £49.56
90th Percentile £72.50 £75.00 £65.00
UK excluding London median hourly rate £37.75 £35.00 £20.00
% change year-on-year +7.86% +75.00% -4.99%

Data Ingestion
Job Vacancy Trend

Job postings citing Data Ingestion as a proportion of all IT jobs advertised.

Job vacancy trend for Data Ingestion in the UK

Data Ingestion
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Ingestion.

Daily rate trend for Data Ingestion in the UK

Data Ingestion
Daily Rate Histogram

Daily rate distribution for jobs citing Data Ingestion over the 6 months to 23 May 2024.

Daily rate histogram for Data Ingestion in the UK

Data Ingestion
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Ingestion.

Hourly rate trend for Data Ingestion in the UK

Data Ingestion
Top 13 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Ingestion within the UK over the 6 months to 23 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England +122 146 £525 -12.50% 58
London +135 115 £500 -13.04% 34
Work from Home +115 53 £530 -11.67% 26
UK excluding London +46 29 £610 +1.67% 26
North of England +39 18 £593 -5.20% 8
Yorkshire +26 9 £610 -2.40%
North West +26 9 £525 -4.55% 7
South East +19 5 £738 +34.09% 4
Scotland +44 2 - - 2
Midlands +31 2 £468 -25.20% 5
East Midlands +17 2 £468 -28.08% 1
South West +9 1 £533 -16.47% 4
East of England -6 1 £550 -8.33% 1

Data Ingestion
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 10 (6.37%) Apache Spark
2 7 (4.46%) Apache
2 7 (4.46%) Apache Airflow
3 4 (2.55%) Confluence
4 2 (1.27%) ArcGIS
5 1 (0.64%) Apache Pulsar
5 1 (0.64%) SharePoint
Applications
1 1 (0.64%) Microsoft Excel
1 1 (0.64%) Microsoft Office
1 1 (0.64%) Microsoft PowerPoint
1 1 (0.64%) Spreadsheet
Business Applications
1 11 (7.01%) Dynamics CRM
2 2 (1.27%) Adobe Campaign
2 2 (1.27%) Unica
Cloud Services
1 51 (32.48%) AWS
2 46 (29.30%) GCP
3 42 (26.75%) Azure
4 29 (18.47%) Serverless
5 26 (16.56%) AWS Lambda
6 22 (14.01%) AWS Step Functions
7 20 (12.74%) Amazon MSK
7 20 (12.74%) dbt
8 19 (12.10%) Power Platform
9 16 (10.19%) Amazon S3
10 11 (7.01%) Snowflake
11 9 (5.73%) Azure Data Factory
11 9 (5.73%) Azure DevOps
12 7 (4.46%) GitHub
12 7 (4.46%) Vertex AI
13 6 (3.82%) Adobe Analytics
13 6 (3.82%) Cloud Computing
13 6 (3.82%) Google Analytics
14 5 (3.18%) Cloud Run
14 5 (3.18%) Google Data Studio
Communications & Networking
1 1 (0.64%) Network Security
Database & Business Intelligence
1 51 (32.48%) Data Warehouse
2 27 (17.20%) Amazon Redshift
3 22 (14.01%) Big Data
4 21 (13.38%) DynamoDB
5 20 (12.74%) Amazon RDS
5 20 (12.74%) Parquet
6 19 (12.10%) BigQuery
6 19 (12.10%) Data Lake
6 19 (12.10%) Power BI
7 10 (6.37%) Tableau
8 7 (4.46%) Azure SQL Database
8 7 (4.46%) Flink
8 7 (4.46%) Relational Database
8 7 (4.46%) SQL Server
9 6 (3.82%) Looker
9 6 (3.82%) Metadata
9 6 (3.82%) NoSQL
10 5 (3.18%) Hadoop
10 5 (3.18%) OLAP
10 5 (3.18%) Spark SQL
Development Applications
1 12 (7.64%) MLflow
2 5 (3.18%) Git
2 5 (3.18%) Postman
3 3 (1.91%) ERwin
3 3 (1.91%) Jenkins
3 3 (1.91%) JIRA
4 2 (1.27%) ER Studio
4 2 (1.27%) kappa
5 1 (0.64%) NUnit
General
1 34 (21.66%) Social Skills
2 24 (15.29%) Analytical Skills
3 17 (10.83%) Finance
4 15 (9.55%) Public Sector
5 13 (8.28%) Banking
6 11 (7.01%) Marketing
7 9 (5.73%) Retail
8 6 (3.82%) Advertising
8 6 (3.82%) Front Office
8 6 (3.82%) Investment Banking
9 5 (3.18%) Documentation Skills
10 3 (1.91%) Financial Institution
10 3 (1.91%) Pharmaceutical
10 3 (1.91%) Presentation Skills
11 2 (1.27%) Organisational Skills
12 1 (0.64%) Law
Job Titles
1 57 (36.31%) Data Engineer
2 38 (24.20%) Developer
3 29 (18.47%) Senior
4 20 (12.74%) Architect
5 18 (11.46%) Data Architect
6 17 (10.83%) Senior Developer
7 11 (7.01%) Consultant
7 11 (7.01%) Microsoft Developer
8 10 (6.37%) Python Developer
9 9 (5.73%) Lead
9 9 (5.73%) Lead Data Engineer
10 7 (4.46%) Senior Microsoft Developer
11 6 (3.82%) Machine Learning Engineer
12 5 (3.18%) Azure Architect
12 5 (3.18%) Cloud Architect
12 5 (3.18%) Data Modeller
12 5 (3.18%) ETL Architect
12 5 (3.18%) GCP Data Engineer
12 5 (3.18%) GCP Engineer
12 5 (3.18%) Senior Data Engineer
Libraries, Frameworks & Software Standards
1 25 (15.92%) JSON
2 19 (12.10%) Apache Avro
3 16 (10.19%) Kafka
4 7 (4.46%) CSS
4 7 (4.46%) FastAPI
4 7 (4.46%) HTML
4 7 (4.46%) PySpark
5 6 (3.82%) Flask
5 6 (3.82%) jQuery
5 6 (3.82%) Node.js
5 6 (3.82%) NumPy
5 6 (3.82%) Pandas
5 6 (3.82%) scikit-learn
5 6 (3.82%) TensorFlow
6 5 (3.18%) DOM
6 5 (3.18%) React
6 5 (3.18%) Swagger
7 4 (2.55%) .NET
7 4 (2.55%) Apache NiFi
8 3 (1.91%) SOAP
Miscellaneous
1 7 (4.46%) Marketing Technology
1 7 (4.46%) Onboarding
1 7 (4.46%) Product Ownership
2 6 (3.82%) Derivative
3 5 (3.18%) Management Information System
4 4 (2.55%) Algorithms
5 3 (1.91%) Data Centre
5 3 (1.91%) Distributed Computing
5 3 (1.91%) Insider Threat
5 3 (1.91%) Renewable Energy
6 2 (1.27%) Data Structures
6 2 (1.27%) Greenfield Project
6 2 (1.27%) Smart Meter
7 1 (0.64%) Cloud Native
7 1 (0.64%) Cyber Threat
7 1 (0.64%) Mobile App
7 1 (0.64%) Security Operations Centre
7 1 (0.64%) Self-Motivation
Operating Systems
1 9 (5.73%) Unix
2 6 (3.82%) Linux
Processes & Methodologies
1 67 (42.68%) Data Modelling
1 67 (42.68%) ETL
2 57 (36.31%) Data Pipeline
3 43 (27.39%) Agile
3 43 (27.39%) Analytics
4 33 (21.02%) CI/CD
5 30 (19.11%) DevOps
5 30 (19.11%) Machine Learning
6 27 (17.20%) Data Governance
7 25 (15.92%) Data Engineering
7 25 (15.92%) Problem-Solving
8 22 (14.01%) Business Transformation
8 22 (14.01%) Data Integration
9 21 (13.38%) Visualisation
10 20 (12.74%) Business Intelligence
10 20 (12.74%) Data Science
11 19 (12.10%) Artificial Intelligence
12 17 (10.83%) Computer Science
13 16 (10.19%) Roadmaps
14 15 (9.55%) Unit Testing
Programming Languages
1 83 (52.87%) Python
2 63 (40.13%) SQL
3 18 (11.46%) JavaScript
4 15 (9.55%) Scala
5 14 (8.92%) Java
6 9 (5.73%) TypeScript
7 8 (5.10%) Go
8 6 (3.82%) C#
9 4 (2.55%) Perl
10 3 (1.91%) Bicep
10 3 (1.91%) Search Processing Language
10 3 (1.91%) Shell Script
10 3 (1.91%) T-SQL
11 2 (1.27%) Lua
11 2 (1.27%) PHP
11 2 (1.27%) PowerShell
Qualifications
1 37 (23.57%) Security Cleared
2 35 (22.29%) SC Cleared
3 21 (13.38%) Degree
4 14 (8.92%) Computer Science Degree
5 13 (8.28%) Master's Degree
6 2 (1.27%) BPSS Clearance
7 1 (0.64%) Azure Certification
7 1 (0.64%) PhD
7 1 (0.64%) Postgraduate
Quality Assurance & Compliance
1 37 (23.57%) Data Quality
2 16 (10.19%) QA
3 3 (1.91%) Accessibility
4 1 (0.64%) GDPR
4 1 (0.64%) NIST
System Software
1 7 (4.46%) Docker
2 1 (0.64%) Apache Flume
2 1 (0.64%) Virtual Machines
Systems Management
1 8 (5.10%) Kubernetes
2 6 (3.82%) Kubeflow
3 5 (3.18%) Terraform
4 1 (0.64%) Kibana
4 1 (0.64%) Matomo
Vendors
1 31 (19.75%) Google
2 20 (12.74%) Databricks
3 13 (8.28%) Microsoft
4 9 (5.73%) Adobe
5 6 (3.82%) Foundry
5 6 (3.82%) Monetate
5 6 (3.82%) Optimizely
5 6 (3.82%) Palantir
6 5 (3.18%) Ensighten
6 5 (3.18%) Omniture
6 5 (3.18%) Tealium
7 3 (1.91%) Splunk
8 2 (1.27%) Cloudera
8 2 (1.27%) ESRI
8 2 (1.27%) Informatica
8 2 (1.27%) Proofpoint
8 2 (1.27%) Workday
9 1 (0.64%) IBM
9 1 (0.64%) SAP
9 1 (0.64%) Talend