Data Ingestion Contracts

Data Ingestion
UK

The following table provides summary statistics for contract job vacancies with a requirement for Data Ingestion skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Ingestion over the 6 months to 28 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
28 Apr 2024
Same period 2023 Same period 2022
Rank 443 570 549
Rank change year-on-year +127 -21 -104
Contract jobs citing Data Ingestion 152 146 316
As % of all contract jobs advertised in the UK 0.35% 0.24% 0.36%
As % of the Processes & Methodologies category 0.41% 0.27% 0.39%
Number of daily rates quoted 111 109 204
10th Percentile £406 £466 £460
25th Percentile £425 £501 £513
Median daily rate (50th Percentile) £525 £597 £600
Median % change year-on-year -12.01% -0.56% +15.66%
75th Percentile £615 £650 £702
90th Percentile £744 £738 £800
UK excluding London median daily rate £610 £600 £600
% change year-on-year +1.67% - +25.00%
Number of hourly rates quoted 1 2 0
10th Percentile - £78.75 -
25th Percentile £66.25 £80.63 -
Median hourly rate £67.50 £85.00 -
Median % change year-on-year -20.59% - -
75th Percentile £68.75 £88.13 -
90th Percentile - £89.25 -
UK excluding London median hourly rate £67.50 - -

All Process and Methodology Skills
UK

Data Ingestion is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 37,383 53,667 80,409
As % of all contract IT jobs advertised in the UK 86.31% 89.90% 90.57%
Number of daily rates quoted 24,097 37,244 56,431
10th Percentile £300 £325 £340
25th Percentile £413 £438 £425
Median daily rate (50th Percentile) £525 £550 £525
Median % change year-on-year -4.55% +4.76% +8.25%
75th Percentile £638 £650 £638
90th Percentile £750 £750 £738
UK excluding London median daily rate £500 £500 £475
% change year-on-year - +5.26% +9.20%
Number of hourly rates quoted 2,426 1,746 1,925
10th Percentile £12.75 £11.00 £12.50
25th Percentile £16.00 £16.25 £15.25
Median hourly rate £35.00 £37.30 £25.00
Median % change year-on-year -6.17% +49.20% -
75th Percentile £59.44 £65.00 £49.25
90th Percentile £72.50 £75.00 £63.75
UK excluding London median hourly rate £36.05 £36.00 £20.00
% change year-on-year +0.13% +80.00% -8.51%

Data Ingestion
Job Vacancy Trend

Job postings citing Data Ingestion as a proportion of all IT jobs advertised.

Job vacancy trend for Data Ingestion in the UK

Data Ingestion
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Ingestion.

Daily rate trend for Data Ingestion in the UK

Data Ingestion
Daily Rate Histogram

Daily rate distribution for jobs citing Data Ingestion over the 6 months to 28 April 2024.

Daily rate histogram for Data Ingestion in the UK

Data Ingestion
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Ingestion.

Hourly rate trend for Data Ingestion in the UK

Data Ingestion
Top 13 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Ingestion within the UK over the 6 months to 28 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England +136 144 £525 -12.01% 57
London +147 113 £500 -13.04% 37
Work from Home +111 51 £528 -12.08% 15
UK excluding London +53 32 £610 +1.67% 24
North of England +39 17 £610 +1.67% 6
North West +24 9 £525 -12.50% 3
Yorkshire +29 8 £610 +0.41% 2
South East +22 5 £738 +34.09% 4
East of England -6 4 £550 -8.33% 3
Scotland +36 3 £450 -28.00% 2
Midlands +23 2 £468 -25.20% 2
East Midlands +20 2 £468 -28.08%
South West +11 1 £533 -16.47% 3

Data Ingestion
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 13 (8.55%) Apache Spark
2 10 (6.58%) Apache
3 8 (5.26%) Apache Airflow
4 4 (2.63%) Confluence
5 2 (1.32%) ArcGIS
6 1 (0.66%) Apache Pulsar
6 1 (0.66%) Luigi
6 1 (0.66%) SharePoint
Applications
1 1 (0.66%) Microsoft Excel
1 1 (0.66%) Microsoft Office
1 1 (0.66%) Microsoft PowerPoint
1 1 (0.66%) Spreadsheet
Business Applications
1 11 (7.24%) Dynamics CRM
2 2 (1.32%) Adobe Campaign
2 2 (1.32%) Unica
Cloud Services
1 56 (36.84%) AWS
2 44 (28.95%) GCP
3 36 (23.68%) Azure
4 30 (19.74%) Serverless
5 28 (18.42%) AWS Lambda
6 22 (14.47%) AWS Step Functions
7 20 (13.16%) Amazon MSK
7 20 (13.16%) dbt
7 20 (13.16%) Power Platform
8 19 (12.50%) Amazon S3
9 12 (7.89%) Snowflake
10 9 (5.92%) Azure Data Factory
11 7 (4.61%) Vertex AI
12 6 (3.95%) Adobe Analytics
12 6 (3.95%) Azure DevOps
12 6 (3.95%) Cloud Computing
12 6 (3.95%) GitHub
12 6 (3.95%) Google Analytics
13 4 (2.63%) Azure Cosmos DB
13 4 (2.63%) Cloud Run
Communications & Networking
1 1 (0.66%) Network Security
Database & Business Intelligence
1 48 (31.58%) Data Warehouse
2 28 (18.42%) Amazon Redshift
3 21 (13.82%) DynamoDB
4 20 (13.16%) Amazon RDS
4 20 (13.16%) Big Data
4 20 (13.16%) Parquet
4 20 (13.16%) Power BI
5 19 (12.50%) Data Lake
6 17 (11.18%) BigQuery
7 10 (6.58%) Tableau
8 9 (5.92%) Relational Database
9 8 (5.26%) Hadoop
10 7 (4.61%) Flink
10 7 (4.61%) Metadata
10 7 (4.61%) NoSQL
11 6 (3.95%) Looker
11 6 (3.95%) SQL Server
12 5 (3.29%) Amazon Athena
12 5 (3.29%) PostgreSQL
12 5 (3.29%) RDBMS
Development Applications
1 12 (7.89%) MLflow
2 5 (3.29%) Git
2 5 (3.29%) Postman
3 4 (2.63%) JIRA
4 3 (1.97%) ERwin
4 3 (1.97%) Jenkins
5 2 (1.32%) ER Studio
5 2 (1.32%) kappa
6 1 (0.66%) Maven
6 1 (0.66%) NUnit
General
1 34 (22.37%) Social Skills
2 23 (15.13%) Analytical Skills
3 17 (11.18%) Finance
4 15 (9.87%) Public Sector
5 14 (9.21%) Banking
6 9 (5.92%) Marketing
6 9 (5.92%) Retail
7 6 (3.95%) Front Office
7 6 (3.95%) Investment Banking
8 5 (3.29%) Advertising
9 4 (2.63%) Documentation Skills
9 4 (2.63%) Pharmaceutical
10 3 (1.97%) Organisational Skills
10 3 (1.97%) Presentation Skills
11 2 (1.32%) Financial Institution
12 1 (0.66%) Automotive
12 1 (0.66%) Law
Job Titles
1 53 (34.87%) Data Engineer
2 36 (23.68%) Developer
3 29 (19.08%) Senior
4 19 (12.50%) Architect
5 17 (11.18%) Senior Developer
6 16 (10.53%) Data Architect
7 11 (7.24%) Consultant
7 11 (7.24%) Microsoft Developer
7 11 (7.24%) Python Developer
8 9 (5.92%) Lead
8 9 (5.92%) Lead Data Engineer
9 7 (4.61%) Senior Microsoft Developer
10 6 (3.95%) Machine Learning Engineer
11 5 (3.29%) Data Modeller
11 5 (3.29%) ETL Architect
11 5 (3.29%) Senior Data Engineer
12 4 (2.63%) Analyst
12 4 (2.63%) Azure Architect
12 4 (2.63%) Senior Python Developer
12 4 (2.63%) Solutions Architect
Libraries, Frameworks & Software Standards
1 26 (17.11%) JSON
2 19 (12.50%) Apache Avro
3 16 (10.53%) Kafka
4 7 (4.61%) CSS
4 7 (4.61%) FastAPI
4 7 (4.61%) HTML
4 7 (4.61%) Node.js
4 7 (4.61%) NumPy
4 7 (4.61%) Pandas
5 6 (3.95%) Flask
5 6 (3.95%) jQuery
5 6 (3.95%) scikit-learn
5 6 (3.95%) TensorFlow
6 5 (3.29%) DOM
6 5 (3.29%) Swagger
7 4 (2.63%) Apache NiFi
8 3 (1.97%) GraphQL
8 3 (1.97%) PySpark
8 3 (1.97%) React
8 3 (1.97%) SOAP
Miscellaneous
1 7 (4.61%) Marketing Technology
1 7 (4.61%) Onboarding
2 6 (3.95%) Derivative
3 5 (3.29%) Management Information System
4 4 (2.63%) Algorithms
5 3 (1.97%) Data Centre
5 3 (1.97%) Data Structures
5 3 (1.97%) Distributed Computing
5 3 (1.97%) Insider Threat
5 3 (1.97%) Product Ownership
6 2 (1.32%) Greenfield Project
7 1 (0.66%) Cloud Native
7 1 (0.66%) Cyber Threat
7 1 (0.66%) Security Operations Centre
7 1 (0.66%) Self-Motivation
Operating Systems
1 10 (6.58%) Unix
2 7 (4.61%) Linux
Processes & Methodologies
1 69 (45.39%) ETL
2 67 (44.08%) Data Modelling
3 54 (35.53%) Data Pipeline
4 40 (26.32%) Analytics
5 39 (25.66%) Agile
6 27 (17.76%) Data Integration
7 26 (17.11%) Data Governance
7 26 (17.11%) Machine Learning
8 25 (16.45%) CI/CD
8 25 (16.45%) Data Engineering
8 25 (16.45%) DevOps
8 25 (16.45%) Problem-Solving
9 22 (14.47%) Business Transformation
10 21 (13.82%) Business Intelligence
11 20 (13.16%) Visualisation
12 19 (12.50%) Computer Science
13 18 (11.84%) Artificial Intelligence
14 17 (11.18%) Data Science
15 15 (9.87%) Roadmaps
16 13 (8.55%) MLOps
Programming Languages
1 85 (55.92%) Python
2 69 (45.39%) SQL
3 19 (12.50%) JavaScript
4 17 (11.18%) Scala
5 15 (9.87%) Java
6 6 (3.95%) Go
6 6 (3.95%) TypeScript
7 4 (2.63%) Perl
7 4 (2.63%) Shell Script
7 4 (2.63%) T-SQL
8 3 (1.97%) C#
8 3 (1.97%) Search Processing Language
9 2 (1.32%) Lua
9 2 (1.32%) PHP
9 2 (1.32%) PowerShell
10 1 (0.66%) R
Qualifications
1 36 (23.68%) Security Cleared
2 34 (22.37%) SC Cleared
3 22 (14.47%) Degree
4 16 (10.53%) Computer Science Degree
5 14 (9.21%) Master's Degree
6 1 (0.66%) Azure Certification
Quality Assurance & Compliance
1 34 (22.37%) Data Quality
2 14 (9.21%) QA
3 4 (2.63%) Accessibility
4 1 (0.66%) GDPR
4 1 (0.66%) NIST
System Software
1 8 (5.26%) Docker
2 1 (0.66%) Apache Flume
2 1 (0.66%) Virtual Machines
Systems Management
1 9 (5.92%) Kubernetes
2 6 (3.95%) Kubeflow
3 3 (1.97%) Terraform
4 2 (1.32%) Kibana
5 1 (0.66%) Matomo
Vendors
1 28 (18.42%) Google
2 16 (10.53%) Databricks
3 14 (9.21%) Microsoft
4 8 (5.26%) Adobe
5 6 (3.95%) Foundry
5 6 (3.95%) Monetate
5 6 (3.95%) Optimizely
5 6 (3.95%) Palantir
6 5 (3.29%) Ensighten
6 5 (3.29%) Omniture
6 5 (3.29%) Tealium
7 3 (1.97%) Splunk
8 2 (1.32%) Cloudera
8 2 (1.32%) ESRI
8 2 (1.32%) Informatica
8 2 (1.32%) Proofpoint
8 2 (1.32%) Workday
9 1 (0.66%) IBM
9 1 (0.66%) SAP
9 1 (0.66%) Talend