Data Ingestion
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Data Ingestion skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Ingestion over the 6 months to 19 April 2024 with a comparison to the same period in the previous 2 years.

6 months to
19 Apr 2024
Same period 2023 Same period 2022
Rank 771 535 791
Rank change year-on-year -236 +256 -77
Permanent jobs citing Data Ingestion 137 541 443
As % of all permanent jobs advertised in the UK 0.14% 0.51% 0.29%
As % of the Processes & Methodologies category 0.16% 0.53% 0.30%
Number of salaries quoted 99 198 191
10th Percentile £50,800 £51,250 £51,250
25th Percentile £60,000 £64,063 £60,000
Median annual salary (50th Percentile) £75,000 £75,000 £75,000
Median % change year-on-year - - +20.00%
75th Percentile £86,250 £110,000 £80,000
90th Percentile £107,500 £147,500 £95,000
UK excluding London median annual salary £65,000 £65,000 £72,000
% change year-on-year - -9.72% +30.91%

All Process and Methodology Skills
UK

Data Ingestion is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 83,814 101,905 146,218
As % of all permanent jobs advertised in the UK 86.22% 95.67% 95.49%
Number of salaries quoted 59,590 59,680 83,719
10th Percentile £29,000 £34,000 £33,250
25th Percentile £40,000 £45,000 £43,750
Median annual salary (50th Percentile) £55,000 £61,500 £60,000
Median % change year-on-year -10.57% +2.50% +9.09%
75th Percentile £72,500 £82,500 £80,000
90th Percentile £92,500 £100,000 £96,250
UK excluding London median annual salary £50,000 £54,882 £52,500
% change year-on-year -8.90% +4.54% +9.38%

Data Ingestion
Job Vacancy Trend

Job postings citing Data Ingestion as a proportion of all IT jobs advertised.

Job vacancy trend for Data Ingestion in the UK

Data Ingestion
Salary Trend

3-month moving average salary quoted in jobs citing Data Ingestion.

Salary trend for Data Ingestion in the UK

Data Ingestion
Salary Histogram

Salary distribution for jobs citing Data Ingestion over the 6 months to 19 April 2024.

Salary histogram for Data Ingestion in the UK

Data Ingestion
Top 15 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Ingestion within the UK over the 6 months to 19 April 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England -200 102 £73,750 -1.67% 51
UK excluding London +15 89 £65,000 - 16
Work from Home +57 50 £73,750 -1.67% 39
London -142 43 £82,500 -2.94% 38
Scotland - 31 £75,000 - 1
North of England +55 19 £67,750 +4.23% 4
Midlands 0 18 £65,000 +52.94% 2
West Midlands +22 17 £65,000 +30.00% 2
North East - 15 £77,000 - 1
South East -10 11 £51,000 -32.00% 3
South West -7 6 £72,500 -17.14% 2
East of England +29 4 £75,000 - 1
Yorkshire +99 2 £42,500 - 1
North West -1 2 £61,750 -5.00% 2
East Midlands -19 1 - -

Data Ingestion
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 16 (11.68%) Apache Airflow
2 4 (2.92%) Apache Spark
3 3 (2.19%) Apache
4 1 (0.73%) Apache Synapse
4 1 (0.73%) Jupyter
Applications
1 6 (4.38%) Microsoft Excel
2 1 (0.73%) Microsoft PowerPoint
2 1 (0.73%) MS Visio
Cloud Services
1 49 (35.77%) AWS
2 47 (34.31%) Azure
3 27 (19.71%) SaaS
4 24 (17.52%) dbt
4 24 (17.52%) Power Platform
5 22 (16.06%) GCP
6 20 (14.60%) Snowflake
7 15 (10.95%) Amazon Kinesis
7 15 (10.95%) Azure Data Factory
8 12 (8.76%) Amazon S3
9 7 (5.11%) Azure DevOps
9 7 (5.11%) Boomi
9 7 (5.11%) GitHub
9 7 (5.11%) PaaS
10 5 (3.65%) IaaS
10 5 (3.65%) Prefect
10 5 (3.65%) Serverless
11 4 (2.92%) AWS Lambda
11 4 (2.92%) Azure Storage
12 3 (2.19%) Azure Synapse Analytics
Communications & Networking
1 3 (2.19%) Firewall
2 1 (0.73%) LAN
Database & Business Intelligence
1 42 (30.66%) Data Warehouse
2 24 (17.52%) Power BI
3 23 (16.79%) Amazon Redshift
3 23 (16.79%) SQL Server
4 22 (16.06%) Data Lake
5 17 (12.41%) BigQuery
6 14 (10.22%) PostgreSQL
7 13 (9.49%) Tableau
8 11 (8.03%) Data Mining
9 10 (7.30%) SQL Server Integration Services
10 9 (6.57%) Azure SQL Database
10 9 (6.57%) Looker
11 8 (5.84%) Relational Database
12 7 (5.11%) NoSQL
13 4 (2.92%) Delta Lake
13 4 (2.92%) MySQL
13 4 (2.92%) SQL Server Reporting Services
14 3 (2.19%) Hadoop
14 3 (2.19%) Metadata
15 2 (1.46%) Impala
Development Applications
1 5 (3.65%) Git
2 4 (2.92%) Jenkins
2 4 (2.92%) SQL Server Management Studio (SSMS)
2 4 (2.92%) TeamCity
2 4 (2.92%) Visual Studio
3 2 (1.46%) ERwin
4 1 (0.73%) Bitbucket
4 1 (0.73%) ER Studio
4 1 (0.73%) GitLab
4 1 (0.73%) Toad
General
1 48 (35.04%) Social Skills
2 40 (29.20%) Finance
3 27 (19.71%) Inclusion and Diversity
3 27 (19.71%) Marketing
4 25 (18.25%) Law
5 24 (17.52%) Games
6 13 (9.49%) Analytical Skills
7 4 (2.92%) Agriculture
7 4 (2.92%) Banking
7 4 (2.92%) Documentation Skills
8 3 (2.19%) Retail
9 2 (1.46%) Automotive
9 2 (1.46%) Publishing
10 1 (0.73%) Financial Institution
10 1 (0.73%) Presentation Skills
Job Titles
1 70 (51.09%) Data Engineer
2 29 (21.17%) Lead
3 21 (15.33%) Software Engineering Director
4 20 (14.60%) Lead Data Engineer
5 15 (10.95%) AWS Data Engineer
5 15 (10.95%) AWS Engineer
6 14 (10.22%) Senior
7 13 (9.49%) Principal Engineer
8 9 (6.57%) Architect
8 9 (6.57%) Developer
8 9 (6.57%) Principal Data Engineer
8 9 (6.57%) Senior Data Engineer
9 8 (5.84%) Python Data Engineer
9 8 (5.84%) Python Engineer
10 7 (5.11%) Data Integration Engineer
10 7 (5.11%) Integration Engineer
10 7 (5.11%) Team Leader
11 6 (4.38%) Azure Data Engineer
11 6 (4.38%) Azure Engineer
11 6 (4.38%) Solutions Architect
Libraries, Frameworks & Software Standards
1 13 (9.49%) GraphQL
2 11 (8.03%) RESTful
3 4 (2.92%) .NET
3 4 (2.92%) Kafka
3 4 (2.92%) PySpark
4 3 (2.19%) React
5 2 (1.46%) LAMP
5 2 (1.46%) Node.js
5 2 (1.46%) REST
6 1 (0.73%) JSON
6 1 (0.73%) Unreal Engine
6 1 (0.73%) XML
6 1 (0.73%) YAML
Miscellaneous
1 21 (15.33%) Cloud Native
2 17 (12.41%) Client/Server
3 14 (10.22%) Data Structures
4 13 (9.49%) Online Games
5 11 (8.03%) Self-Motivation
6 5 (3.65%) Legacy Systems
7 4 (2.92%) Product Ownership
8 2 (1.46%) Data Centre
8 2 (1.46%) Enterprise Software
8 2 (1.46%) Video Conferencing
8 2 (1.46%) Virtual Team
9 1 (0.73%) Algorithms
9 1 (0.73%) Cyber Threat
9 1 (0.73%) Data Protection Act
9 1 (0.73%) Greenfield Project
9 1 (0.73%) Life Science
9 1 (0.73%) Linked Data
9 1 (0.73%) Reinsurance
9 1 (0.73%) Renewable Energy
9 1 (0.73%) Security Operations Centre
Operating Systems
1 2 (1.46%) Linux
2 1 (0.73%) Windows
Processes & Methodologies
1 83 (60.58%) ETL
2 67 (48.91%) Agile
3 59 (43.07%) Data Modelling
4 44 (32.12%) Data Pipeline
5 36 (26.28%) Data Engineering
6 33 (24.09%) Visualisation
7 32 (23.36%) Decision-Making
8 31 (22.63%) Business Intelligence
8 31 (22.63%) Computer Science
8 31 (22.63%) Data Transformation
9 30 (21.90%) Data-Driven Decision Making
9 30 (21.90%) Machine Learning
9 30 (21.90%) Problem-Solving
10 29 (21.17%) Data Integration
10 29 (21.17%) Software Engineering
11 27 (19.71%) Mathematics
12 25 (18.25%) Artificial Intelligence
12 25 (18.25%) Data Science
12 25 (18.25%) DevOps
12 25 (18.25%) Mentoring
Programming Languages
1 76 (55.47%) Python
2 75 (54.74%) SQL
3 17 (12.41%) Java
4 13 (9.49%) Scala
5 9 (6.57%) C#
6 4 (2.92%) PowerShell
6 4 (2.92%) T-SQL
7 1 (0.73%) Bicep
7 1 (0.73%) C++
7 1 (0.73%) TypeScript
Qualifications
1 19 (13.87%) Degree
2 4 (2.92%) Computer Science Degree
2 4 (2.92%) Master's Degree
3 1 (0.73%) A+ Certification
3 1 (0.73%) CCNA
3 1 (0.73%) Cisco Certification
3 1 (0.73%) MCDST
3 1 (0.73%) MCSA
3 1 (0.73%) Microsoft Certification
3 1 (0.73%) Network+ Certification
3 1 (0.73%) SC Cleared
3 1 (0.73%) Security Cleared
3 1 (0.73%) VTSP
Quality Assurance & Compliance
1 35 (25.55%) Data Quality
2 3 (2.19%) PSD2
2 3 (2.19%) QA
System Software
1 4 (2.92%) Docker
2 2 (1.46%) Active Directory
3 1 (0.73%) HDFS
3 1 (0.73%) Virtual Desktop
Systems Management
1 8 (5.84%) Terraform
2 3 (2.19%) Kubernetes
3 1 (0.73%) Microsoft Intune
Vendors
1 17 (12.41%) Microsoft
2 14 (10.22%) Databricks
3 10 (7.30%) Google
4 7 (5.11%) MuleSoft
5 2 (1.46%) Confluent
5 2 (1.46%) Informatica
5 2 (1.46%) Oracle
6 1 (0.73%) Brio
6 1 (0.73%) Cloudera
6 1 (0.73%) Commvault
6 1 (0.73%) ServiceNow
6 1 (0.73%) Splunk