Data Engineering Contracts

Data Engineering
UK

The following table provides summary statistics for contract job vacancies with a requirement for Data Engineering skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Engineering over the 6 months to 4 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
4 May 2024
Same period 2023 Same period 2022
Rank 200 214 214
Rank change year-on-year +14 0 +8
Contract jobs citing Data Engineering 505 775 1,202
As % of all contract jobs advertised in the UK 1.17% 1.31% 1.35%
As % of the Processes & Methodologies category 1.36% 1.46% 1.50%
Number of daily rates quoted 379 514 826
10th Percentile £373 £453 £456
25th Percentile £463 £513 £510
Median daily rate (50th Percentile) £550 £600 £575
Median % change year-on-year -8.33% +4.35% +4.55%
75th Percentile £658 £736 £688
90th Percentile £750 £800 £775
UK excluding London median daily rate £550 £538 £550
% change year-on-year +2.23% -2.18% +10.00%
Number of hourly rates quoted 14 24 5
10th Percentile £30.63 £19.00 £22.20
25th Percentile £31.25 £20.10 £25.64
Median hourly rate £35.00 £73.00 £56.50
Median % change year-on-year -52.05% +29.20% +58.31%
75th Percentile £57.56 £78.00 £64.75
90th Percentile £60.00 £87.75 £80.44
UK excluding London median hourly rate £60.00 £35.00 £38.21
% change year-on-year +71.43% -8.39% -0.46%

All Process and Methodology Skills
UK

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 37,262 53,150 80,380
As % of all contract IT jobs advertised in the UK 86.35% 89.86% 90.59%
Number of daily rates quoted 24,013 36,862 56,431
10th Percentile £300 £325 £341
25th Percentile £413 £438 £425
Median daily rate (50th Percentile) £525 £550 £530
Median % change year-on-year -4.55% +3.77% +8.72%
75th Percentile £638 £650 £638
90th Percentile £750 £750 £738
UK excluding London median daily rate £500 £500 £475
% change year-on-year - +5.26% +8.57%
Number of hourly rates quoted 2,440 1,756 1,916
10th Percentile £12.75 £11.00 £12.50
25th Percentile £16.00 £16.25 £15.50
Median hourly rate £35.95 £36.00 £25.00
Median % change year-on-year -0.14% +44.00% +2.04%
75th Percentile £60.00 £65.00 £49.25
90th Percentile £72.50 £75.00 £64.88
UK excluding London median hourly rate £37.50 £35.00 £20.00
% change year-on-year +7.14% +75.00% -6.98%

Data Engineering
Job Vacancy Trend

Job postings citing Data Engineering as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineering in the UK

Data Engineering
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Engineering.

Daily rate trend for Data Engineering in the UK

Data Engineering
Daily Rate Histogram

Daily rate distribution for jobs citing Data Engineering over the 6 months to 4 May 2024.

Daily rate histogram for Data Engineering in the UK

Data Engineering
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Engineering.

Hourly rate trend for Data Engineering in the UK

Data Engineering
Hourly Rate Histogram

Hourly rate distribution of jobs citing Data Engineering over the 6 months to 4 May 2024.

Hourly rate histogram for Data Engineering in the UK

Data Engineering
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineering within the UK over the 6 months to 4 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -10 432 £561 -8.37% 339
London -16 262 £585 -10.00% 180
Work from Home +40 203 £550 -8.33% 185
UK excluding London +20 163 £550 +2.23% 159
South East +1 46 £550 +4.76% 33
North of England +25 44 £520 -5.02% 38
Midlands +30 41 £567 +4.91% 38
West Midlands +14 25 £642 +18.87% 27
North West +15 22 £510 -7.27% 23
Yorkshire +23 20 £605 +24.10% 8
East Midlands +35 16 £550 -4.35% 11
Scotland +37 15 £453 -7.55% 11
South West +4 9 £491 -26.82% 23
East of England +9 7 £525 +7.69% 13
North East +19 2 £423 -32.32% 7
Wales +12 1 £625 - 6

Data Engineering
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 54 (10.69%) Apache Spark
2 47 (9.31%) Apache Airflow
3 38 (7.52%) Apache
4 8 (1.58%) Confluence
5 6 (1.19%) Tornado
6 5 (0.99%) SharePoint
7 3 (0.59%) ArcGIS
8 1 (0.20%) Apache Pulsar
8 1 (0.20%) BizTalk Server
Applications
1 8 (1.58%) Microsoft Excel
2 2 (0.40%) Microsoft PowerPoint
3 1 (0.20%) AutoCAD
3 1 (0.20%) Microsoft Office
3 1 (0.20%) MS Visio
3 1 (0.20%) Sketch
3 1 (0.20%) Spreadsheet
Business Applications
1 2 (0.40%) Markit EDM
2 1 (0.20%) Aladdin
2 1 (0.20%) Oracle ERP
2 1 (0.20%) Oracle General Ledger
2 1 (0.20%) Oracle Utilities
2 1 (0.20%) SAP GRC
2 1 (0.20%) Shopify
Cloud Services
1 211 (41.78%) Azure
2 163 (32.28%) AWS
3 72 (14.26%) GCP
4 66 (13.07%) Power Platform
5 64 (12.67%) Azure Data Factory
6 53 (10.50%) Snowflake
7 46 (9.11%) Serverless
8 39 (7.72%) Azure Synapse Analytics
9 29 (5.74%) Amazon S3
10 26 (5.15%) Azure DevOps
11 24 (4.75%) AWS Lambda
12 22 (4.36%) dbt
13 21 (4.16%) GitHub
14 18 (3.56%) Azure Functions
15 17 (3.37%) Amazon EMR
16 15 (2.97%) Amazon EC2
17 14 (2.77%) Azure Key Vault
18 13 (2.57%) Amazon Kinesis
18 13 (2.57%) Cloud Computing
18 13 (2.57%) GitHub Actions
Communications & Networking
1 20 (3.96%) TCP/IP
2 18 (3.56%) SAN
3 17 (3.37%) Network Security
4 15 (2.97%) Intrusion Detection
5 5 (0.99%) FTP
6 2 (0.40%) AMQP
6 2 (0.40%) BGP
6 2 (0.40%) Cisco ASA
6 2 (0.40%) Cisco Nexus
6 2 (0.40%) DHCP
6 2 (0.40%) DMZ
6 2 (0.40%) DNS
6 2 (0.40%) Firewall
6 2 (0.40%) HTTP
6 2 (0.40%) Modbus
6 2 (0.40%) MQTT
6 2 (0.40%) OSPF
6 2 (0.40%) SNMP
Database & Business Intelligence
1 115 (22.77%) Data Warehouse
2 88 (17.43%) Data Lake
3 80 (15.84%) Big Data
4 66 (13.07%) Power BI
5 34 (6.73%) SQL Server
6 28 (5.54%) Azure SQL Database
7 27 (5.35%) BigQuery
8 22 (4.36%) Amazon Redshift
8 22 (4.36%) Tableau
9 21 (4.16%) Delta Lake
9 21 (4.16%) Flink
9 21 (4.16%) Metadata
10 19 (3.76%) Spark SQL
11 17 (3.37%) NoSQL
12 16 (3.17%) Amazon Athena
12 16 (3.17%) Hadoop
13 15 (2.97%) Relational Database
14 12 (2.38%) SQL Server Integration Services
15 8 (1.58%) PostgreSQL
15 8 (1.58%) Star Schema
Development Applications
1 32 (6.34%) JIRA
2 27 (5.35%) Git
3 6 (1.19%) Jenkins
4 3 (0.59%) SonarQube
5 2 (0.40%) Bitbucket
5 2 (0.40%) GitLab
5 2 (0.40%) IntelliJ
5 2 (0.40%) MLflow
5 2 (0.40%) Zephyr
6 1 (0.20%) Deequ
6 1 (0.20%) Visual Studio
General
1 102 (20.20%) Social Skills
2 81 (16.04%) Analytical Skills
3 71 (14.06%) Finance
4 49 (9.70%) Public Sector
5 23 (4.55%) Banking
6 16 (3.17%) Pharmaceutical
7 15 (2.97%) Retail
8 14 (2.77%) Marketing
9 13 (2.57%) Manufacturing
10 8 (1.58%) Telecoms
11 7 (1.39%) Legal
12 6 (1.19%) Presentation Skills
13 5 (0.99%) Law
14 4 (0.79%) Back Office
14 4 (0.79%) Electronics
14 4 (0.79%) Front Office
14 4 (0.79%) Inclusion and Diversity
14 4 (0.79%) Influencing Skills
14 4 (0.79%) Investment Banking
15 3 (0.59%) Advertising
Job Titles
1 260 (51.49%) Data Engineer
2 66 (13.07%) Developer
3 59 (11.68%) Azure Engineer
4 56 (11.09%) Senior
5 50 (9.90%) Lead
6 45 (8.91%) Azure Data Engineer
7 42 (8.32%) AWS Engineer
8 39 (7.72%) Senior Data Engineer
9 37 (7.33%) Python Developer
10 31 (6.14%) AWS Data Engineer
11 29 (5.74%) Architect
12 24 (4.75%) Analyst
13 23 (4.55%) Lead Data Engineer
14 22 (4.36%) Data Architect
15 16 (3.17%) Consultant
15 16 (3.17%) Python Engineer
15 16 (3.17%) Snowflake Data Engineer
16 11 (2.18%) Cloud Engineer
17 10 (1.98%) Platform Engineer
17 10 (1.98%) Project Manager
Libraries, Frameworks & Software Standards
1 70 (13.86%) PySpark
2 56 (11.09%) Kafka
3 21 (4.16%) Apache NiFi
4 17 (3.37%) .NET
5 15 (2.97%) XML
6 14 (2.77%) FastAPI
7 12 (2.38%) Flask
8 11 (2.18%) JSON
8 11 (2.18%) Pandas
8 11 (2.18%) RESTful
9 10 (1.98%) Node.js
9 10 (1.98%) PyTorch
9 10 (1.98%) React
10 9 (1.78%) pytest
11 8 (1.58%) TensorFlow
12 7 (1.39%) AngularJS
13 6 (1.19%) ASP.NET
13 6 (1.19%) Django
13 6 (1.19%) OAuth
13 6 (1.19%) OAuth2
Miscellaneous
1 15 (2.97%) Cyber Defence
1 15 (2.97%) Distributed Applications
2 12 (2.38%) Distributed Systems
3 11 (2.18%) Data Structures
3 11 (2.18%) Management Information System
3 11 (2.18%) Product Ownership
4 9 (1.78%) Cloud Native
5 8 (1.58%) Algorithms
6 5 (0.99%) Distributed Computing
6 5 (0.99%) Onboarding
6 5 (0.99%) Renewable Energy
6 5 (0.99%) Smart Meter
6 5 (0.99%) Virtual Team
7 4 (0.79%) Data Protection Act
7 4 (0.79%) FMCG
7 4 (0.79%) Market Risk
8 3 (0.59%) Fixed Income
8 3 (0.59%) NHS
8 3 (0.59%) Reference Data
8 3 (0.59%) Team-Oriented Environment
Operating Systems
1 38 (7.52%) Linux
2 19 (3.76%) Windows
3 18 (3.56%) Debian
3 18 (3.56%) Ubuntu
4 17 (3.37%) Unix
5 13 (2.57%) Android
5 13 (2.57%) Apple iOS
6 2 (0.40%) Windows Server
Processes & Methodologies
1 173 (34.26%) Analytics
2 168 (33.27%) ETL
3 164 (32.48%) Data Modelling
4 155 (30.69%) Data Pipeline
5 141 (27.92%) Agile
6 104 (20.59%) Business Intelligence
7 103 (20.40%) DevOps
8 94 (18.61%) CI/CD
9 76 (15.05%) Problem-Solving
10 73 (14.46%) Data Science
11 67 (13.27%) Visualisation
12 59 (11.68%) Data Governance
12 59 (11.68%) Data Management
13 58 (11.49%) Data Analysis
14 56 (11.09%) Data Integration
15 47 (9.31%) Computer Science
16 46 (9.11%) Machine Learning
17 45 (8.91%) Software Engineering
18 43 (8.51%) Data Visualisation
19 35 (6.93%) Data Architecture
Programming Languages
1 270 (53.47%) Python
2 247 (48.91%) SQL
3 57 (11.29%) Java
4 51 (10.10%) Scala
5 20 (3.96%) C#
6 19 (3.76%) JavaScript
7 14 (2.77%) T-SQL
8 13 (2.57%) TypeScript
9 11 (2.18%) PowerShell
10 10 (1.98%) R
11 7 (1.39%) Data Analysis Expressions
12 5 (0.99%) Kusto Query Language
12 5 (0.99%) Perl
13 4 (0.79%) PL/SQL
14 3 (0.59%) C++
15 2 (0.40%) Bash
15 2 (0.40%) Go
15 2 (0.40%) Groovy
15 2 (0.40%) Shell Script
15 2 (0.40%) XQuery
Qualifications
1 114 (22.57%) Security Cleared
2 93 (18.42%) SC Cleared
3 42 (8.32%) Degree
4 32 (6.34%) DV Cleared
5 24 (4.75%) Computer Science Degree
6 9 (1.78%) Azure Certification
6 9 (1.78%) Master's Degree
7 3 (0.59%) BPSS Clearance
8 2 (0.40%) AWS Certification
8 2 (0.40%) AWS Certified Solutions Architect
8 2 (0.40%) CCDP
8 2 (0.40%) CCNP
8 2 (0.40%) Cisco Certification
8 2 (0.40%) IBM Certification
8 2 (0.40%) Microsoft Certification
8 2 (0.40%) Numerate Degree
8 2 (0.40%) PhD
9 1 (0.20%) CTC Cleared
9 1 (0.20%) ITIL Certification
Quality Assurance & Compliance
1 60 (11.88%) Data Quality
2 15 (2.97%) Actionable Recommendations
3 7 (1.39%) QA
4 5 (0.99%) Accessibility
4 5 (0.99%) GDPR
5 3 (0.59%) IFRS
5 3 (0.59%) IFRS 17
5 3 (0.59%) Solvency II
6 2 (0.40%) California Consumer Privacy Act
7 1 (0.20%) GRC
7 1 (0.20%) GxP
7 1 (0.20%) ISO/IEC 20000
System Software
1 36 (7.13%) Docker
2 3 (0.59%) HDFS
3 1 (0.20%) Apache Flume
Systems Management
1 41 (8.12%) Kubernetes
2 40 (7.92%) Terraform
3 4 (0.79%) Grafana
4 3 (0.59%) Ansible
5 1 (0.20%) Kibana
5 1 (0.20%) Kubeflow
5 1 (0.20%) Matomo
5 1 (0.20%) Prometheus
5 1 (0.20%) RSA Archer
Vendors
1 122 (24.16%) Databricks
2 64 (12.67%) Microsoft
3 35 (6.93%) Google
4 28 (5.54%) Red Hat
5 27 (5.35%) Oracle
6 18 (3.56%) VMware
7 17 (3.37%) Informatica
7 17 (3.37%) SAP
8 14 (2.77%) Talend
9 10 (1.98%) Foundry
9 10 (1.98%) Palantir
10 5 (0.99%) Ab Initio
10 5 (0.99%) Confluent
10 5 (0.99%) IBM
11 3 (0.59%) OpenAI
12 2 (0.40%) Arista
12 2 (0.40%) Dataiku
12 2 (0.40%) Palo Alto
12 2 (0.40%) SnapLogic
12 2 (0.40%) Zscaler