AIKIDO-2026-180159
crawlee is vulnerable to Denial of Service (DoS)
59
Medium Risk
This Affects:
crawleeTL;DR
The sitemap parsing pipeline in crawlee processes sitemap content fetched from arbitrary, untrusted crawled hosts. Gzipped sitemaps are decompressed with no output size cap, so a small compressed payload can inflate to gigabytes and exhaust process memory, and nested sitemap parsing defaults to an unlimited recursion depth with only exact-URL deduplication, so a chain of unique nested-sitemap URLs recurses without bound. A malicious host can use either vector to exhaust crawler memory or trap the crawler in unbounded work, degrading or crashing the process. The fix caps decompression and parsing at the sitemap-protocol size limit and enforces a finite default nested-sitemap depth.
Who does this affect?
You are affected if you are using a version that falls within the vulnerable range and your crawler loads or parses sitemaps from untrusted hosts.
Background info
crawlee is vulnerable to Denial of Service (DoS) in versions 1.0.0 - 1.8.2.
How to fix this
Upgrade the crawlee library to the patch version.
Are You Affected?
Connect your repositories to instantly see whether vulnerable or malicious packages exist in your codebase.
Free. No credit card required.
I consent to receiving marketing communications based on Aikido’s Privacy Policy.
SOC 2Compliant
ISO 27001Compliant