Crawler hang via inefficient XML regular expressions
Published Feb 28, 2024 · Updated Aug 11, 2024
Regular expression denial of service in Scrapy before 1.8.4 and 2.0 through 2.11.0 allows remote attackers to hang XML-feed crawlers. XMLFeedSpider's default iternodes path passes response bodies to scrapy.utils.iterators.xmliter, whose backtracking regular expressions parse element boundaries with inefficient worst-case complexity. The crawler must process attacker-controlled XML through the default iterator; resulting CPU and memory exhaustion can leave its service unresponsive.
Summary
What happened
Regular expression denial of service in Scrapy before 1.8.4 and 2.0 through 2.11.0 allows remote attackers to hang XML-feed crawlers. XMLFeedSpider's default iternodes path passes response bodies to scrapy.utils.iterators.xmliter, whose backtracking regular expressions parse element boundaries with inefficient worst-case complexity. The crawler must process attacker-controlled XML through the default iterator; resulting CPU and memory exhaustion can leave its service unresponsive.
The record
- CVE
- CVE-2024-1892
- Published
- Feb 28, 2024
- Updated
- Aug 11, 2024
- Vendor
- Scrapy
- Product
- Scrapy
- Classifications
- CWE-1333, T1499.004
- Attack vector
- network
- Privileges
- unauthenticated
Timeline
How it unfolded
- Feb 28, 2024CVE publishedPublication date reported by the CVE source.
- Aug 11, 2024Record updatedLatest update available in the CVE record.
Exploitability
Present is not the same as exploitable
Compare your product and version with the public record. A matching version still requires validation against your environment.
Is a vulnerable build present?
Compare these published version ranges with your installed build and any vendor patches.
- Affected versionversion=0 <2.11
- Affected versionversion=unspecified <2.11
What conditions does exploitation require?
What is affected?
Attacks
What attackers are doing with it
Daily unique IPs observed by Shadowserver honeypots for known exploited vulnerabilities (KEVs). Missing observations do not establish an absence of attacks.
Weakness, pattern, technique
Public exploit references
- huntr bounty exploit for CVE-2024-1892proof of concept · unverified
Labels summarize the accepted research assessment. They do not indicate a test against your environment.
Technologies
Your stack
See the directory against your own environment.
Your stack
Check the software in your environment
Book a demo to see how Hinoki identifies affected software and validates exploitability in your environment.
Book a demo