Application hang via quadratic sentence-boundary matching
Published Dec 23, 2021 · Updated Aug 4, 2024
Regular expression denial of service in NLTK before 3.6.5 allows remote attackers to hang applications via crafted tokenizer input. PunktSentenceTokenizer's period-context expression greedily matches non-whitespace text, then repeatedly backtracks while searching for a sentence-ending character. Exposure requires an application to pass unpredictable input to PunktSentenceTokenizer, sent_tokenize, or word_tokenize; processing can occupy the application for hours.
Summary
What happened
Regular expression denial of service in NLTK before 3.6.5 allows remote attackers to hang applications via crafted tokenizer input. PunktSentenceTokenizer's period-context expression greedily matches non-whitespace text, then repeatedly backtracks while searching for a sentence-ending character. Exposure requires an application to pass unpredictable input to PunktSentenceTokenizer, sent_tokenize, or word_tokenize; processing can occupy the application for hours.
The record
- CVE
- CVE-2021-43854
- Published
- Dec 23, 2021
- Updated
- Aug 4, 2024
- Vendor
- NLTK Project
- Product
- NLTK
- Classifications
- CWE-400, CWE-1333, T1499.004
- Attack vector
- network
- Privileges
- unauthenticated
Timeline
How it unfolded
- Dec 23, 2021CVE publishedPublication date reported by the CVE source.
- Aug 4, 2024Record updatedLatest update available in the CVE record.
Exploitability
Present is not the same as exploitable
Compare your product and version with the public record. A matching version still requires validation against your environment.
Is a vulnerable build present?
Compare these published version ranges with your installed build and any vendor patches.
- Affected versionversion=< 3.6.5
What conditions does exploitation require?
What is affected?
Published CVSS scores
CVSS describes severity. EPSS estimates exploitation probability.
Attacks
What attackers are doing with it
Daily unique IPs observed by Shadowserver honeypots for known exploited vulnerabilities (KEVs). Missing observations do not establish an absence of attacks.
Weakness, pattern, technique
Public exploit references
- Upstream tokenizer ReDoS proof of conceptproof of concept · demonstrated
Labels summarize the accepted research assessment. They do not indicate a test against your environment.
Technologies
Your stack
See the directory against your own environment.
Your stack
Check the software in your environment
Book a demo to see how Hinoki identifies affected software and validates exploitability in your environment.
Book a demo