High

NLTK TweetTokenizer vulnerable to denial of service through catastrophic regex backtracking

  • Disclosed: 21.08.2026
  • Updated: 11.10.2026 15:18

The URLS regular expression in nltk/tokenize/casual.py, compiled into TweetTokenizer.WORD_RE and applied by TweetTokenizer.tokenize, contains a naked-domain branch whose domain-label prefix [a-z0-9]+(?:[.-][a-z0-9]+)* is unbounded. Input consisting of many alternating label separators can be partitioned in exponentially many ways, and because the branch also requires a trailing top-level domain that such input never supplies, the engine explores those partitions before failing at each offset. A few kilobytes of input therefore consumes seconds to minutes of single-threaded CPU, and the HANG_RE substitution performed before matching does not collapse the pattern. TweetTokenizer is intended for tokenizing untrusted social-media text, so any service that applies it, or the module-level casual_tokenize, to submitted text can be stalled per request without authentication. Version 3.10.1 bounds the label repetition.

Affected software

Click a technology to see all vulnerabilities affecting it.

PlatformPackageVulnerable versionsFixed in
Python (PyPI) nltk < 3.10.1 3.10.1

References

CVSS score 7.5/10
CVSS vector
CVSS:3.1/AV:N/AC:L/PR:N/UI:N/S:U/C:N/I:N/A:H
Weakness (CWE)
CWE-1333
Platform
Python (PyPI)
Package
nltk
Disclosed
21.08.2026
Updated
11.10.2026 15:18

Sources and licenses

OSV / GitHub Advisory Database - PYSEC-2026-3870 - PyPA Advisory Database; CC BY 4.0

OSV / GitHub Advisory Database - GHSA-qx2g-xrx7-vfh8 - CC BY 4.0

Vulnerability history: nltk

All published vulnerabilities of this package (Python (PyPI)), newest first. Shows whether this is a one-off slip or a package that needs watching.

All (52) in the archive
Total entries
52
First → latest
08.2019 09.2026
Without a fix
6
Exploited in attacks
0

Severity breakdown

  • Critical 5
  • High 32
  • Medium 13
  • Low 2

Disclosures per year

  1. 2019: 1
  2. 2020: 0
  3. 2021: 2
  4. 2022: 1
  5. 2023: 0
  6. 2024: 1
  7. 2025: 0
  8. 2026: 47
Severity:
  1. High CVE-2026-79674 < 3.10.3 3.10.3
  2. High · 8.8 CVE-2026-71513 >= 3.10.0, < 3.10.3 3.10.3
  3. High · 5.9 CVE-2026-62385 < 3.10.0 3.10.0
  4. NLTK TweetTokenizer vulnerable to denial of service through catastrophic regex backtracking this entry
    High · 7.5 CVE-2026-72818 < 3.10.1 3.10.1
  5. High · 7.5 CVE-2026-33231 < 3.9.4 3.9.4
  6. Critical · 10.0 CVE-2025-14009 < 3.9.3 3.9.3
  7. High · 7.5 CVE-2024-39705 < 3.9 3.9
  8. High · 7.5 CVE-2021-3842 < 3.6.6 3.6.6
  9. High · 7.5 CVE-2021-3828 < 3.6.4 3.6.4
  10. High · 7.5 CVE-2019-14751 < 3.4.5 3.4.5

Know which vulnerabilities affect your application

With the DockRay integration and software inventory enabled, DockRay checks reported component versions against known vulnerabilities and notifies you about confirmed matches. Coverage depends on the supported technology and available advisory data.

Connect your application
DockRay newsletter

Application security in your inbox

Important vulnerabilities, actionable guidance and practical advice for your applications. Choose your technologies and follow what matters to your project.

  • A daily digest of new vulnerabilities, critical ones included.
  • Notifications about important updates.
  • Practical advice on application security and monitoring.

Leave empty to receive updates for every technology.

Free to subscribe. Unsubscribe with one click in any email.