Structs§
- Gibberish
Detector - Gibberish detector with optional enhanced model
Enums§
- Model
Error - Errors that can occur during model operations
- Sensitivity
- Sensitivity level for gibberish detection
- Token
Status - Status of the HuggingFace token
Functions§
- calculate_
non_ printable_ ratio - Calculate the ratio of non-printable characters in a string Returns a value between 0.0 (all printable) and 1.0 (all non-printable)
- check_
token_ status - Check if HuggingFace token is required and available
- default_
model_ path - Get default model path in user’s cache directory
- download_
model - Download model files with progress reporting
- download_
model_ with_ progress_ bar - Download model with a simple progress bar
- is_
gibberish - Checks if the given text is gibberish based on English word presence and n-gram analysis scores. The sensitivity level determines how strict the classification should be.
- is_
password - Checks if the given text matches a known common password.
- is_
string_ bad_ quality - is it worth it to calculate this string?
- model_
exists - Check if model exists at given path