Struct lingua::LanguageModelFilesWriter

pub struct LanguageModelFilesWriter;

This struct creates language model files and writes them to a directory.

Implementations

impl LanguageModelFilesWriter

pub fn create_and_write_language_model_files(
    input_file_path: &Path,
    output_directory_path: &Path,
    language: &Language,
    char_class: &str
) -> Result<()>

Creates language model files for accuracy report generation and writes them to a directory.

input_file_path: The path to a txt file used for language model creation. The assumed encoding of the txt file is UTF-8.

output_directory_path: The path to an existing directory where the language model files are to be written.

language: The language for which to create language models.

char_class: A regex character class such as \\p{L} to restrict the set of characters that the language models are built from.

⚠ Panics if:

• the input file path is not absolute or does not point to an existing txt file
• the input file’s encoding is not UTF-8
• the output directory path is not absolute or does not point to an existing directory
• the character class cannot be compiled to a valid regular expression