lingua-tsonga-language-model 1.3.0

The Tsonga language model for Lingua, an accurate natural language detection library

Coverage
0%
0 out of 3 items documented0 out of 0 items with examples
Size
Source code size: 723.12 kB This is the summed size of all the files inside the crates.io package for this release.
Documentation size: 1.02 MB This is the summed size of all files generated by rustdoc for all configured targets
Ø build duration
this release: 22s Average build duration of successful builds.
all releases: 13s Average build duration of successful builds in releases after 2024-10-23.
Links
Homepage
pemistahl/lingua-rs
1071 55 24
crates.io
Dependencies
- include_dir ^0.7.4 normal
Versions
Owners

Tsonga language model for Lingua

This is the language model for the Tsonga language which is used by Lingua, the most accurate natural language detection library in the Rust ecosystem.

Changelog

Version 1.3.0

The language model files have been converted into a new storage format. They are now stored as finite-state transducers (FSTs) which reduces memory consumption drastically at the cost of a slightly slower runtime performance.

Version 1.2.0

The language model has been enhanced by including unique and most common ngrams to support an absolute confidence metric which is independent of other languages.

Version 1.1.0

The language model files are now compressed with the Brotli algorithm which reduces the file size by 15 %, on average.