[−][src]Module tokenizers::pre_tokenizers::metaspace
Structs
Metaspace | Replaces all the whitespaces by the provided meta character and then splits on this character |
Metaspace | Replaces all the whitespaces by the provided meta character and then splits on this character |