Module llama_cpp_2::model

source ·
Expand description

A safe wrapper around llama_model.

Modules§

  • A safe wrapper around llama_model_params.

Structs§

Enums§

  • How to determine if we should prepend a bos token to tokens
  • There was an error converting a llama_vocab_type to a VocabType.
  • How to determine if we should tokenize special tokens
  • a rusty equivalent of llama_vocab_type