Module llama_cpp_2::llama_batch

Safe wrapper around llama_batch.

Structs

• LlamaBatch
  A safe wrapper around llama_batch.

Enums

• BatchAddError
  Errors that can occur when adding a token to a batch.