Expand description
Model-specific conversation rendering and token encoding.
V4 and V4.1 provide prompt rendering. Attach a tokenizer to an encoding to encode conversations into token IDs.
Re-exports§
Modules§
Structs§
- Rendered
Prompt - A rendered prompt and the images its placeholders refer to.
Enums§
- Encoding
Error - Failure to encode a conversation.
Traits§
- Prompt
Encoding - Render model prompts and encode conversations into token IDs.
- Tokenizer
Encoder - Encode text into model token ids.