Skip to main content

encode_chat_auto

rlx_models

Function encode_chat_auto 

Source 
pub fn encode_chat_auto(
    weights: &Path,
    explicit_tokenizer: Option<&Path>,
    messages: &[ChatMessage],
) -> Result<Vec<u32>, Error>
Expand description

Resolve tokenizer next to weights and encode a chat conversation.