Skip to main content

encode_prompt

maolan_generate

Function encode_prompt 

Source 
pub fn encode_prompt(
    tokenizer: &SentencePieceProcessor,
    prompt: &str,
    max_tokens: usize,
) -> Result<(Vec<i64>, Vec<i64>)>