Skip to main content

pack_input_ids

Function pack_input_ids 

Source
pub fn pack_input_ids(
    batch_prompts: &[Vec<u32>],
    max_seq: usize,
) -> Result<Vec<f32>, Error>
Expand description

Pack per-row prompts into [batch, max_seq] row-major F32 ids (zero-pad).