Skip to main content

DEFAULT_MAX_BATCH

rightkit_embed

Constant DEFAULT_MAX_BATCH 

Source 
pub const DEFAULT_MAX_BATCH: usize = 16;
Expand description

Default rows per ONNX call for embed_batch / embed_query_batch.