Skip to main content

CHUNK_EMBED_BATCH_SIZE

Constant CHUNK_EMBED_BATCH_SIZE 

Source
pub const CHUNK_EMBED_BATCH_SIZE: usize = 8;
Expand description

Calibration base: chunk (long-text) batch size per LLM call at the calibration dimensionality (G42/S2). Use chunk_embed_batch_size for the dim-adaptive value (G44).