pub const COMPLETION_FLOOR: i64 = 256;Expand description
The number of tokens reserved for the completion when deciding if a prompt fits the window, wherever the window can afford it. A window too small for it reserves half of itself instead, so a model declaring fewer than twice this is still usable.