Skip to main content

TOKENIZE

Constant TOKENIZE 

Source
pub const TOKENIZE: &str = "/tokenize";
Expand description

llama.cpp’s spelling of V1_TOKENIZE, mounted on the same handler.

The /v1/ prefix was ferrox’s invention: OpenAI has no tokenize endpoint at all, and llama.cpp serves this one unprefixed (tools/server/server.cpp:259). Every llama.cpp client therefore asked for a path that did not exist, and got a 404 that named nothing. Both spellings now answer, and the handler accepts llama.cpp’s content field alongside ferrox’s prompt.