Skip to main content

Crate mesh_llm_routing

Crate mesh_llm_routing 

Source

Modules§

prefix_affinity

Structs§

ModelTargets
Per-model routing table.

Enums§

InferenceTarget
The current inference target selected by runtime planning.

Functions§

total_model_bytes
Calculate total model size, summing all split files if present. Split files follow the pattern: name-00001-of-00004.gguf.