Skip to main content

Module monitor

Module monitor 

Source

Functionsยง

estimate_cost
Estimate USD cost based on token usage and model.
infer_status
model_context_max
Max context window tokens by model.
shorten_model
update_tokens
Read new JSONL entries since last offset, accumulate token stats.