Expand description
Keep-warm: whether, and when, a prompt cache still in use is renewed
before the provider lets it expire.
The part crates/kernel/spec/KeepWarm.lean specifies this module.
Off unless the city enables it. A renewal is a request the person
pays for, so KeepWarm::Off is the default and plans nothing. Spend
is observed where every request’s usage is recorded; this decision
reads no balance and refuses nothing.
Structs§
- Cache
Use - One prefix’s cache as last seen: when a real request carried it, in milliseconds, and whether that use still owes its one renewal.
Enums§
- Keep
Warm - Whether this city renews a warm prompt cache before it expires.
Functions§
- renewal_
due - The instant the next renewal request is sent, or
Nonewhen none is.