Skip to main content

Module keep_warm

Module keep_warm 

Source
Expand description

Keep-warm: whether, and when, a prompt cache still in use is renewed before the provider lets it expire. The part crates/kernel/spec/KeepWarm.lean specifies this module.

Off unless the city enables it. A renewal is a request the person pays for, so KeepWarm::Off is the default and plans nothing. Spend is observed where every request’s usage is recorded; this decision reads no balance and refuses nothing.

Structs§

CacheUse
One prefix’s cache as last seen: when a real request carried it, in milliseconds, and whether that use still owes its one renewal.

Enums§

KeepWarm
Whether this city renews a warm prompt cache before it expires.

Functions§

renewal_due
The instant the next renewal request is sent, or None when none is.