Skip to main content

Module hooks

Module hooks 

Source

Structs§

GenerationContext
Identity of the model that handled a generation.
HookedModel
A model wrapper that invokes GenerationHook callbacks after generate() completes and for each streaming part yielded by stream().
HookedRouter
A LanguageModelRouter wrapper that attaches GenerationHooks to every model returned by the inner router.

Traits§

GenerationHook
A hook that observes generation lifecycle events for side-effect purposes (logging, metrics, token tracking, auditing).