Skip to main content

Module llm

Module llm 

Source

Re-exports§

pub use router::ModelRouter;
pub use router::ModelTier;
pub use router::TaskComplexity;
pub use streaming::StreamAccumulator;
pub use streaming::StreamBox;
pub use streaming::StreamDelta;
pub use types::*;

Modules§

router
streaming
Streaming types for LLM responses.
types

Traits§

LlmProvider

Functions§

collect_stream
Helper function to consume a stream and collect it into a ChatResponse.