Module llm

Module llm 

Source

Structs§

LlmRequest
Minimal request structure passed to a language model.
LlmResponse

Enums§

StreamChunk
A chunk of streaming response from the LLM

Traits§

LanguageModel

Type Aliases§

ChunkStream
Type alias for a pinned boxed stream of chunks