Crate katu_llm 

katu-llm

职责

定义 LLM 抽象层的核心数据类型，包括模型引用、生成参数、 模型能力描述、定价信息、HTTP 选项与缓存策略。

模块

• model — 模型相关类型 (ModelRef, ModelLimits, ModelPricing, ModelCapabilities, …)
• http — HTTP 传输选项 (HttpOptions)
• cache — 缓存策略 (CachePolicy)
• request — 请求与响应 (LlmRequest, LlmResponse)
• provider — Provider trait (stream, generate)

Re-exports

pub use cache::CachePolicy;

pub use http::HttpOptions;

pub use model::InputModality;

pub use model::ModelCapabilities;

pub use model::ModelLimits;

pub use model::ModelPricing;

pub use model::ModelRef;

pub use model::ReasoningEffort;

pub use model::ThinkingConfig;

pub use model::ThinkingMode;

pub use provider::EventStream;

pub use provider::Provider;

pub use request::LlmRequest;

pub use request::LlmResponse;

Modules

cache

katu_llm::cache

http

katu_llm::http

model

katu_llm::model

provider

katu_llm::provider

request

katu_llm::request

Structs

GenerationOptions

Provider 无关的 LLM 生成参数。