katu-llm 0.1.0

LLM abstraction layer for the Katu AI Agent framework
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29

//! # katu-llm
//!
//! ## 职责
//! 定义 LLM 抽象层的核心数据类型，包括模型引用、生成参数、
//! 模型能力描述、定价信息、HTTP 选项与缓存策略。
//!
//! ## 模块
//! - `model` — 模型相关类型 (ModelRef, ModelLimits, ModelPricing, ModelCapabilities, ...)
//! - `http` — HTTP 传输选项 (HttpOptions)
//! - `cache` — 缓存策略 (CachePolicy)
//! - `request` — 请求与响应 (LlmRequest, LlmResponse)
//! - `provider` — Provider trait (stream, generate)

pub mod cache;
pub mod http;
pub mod model;
pub mod provider;
pub mod request;

// re-export 常用类型到 crate 根
pub use cache::CachePolicy;
pub use katu_core::GenerationOptions;
pub use http::HttpOptions;
pub use model::{
    InputModality, ModelCapabilities, ModelLimits, ModelPricing, ModelRef, ReasoningEffort,
    ThinkingConfig, ThinkingMode,
};
pub use provider::{EventStream, Provider};
pub use request::{LlmRequest, LlmResponse};