Skip to main content

Module llm

Module llm 

Source
Expand description

Consumer SDK surface for the public api-store LLM endpoint (feature 472).

These types let a Rust application (or another builtin app) call the host’s /api/v2/public/api_store/llm/{call,stream} endpoints in a type-safe way, with the routing fields (route / execution_route / via_node_id) threaded through the request and response shapes.

Honest framing (security finding S5 / U4, surfaced via rustdoc on LlmRoute): Private isolates the upstream provider’s API credentials on the peer’s host and routes egress through a separate device; it does NOT mask prompt contents from the upstream provider or anonymize the user.

Re-exports§

pub use api_store_client::WithRoute;
pub use errors::InvalidRouteModeCombinationError;
pub use errors::PrivateUnavailableError;
pub use types::ChatMessage;
pub use types::ExecuteBestModelRequest;
pub use types::ExecuteChatRequest;
pub use types::ExecuteChatResponse;
pub use types::ExecuteRequest;
pub use types::LlmRoute;
pub use types::ProxyMode;
pub use types::StreamChatChunk;
pub use types::StreamChatRequest;

Modules§

api_store_client
Ergonomic shortcuts for building public LLM call requests (feature 472, T1012). Resolves UI finding U2 — single-line construction of a request with a specific routing intent.
errors
Typed errors for the public api-store LLM endpoint (feature 472).
types
Rust consumer SDK types for the public api-store LLM endpoint (feature 472).