Expand description
Consumer SDK surface for the public api-store LLM endpoint (feature 472).
These types let a Rust application (or another builtin app) call the
host’s /api/v2/public/api_store/llm/{call,stream} endpoints in a
type-safe way, with the routing fields (route / execution_route /
via_node_id) threaded through the request and response shapes.
Honest framing (security finding S5 / U4, surfaced via rustdoc on
LlmRoute): Private isolates the upstream provider’s API
credentials on the peer’s host and routes egress through a separate
device; it does NOT mask prompt contents from the upstream provider or
anonymize the user.
Re-exports§
pub use api_store_client::WithRoute;pub use errors::InvalidRouteModeCombinationError;pub use types::ChatMessage;pub use types::ExecuteBestModelRequest;pub use types::ExecuteChatRequest;pub use types::ExecuteChatResponse;pub use types::ExecuteRequest;pub use types::LlmRoute;pub use types::ProxyMode;pub use types::StreamChatChunk;pub use types::StreamChatRequest;
Modules§
- api_
store_ client - Ergonomic shortcuts for building public LLM call requests (feature 472, T1012). Resolves UI finding U2 — single-line construction of a request with a specific routing intent.
- errors
- Typed errors for the public api-store LLM endpoint (feature 472).
- types
- Rust consumer SDK types for the public api-store LLM endpoint (feature 472).