Expand description
Transport-neutral model, chat, and tool-call types shared by Decompute runtimes.
Structs§
- Chat
Message - Function
Call - Function
Definition - Hardware
Info - Model
File - Model
Manifest - Session
Cache Config - Configuration shared by the worker and the in-process inference runtime. Durations are represented as milliseconds so this type remains transport and runtime neutral.
- Session
Cache Stats - Process-local cumulative cache counters. The runtime updates these without retaining session identifiers, prompts, or token contents.
- Tool
Call - Tool
Definition
Enums§
Functions§
- validate_
tool_ history - Validates the assistant/tool message protocol before a message history is rendered into a model prompt. Tool implementations remain outside the worker; this only checks that client-supplied results match model requests.