Expand description
Stateless execution support. Stateless LLM execution without session management.
Structs§
- Request
Options - Request options that can override config defaults.
- Stateless
Config - Configuration for creating a stateless executor.
- Stateless
Executor - Stateless executor for single LLM requests without session state. Safe for concurrent use - multiple tasks can call execute simultaneously.
- Stateless
Result - Result from a stateless execution.
Enums§
- Stateless
Error - Errors that can occur during stateless execution.
Constants§
- DEFAULT_
MAX_ TOKENS - Default maximum tokens for responses when not specified.
Type Aliases§
- Stream
Callback - Callback for streaming text chunks. Return Ok(()) to continue streaming, or Err to stop early.