Module stateless
Source - RequestOptions
- Request options that can override config defaults.
- StatelessConfig
- Configuration for creating a stateless executor.
- StatelessExecutor
- Stateless executor for single LLM requests without session state.
Safe for concurrent use - multiple tasks can call execute simultaneously.
- StatelessResult
- Result from a stateless execution.
- StatelessError
- Errors that can occur during stateless execution.
- DEFAULT_MAX_TOKENS
- Default maximum tokens for responses when not specified.
- StreamCallback
- Callback for streaming text chunks.
Return Ok(()) to continue streaming, or Err to stop early.