Module stateless

Module stateless 

Source
Expand description

Stateless execution support. Stateless LLM execution without session management.

Structs§

RequestOptions
Request options that can override config defaults.
StatelessConfig
Configuration for creating a stateless executor.
StatelessExecutor
Stateless executor for single LLM requests without session state. Safe for concurrent use - multiple tasks can call execute simultaneously.
StatelessResult
Result from a stateless execution.

Enums§

StatelessError
Errors that can occur during stateless execution.

Constants§

DEFAULT_MAX_TOKENS
Default maximum tokens for responses when not specified.

Type Aliases§

StreamCallback
Callback for streaming text chunks. Return Ok(()) to continue streaming, or Err to stop early.