Skip to main content

Module stateless

Module stateless 

Source
Expand description

Stateless execution support. Stateless LLM execution without session management.

Structs§

RequestOptions
Request options that can override config defaults.
StatelessConfig
Configuration for creating a stateless executor.
StatelessExecutor
Stateless executor for single LLM requests without session state. Safe for concurrent use - multiple tasks can call execute simultaneously.
StatelessResult
Result from a stateless execution.

Enums§

StatelessError
Errors that can occur during stateless execution.

Constants§

DEFAULT_MAX_TOKENS
Default maximum tokens for responses when not specified.

Type Aliases§

StreamCallback
Callback for streaming text chunks. Return Ok(()) to continue streaming, or Err to stop early.