Struct LLMSessionManager 

pub struct LLMSessionManager { /* private fields */ }

Manages multiple LLM sessions

Implementations

impl LLMSessionManager

pub fn new() -> Self

Creates a new session manager

pub async fn create_session( &self, config: LLMSessionConfig, from_llm: Sender<FromLLMPayload>, ) -> Result<i64, LlmError>

Creates a new LLM session and starts it.

Arguments

• config - Session configuration (includes model, API key, etc.)
• from_llm - Channel sender for responses from the LLM

Returns

The session ID of the newly created session

Errors

Returns an error if the session fails to initialize (e.g., TLS setup failure)

pub async fn get_session_by_id( &self, session_id: i64, ) -> Option<Arc<LLMSession>>

Retrieves a session by its ID.

Returns

The session if found, None otherwise

pub async fn remove_session(&self, session_id: i64) -> bool

Removes and shuts down a specific session.

Arguments

• session_id - The ID of the session to remove

Returns

true if the session was found and removed, false otherwise

pub async fn shutdown(&self)

Shuts down all sessions managed by this manager. This is idempotent and safe to call multiple times.

pub async fn session_count(&self) -> usize

Returns the number of active sessions

Trait Implementations

impl Default for LLMSessionManager

fn default() -> Self

Returns the “default value” for a type.