Struct LLMController 

pub struct LLMController { /* private fields */ }

The main LLM controller that manages sessions and coordinates communication

Implementations

impl LLMController

pub fn new(event_func: Option<EventFunc>) -> Self

Creates a new LLM controller

Arguments

• event_func - Optional callback for controller events

pub async fn start(&self)

Starts the controller’s event loop. This is idempotent - calling it multiple times has no effect. Should be spawned as a tokio task.

pub async fn shutdown(&self)

Gracefully shuts down the controller and all sessions. This is idempotent - calling it multiple times has no effect.

pub fn is_shutdown(&self) -> bool

Returns true if the controller has been shutdown

pub fn is_started(&self) -> bool

Returns true if the controller has been started

pub async fn create_session( &self, config: LLMSessionConfig, ) -> Result<i64, LlmError>

Creates a new LLM session.

Arguments

• config - Session configuration (includes model, API key, etc.)

Returns

The session ID of the newly created session

Errors

Returns an error if the session fails to initialize (e.g., TLS setup failure)

pub async fn get_session(&self, session_id: i64) -> Option<Arc<LLMSession>>

Retrieves a session by its ID.

Returns

The session if found, None otherwise

pub async fn session_count(&self) -> usize

Returns the number of active sessions

pub async fn send_input( &self, input: ControllerInputPayload, ) -> Result<(), ControllerError>

Sends input to the controller for processing.

Arguments

• input - The input payload to send

Returns

Ok(()) if the input was sent successfully, Err otherwise.

pub async fn get_session_token_usage( &self, session_id: i64, ) -> Option<TokenMeter>

Get token usage for a specific session.

pub async fn get_model_token_usage(&self, model: &str) -> Option<TokenMeter>

Get token usage for a specific model.

pub async fn get_total_token_usage(&self) -> TokenMeter

Get total token usage across all sessions.

pub fn token_usage(&self) -> &TokenUsageTracker

Get a reference to the token usage tracker for advanced queries.

pub fn tool_registry(&self) -> &Arc<ToolRegistry>

Returns a reference to the tool registry.

pub fn user_interaction_registry(&self) -> &Arc<UserInteractionRegistry>

Returns a reference to the user interaction registry.

pub async fn respond_to_interaction( &self, tool_use_id: &str, response: AskUserQuestionsResponse, ) -> Result<(), UserInteractionError>

Respond to a pending user interaction.

This is called by the UI when the user has answered questions.

Arguments

• tool_use_id - ID of the tool use to respond to.
• response - The user’s answers.

pub async fn pending_interactions_for_session( &self, session_id: i64, ) -> Vec<PendingQuestionInfo>

Get all pending interactions for a session.

This is called by the UI when switching sessions to display any pending questions for that session.

pub async fn has_pending_interactions(&self, session_id: i64) -> bool

Check if a session has pending user interactions.

pub fn permission_registry(&self) -> &Arc<PermissionRegistry>

Returns a reference to the permission registry.

pub async fn respond_to_permission( &self, tool_use_id: &str, response: PermissionResponse, ) -> Result<(), PermissionError>

Respond to a pending permission request.

This is called by the UI when the user has granted or denied permission.

Arguments

• tool_use_id - ID of the tool use to respond to.
• response - The user’s response (grant/deny with scope).

pub async fn pending_permissions_for_session( &self, session_id: i64, ) -> Vec<PendingPermissionInfo>

Get all pending permission requests for a session.

This is called by the UI when switching sessions to display any pending permission requests for that session.

pub async fn has_pending_permissions(&self, session_id: i64) -> bool

Check if a session has pending permission requests.

pub async fn cancel_permission( &self, tool_use_id: &str, ) -> Result<(), PermissionError>

Cancel a pending permission request.

This is called by the UI when the user closes the permission dialog without responding.