Struct LLMController 

pub struct LLMController { /* private fields */ }

The main LLM controller that manages sessions and coordinates communication

Implementations

impl LLMController

pub fn new( permission_registry: Arc<PermissionRegistry>, ui_tx: Option<Sender<UiMessage>>, channel_size: Option<usize>, ) -> Self

Creates a new LLM controller

Arguments

• permission_registry - Permission registry for batch permission requests
• ui_tx - Optional UI channel sender for forwarding events
• channel_size - Optional channel buffer size (defaults to DEFAULT_CHANNEL_SIZE)

pub async fn start(&self)

Starts the controller’s event loop. This is idempotent - calling it multiple times has no effect. Should be spawned as a tokio task.

pub async fn shutdown(&self)

Gracefully shuts down the controller and all sessions. This is idempotent - calling it multiple times has no effect.

pub fn is_shutdown(&self) -> bool

Returns true if the controller has been shutdown

pub fn is_started(&self) -> bool

Returns true if the controller has been started

pub async fn create_session( &self, config: LLMSessionConfig, ) -> Result<i64, LlmError>

Creates a new LLM session.

Arguments

• config - Session configuration (includes model, API key, etc.)

Returns

The session ID of the newly created session

Errors

Returns an error if the session fails to initialize (e.g., TLS setup failure)

pub async fn get_session(&self, session_id: i64) -> Option<Arc<LLMSession>>

Retrieves a session by its ID.

Returns

The session if found, None otherwise

pub async fn session_count(&self) -> usize

Returns the number of active sessions

pub async fn remove_session(&self, session_id: i64) -> bool

Removes a session from the controller.

This only removes the session from the session manager. For full cleanup including permission and interaction registries, use AgentCore::remove_session.

Arguments

• session_id - The ID of the session to remove

Returns

true if the session was found and removed, false otherwise

pub async fn send_input( &self, input: ControllerInputPayload, ) -> Result<(), ControllerError>

Sends input to the controller for processing.

Arguments

• input - The input payload to send

Returns

Ok(()) if the input was sent successfully, Err otherwise.

pub async fn get_session_token_usage( &self, session_id: i64, ) -> Option<TokenMeter>

Get token usage for a specific session.

pub async fn get_model_token_usage(&self, model: &str) -> Option<TokenMeter>

Get token usage for a specific model.

pub async fn get_total_token_usage(&self) -> TokenMeter

Get total token usage across all sessions.

pub fn token_usage(&self) -> &TokenUsageTracker

Get a reference to the token usage tracker for advanced queries.

pub fn tool_registry(&self) -> &Arc<ToolRegistry>

Returns a reference to the tool registry.