Struct ServerState 

pub struct ServerState {
    pub llm_client: Option<Arc<LLMClient>>,
    pub agent: Option<Arc<RwLock<Agent>>>,
    pub model_name: String,
}

Server state containing the LLM client and agent (if any).

Fields

llm_client: Option<Arc<LLMClient>>

The LLM client for direct LLM calls.

agent: Option<Arc<RwLock<Agent>>>

The agent (if serving an agent).

model_name: String

The model name being served.

Implementations

impl ServerState

pub fn with_llm_client(llm_client: LLMClient, model_name: String) -> Self

Creates a new server state with an LLM client.

pub fn with_agent(agent: Agent, model_name: String) -> Self

Creates a new server state with an agent.

Trait Implementations

impl Clone for ServerState

fn clone(&self) -> ServerState

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.