Struct LlmClient 

pub struct LlmClient { /* private fields */ }

Client for making LLM inference calls.

Implementations

impl LlmClient

pub fn new(config: LlmConfig) -> Self

Create a new LLM client with the given configuration.

pub fn from_env() -> Self

Create a client from environment variables.

pub fn mock() -> Self

Create a mock client for testing.

pub async fn infer_string(&self, prompt: &str) -> SageResult<String>

Call the LLM with a prompt and return the raw string response.

pub async fn infer<T>(&self, prompt: &str) -> SageResult<T>

where T: DeserializeOwned,

Call the LLM with a prompt and parse the response as the given type.

pub async fn infer_structured<T>( &self, prompt: &str, schema: &str, ) -> SageResult<T>

where T: DeserializeOwned,

Call the LLM with schema-injected prompt engineering for structured output.

The schema is injected as a system message, and the runtime retries up to SAGE_INFER_RETRIES times (default 3) on parse failure.

Trait Implementations

impl Clone for LlmClient

fn clone(&self) -> LlmClient

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.