Struct ZhipuClient 

pub struct ZhipuClient(/* private fields */);

Zhipu AI (GLM) client

Implementations

impl ZhipuClient

pub fn new(api_key: String, model: String) -> Self

pub fn with_temperature(self, temperature: f32) -> Self

pub fn with_max_tokens(self, max_tokens: usize) -> Self

pub fn with_logprobs(self, enabled: bool) -> Self

pub fn with_top_logprobs(self, top_logprobs: usize) -> Self

pub fn with_base_url(self, base_url: String) -> Self

pub fn with_retry_config(self, retry_config: RetryConfig) -> Self

pub fn with_http_client(self, http: Arc<dyn HttpClient>) -> Self

Trait Implementations

impl LlmClient for ZhipuClient

fn model_generation_pool(&self) -> Option<ModelGenerationPool>

Describe the non-secret provider/model capacity pool shared by this client. The default is None for custom clients that do not expose a stable routing identity; they retain the existing per-client gate.

fn complete<'life0, 'life1, 'life2, 'life3, 'async_trait>( &'life0 self, messages: &'life1 [Message], system: Option<&'life2 str>, tools: &'life3 [ToolDefinition], ) -> Pin<Box<dyn Future<Output = Result<LlmResponse>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait, 'life3: 'async_trait,

Complete a conversation (non-streaming)

fn complete_streaming<'life0, 'life1, 'life2, 'life3, 'async_trait>( &'life0 self, messages: &'life1 [Message], system: Option<&'life2 str>, tools: &'life3 [ToolDefinition], cancel_token: CancellationToken, ) -> Pin<Box<dyn Future<Output = Result<Receiver<StreamEvent>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait, 'life3: 'async_trait,

Complete a conversation with streaming Returns a receiver for streaming events. The cancel_token is checked during the HTTP request; if cancelled, the request is aborted.

fn native_structured_support(&self) -> NativeStructuredSupport

Report the strongest provider-native structured-output enforcement this client supports. Used by structured to decide whether to force a tool call, request a native response_format, or fall back to prompt-and-parse. Defaults to no native support.

fn has_distinct_non_streaming_transport(&self) -> bool

Report whether LlmClient::complete_structured uses a transport that is independent from the streaming implementation.

fn complete_structured<'life0, 'life1, 'life2, 'life3, 'life4, 'async_trait>( &'life0 self, messages: &'life1 [Message], system: Option<&'life2 str>, tools: &'life3 [ToolDefinition], directive: &'life4 StructuredDirective, ) -> Pin<Box<dyn Future<Output = Result<LlmResponse>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait, 'life3: 'async_trait, 'life4: 'async_trait,

Complete a conversation while honoring a structured-output directive (forced tool_choice and/or native response_format).

fn complete_streaming_structured<'life0, 'life1, 'life2, 'life3, 'life4, 'async_trait>( &'life0 self, messages: &'life1 [Message], system: Option<&'life2 str>, tools: &'life3 [ToolDefinition], directive: &'life4 StructuredDirective, cancel_token: CancellationToken, ) -> Pin<Box<dyn Future<Output = Result<Receiver<StreamEvent>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait, 'life3: 'async_trait, 'life4: 'async_trait,

Streaming counterpart of LlmClient::complete_structured. Defaults to LlmClient::complete_streaming, ignoring the directive.

fn model_generation_concurrency(&self) -> ModelGenerationConcurrency

Report the client’s explicitly supported active-generation capacity.

fn bind_model_generation_admission( &self, _admission: ModelGenerationAdmission, _preadmitted: Option<Arc<ModelGenerationPermit>>, ) -> Option<Arc<dyn LlmClient>>

Rebind a governed model facade to an invocation-owned generation gate.

fn model_generation_is_managed(&self) -> bool

Whether this client already applies the model-generation admission contract around every provider call. Built-in run-bound clients use this marker so structured tools do not acquire the same permit twice.

fn take_model_generation_queue_wait(&self) -> Duration

Take queue wait accumulated by a managed client since the previous observation. Unmanaged clients report zero.

fn fork_for_session(&self, _session_id: &str) -> Option<Arc<dyn LlmClient>>

Derive a provider client bound to one logical agent session.

fn with_active_generation_timeout( &self, _timeout: Duration, ) -> Option<Arc<dyn LlmClient>>

Return a view of this client configured for one active generation deadline. The caller still owns and enforces the outer deadline.