Struct ChatModelConfig 

pub struct ChatModelConfig {
    pub base: LanguageModelConfig,
    pub rate_limiter: Option<Arc<dyn BaseRateLimiter>>,
    pub disable_streaming: DisableStreaming,
    pub output_version: Option<String>,
    pub profile: Option<ModelProfile>,
}

Configuration specific to chat models.

Fields

base: LanguageModelConfig

Base language model configuration.

rate_limiter: Option<Arc<dyn BaseRateLimiter>>

Rate limiter for limiting API requests.

disable_streaming: DisableStreaming

Whether to disable streaming for this model.

If streaming is bypassed, then stream/astream will defer to invoke/ainvoke.

• If Bool(true), will always bypass streaming case.
• If ToolCalling, will bypass streaming case only when tools are present.
• If Bool(false) (default), will always use streaming case if available.

output_version: Option<String>

Version of AIMessage output format.

• "v0": provider-specific format in content
• "v1": standardized format in content

Can also be set via LC_OUTPUT_VERSION environment variable.

profile: Option<ModelProfile>

Profile detailing model capabilities.

Implementations

impl ChatModelConfig

pub fn new() -> Self

Create a new chat model configuration.

pub fn with_rate_limiter(self, rate_limiter: Arc<dyn BaseRateLimiter>) -> Self

Set the rate limiter.

pub fn with_disable_streaming( self, disable: impl Into<DisableStreaming>, ) -> Self

Set whether to disable streaming.

pub fn with_output_version(self, version: impl Into<String>) -> Self

Set the output version.

pub fn with_profile(self, profile: ModelProfile) -> Self

Set the model profile.

pub fn with_cache(self, cache: bool) -> Self

Enable caching.

pub fn with_verbose(self, verbose: bool) -> Self

Enable verbose mode.

pub fn with_tags(self, tags: Vec<String>) -> Self

Set tags.

pub fn with_metadata(self, metadata: HashMap<String, Value>) -> Self

Set metadata.

Trait Implementations

impl Clone for ChatModelConfig

fn clone(&self) -> ChatModelConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ChatModelConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ChatModelConfig

fn default() -> ChatModelConfig

Returns the “default value” for a type.