Struct OpenAiCompatibleModelClient 

pub struct OpenAiCompatibleModelClient { /* private fields */ }

Implementations

impl OpenAiCompatibleModelClient

pub fn new(config: OpenAiCompatibleConfig) -> Self

Trait Implementations

impl Clone for OpenAiCompatibleModelClient

fn clone(&self) -> OpenAiCompatibleModelClient

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for OpenAiCompatibleModelClient

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl ModelClient for OpenAiCompatibleModelClient

fn stream<'life0, 'async_trait>( &'life0 self, input: ModelTurnInput, ) -> Pin<Box<dyn Future<Output = Result<BoxStream<'static, Result<ModelChunk, ModelClientError>>, ModelClientError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Stream the model’s response as a sequence of ModelChunks. Production ScriptedModelClient / OpenAiCompatibleModelClient implement this; next() is provided as a folding convenience for callers that don’t need token-level events.

fn next<'life0, 'async_trait>( &'life0 self, input: ModelTurnInput, ) -> Pin<Box<dyn Future<Output = Result<ModelResponse, ModelClientError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Buffer the stream into a single ModelResponse. Default impl awaits every chunk and then runs collect_model_response. Override only if a provider has a cheaper non-streaming path (none today — even OpenAI’s non-stream call still goes through the same SSE-or-not branch on our side).