Struct StubModel 

pub struct StubModel { /* private fields */ }

Deterministic stand-in used when no API key / openai feature is present.

Implementations

impl StubModel

pub fn new(agent_name: &str) -> Self

Trait Implementations

impl ModelClient for StubModel

fn complete<'life0, 'life1, 'async_trait>( &'life0 self, req: &'life1 ModelRequest, ) -> Pin<Box<dyn Future<Output = Result<ModelResponse, CoreError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Produce a complete reply in one shot.

fn stream<'life0, 'life1, 'async_trait>( &'life0 self, req: &'life1 ModelRequest, ) -> Pin<Box<dyn Future<Output = Result<BoxStream<'static, Result<String, CoreError>>, CoreError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Stream the reply as a sequence of tokens. The default implementation yields the full ModelResponse::text as a single chunk, so backends that only support non-streaming calls work unchanged.