Struct StubBackend 

pub struct StubBackend {
    pub reply: String,
}

A deterministic fake that streams a fixed reply word by word.

Enough to exercise streaming, early-stop, and token accounting with no model present.

Fields

reply: String

What every request generates.

Trait Implementations

impl Default for StubBackend

fn default() -> Self

Returns the “default value” for a type.

impl InferBackend for StubBackend

fn infer<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, prompt: &'life1 str, max_tokens: u32, on_token: &'life2 mut (dyn for<'t> FnMut(&'t str) -> bool + Send), ) -> Pin<Box<dyn Future<Output = Result<InferResult>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Generate from prompt, invoking on_token once per token.

fn model_name(&self) -> String

Identifier recorded in the job’s usage accounting.