Struct DummyLM 

pub struct DummyLM {
    pub api_key: String,
    pub base_url: String,
    pub temperature: f32,
    pub max_tokens: u32,
    pub cache: bool,
    pub cache_handler: Option<Arc<Mutex<ResponseCache>>>,
}

In-memory LM used for deterministic tests and examples.

Fields

api_key: String

base_url: String

temperature: f32

max_tokens: u32

cache: bool

cache_handler: Option<Arc<Mutex<ResponseCache>>>

Cache backing storage shared with the real implementation.

Implementations

impl DummyLM

pub fn builder() -> DummyLMBuilder

Create an instance of DummyLM using the builder syntax

impl DummyLM

pub async fn new() -> Self

Creates a new DummyLM with an enabled in-memory cache.

pub async fn call( &self, example: Example, messages: Chat, prediction: String, ) -> Result<LMResponse>

Mimics LM::call without hitting a remote provider.

The provided prediction becomes the assistant output and is inserted into the shared cache when caching is enabled.

pub async fn inspect_history(&self, n: usize) -> Vec<CallResult>

Returns cached entries just like LM::inspect_history.

Trait Implementations

impl Clone for DummyLM

fn clone(&self) -> DummyLM

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Default for DummyLM

fn default() -> DummyLM

Returns the “default value” for a type.