Enum Backend 

pub enum Backend {
    Prompt(Arc<dyn LlmBackend>),
    Chat(Arc<dyn ChatBackend>),
}

Whichever kind of backend a turn is being run against.

Callers do not name this: Arc<dyn LlmBackend> and Arc<dyn ChatBackend> both convert into it, so Agent::prompt takes either and every existing caller keeps compiling.

Variants

Prompt(Arc<dyn LlmBackend>)

A backend fed a formatted prompt string.

Chat(Arc<dyn ChatBackend>)

A backend fed structured messages.

Implementations

impl Backend

pub fn is_ready(&self) -> bool

Whether the backend can be asked to run.

pub fn tokenize_count(&self, text: &str) -> u32

Tokens in a string, however this backend counts them.

Trait Implementations

impl Clone for Backend

fn clone(&self) -> Backend

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl From<Arc<dyn ChatBackend>> for Backend

Available on crate feature chat-backend only.

fn from(backend: Arc<dyn ChatBackend>) -> Self

Converts to this type from the input type.

impl From<Arc<dyn LlmBackend>> for Backend

fn from(backend: Arc<dyn LlmBackend>) -> Self

Converts to this type from the input type.