Trait ErasedModel 

pub trait ErasedModel: Send + Sync {
    // Required methods
    fn generate_erased<'a>(
        &'a self,
        request: &'a ChatRequest,
    ) -> Pin<Box<dyn Future<Output = Result<ChatResponse>> + Send + 'a>>;
    fn generate_stream_erased<'a>(
        &'a self,
        request: &'a ChatRequest,
    ) -> Pin<Box<dyn Future<Output = Result<ResponseStream>> + Send + 'a>>;
}

Object-safe wrapper for Model, enabling dynamic dispatch via Arc<dyn ErasedModel>.

Required Methods

fn generate_erased<'a>( &'a self, request: &'a ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<ChatResponse>> + Send + 'a>>

Object-safe version of Model::generate.

fn generate_stream_erased<'a>( &'a self, request: &'a ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<ResponseStream>> + Send + 'a>>

Object-safe version of Model::generate_stream.

Implementors

impl<T: Model> ErasedModel for T