Struct Model 

pub struct Model<P: Provider + 'static> { /* private fields */ }

A wcore-typed view over a crabllm_core::Provider.

Holds an Arc<P> so cloning is cheap. The 'static bound on P flows from the streaming path.

Implementations

impl<P: Provider + 'static> Model<P>

pub fn new(provider: P) -> Self

Wrap a provider in a Model.

pub fn from_arc(provider: Arc<P>) -> Self

Wrap an existing Arc<P> without re-allocating.

pub async fn send_ct( &self, request: ChatCompletionRequest, ) -> Result<ChatCompletionResponse>

Send a non-streaming chat completion request.

pub fn stream_ct( &self, request: ChatCompletionRequest, ) -> impl Stream<Item = Result<ChatCompletionChunk>> + Send + 'static

Stream a chat completion response.

Trait Implementations

impl<P: Provider + 'static> Clone for Model<P>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<P: Provider + 'static> Debug for Model<P>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.