Struct LlmRequestWrapper 

pub struct LlmRequestWrapper {
    pub request: LlmRequest,
}

Request type for LLM completion services.

Fields

request: LlmRequest

The LLM request to execute.

Trait Implementations

impl Clone for LlmRequestWrapper

fn clone(&self) -> LlmRequestWrapper

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LlmRequestWrapper

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Service<LlmRequestWrapper> for LlmService

type Response = LlmResponseWrapper

Responses given by the service.

type Error = LlmError

Errors produced by the service.

type Future = Pin<Box<dyn Future<Output = Result<<LlmService as Service<LlmRequestWrapper>>::Response, <LlmService as Service<LlmRequestWrapper>>::Error>> + Send>>

The future response value.

fn poll_ready(&mut self, _cx: &mut Context<'_>) -> Poll<Result<(), Self::Error>>

Returns Poll::Ready(Ok(())) when the service is able to process requests.

fn call(&mut self, req: LlmRequestWrapper) -> Self::Future

Process the request and return the response asynchronously.