Trait LlmPortServiceExt 

pub trait LlmPortServiceExt: LlmPort {
    // Required method
    fn into_llm_service(self: Arc<Self>) -> LlmService;
}

Extension trait that converts an LlmPort into a tower service.

Required Methods

fn into_llm_service(self: Arc<Self>) -> LlmService

Convert this LLM port into a tower::Service for completions.

Implementations on Foreign Types

impl LlmPortServiceExt for dyn LlmPort

fn into_llm_service(self: Arc<Self>) -> LlmService

Implementors

impl<T: LlmPort + 'static> LlmPortServiceExt for T