ModelService

tower_llm::provider

Trait ModelService 

Source 
pub trait ModelService: Service<CreateChatCompletionRequest, Response = ProviderResponse, Error = BoxError> { }
Expand description

Trait alias for non-streaming model services

Implementors§