Struct CostRouter 

pub struct CostRouter { /* private fields */ }

Router that selects providers based on lowest cost.

Implementations

impl CostRouter

pub fn new( providers: Vec<Arc<dyn Provider>>, config: CostRouterConfig, ) -> Result<Self>

Create a cost router using the provided config.

Errors

Returns a routing error if providers or costs are missing.

pub async fn complete( &self, request: &CompletionRequest, ) -> Result<CompletionResponse>

Execute a completion request using cost-based selection.

pub async fn stream( &self, request: &CompletionRequest, ) -> Result<Box<dyn Stream<Item = Result<CompletionChunk>> + Send + Unpin>>

Execute a streaming request using cost-based selection.