Struct PoolCreate 

pub struct PoolCreate { /* private fields */ }

Creates a pool. Build with Pools::create.

Implementations

impl PoolCreate

pub fn gpus(self, gpus: impl IntoIterator<Item = (String, u32)>) -> Self

How many workers of each GPU type the pool reserves.

pub fn gpu_caps(self, caps: impl IntoIterator<Item = (String, u32)>) -> Self

Ceiling on assigned workers per GPU type.

pub fn queue_pool(self, queue_pool: impl Into<String>) -> Self

Which queue pool the workers draw from. Defaults to default server-side.

pub fn bundle(self, bundle: impl Into<String>) -> Self

Which model bundle the workers run.

pub fn minimum_worker_count(self, count: u32) -> Self

Workers to keep warm. Zero, the default, allows scaling to zero.

pub fn pinned_models( self, models: impl IntoIterator<Item = impl Into<String>>, ) -> Self

Models to keep resident, as model or model:profile.

pub async fn send(self) -> Result<PoolInfo>

Send the request and start renewing the pool’s lease.

Trait Implementations

impl Clone for PoolCreate

fn clone(&self) -> PoolCreate

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PoolCreate

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.