pub struct QoSRequirements {
pub max_latency: Option<Duration>,
pub min_throughput: Option<u32>,
pub privacy: PrivacyLevel,
pub prefer_gpu: bool,
pub cost_tolerance: u8,
}Expand description
Quality of Service requirements
Fields§
§max_latency: Option<Duration>Maximum acceptable latency
min_throughput: Option<u32>Minimum throughput (tokens/sec)
privacy: PrivacyLevelPrivacy level required
prefer_gpu: boolPrefer GPU acceleration
cost_tolerance: u8Cost tier (0 = cheapest, 100 = fastest)
Trait Implementations§
Source§impl Clone for QoSRequirements
impl Clone for QoSRequirements
Source§fn clone(&self) -> QoSRequirements
fn clone(&self) -> QoSRequirements
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for QoSRequirements
impl Debug for QoSRequirements
Auto Trait Implementations§
impl Freeze for QoSRequirements
impl RefUnwindSafe for QoSRequirements
impl Send for QoSRequirements
impl Sync for QoSRequirements
impl Unpin for QoSRequirements
impl UnwindSafe for QoSRequirements
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more