pub enum AdmissionRejection {
PromptExceedsContext {
prompt_positions: u64,
maximum_positions: u64,
},
OutputHeadroomExceedsContext {
prompt_positions: u64,
output_tokens: u64,
maximum_positions: u64,
},
MemoryBudgetExceeded {
required_bytes: u64,
budget_bytes: u64,
},
InsufficientAvailableMemory {
required_bytes: u64,
available_bytes: u64,
},
AvailableMemoryUnavailable {
reason: String,
},
EstimationUnsupported {
reason: String,
},
}Expand description
Structured reason a request was rejected before generation.
Variants§
PromptExceedsContext
Prompt alone exceeds configured context.
OutputHeadroomExceedsContext
Prompt fits but output allowance does not.
Fields
MemoryBudgetExceeded
Application budget is smaller than modeled state plus reserve.
InsufficientAvailableMemory
Current availability is smaller than modeled state plus reserve.
Fields
A requested availability check could not be performed.
EstimationUnsupported
Policy requires estimator coverage the model cannot provide.
Trait Implementations§
Source§impl Clone for AdmissionRejection
impl Clone for AdmissionRejection
Source§fn clone(&self) -> AdmissionRejection
fn clone(&self) -> AdmissionRejection
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for AdmissionRejection
impl Debug for AdmissionRejection
Source§impl<'de> Deserialize<'de> for AdmissionRejection
impl<'de> Deserialize<'de> for AdmissionRejection
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for AdmissionRejection
Source§impl PartialEq for AdmissionRejection
impl PartialEq for AdmissionRejection
Source§impl Serialize for AdmissionRejection
impl Serialize for AdmissionRejection
impl StructuralPartialEq for AdmissionRejection
Auto Trait Implementations§
impl Freeze for AdmissionRejection
impl RefUnwindSafe for AdmissionRejection
impl Send for AdmissionRejection
impl Sync for AdmissionRejection
impl Unpin for AdmissionRejection
impl UnsafeUnpin for AdmissionRejection
impl UnwindSafe for AdmissionRejection
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more