pub struct Hint {
pub modality: Option<Modality>,
pub capabilities: Vec<Capability>,
pub execution: ExecutionMode,
pub context_length: Option<i64>,
pub quantization: Option<String>,
}Expand description
A best-effort guess at a model’s shape from its config metadata.
Fields§
§modality: Option<Modality>The guessed modality, if any.
capabilities: Vec<Capability>The guessed capabilities.
execution: ExecutionModeHow the model executes.
context_length: Option<i64>A context-window hint pulled from the config.
quantization: Option<String>The quantization the config names, as 4bit, when it does.
Implementations§
Trait Implementations§
impl StructuralPartialEq for Hint
Auto Trait Implementations§
impl Freeze for Hint
impl RefUnwindSafe for Hint
impl Send for Hint
impl Sync for Hint
impl Unpin for Hint
impl UnsafeUnpin for Hint
impl UnwindSafe for Hint
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more