pub struct ModelProfile {
pub profile_key: String,
pub context_window_tokens: u32,
}Expand description
Provider-neutral limits for one frozen logical model route.
profile_key is opaque to Runtime. Implementations must change it whenever the concrete
model, tokenizer, or another input-serialization detail changes.
Fields§
§profile_key: StringOpaque stable identity of the frozen model and tokenizer route.
context_window_tokens: u32Maximum total context accepted by the concrete model.
Trait Implementations§
Source§impl Clone for ModelProfile
impl Clone for ModelProfile
Source§fn clone(&self) -> ModelProfile
fn clone(&self) -> ModelProfile
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ModelProfile
impl Debug for ModelProfile
Source§impl<'de> Deserialize<'de> for ModelProfile
impl<'de> Deserialize<'de> for ModelProfile
Source§fn deserialize<__D>(
__deserializer: __D,
) -> Result<ModelProfile, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(
__deserializer: __D,
) -> Result<ModelProfile, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for ModelProfile
Source§impl PartialEq for ModelProfile
impl PartialEq for ModelProfile
Source§impl Serialize for ModelProfile
impl Serialize for ModelProfile
Source§fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
Serialize this value into the given Serde serializer. Read more
impl StructuralPartialEq for ModelProfile
Auto Trait Implementations§
impl Freeze for ModelProfile
impl RefUnwindSafe for ModelProfile
impl Send for ModelProfile
impl Sync for ModelProfile
impl Unpin for ModelProfile
impl UnsafeUnpin for ModelProfile
impl UnwindSafe for ModelProfile
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more