pub struct InferenceSessionConfig {
pub memory_k_type: ModelKVMemoryType,
pub memory_v_type: ModelKVMemoryType,
}
Expand description
Configuration for an inference session.
This is specified at the time of creation of an InferenceSession, and cannot be changed after the session has been created.
Fields§
§memory_k_type: ModelKVMemoryType
The type of the memory K tensor.
memory_v_type: ModelKVMemoryType
The type of the memory V tensor.
Trait Implementations§
Source§impl Clone for InferenceSessionConfig
impl Clone for InferenceSessionConfig
Source§fn clone(&self) -> InferenceSessionConfig
fn clone(&self) -> InferenceSessionConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§const fn clone_from(&mut self, source: &Self)
const fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source
. Read moreSource§impl Debug for InferenceSessionConfig
impl Debug for InferenceSessionConfig
Source§impl Default for InferenceSessionConfig
impl Default for InferenceSessionConfig
Source§impl<'de> Deserialize<'de> for InferenceSessionConfig
impl<'de> Deserialize<'de> for InferenceSessionConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for InferenceSessionConfig
impl PartialEq for InferenceSessionConfig
Source§fn eq(&self, other: &InferenceSessionConfig) -> bool
fn eq(&self, other: &InferenceSessionConfig) -> bool
Tests for
self
and other
values to be equal, and is used by ==
.Source§impl Serialize for InferenceSessionConfig
impl Serialize for InferenceSessionConfig
impl Copy for InferenceSessionConfig
impl Eq for InferenceSessionConfig
impl StructuralPartialEq for InferenceSessionConfig
Auto Trait Implementations§
impl Freeze for InferenceSessionConfig
impl RefUnwindSafe for InferenceSessionConfig
impl Send for InferenceSessionConfig
impl Sync for InferenceSessionConfig
impl Unpin for InferenceSessionConfig
impl UnwindSafe for InferenceSessionConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more