Skip to main content

ExecutorConfig

ferrum_interfaces::model_executor

Struct ExecutorConfig

pub struct ExecutorConfig {
    pub model_info: ModelInfo,
    pub device: Device,
    pub dtype: DataType,
    pub max_batch_size: usize,
    pub max_sequence_length: usize,
    pub attention_config: ExecutorAttentionConfig,
    pub memory_config: ExecutorMemoryConfig,
    pub optimization_config: OptimizationConfig,
    pub executor_options: HashMap<String, Value>,
}

Expand description

Executor configuration

Fields§

§model_info: ModelInfo

Model information

§device: Device

Target device

§dtype: DataType

Data type for computation

§max_batch_size: usize

Maximum batch size

§max_sequence_length: usize

Maximum sequence length

§attention_config: ExecutorAttentionConfig

Attention configuration

§memory_config: ExecutorMemoryConfig

Memory configuration

§optimization_config: OptimizationConfig

Optimization settings

§executor_options: HashMap<String, Value>

Additional executor-specific options

Trait Implementations§

impl Clone for ExecutorConfig

fn clone(&self) -> ExecutorConfig

Returns a duplicate of the value. Read more

1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more

impl Debug for ExecutorConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

impl<'de> Deserialize<'de> for ExecutorConfig

fn deserialize<D>(deserializer: D) -> Result<Self, D::Error>
where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer. Read more

impl Serialize for ExecutorConfig

fn serialize<S>(&self, serializer: S) -> Result<S::Ok, S::Error>
where S: Serializer,

Serialize this value into the given Serde serializer. Read more

Auto Trait Implementations§

impl Freeze for ExecutorConfig

impl RefUnwindSafe for ExecutorConfig

impl Send for ExecutorConfig

impl Sync for ExecutorConfig

impl Unpin for ExecutorConfig

impl UnsafeUnpin for ExecutorConfig

impl UnwindSafe for ExecutorConfig

Blanket Implementations§

impl<T> Any for T
where T: 'static + ?Sized,

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more

impl<T> Borrow<T> for T
where T: ?Sized,

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more

impl<T> BorrowMut<T> for T
where T: ?Sized,

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more

impl<T> CloneToUninit for T
where T: Clone,

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)

Performs copy-assignment from self to dest. Read more

impl<T> From<T> for T

fn from(t: T) -> T

Returns the argument unchanged.

impl<T, U> Into<U> for T
where U: From<T>,

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

impl<T> ToOwned for T
where T: Clone,

type Owned = T

The resulting type after obtaining ownership.

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more

impl<T, U> TryFrom<U> for T
where U: Into<T>,

type Error = Infallible

The type returned in the event of a conversion error.

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

fn vzip(self) -> V

impl<T> DeserializeOwned for T
where T: for<'de> Deserialize<'de>,