pub struct ExecutableCapabilities {
pub clone: bool,
pub moe: bool,
pub persistent_handles: bool,
pub gpu_handles: bool,
pub kv_resident: bool,
pub typed_io: bool,
pub async_pipeline: bool,
pub active_extent: bool,
}Expand description
Advisory feature flags for a compiled executable.
Fields§
§clone: boolcrate::ExecutableGraph::clone_box is implemented (not the default panic).
moe: boolset_moe_resident_experts (and the per-layer form) pin experts on the
device instead of streaming them per token.
This is the half that needs a flag: those setters return (), so a
caller has no other way to learn the backend ignored them. The
instrumentation hooks (enable_moe_topk_capture,
take_moe_residency_stats) return Option/bool and report for
themselves — they are CPU-only and are NOT implied by this flag.
persistent_handles: boolPersistent named handles (bind_handle / read_handle).
gpu_handles: boolGPU-resident input handles (bind_gpu_handle, feeds, …).
kv_resident: boolDevice-resident KV row feed / D2D seed path.
typed_io: boolNative non-F32 set_param_typed / run_typed (not F32-only default).
async_pipeline: boolcommit_no_wait / run_pipelined do real async work.
active_extent: boolset_active_extent is honored for bucketed decode.
Implementations§
Trait Implementations§
Source§impl Clone for ExecutableCapabilities
impl Clone for ExecutableCapabilities
Source§fn clone(&self) -> ExecutableCapabilities
fn clone(&self) -> ExecutableCapabilities
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read moreimpl Copy for ExecutableCapabilities
Source§impl Debug for ExecutableCapabilities
impl Debug for ExecutableCapabilities
Source§impl Default for ExecutableCapabilities
impl Default for ExecutableCapabilities
Source§fn default() -> ExecutableCapabilities
fn default() -> ExecutableCapabilities
impl Eq for ExecutableCapabilities
Source§impl PartialEq for ExecutableCapabilities
impl PartialEq for ExecutableCapabilities
impl StructuralPartialEq for ExecutableCapabilities
Auto Trait Implementations§
impl Freeze for ExecutableCapabilities
impl RefUnwindSafe for ExecutableCapabilities
impl Send for ExecutableCapabilities
impl Sync for ExecutableCapabilities
impl Unpin for ExecutableCapabilities
impl UnsafeUnpin for ExecutableCapabilities
impl UnwindSafe for ExecutableCapabilities
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
key and return true if they are equal.Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more