pub struct PlanRuntimePrefillAuthority { /* private fields */ }Expand description
Exact executor-owned authority advanced by one prefill completion.
Implementations§
Source§impl PlanRuntimePrefillAuthority
impl PlanRuntimePrefillAuthority
pub fn request_id(&self) -> &RequestId
pub const fn committed_tokens(&self) -> usize
pub fn kv_cache(&self) -> &Arc<dyn KvCacheHandle> ⓘ
pub fn into_cache(self) -> Arc<dyn KvCacheHandle> ⓘ
Trait Implementations§
Auto Trait Implementations§
impl !RefUnwindSafe for PlanRuntimePrefillAuthority
impl !UnwindSafe for PlanRuntimePrefillAuthority
impl Freeze for PlanRuntimePrefillAuthority
impl Send for PlanRuntimePrefillAuthority
impl Sync for PlanRuntimePrefillAuthority
impl Unpin for PlanRuntimePrefillAuthority
impl UnsafeUnpin for PlanRuntimePrefillAuthority
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more