Skip to main content

EngineSnapshot

Struct EngineSnapshot 

Source
pub struct EngineSnapshot {
Show 13 fields pub magic: [u8; 8], pub version: u32, pub arch_id: String, pub model_path: String, pub tokenizer_path: Option<String>, pub model_fingerprint: ModelFingerprint, pub tokens: Vec<u32>, pub sequence_state: SequenceStatePayload, pub sampler_state: SamplerStatePayload, pub grammar_state: Option<GrammarStatePayload>, pub max_context_length: usize, pub num_threads: usize, pub prefill_chunk_size: usize,
}
Expand description

The complete engine snapshot — opaque to callers outside this module.

Callers should treat the serialized form as opaque bytes: construct via InferenceEngine::snapshot(), persist however is appropriate, then pass the bytes to InferenceEngine::resume().

Fields§

§magic: [u8; 8]

Magic bytes: must equal SNAPSHOT_MAGIC.

§version: u32

Format version. Current: EngineSnapshot::VERSION.

§arch_id: String

Architecture identifier (e.g. "llama", "qwen3", …).

§model_path: String

Absolute path to the model file at snapshot time.

§tokenizer_path: Option<String>

Optional explicit tokenizer path (None = auto-detect).

§model_fingerprint: ModelFingerprint

Bounded fingerprint of the model file.

§tokens: Vec<u32>

All token IDs processed so far (prompt + generated).

§sequence_state: SequenceStatePayload

Sequence / KV state at snapshot time.

§sampler_state: SamplerStatePayload

Sampler state at snapshot time.

§grammar_state: Option<GrammarStatePayload>

Optional grammar state (None when no grammar is configured).

§max_context_length: usize

Maximum context length the engine was configured with.

§num_threads: usize

Number of parallel inference threads.

§prefill_chunk_size: usize

Prefill chunk size.

Implementations§

Source§

impl EngineSnapshot

Source

pub const VERSION: u32 = 1

Current snapshot format version.

Source

pub fn serialize(&self) -> RuntimeResult<Vec<u8>>

Serialize this snapshot to bytes using oxicode.

Source

pub fn deserialize(bytes: &[u8]) -> RuntimeResult<Self>

Deserialize a snapshot from bytes.

Returns SnapshotIncompatible if the bytes cannot be decoded, the magic is wrong, or the version is not supported.

Trait Implementations§

Source§

impl Clone for EngineSnapshot

Source§

fn clone(&self) -> EngineSnapshot

Returns a duplicate of the value. Read more
1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for EngineSnapshot

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Decode for EngineSnapshot

Source§

fn decode<__D: Decoder<Context = ()>>(decoder: &mut __D) -> Result<Self, Error>

Decode a value from the given decoder
Source§

impl Encode for EngineSnapshot

Source§

fn encode<__E: Encoder>(&self, encoder: &mut __E) -> Result<(), Error>

Encode this value into the given encoder

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more