Struct NullEngine 

pub struct NullEngine {
    pub eos: Token,
    pub vocab: usize,
}

A trivial engine that emits EOS immediately after prefill. Lets you exercise the full session lifecycle without the Candle adapter (ADR-002 is the real engine). Not for production inference.

Fields

eos: Token

vocab: usize

Implementations

impl NullEngine

pub fn new(eos: Token, vocab: usize) -> Self

Trait Implementations

impl InferenceEngine for NullEngine

fn prefill(&mut self, tokens: &[Token]) -> Result<u32>

Encode the (compressed) prompt; returns the resulting KV length.

fn next_logits(&mut self, _committed: &[Token]) -> Vec<i32>

Produce next-token logits given the committed context.

fn eos_token(&self) -> Token

The end-of-sequence token id.