Module generation 

Backend-neutral causal-model and token-sampling contracts. Backend-neutral causal-model and token-sampling contracts.

Structs

ConstrainedSampler

Grammar-aware wrapper around a backend-neutral sampling policy.

DefaultSampler

Stateless greedy/categorical sampler.

GenerationSampler

Configurable backend-neutral text sampler.

MirostatV2Sampler

Adaptive Mirostat V2 policy with backend-neutral state.

PenaltyConfig

Backend-neutral repetition/frequency/presence controls.

TokenDomain

Portable cardinality of one zero-based token-id domain.

Enums

SamplingConfigurationError

Invalid backend-neutral sampling configuration.

Traits

CausalModel

Monomorphized causal model used by generation sessions.

Sampler

Strategy for choosing a token from model logits.

SamplingBackend

Backend primitives required by generic token-sampling policies.

SpeculativeSampler

Sampling policy suitable for lossless speculative decoding.