Skip to main content

Module sampling

Module sampling 

Source
Expand description

Safe wrapper around llama_sampler.

Structs§

LlamaSampler
A safe wrapper around llama_sampler.
LlamaSamplerParams

Enums§

SamplerInitError
Why a sampler could not be constructed.

Constants§

DRY_MAX_BREAKER_LEN
Longest DRY sequence breaker llama.cpp keeps; it truncates anything longer.
DRY_MAX_SEQ_BREAKERS
Most distinct DRY sequence breakers llama.cpp will process.