llama-sampling 0.1.0

Sampling strategies for llama.rs — temperature, top-k/p, repetition penalty
Documentation
  • Coverage
  • 45.45%
    10 out of 22 items documented0 out of 8 items with examples
  • Size
  • Source code size: 13.49 kB This is the summed size of all the files inside the crates.io package for this release.
  • Documentation size: 2.37 MB This is the summed size of all files generated by rustdoc for all configured targets
  • Ø build duration
  • this release: 14s Average build duration of successful builds.
  • all releases: 13s Average build duration of successful builds in releases after 2024-10-23.
  • Links
  • stevedores-org/llama.rs
    1 0 0
  • crates.io
  • Dependencies
  • Versions
  • Owners
  • community-stevedores-org

llama-sampling

Sampling and decoding strategies for llama.rs. Implements greedy, temperature, top-k, top-p, and repetition penalty sampling with deterministic seeded RNG for reproducible test runs.