abyo-speculate 0.5.0

Pure Rust Speculative Decoding library for local LLMs — vanilla SD + Medusa, Qwen2 + Llama, batch-1 optimised
Documentation

abyo-speculate

There is very little structured metadata to build this page from currently. You should check the main library docs, readme, or Cargo.toml in case the author documented the features in them.

This version has 5 feature flags, 0 of them enabled by default.

default

This feature flag does not enable additional features.

accelerate

cuda

metal

mkl

test-util

This feature flag does not enable additional features.