vil_speculative 0.2.2

VIL Speculative Decoding Proxy — draft+verify for 2-3x faster LLM generation

Coverage
37.5%
27 out of 72 items documented0 out of 29 items with examples
Size
Source code size: 120.25 kB This is the summed size of all the files inside the crates.io package for this release.
Documentation size: 2.16 MB This is the summed size of all files generated by rustdoc for all configured targets
Ø build duration
this release: 4m 7s Average build duration of successful builds.
all releases: 2m 33s Average build duration of successful builds in releases after 2024-10-23.
Links
Homepage
Documentation
OceanOS-id/VIL
3 1 0
crates.io
Dependencies
Versions
Owners

vil_speculative

VIL Speculative Decoding Proxy — draft+verify for 2-3x faster LLM generation

This crate is part of VIL — a process-oriented language and framework for building zero-copy, high-performance distributed systems.

Licensed under either of Apache License 2.0 or MIT License.