wgml 0.2.0

Cross-platform GPU LLM inference.
Documentation
1
2
3
4
5
//! LLM transformer implementations for inference.

pub mod gpt2;
pub mod llama2;
pub mod sampler;