Rust CLI that compiles LLM weights (GGUF, Safetensors, ONNX, PyTorch) into a single .modelc artifact and serves a local OpenAI-compatible inference API with Metal GPU and CPU SIMD acceleration.
//! Tensor runtime and inference ops used by tests and examples (`matmul`, `linear`, etc.).
pubmodgemv;pubmodops;pubmodserve;pubmodtensor;pubmodtransformer;