modelc 0.1.8

Rust CLI that compiles LLM weights (GGUF, Safetensors, ONNX, PyTorch) into a single .modelc artifact and serves a local OpenAI-compatible inference API with Metal GPU and CPU SIMD acceleration.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14

pub mod gguf;
pub mod onnx;
pub mod pytorch;
pub mod safetensors;

use anyhow::Result;
use std::path::Path;

use crate::model::Model;

pub trait WeightParser: Send + Sync {
    fn parse(&self, path: &Path) -> Result<Model>;
    fn format_name(&self) -> &'static str;
}