ferrox-models-0.19.0
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

ferrox-models 0.19.0

Model loaders and decoder stacks for the Ferrox inference engine

Crate
Source
Builds
Feature flags

..
deepseek-r1-distill-qwen-1.5b.expected
deepseek-r1-distill-qwen-1.5b.jinja
deepseek-r1-distill-qwen-1.5b.system.expected
gemma-2-2b-it.expected
gemma-2-2b-it.jinja
gemma-2-2b-it.system.raises
gemma-3-1b-it.expected
gemma-3-1b-it.jinja
gemma-3-1b-it.system.expected
gemma-4-E2B-it.expected
gemma-4-E2B-it.jinja
gemma-4-E2B-it.system.expected
llama-3.1-8b-instruct.expected
llama-3.1-8b-instruct.jinja
llama-3.1-8b-instruct.system.expected
llama-3.2-1b-instruct.expected
llama-3.2-1b-instruct.jinja
llama-3.2-1b-instruct.system.expected
mistral-7b-instruct-v0.2.expected
mistral-7b-instruct-v0.2.jinja
mistral-7b-instruct-v0.2.system.raises
phi-3-mini-4k-instruct.expected
phi-3-mini-4k-instruct.jinja
phi-3-mini-4k-instruct.system.expected
phi-4-mini-instruct.expected
phi-4-mini-instruct.jinja
phi-4-mini-instruct.system.expected
qwen1.5-moe-a2.7b-chat.expected
qwen1.5-moe-a2.7b-chat.jinja
qwen1.5-moe-a2.7b-chat.system.expected
qwen2.5-instruct.expected
qwen2.5-instruct.jinja
qwen2.5-instruct.system.expected
qwen3-0.6b.expected
qwen3-0.6b.jinja
qwen3-0.6b.system.expected
smollm2-135m-instruct.expected
smollm2-135m-instruct.jinja
smollm2-135m-instruct.system.expected
tinyllama-1.1b-chat.expected
tinyllama-1.1b-chat.jinja
tinyllama-1.1b-chat.system.expected
yi-1.5-6b-chat.expected
yi-1.5-6b-chat.jinja
yi-1.5-6b-chat.system.expected

<|system|>Answer with one word.<|end|><|user|>What is the capital of France?<|end|><|assistant|>