flint-ai-0.1.0 has been yanked.
flint-ai
A lightweight local AI runtime. Drop it into any Rust app and run AI inference locally. No internet, no API keys, no cloud.
Install
cargo add flint-ai
Quick start
let ai = LocalAI::new("TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF"); let response = ai.chat("hello")?;
Download a model
flint use TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF
License
Flint-AI is source available.
Free for:
- Personal projects
- Open source projects
Paid license required for:
- Commercial products or services
- Internal use at any for-profit company
- Production deployments
To purchase a commercial license email contact@brantandco.com or go to flint.brantandco.com
Documentation
Full documentation including API reference, CLI commands, model recommendations, and hardware support is available at: