newt-inference 0.6.2

Newt-Agent inference layer: backend trait + local Ollama/vLLM + provider-plugin host

Coverage
46.15%
30 out of 65 items documented0 out of 48 items with examples
Size
Source code size: 133.6 kB This is the summed size of all the files inside the crates.io package for this release.
Documentation size: 1.6 MB This is the summed size of all files generated by rustdoc for all configured targets
Ø build duration
this release: 16s Average build duration of successful builds.
all releases: 42s Average build duration of successful builds in releases after 2024-10-23.
Links
Homepage
Repository
crates.io
Dependencies
Versions
Owners

Newt-Agent inference layer.

backend::InferenceBackend is the trait every backend implements.
local::LocalOllamaBackend and local::LocalVllmBackend are the only backends compiled into the default Newt binary.
provider_plugin::ProviderPluginBackend spawns a subprocess that speaks the Newt-Provider JSON-RPC protocol — this is how OpenAI, Anthropic, etc. join via opt-in plugin installs.