Skip to main content

Module inference

Module inference 

Source
Expand description

Native-only governed inference providers, enabled by the native-inference feature. This surface is intentionally unavailable to no-default-features wasm32 builds because its Ollama implementation requires TCP sockets. Governed local inference providers for Traverse.

Structs§

GovernedModelExecutionError
GovernedModelExecutionOutcome
GovernedModelExecutionRequest
OllamaInferenceError
OllamaInferenceEvidence
OllamaInferenceOutput
OllamaInferenceProvider
OllamaInferenceRequest
OllamaModelAvailabilityProbe
OllamaProviderConfig

Enums§

GovernedModelExecutionErrorCode
OllamaInferenceErrorCode

Functions§

execute_governed_ollama_model_dependency
Resolves and executes one app-declared model dependency through Traverse.
resolve_ollama_model_dependency