Struct ToolRouterConfig 

pub struct ToolRouterConfig {
    pub enabled: bool,
    pub model_path: Option<String>,
    pub tokenizer_path: Option<String>,
    pub arch: String,
    pub device: CandleDevicePreference,
    pub max_tokens: usize,
    pub temperature: f32,
}

Environment-variable driven configuration for the tool-call router.

Fields

enabled: bool

Whether the router is active. Default: false.

model_path: Option<String>

Filesystem path to the FunctionGemma GGUF model.

tokenizer_path: Option<String>

Filesystem path to the matching tokenizer.json.

arch: String

Architecture hint (default: "gemma3").

device: CandleDevicePreference

Device preference (auto / cpu / cuda).

max_tokens: usize

Max tokens for the FunctionGemma response. FunctionGemma only outputs <tool_call> JSON blocks — 128 is generous.

temperature: f32

Temperature for FunctionGemma sampling.

Implementations

impl ToolRouterConfig

pub fn from_env() -> Self

Build from environment variables.

Variable	Description
CODETETHER_TOOL_ROUTER_ENABLED	true / 1 to activate
CODETETHER_TOOL_ROUTER_MODEL_PATH	Path to .gguf model
CODETETHER_TOOL_ROUTER_TOKENIZER_PATH	Path to tokenizer.json
CODETETHER_TOOL_ROUTER_ARCH	Architecture hint (default: gemma3)
CODETETHER_TOOL_ROUTER_DEVICE	auto / cpu / cuda
CODETETHER_TOOL_ROUTER_MAX_TOKENS	Max decode tokens (default: 512)
CODETETHER_TOOL_ROUTER_TEMPERATURE	Sampling temp (default: 0.1)
CODETETHER_FUNCTIONGEMMA_DISABLED	Emergency kill switch. Defaults to true

Trait Implementations

impl Clone for ToolRouterConfig

fn clone(&self) -> ToolRouterConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ToolRouterConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ToolRouterConfig

fn default() -> Self

Returns the “default value” for a type.