Skip to main content

Module inference

Module inference 

Source

Re-exports§

pub use crate::agent::economics::SessionEconomics;
pub use crate::agent::economics::ToolRecord;

Structs§

ChatMessage
OpenAI-compatible chat message. Content can be a string (legacy) or a Vec of ContentPart (multimodal).
ImageUrlSource
InferenceEngine
TokenUsage
ToolCallFn
ToolCallResponse
ToolDefinition
ToolFunction
ToolMetadata

Enums§

ContentPart
InferenceEvent
McpRuntimeState
MessageContent
OperatorCheckpointState
ProviderRuntimeState
ToolCategory

Functions§

estimate_message_batch_tokens
estimate_prompt_pressure
extract_native_tool_calls
Extract native Gemma-4 <|tool_call|> tags from text. Format: <|tool_call|>call:func_name{key:<|“|>value<|”|>, key2:value2}<tool_call|>
extract_think_block
is_compact_context_window_pub
is_gemma4_model_name
normalize_tool_argument_string
strip_native_tool_call_text
strip_think_blocks
tool_metadata_for_name