Skip to main content

Crate roder_inference

Crate roder_inference 

Source

Structs§

AgentInferenceRequest
CompactionProgress
CompletionMetadata
HostedToolCallCompleted
HostedToolCallStarted
HostedWebSearchConfig
InferenceCapabilities
InferenceFailure
InferenceProviderContext
InferenceProviderMetadata
InferenceTurnContext
InstructionBundle
MessageDelta
ModelDescriptor
ModelHarnessProfile
ModelProfileReasoning
ModelSelection
OutputConfig
ReasoningConfig
ReasoningDelta
ReasoningEffortDescriptor
RuntimeHints
SpeedPolicyDecision
TokenUsage
ToolCallCompleted
ToolCallDelta
ToolCallStarted
ToolSearchConfig
ToolSearchConfigOverlay
TurnToolOutcome
Result of executing one tool call via TurnToolExecutor.

Enums§

EffectiveToolSearchMode
HostedWebSearchMode
InferenceEvent
ModelInstructionOverlay
ModelSchemaPolicy
ProviderAuthType
ProviderFamily
RuntimeProfile
SpeedPolicyPhase
ToolSearchMode
ToolSearchModeError
ToolSearchProviderVariant

Traits§

InferenceEngine
TurnToolExecutor
Executes a single tool call through the runtime’s registry + policy. Implemented by the runtime; used by providers that run their own in-stream agent loop.

Functions§

cache_hit_rate
finish_reason_from_stop_reason
Canonical mapping from provider-native stop reasons to the finish reason surfaced as finishReason on turn/completed. Only the terminal inference step’s stop reason reaches the turn surface, so toolUse appears only when a turn genuinely ends on a tool-use step (e.g. tool rounds exhausted). Unknown stop reasons pass through unchanged.
provider_supports_streaming
provider_supports_tools

Type Aliases§

InferenceEventStream