Struct InferenceConfig 

pub struct InferenceConfig {
    pub temperature: Option<f32>,
    pub max_output_tokens: Option<usize>,
    pub extra_params: Map<String, Value>,
    pub batch_tool_hint: bool,
    pub request_timeout_secs: Option<u64>,
}

Per-stage inference configuration overrides.

Set on the agent entity before each stage to override default inference parameters like temperature and max output tokens. When absent, defaults are used (temperature 0.7, max output 4096).

Fields

temperature: Option<f32>

Temperature override. If None, uses 0.7 (or 0.0 if model doesn’t support it).

max_output_tokens: Option<usize>

Max output tokens override. If None, caps at model’s max_output_tokens capability.

extra_params: Map<String, Value>

Extra provider parameters from [stages.<name>.model.parameters] beyond temperature/max_output_tokens (e.g. top_p, stop, seed, frequency_penalty). Passed through to the provider request so models can be tuned from the manifest. Empty when none are set.

batch_tool_hint: bool

Whether to prepend the batch-tool-calls hint to this stage’s system prompt. Resolved from the global config → agent → stage cascade at spawn (see leviath_core::taint::resolve_batch_tool_hint); false by default so an unset config is a no-op.

request_timeout_secs: Option<u64>

Per-stage cap on the wall-clock time (in seconds) one inference for this stage may run (the whole call including retries). Sourced from [stages.<name>.model] request_timeout_secs. When Some, it overrides the default inference job timeout at dispatch; when None, the default applies.

Trait Implementations

impl Clone for InferenceConfig

fn clone(&self) -> InferenceConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Component for InferenceConfig

where Self: Send + Sync + 'static,

const STORAGE_TYPE: StorageType = bevy_ecs::component::StorageType::Table

A constant indicating the storage type used for this component.

type Mutability = Mutable

A marker type to assist Bevy with determining if this component is mutable, or immutable. Mutable components will have Component<Mutability = Mutable>, while immutable components will instead have Component<Mutability = Immutable>.

fn register_required_components( _requiree: ComponentId, required_components: &mut RequiredComponentsRegistrator<'_, '_>, )

Registers required components.

fn clone_behavior() -> ComponentCloneBehavior

Called when registering this component, allowing to override clone function (or disable cloning altogether) for this component.

fn relationship_accessor() -> Option<ComponentRelationshipAccessor<Self>>

Returns ComponentRelationshipAccessor required for working with relationships in dynamic contexts.

fn on_add() -> Option<for<'w> fn(DeferredWorld<'w>, HookContext)>

Gets the on_add ComponentHook for this Component if one is defined.

fn on_insert() -> Option<for<'w> fn(DeferredWorld<'w>, HookContext)>

Gets the on_insert ComponentHook for this Component if one is defined.

fn on_discard() -> Option<for<'w> fn(DeferredWorld<'w>, HookContext)>

Gets the on_discard ComponentHook for this Component if one is defined.

fn on_remove() -> Option<for<'w> fn(DeferredWorld<'w>, HookContext)>

Gets the on_remove ComponentHook for this Component if one is defined.

fn on_despawn() -> Option<for<'w> fn(DeferredWorld<'w>, HookContext)>

Gets the on_despawn ComponentHook for this Component if one is defined.

fn map_entities<E>(_this: &mut Self, _mapper: &mut E)

where E: EntityMapper,

Maps the entities on this component using the given EntityMapper. This is used to remap entities in contexts like scenes and entity cloning. When deriving Component, this is populated by annotating fields containing entities with #[entities]

impl Debug for InferenceConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for InferenceConfig

fn default() -> InferenceConfig

Returns the “default value” for a type.