Structs§
- Advanced
Config - Advanced
Server Config - Built
InConfig Path Resolution - Config
Alias Policy - Config
Conditional Disable - Config
Conflict Rule - Config
Control Availability - Config
Control Behavior - Config
Control Condition - Config
Diagnostic - Config
Editor - Config
Numeric Control - Config
Path - Config
Path Alias - Config
Presentation Metadata - Config
Schema - Config
Schema Builder - Config
Setting Schema - Config
Setting Schema Builder - Config
Store - GpuConfig
- Hardware
Config - Local
Serving Node Config - Mesh
Config - Mesh
Requirements Config - Model
Config Defaults - Model
Config Editor - Model
Config Entry - Model
Defaults Editor - Model
FitConfig - Multimodal
Config - Native
Runtime Config - Owner
Control Config - Plugin
Conditional Disable - Plugin
Config Editor - Plugin
Config Entry - Plugin
Config Schema - Plugin
Conflict Rule - Plugin
Control Availability - Plugin
Control Behavior - Plugin
Control Condition - Plugin
Numeric Control - Plugin
Object Property Schema - Plugin
Setting Schema - Plugin
Startup Config - Plugin
Value Schema - Prefix
Cache Config - Request
Defaults Config - Reserved
Object Config - Runtime
Activity Config - Runtime
Config - Skippy
Config - Speculative
Config - Telemetry
Config - Telemetry
Metrics Config - Throughput
Config
Enums§
- Activity
Advertisement - How much admission state is shared with mesh peers.
- Activity
Response - What the runtime does when host activity is detected and policy is enabled.
- Bool
OrAuto - Bool
OrString - Config
Alias Mode - Config
Apply Mode - Config
Condition Operator - Config
Condition Value - Config
Constraint - Config
Control Availability Source - Config
Control Surface - Config
Diagnostic Code - Config
Diagnostic Schema Source - Config
Diagnostic Severity - Config
Diagnostic Source - Config
Disabled Write Policy - Config
Options Source - Config
Path Alias Kind - Config
Path Segment - Config
Restart Scope - Config
Setting Owner - Config
Support State - Config
Text Format - Config
Value Schema - Config
Visibility - Flash
Attention Type - GpuAssignment
- Integer
OrString - Model
Runtime Kind - Plugin
Condition Operator - Plugin
Condition Value - Plugin
Control Availability Source - Plugin
Disabled Write Policy - Plugin
Options Source - Plugin
Schema Availability - Plugin
Setting Constraint - Plugin
Text Format - Plugin
Value Kind - Plugin
WebUi Preference - Reasoning
Budget - Reasoning
Enabled - Runtime
Mode - Top-level runtime operating mode.
- Startup
Failure Policy - How the runtime reacts when a model fails to load during startup.
- String
OrString List - Tensor
Split Config
Constants§
- CANONICAL_
MODEL_ REF_ SEGMENT - CANONICAL_
PLUGIN_ NAME_ SEGMENT - DEFAULT_
DRAIN_ TIMEOUT_ MAX_ SECS - Default maximum drain timeout cap in seconds.
- DEFAULT_
DRAIN_ TIMEOUT_ SECS - Default drain timeout in seconds before a model instance is forcibly unloaded.
- DEFAULT_
MODEL_ TARGET_ DEMAND_ UPGRADE_ MAX_ AGE_ SECS - DEFAULT_
MODEL_ TARGET_ DEMAND_ UPGRADE_ MIN_ REQUESTS - SUPPORTED_
PLUGIN_ CONFIG_ SCHEMA_ VERSION
Functions§
- alias_
diagnostic - built_
in_ config_ schema - built_
in_ config_ schema_ descriptor - built_
in_ config_ settings - built_
in_ support_ diagnostic - canonical_
builtin_ diagnostic_ path - canonicalize_
built_ in_ config_ identifier - canonicalize_
built_ in_ config_ path - config_
path - config_
to_ toml - invalid_
value_ diagnostic - legacy_
validation_ error_ text - load_
config - parse_
config_ toml - rejected_
field_ diagnostic - resolve_
built_ in_ config_ identifier - resolve_
built_ in_ config_ path - unsupported_
field_ diagnostic - validate_
config - validate_
config_ diagnostics - validate_
config_ diagnostics_ with_ plugin_ schemas - validate_
config_ with_ plugin_ schemas