Struct Objective 

pub struct Objective {
    pub optimize: Optimize,
    pub context: usize,
    pub hop_secs: f64,
    pub kv_bytes_per_layer_token: Option<u64>,
    pub on_unknown_kv: UnknownKv,
    pub kv_dtype: Option<String>,
    pub precision_ladder: Vec<Precision>,
}

Objective plus the constraints that shape it.

Fields

optimize: Optimize

context: usize

Context length the KV cache must hold. The planner reserves KV bytes per node before fitting weights — a plan that fits at seq 8 and OOMs at 128 k is not a plan.

hop_secs: f64

Seconds a network hop adds to the critical path. Only Optimize::Latency uses it; the default is a LAN round trip for a hidden-state relay.

kv_bytes_per_layer_token: Option<u64>

Cache bytes per layer per token, when you know it and the checkpoint cannot be read for it. Overrides inference.

on_unknown_kv: UnknownKv

What to do when the cache size cannot be determined.

kv_dtype: Option<String>

Cache element dtype at plan time (f32 default, f16/bf16, f8).

Mirrors CostOptions::kv_dtype, which applies when the profile is inferred; this one applies when the planner has to synthesize a bound itself. Defaulting to f32 keeps that bound the conservative one.

precision_ladder: Vec<Precision>

Precisions to try, widest first. The planner walks down until the model fits and reports what it settled on, instead of failing with “too big” and leaving you to guess the next step.

Trait Implementations

impl Clone for Objective

fn clone(&self) -> Objective

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Objective

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Objective

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for Objective

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for Objective

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.