Enum SpeedTier 

#[non_exhaustive]
pub enum SpeedTier {
    Standard,
    Fast,
}

Inference speed tier — the “pay a premium for lower latency” knob.

Providers expose this under different names for different mechanisms, so only the shared economics are modelled here: Self::Fast costs more per token and is expected to return sooner.

• Anthropic calls it fast mode (speed: "fast"): the same model weights on a faster inference configuration, up to 2.5x the output tokens per second. Supported only on Opus 5 and Opus 4.8.
• OpenAI calls it priority processing (service_tier: "priority"): queue priority for lower, more consistent latency.

Neither mechanism changes model behaviour or capabilities. Because both providers can serve a premium request at standard speed — and bill it at standard rates — a requested tier is not a guarantee; see LlmProvider::validate_speed_tier for how unsupported combinations are rejected up front.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

Standard

The provider’s normal inference path at standard pricing.

Fast

The provider’s premium low-latency path at premium pricing.

Implementations

impl SpeedTier

pub const fn is_premium(self) -> bool

Whether this tier asks for the premium low-latency path.

Prefer this over matching on the variant so that a future intermediate tier does not silently read as standard at every call site.

pub const fn same(self, other: Self) -> bool

const-callable equality, since PartialEq::eq is not const.

Trait Implementations

impl Clone for SpeedTier

fn clone(&self) -> SpeedTier

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for SpeedTier

impl Debug for SpeedTier

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SpeedTier

fn default() -> SpeedTier

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for SpeedTier

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for SpeedTier

impl PartialEq for SpeedTier

fn eq(&self, other: &SpeedTier) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for SpeedTier

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for SpeedTier