Struct OpenAiChatExt 

#[non_exhaustive]
pub struct OpenAiChatExt {
    pub cache_key: Option<String>,
    pub service_tier: Option<ServiceTier>,
}

OpenAI Chat Completions API knobs.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

cache_key: Option<String>

prompt_cache_key — routing key into OpenAI’s auto-cache bucket. Related requests sharing this key land in the same cache shard for higher hit rate. OpenAI-specific (Anthropic per-block cache_control, Gemini cachedContent, and Bedrock cachePoint are different mechanisms with different shapes). Mirrored on OpenAiResponsesExt::cache_key.

service_tier: Option<ServiceTier>

service_tier — cost / latency routing for the request. Flex halves cost in exchange for higher latency, Priority reserves dedicated capacity for SLA-bound workflows, Scale targets sustained high-throughput tenants. OpenAI-specific (no other vendor exposes a comparable per-request routing knob). Mirrored on OpenAiResponsesExt::service_tier.

Implementations

impl OpenAiChatExt

pub fn with_cache_key(self, key: impl Into<String>) -> Self

Set the prompt-cache routing key.

pub const fn with_service_tier(self, tier: ServiceTier) -> Self

Set the service-tier routing.

Trait Implementations

impl Clone for OpenAiChatExt

fn clone(&self) -> OpenAiChatExt

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for OpenAiChatExt

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for OpenAiChatExt

fn default() -> OpenAiChatExt

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for OpenAiChatExt

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for OpenAiChatExt

fn eq(&self, other: &OpenAiChatExt) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for OpenAiChatExt

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Eq for OpenAiChatExt

impl StructuralPartialEq for OpenAiChatExt