pub struct EndpointRequirement {
pub protocol: EndpointProtocol,
pub completions_path: String,
pub chat_completions_path: String,
pub server_metrics: Option<ServerMetricsEndpointRequirement>,
pub prefix_cache_reset: Option<HttpActionSpec>,
pub prefix_cache_conditioning: Option<HttpActionSpec>,
pub prompt_cache_read_zero_representation: Option<PromptCacheReadZeroRepresentation>,
}Expand description
The resolved workload endpoint requirement: the accepted declaration plus
the named OpenAI paths. The control plane fills the pinned
/v1/completions and /v1/chat/completions paths at plan acceptance
([[RFC-0006:C-OPENAI-ENDPOINT-CONTRACT]]); resolved evidence and client
inputs preserve both strings exactly.
Fields§
§protocol: EndpointProtocol§completions_path: String§chat_completions_path: String§server_metrics: Option<ServerMetricsEndpointRequirement>§prefix_cache_reset: Option<HttpActionSpec>§prefix_cache_conditioning: Option<HttpActionSpec>A Gateway-backend conditioning fan-out action: the frontend routes one conditioning request per prefill replica and attention data-parallel rank ([[RFC-0004:C-BENCH-CACHE-STATE]]).
prompt_cache_read_zero_representation: Option<PromptCacheReadZeroRepresentation>Trait Implementations§
Source§impl Clone for EndpointRequirement
impl Clone for EndpointRequirement
Source§fn clone(&self) -> EndpointRequirement
fn clone(&self) -> EndpointRequirement
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for EndpointRequirement
impl Debug for EndpointRequirement
Source§impl<'de> Deserialize<'de> for EndpointRequirement
impl<'de> Deserialize<'de> for EndpointRequirement
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for EndpointRequirement
Source§impl JsonSchema for EndpointRequirement
impl JsonSchema for EndpointRequirement
Source§fn schema_id() -> Cow<'static, str>
fn schema_id() -> Cow<'static, str>
Returns a string that uniquely identifies the schema produced by this type. Read more
Source§fn json_schema(generator: &mut SchemaGenerator) -> Schema
fn json_schema(generator: &mut SchemaGenerator) -> Schema
Generates a JSON Schema for this type. Read more
Source§fn inline_schema() -> bool
fn inline_schema() -> bool
Whether JSON Schemas generated for this type should be included directly in parent schemas,
rather than being re-used where possible using the
$ref keyword. Read moreSource§impl PartialEq for EndpointRequirement
impl PartialEq for EndpointRequirement
Source§impl Serialize for EndpointRequirement
impl Serialize for EndpointRequirement
impl StructuralPartialEq for EndpointRequirement
Auto Trait Implementations§
impl Freeze for EndpointRequirement
impl RefUnwindSafe for EndpointRequirement
impl Send for EndpointRequirement
impl Sync for EndpointRequirement
impl Unpin for EndpointRequirement
impl UnsafeUnpin for EndpointRequirement
impl UnwindSafe for EndpointRequirement
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more