pub struct EndpointDeclaration {
pub protocol: EndpointProtocol,
pub server_metrics: Option<ServerMetricsEndpointRequirement>,
pub prefix_cache_reset: Option<HttpActionSpec>,
pub prefix_cache_conditioning: Option<HttpActionSpec>,
pub prompt_cache_read_zero_representation: Option<PromptCacheReadZeroRepresentation>,
}Expand description
The plan-response endpoint capability declaration ([[RFC-0006:C-OPENAI-ENDPOINT-CONTRACT]]): the protocol plus the integration-owned capability members (server metrics, prefix-cache actions, and the cache-read representation). The control plane owns the route paths, so this declaration carries no path values and rejects them as unknown fields.
Fields§
§protocol: EndpointProtocol§server_metrics: Option<ServerMetricsEndpointRequirement>§prefix_cache_reset: Option<HttpActionSpec>§prefix_cache_conditioning: Option<HttpActionSpec>A Gateway-backend conditioning fan-out action: the frontend routes one conditioning request per prefill replica and attention data-parallel rank ([[RFC-0004:C-BENCH-CACHE-STATE]]).
prompt_cache_read_zero_representation: Option<PromptCacheReadZeroRepresentation>Trait Implementations§
Source§impl Clone for EndpointDeclaration
impl Clone for EndpointDeclaration
Source§fn clone(&self) -> EndpointDeclaration
fn clone(&self) -> EndpointDeclaration
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for EndpointDeclaration
impl Debug for EndpointDeclaration
Source§impl<'de> Deserialize<'de> for EndpointDeclaration
impl<'de> Deserialize<'de> for EndpointDeclaration
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for EndpointDeclaration
Source§impl JsonSchema for EndpointDeclaration
impl JsonSchema for EndpointDeclaration
Source§fn schema_id() -> Cow<'static, str>
fn schema_id() -> Cow<'static, str>
Returns a string that uniquely identifies the schema produced by this type. Read more
Source§fn json_schema(generator: &mut SchemaGenerator) -> Schema
fn json_schema(generator: &mut SchemaGenerator) -> Schema
Generates a JSON Schema for this type. Read more
Source§fn inline_schema() -> bool
fn inline_schema() -> bool
Whether JSON Schemas generated for this type should be included directly in parent schemas,
rather than being re-used where possible using the
$ref keyword. Read moreSource§impl PartialEq for EndpointDeclaration
impl PartialEq for EndpointDeclaration
Source§impl Serialize for EndpointDeclaration
impl Serialize for EndpointDeclaration
impl StructuralPartialEq for EndpointDeclaration
Auto Trait Implementations§
impl Freeze for EndpointDeclaration
impl RefUnwindSafe for EndpointDeclaration
impl Send for EndpointDeclaration
impl Sync for EndpointDeclaration
impl Unpin for EndpointDeclaration
impl UnsafeUnpin for EndpointDeclaration
impl UnwindSafe for EndpointDeclaration
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more