Struct OpenAiFederation 

pub struct OpenAiFederation { /* private fields */ }

Registry of remote gateways reachable for federated inference, keyed by address.

Implementations

impl OpenAiFederation

pub fn new() -> Self

Returns an empty federation registry.

pub fn insert_gateway( &self, address: impl AsRef<str>, default_model: impl Into<String>, fabric: EvalFabricRef, ) -> Result<()>

Registers a remote gateway under its normalized address.

pub fn infer( &self, cx: &mut Cx, address: &str, request: &ModelRequest, policy: &OpenAiFederationPolicy, ) -> Result<ModelResponse>

Runs request against the federated gateway at address and returns its response.

Requires the federation capability, encodes the request (with policy) as a /v1/responses body, realizes it through the gateway’s eval fabric, and decodes the reply; errors if the gateway is unknown, denies the capability, or returns a non-200 / non-response value.

Trait Implementations

impl Clone for OpenAiFederation

fn clone(&self) -> OpenAiFederation

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Default for OpenAiFederation

fn default() -> OpenAiFederation

Returns the “default value” for a type.