Struct ProxyRequestOptions

pub struct ProxyRequestOptions {
    pub model: Option<String>,
    pub provider: Option<String>,
    pub override_url: Option<String>,
    pub api_key: Option<String>,
    pub models: Vec<ModelAndProvider>,
    pub random_choice: Option<bool>,
    pub timeout: Option<Duration>,
    pub retry: Option<RetryOptions>,
    pub metadata: ProxyRequestMetadata,
    pub internal_metadata: ProxyRequestInternalMetadata,
}

Fields

model: Option<String>

Override the model from the request body or select an alias. This can also be set by passing the x-chronicle-model HTTP header.

provider: Option<String>

Choose a specific provider to use. This can also be set by passing the x-chronicle-provider HTTP header.

override_url: Option<String>

Force the provider to use a specific URL instead of its default. This can also be set by passing the x-chronicle-override-url HTTP header.

api_key: Option<String>

An API key to pass to the provider. This can also be set by passing the x-chronicle-provider-api-key HTTP header.

models: Vec<ModelAndProvider>

Supply multiple provider/model choices, which will be tried in order. If this is provided, the model, provider, and api_key fields are ignored. This field can not reference model aliases. This can also be set by passing the x-chronicle-models HTTP header using JSON syntax.

random_choice: Option<bool>

When using models to supply multiple choices, start at a random choice instead of the first one. This can also be set by passing the x-chronicle-random-choice HTTP header.

timeout: Option<Duration>

Customize the proxy’s timeout when waiting for the request. This can also be set by passing the x-chronicle-timeout HTTP header.

retry: Option<RetryOptions>

Customize the retry behavior. This can also be set by passing the x-chronicle-retry HTTP header.

metadata: ProxyRequestMetadata

Metadata to record for the request

internal_metadata: ProxyRequestInternalMetadata

Internal user authentication metadata for the request. This can be useful if you have a different set of internal users and organizations than what gets recorded in metadata.

Implementations

impl ProxyRequestOptions

pub fn merge_request_headers( &mut self, headers: &HeaderMap, ) -> Result<(), Report<Error>>

pub fn merge_from(&mut self, other: &Self)

Merge values from other, when the values in the current object are not set.

Trait Implementations

impl Debug for ProxyRequestOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ProxyRequestOptions

fn default() -> ProxyRequestOptions

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for ProxyRequestOptions

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for ProxyRequestOptions

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.