Struct TogetherOptions 

#[non_exhaustive]
pub struct TogetherOptions {
    pub shared: TogetherShared,
}

Together AI’s request options.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

shared: TogetherShared

The fields every route takes.

Implementations

impl TogetherOptions

pub fn new() -> Self

No option set.

pub fn chat_template_kwarg(self, key: impl Into<String>, value: Value) -> Self

Pass key, value to the model’s chat template.

pub fn top_k(self, k: i32) -> Self

Sample from the k most likely tokens.

pub fn min_p(self, p: f64) -> Self

Set the minimum relative token probability.

pub fn repetition_penalty(self, penalty: f64) -> Self

Set the repetition penalty.

pub fn safety_model(self, model: impl Into<String>) -> Self

Screen the request with moderation model model.

Trait Implementations

impl Clone for TogetherOptions

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TogetherOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for TogetherOptions

fn default() -> Self

Returns the “default value” for a type.

impl ExtensionOptions for TogetherOptions

type Ext = TogetherExt

The provider these options are for: the entry ProviderOptions::set stores them under. A type that serves as the Options of several providers names one of them here, and is stored for the others with ProviderOptions::with.

fn unsupported( &self, target: &dyn ReplayTarget, request: &CompletionRequest, ) -> Vec<(&'static str, String)>

The fields target cannot send for request, each a top-level body key with the reason. Each one set is reported through the request’s OnUnsupported policy under the name "<provider>.<section>.<field>". It must not call options::param, which reads it. By default every field is sent.

impl PartialEq for TogetherOptions

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for TogetherOptions

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for TogetherOptions