Struct CohereOptions 

#[non_exhaustive]
pub struct CohereOptions {
    pub shared: CohereShared,
    pub chat: CohereNative,
}

Cohere’s request options.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

shared: CohereShared

The fields both routes read.

chat: CohereNative

The fields only the native chat API reads.

Implementations

impl CohereOptions

pub fn frequency_penalty(self, penalty: f64) -> Self

Penalize tokens by how often they appeared (frequency_penalty, 0.0 to 1.0).

pub fn presence_penalty(self, penalty: f64) -> Self

Penalize tokens that appeared at all (presence_penalty, 0.0 to 1.0).

pub fn citation_mode(self, mode: CitationMode) -> Self

How the native API cites the documents (citation_options.mode).

pub fn safety_mode(self, mode: SafetyMode) -> Self

The safety instruction the native API adds (safety_mode).

pub fn priority(self, priority: u32) -> Self

The request’s queue priority on the native API (priority): lower is served first, and 0 is the default.

pub fn top_k(self, top_k: u32) -> Self

Sample from the top_k most likely tokens on the native API (k, 0 to 500).

pub fn logprobs(self, logprobs: bool) -> Self

Return each generated token’s log probability on the native API (logprobs), read back as CohereExtras::logprobs.

Trait Implementations

impl Clone for CohereOptions

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CohereOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for CohereOptions

fn default() -> Self

Returns the “default value” for a type.

impl ExtensionOptions for CohereOptions

type Ext = CohereExt

The provider these options are for: the entry ProviderOptions::set stores them under. A type that serves as the Options of several providers names one of them here, and is stored for the others with ProviderOptions::with.

fn unsupported( &self, target: &dyn ReplayTarget, request: &CompletionRequest, ) -> Vec<(&'static str, String)>

The fields target cannot send for request, each a top-level body key with the reason. Each one set is reported through the request’s OnUnsupported policy under the name "<provider>.<section>.<field>". It must not call options::param, which reads it. By default every field is sent.

impl PartialEq for CohereOptions

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for CohereOptions

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for CohereOptions