Struct TokenizationRequest

pub struct TokenizationRequest {
    pub model: String,
    pub prompt: String,
    pub tokens: bool,
    pub token_ids: bool,
}

Fields

model: String

Name of the model tasked with completing the prompt. E.g. luminous-base.

prompt: String

String to tokenize.

tokens: bool

Set this value to true to return text-tokens.

token_ids: bool

Set this value to `true to return numeric token-ids.

Trait Implementations

impl Serialize for TokenizationRequest

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.