Struct TokensInfo 

#[non_exhaustive]
pub struct TokensInfo {
    pub tokens: Vec<Bytes>,
    pub token_ids: Vec<i64>,
    pub role: String,
    /* private fields */
}

Available on crate feature llm-utility-service only.

Tokens info with a list of tokens and the corresponding list of token ids.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

tokens: Vec<Bytes>

A list of tokens from the input.

token_ids: Vec<i64>

A list of token ids from the input.

role: String

Optional. Optional fields for the role from the corresponding Content.

Implementations

impl TokensInfo

pub fn new() -> Self

pub fn set_tokens<T, V>(self, v: T) -> Self

where T: IntoIterator<Item = V>, V: Into<Bytes>,

Sets the value of tokens.

Example

let b1 = bytes::Bytes::from_static(b"abc");
let b2 = bytes::Bytes::from_static(b"xyz");
let x = TokensInfo::new().set_tokens([b1, b2]);

pub fn set_token_ids<T, V>(self, v: T) -> Self

where T: IntoIterator<Item = V>, V: Into<i64>,

Sets the value of token_ids.

Example

let x = TokensInfo::new().set_token_ids([1, 2, 3]);

pub fn set_role<T: Into<String>>(self, v: T) -> Self

Sets the value of role.

Example

let x = TokensInfo::new().set_role("example");

Trait Implementations

impl Clone for TokensInfo

fn clone(&self) -> TokensInfo

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokensInfo

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for TokensInfo

fn default() -> TokensInfo

Returns the “default value” for a type.

impl Message for TokensInfo

fn typename() -> &'static str

The typename of this message.

impl PartialEq for TokensInfo

fn eq(&self, other: &TokensInfo) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for TokensInfo