Struct TaskTokenization

pub struct TaskTokenization<'a> {
    pub prompt: &'a str,
    pub tokens: bool,
    pub token_ids: bool,
}

Input for a crate::Client::tokenize request.

Fields

prompt: &'a str

The text prompt which should be converted into tokens

tokens: bool

Specify true to return text-tokens.

token_ids: bool

Specify true to return numeric token-ids.

Implementations

impl TaskTokenization<'_>

pub fn new(prompt: &str, tokens: bool, token_ids: bool) -> TaskTokenization<'_>

Trait Implementations

impl<'a> From<&'a str> for TaskTokenization<'a>

fn from(prompt: &str) -> TaskTokenization<'_>

Converts to this type from the input type.

impl Task for TaskTokenization<'_>

type Output = TokenizationOutput

Output returned by crate::Client::output_of

type ResponseBody = ResponseTokenization

Expected answer of the Aleph Alpha API

fn build_request( &self, client: &Client, base: &str, model: &str, ) -> RequestBuilder

Prepare the request for the Aleph Alpha API. Authentication headers can be assumed to be already set.

fn body_to_output(&self, response: Self::ResponseBody) -> Self::Output

Parses the response of the server into higher level structs for the user.

fn with_model<'a>(&'a self, model: &'a str) -> MethodJob<'a, Self>

where Self: Sized,

Turn your task into Job by annotating it with a model name.