Struct aleph_alpha_client::TaskCompletion

pub struct TaskCompletion<'a> {
    pub prompt: Prompt<'a>,
    pub maximum_tokens: u32,
    pub sampling: Sampling,
}

Completes a prompt. E.g. continues a text.

Fields

prompt: Prompt<'a>

The prompt (usually text) to be completed. Unconditional completion can be started with an empty string. The prompt may contain a zero shot or few shot task.

maximum_tokens: u32

The maximum number of tokens to be generated. Completion will terminate after the maximum number of tokens is reachedIncrease this value to allow for longer outputs. A text is split into tokens. Usually there are more tokens than words. The total number of tokens of prompt and maximum_tokens depends on the model.

sampling: Sampling

Sampling controls how the tokens (“words”) are selected for the completion.

Trait Implementations

impl Task for TaskCompletion<'_>

type Output = CompletionOutput

Output returned by Client::execute

type ResponseBody = ResponseCompletion

Expected answer of the Aleph Alpha API

fn build_request(&self, client: &Client, base: &str, model: &str) -> RequestBuilder

Prepare the request for the Aleph Alpha API. Authentication headers can be assumed to be already set.

fn body_to_output(&self, response: Self::ResponseBody) -> Self::Output

Parses the response of the server into higher level structs for the user.