pub struct Edit<'a> {
pub input: Cow<'a, str>,
pub instruction: Cow<'a, str>,
pub temperature: f32,
pub top_p: f32,
}
Expand description
Given a prompt and an instruction, the model will return an edited version of the prompt.
Fields§
§input: Cow<'a, str>
The input text to use as a starting point for the edit.
instruction: Cow<'a, str>
The instruction that tells the model how to edit the prompt.
temperature: f32
What sampling temperature to use. Higher values means the model will take more risks. Try 0.9 for more creative applications, and 0 (argmax sampling) for ones with a well-defined answer. We generally recommend altering this or top_p but not both.
top_p: f32
An alternative to sampling with temperature, called nucleus sampling, where the model considers the results of the tokens with top_p probability mass. So 0.1 means only the tokens comprising the top 10% probability mass are considered. We generally recommend altering this or temperature but not both.