Enum PromptField 

pub enum PromptField {
    Single(String),
    Batch(Vec<String>),
}

The prompt field of an OpenAI-compatible completions request.

One string is the shape every runtime accepts; an array asks for several prompts in one request, which lets a prefix-caching server prefill the shared part once. Both llama.cpp and vLLM accept the array form.

Variants

Single(String)

One prompt.

Batch(Vec<String>)

Several prompts, read in one request.

Trait Implementations

impl Debug for PromptField

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Serialize for PromptField

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.