Struct BatchRequest 

pub struct BatchRequest {
    pub prompt: String,
    pub config: Option<GenerationConfig>,
    pub id: Option<String>,
}

A single request in a batch generation operation

Fields

prompt: String

The prompt to generate text for

config: Option<GenerationConfig>

Optional configuration (uses default if None)

id: Option<String>

Optional identifier for tracking this request

Implementations

impl BatchRequest

pub fn new(prompt: impl Into<String>) -> Self

Create a new batch request with a prompt

pub fn with_config(prompt: impl Into<String>, config: GenerationConfig) -> Self

Create a new batch request with prompt and config

pub fn with_id(self, id: impl Into<String>) -> Self

Set an identifier for this request

Trait Implementations

impl Clone for BatchRequest

fn clone(&self) -> BatchRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for BatchRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.