Enum Params 

pub enum Params {
    Chat {
        request: Arc<ChatCompletionCreateParams>,
    },
    Vector {
        request: Arc<VectorCompletionCreateParams>,
        vector_pfx_indices: Arc<Vec<(String, usize)>>,
    },
}

Parameters for an upstream completion request.

Variants

Chat

Parameters for a chat completion request.

Fields

request: Arc<ChatCompletionCreateParams>

The chat completion request.

Vector

Parameters for a chat completion used to collect an LLM vote for vector completions.

Fields

request: Arc<VectorCompletionCreateParams>

The vector completion request.

vector_pfx_indices: Arc<Vec<(String, usize)>>

Maps prefix keys shown to the LLM (e.g., “A”) to response indices in the original request.

Trait Implementations

impl Clone for Params

fn clone(&self) -> Params

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Params

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.