Struct ChatSisoRequest

pub struct ChatSisoRequest {
    pub system_prompt: String,
    pub user_prompt: String,
    pub model_params: ChatModelParams,
}

A SISO (single input, single output) request for the OpenAI Chat API.

Refer to the Orchestrator for usage.

Fields

system_prompt: String

user_prompt: String

model_params: ChatModelParams

Implementations

impl ChatSisoRequest

pub fn new( system_prompt: String, user_prompt: String, model_params: ChatModelParams, ) -> Self

Trait Implementations

impl Clone for ChatSisoRequest

fn clone(&self) -> ChatSisoRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl OrchRequest for ChatSisoRequest

type Res = ChatSisoResponse

The type of response returned by the request.

fn send<'life0, 'async_trait>( &'life0 self, policies: Policies, keys: Keys, id: u64, ) -> Pin<Box<dyn Future<Output = Result<Self::Res>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Business logic of a request. Given the policies, keys, and request ID (for debugging, send the request and return the response.