pub struct InferenceRequest {
pub prompt: String,
pub system_instruction: Option<String>,
pub structured_output: Option<StructuredOutput>,
pub options: GenerationOptions,
}Expand description
One text-only inference request.
Fields§
§prompt: StringUser prompt.
system_instruction: Option<String>Optional system instruction.
structured_output: Option<StructuredOutput>Optional JSON structured-output contract.
options: GenerationOptionsGeneration controls.
Implementations§
Trait Implementations§
Source§impl Clone for InferenceRequest
impl Clone for InferenceRequest
Source§fn clone(&self) -> InferenceRequest
fn clone(&self) -> InferenceRequest
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for InferenceRequest
impl Debug for InferenceRequest
Source§impl PartialEq for InferenceRequest
impl PartialEq for InferenceRequest
impl StructuralPartialEq for InferenceRequest
Auto Trait Implementations§
impl Freeze for InferenceRequest
impl RefUnwindSafe for InferenceRequest
impl Send for InferenceRequest
impl Sync for InferenceRequest
impl Unpin for InferenceRequest
impl UnsafeUnpin for InferenceRequest
impl UnwindSafe for InferenceRequest
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more