pub struct ChatCompletionStreamOptions {
pub include_usage: bool,
pub continuous_usage_stats: bool,
}Expand description
Options for streaming response. Only set this when you set stream: true.
Fields§
§include_usage: boolIf set, an additional chunk will be streamed before the data: [DONE] message. The usage field on this chunk shows the token usage statistics for the entire request, and the choices field will always be an empty array. All other chunks will also include a usage field, but with a null value.
continuous_usage_stats: boolNVIDIA-specific and industrial common extensions for per chunk usage reporting.
Trait Implementations§
Source§impl Clone for ChatCompletionStreamOptions
impl Clone for ChatCompletionStreamOptions
Source§fn clone(&self) -> ChatCompletionStreamOptions
fn clone(&self) -> ChatCompletionStreamOptions
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl ComposeSchema for ChatCompletionStreamOptions
impl ComposeSchema for ChatCompletionStreamOptions
impl Copy for ChatCompletionStreamOptions
Source§impl Debug for ChatCompletionStreamOptions
impl Debug for ChatCompletionStreamOptions
Source§impl<'de> Deserialize<'de> for ChatCompletionStreamOptions
impl<'de> Deserialize<'de> for ChatCompletionStreamOptions
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl StructuralPartialEq for ChatCompletionStreamOptions
Auto Trait Implementations§
impl Freeze for ChatCompletionStreamOptions
impl RefUnwindSafe for ChatCompletionStreamOptions
impl Send for ChatCompletionStreamOptions
impl Sync for ChatCompletionStreamOptions
impl Unpin for ChatCompletionStreamOptions
impl UnsafeUnpin for ChatCompletionStreamOptions
impl UnwindSafe for ChatCompletionStreamOptions
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more