pub struct ChatCompletionStreamOptions {
pub include_usage: bool,
pub continuous_usage_stats: bool,
}Expand description
Stream options with per-chunk usage reporting.
Extends upstream ChatCompletionStreamOptions with:
continuous_usage_stats: emit usage in every chunk, not just the final one
Fields§
§include_usage: bool§continuous_usage_stats: boolWhen true, usage statistics are included in every streaming chunk. Backends like vLLM/SGLang support this for real-time token counting.
Trait Implementations§
Source§impl Clone for ChatCompletionStreamOptions
impl Clone for ChatCompletionStreamOptions
Source§fn clone(&self) -> ChatCompletionStreamOptions
fn clone(&self) -> ChatCompletionStreamOptions
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for ChatCompletionStreamOptions
Source§impl Debug for ChatCompletionStreamOptions
impl Debug for ChatCompletionStreamOptions
Source§impl<'de> Deserialize<'de> for ChatCompletionStreamOptions
impl<'de> Deserialize<'de> for ChatCompletionStreamOptions
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl StructuralPartialEq for ChatCompletionStreamOptions
Auto Trait Implementations§
impl Freeze for ChatCompletionStreamOptions
impl RefUnwindSafe for ChatCompletionStreamOptions
impl Send for ChatCompletionStreamOptions
impl Sync for ChatCompletionStreamOptions
impl Unpin for ChatCompletionStreamOptions
impl UnsafeUnpin for ChatCompletionStreamOptions
impl UnwindSafe for ChatCompletionStreamOptions
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more