pub struct ChatCompletionStreamOptions {
pub include_usage: Option<bool>,
pub include_obfuscation: Option<bool>,
}
Expand description
Options for streaming response. Only set this when you set stream: true
.
Fields§
§include_usage: Option<bool>
If set, an additional chunk will be streamed before the data: [DONE]
message. The usage
field on this chunk shows the token usage statistics
for the entire request, and the choices
field will always be an empty
array.
All other chunks will also include a usage
field, but with a null
value. NOTE: If the stream is interrupted, you may not receive the
final usage chunk which contains the total token usage for the request.
include_obfuscation: Option<bool>
When true, stream obfuscation will be enabled. Stream obfuscation adds
random characters to an obfuscation
field on streaming delta events to
normalize payload sizes as a mitigation to certain side-channel attacks.
These obfuscation fields are included by default, but add a small amount
of overhead to the data stream. You can set include_obfuscation
to
false to optimize for bandwidth if you trust the network links between
your application and the OpenAI API.
Implementations§
Source§impl ChatCompletionStreamOptions
impl ChatCompletionStreamOptions
Sourcepub fn builder() -> ChatCompletionStreamOptionsBuilder<((), ())>
pub fn builder() -> ChatCompletionStreamOptionsBuilder<((), ())>
Create a builder for building ChatCompletionStreamOptions
.
On the builder, call .include_usage(...)
(optional), .include_obfuscation(...)
(optional) to set the values of the fields.
Finally, call .build()
to create the instance of ChatCompletionStreamOptions
.
Trait Implementations§
Source§impl Clone for ChatCompletionStreamOptions
impl Clone for ChatCompletionStreamOptions
Source§fn clone(&self) -> ChatCompletionStreamOptions
fn clone(&self) -> ChatCompletionStreamOptions
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source
. Read more