GEN_AI_REQUEST_MAX_TOKENS

Constant GEN_AI_REQUEST_MAX_TOKENS 

Source
pub const GEN_AI_REQUEST_MAX_TOKENS: &'static str;
Expand description

The maximum number of tokens the model generates for a request.

§Notes

§Examples

  • 100