alith_interface::requests

Module res_components

Source

Structsยง

GenerationSettings
The settings used to generate the completion.
InferenceProbabilities
The log probability of the completion.
TimingUsage
Timing statistics for the completion request.
TokenUsage
Token statistics for the completion request.
TopProbabilities