Trait LogprobExtractor 

pub trait LogprobExtractor {
    // Required method
    fn extract_logprobs_by_choice(&self) -> HashMap<u32, Vec<TokenLogProbs>>;
}

Trait for extracting logprob information from various response types

Required Methods

fn extract_logprobs_by_choice(&self) -> HashMap<u32, Vec<TokenLogProbs>>

Extract logprobs organized by choice index Returns: HashMap<choice_index, Vec>

Implementors

impl LogprobExtractor for NvCreateChatCompletionStreamResponse

Implementation for NvCreateChatCompletionStreamResponse (our main streaming response type)