Expand description
Auxiliary module for examples::ch05
Functions§
- get_
next_ token_ logits - Helper function to get the example next token logits used in the book
- get_
target_ token_ probas_ helper - Helper function to target_tokens of the i-th input sequence
- get_
train_ val_ data_ loaders - Helper function for producing
GPTDataLoader
for train and val splits - get_
vocab_ and_ inversed_ vocab - Helper function to get vocab and inversed vocab
HashMap
’s