Module ch05 

Examples from Chapter 5

Modules

addons

Auxiliary module for examples::ch05

Structs

EG01

Example usage of text_to_token_ids and token_ids_to_text

EG02

Example computation of cross-entropy and perplexity

EG03

Split text into train and validation datasets and loaders

EG04

Example usage of `calc_loss_loader

EG05

Example usage of train_model_simple function and plotting loss curves

EG06

Manual multinomial with/without temperature scaling

EG07

Example of extracting topk probas

EG08

Example usage of generate

EG09

Saving and loading a candle model

EG10

Example for downloading safetensors from HuggingFace Hub

EG11

Example usage of load_weights_into_gpt