llms_from_scratch_rs::examples

Module ch05

Source
Expand description

Examples from Chapter 5

Modules§

  • addons
    Auxiliary module for examples::ch05

Structs§

  • EG01
    Example usage of text_to_token_ids and token_ids_to_text
  • EG02
    Example computation of cross-entropy and perplexity
  • EG03
    Split text into train and validation datasets and loaders
  • EG04
    Example usage of `calc_loss_loader
  • EG05
    Example usage of train_model_simple function and plotting loss curves
  • EG06
    Manual multinomial with/without temperature scaling
  • EG07
    Example of extracting topk probas
  • EG08
    Example usage of generate
  • EG09
    Saving and loading a candle model
  • EG10
    Example for downloading safetensors from HuggingFace Hub
  • EG11
    Example usage of load_weights_into_gpt