List of all items

Structs

• candle_addons::SequentialT
• examples::apdx_e::EG01
• examples::apdx_e::EG02
• examples::apdx_e::EG03
• examples::apdx_e::EG04
• examples::apdx_e::EG05
• examples::apdx_e::EG06
• examples::apdx_e::EG07
• examples::ch02::EG01
• examples::ch02::EG02
• examples::ch02::EG03
• examples::ch02::EG04
• examples::ch03::EG01
• examples::ch03::EG02
• examples::ch03::EG03
• examples::ch03::EG04
• examples::ch03::EG05
• examples::ch03::EG06
• examples::ch03::EG07
• examples::ch03::EG08
• examples::ch03::EG09
• examples::ch03::EG10
• examples::ch03::EG11
• examples::ch04::EG01
• examples::ch04::EG02
• examples::ch04::EG03
• examples::ch04::EG04
• examples::ch04::EG05
• examples::ch04::EG06
• examples::ch04::EG07
• examples::ch04::EG08
• examples::ch05::EG01
• examples::ch05::EG02
• examples::ch05::EG03
• examples::ch05::EG04
• examples::ch05::EG05
• examples::ch05::EG06
• examples::ch05::EG07
• examples::ch05::EG08
• examples::ch05::EG09
• examples::ch05::EG10
• examples::ch05::EG11
• examples::ch06::EG01
• examples::ch06::EG02
• examples::ch06::EG03
• examples::ch06::EG04
• examples::ch06::EG05
• examples::ch06::EG06
• examples::ch06::EG07
• examples::ch06::EG08
• examples::ch06::EG09
• examples::ch06::EG10
• examples::ch06::EG11
• examples::ch06::EG12
• examples::ch06::EG13
• examples::ch06::EG14
• examples::ch06::EG15
• examples::ch07::EG01
• examples::ch07::EG02
• examples::ch07::EG03
• examples::ch07::EG04
• examples::ch07::EG05
• examples::ch07::EG06
• examples::ch07::EG07
• examples::ch07::EG08
• examples::ch07::EG09
• examples::ch07::EG10
• examples::ch07::EG11
• examples::ch07::EG12
• examples::ch07::EG13
• examples::ch07::EG14
• examples::ch07::EG15
• examples::ch07::EG16
• examples::ch07::EG17
• examples::ch07::EG18
• examples::ch07::EG19
• examples::ch07::EG20
• examples::ch07::EG21
• examples::ch07::EG22
• examples::ch07::EG23
• exercises::ch02::X1
• exercises::ch02::X2
• exercises::ch03::X1
• exercises::ch03::X2
• exercises::ch03::X3
• exercises::ch04::X1
• exercises::ch04::X2
• exercises::ch04::X3
• exercises::ch04::addons::ConfigV2
• exercises::ch05::X1
• exercises::ch05::X2
• exercises::ch05::X3
• exercises::ch05::X4
• exercises::ch05::X5
• exercises::ch05::X6
• exercises::ch06::X1
• exercises::ch06::X2
• exercises::ch06::X3
• exercises::ch07::X1
• exercises::ch07::X2
• exercises::ch07::X3
• exercises::ch07::X4
• exercises::ch07::addons::InstructionDataLoader
• exercises::ch07::addons::InstructionDataset
• exercises::ch07::addons::InstructionDatasetIter
• exercises::ch07::addons::InstructionDataset_
• exercises::ch07::addons::MaskedInstructionCollator
• listings::apdx_e::FeedForwardWithLoRA
• listings::apdx_e::GPTModelWithLoRA
• listings::apdx_e::LinearWithLoRA
• listings::apdx_e::LoRALayer
• listings::apdx_e::MultiHeadAttentionWithLoRA
• listings::apdx_e::SequentialTransformersWithLoRA
• listings::apdx_e::TransformerBlockWithLoRA
• listings::ch02::GPTDataLoader
• listings::ch02::GPTDatasetIter
• listings::ch02::GPTDatasetV1
• listings::ch02::GPTDatasetV1_
• listings::ch02::SimpleTokenizerV1
• listings::ch02::SimpleTokenizerV2
• listings::ch03::CausalAttention
• listings::ch03::MultiHeadAttention
• listings::ch03::MultiHeadAttentionWrapper
• listings::ch03::SelfAttentionV1
• listings::ch03::SelfAttentionV2
• listings::ch04::Config
• listings::ch04::DummyGPTModel
• listings::ch04::DummyLayerNorm
• listings::ch04::DummyTransformerBlock
• listings::ch04::ExampleDeepNeuralNetwork
• listings::ch04::FeedForward
• listings::ch04::GELU
• listings::ch04::GPTModel
• listings::ch04::LayerNorm
• listings::ch04::SequentialTransformers
• listings::ch04::TransformerBlock
• listings::ch06::SpamDataLoader
• listings::ch06::SpamDataset
• listings::ch06::SpamDatasetBuilder
• listings::ch06::SpamDatasetIter
• listings::ch06::SpamDataset_
• listings::ch07::AlpacaPromptFormatter
• listings::ch07::InstructionDataBatcher
• listings::ch07::InstructionDataCollator
• listings::ch07::InstructionDataLoader
• listings::ch07::InstructionDataset
• listings::ch07::InstructionDatasetIter
• listings::ch07::InstructionDataset_
• listings::ch07::InstructionResponseExample
• listings::ch07::IterResult1
• listings::ch07::IterResult2
• listings::ch07::OllamaChatMessage
• listings::ch07::OllamaChatResponse
• listings::ch07::OllamaOptions
• listings::ch07::OllamaRequestData
• listings::ch07::Phi3PromptFormatter
• listings::ch07::bonus::EncodedPreferenceExample
• listings::ch07::bonus::IterResult1
• listings::ch07::bonus::PreferenceDataBatcher
• listings::ch07::bonus::PreferenceDataCollator
• listings::ch07::bonus::PreferenceDataLoader
• listings::ch07::bonus::PreferenceDataset
• listings::ch07::bonus::PreferenceDatasetCollatorItem
• listings::ch07::bonus::PreferenceDatasetIter
• listings::ch07::bonus::PreferenceDataset_
• listings::ch07::bonus::PreferenceExample
• listings::ch07::bonus::Tracking

Enums

• listings::apdx_e::FFLayer
• listings::ch04::FFLayer
• listings::ch06::TextClassification

Traits

• Example
• Exercise
• candle_addons::TopK
• listings::ch02::DataLoader
• listings::ch04::GPT
• listings::ch07::CustomCollator
• listings::ch07::InstructionExample
• listings::ch07::PromptFormatter
• listings::ch07::bonus::CustomCollator

Functions

• candle_addons::seqt
• examples::ch03::addons::get_inputs
• examples::ch03::addons::masked_fill
• examples::ch04::addons::get_batch_for_gpts
• examples::ch04::addons::print_gradients
• examples::ch05::addons::get_next_token_logits
• examples::ch05::addons::get_target_token_probas_helper
• examples::ch05::addons::get_train_val_data_loaders
• examples::ch05::addons::get_vocab_and_inversed_vocab
• examples::ch06::addons::get_value_counts
• examples::ch06::addons::write_csv
• examples::ch06::addons::write_parquet
• examples::ch07::addons::load_ift_gpt_model
• listings::apdx_e::create_candle_dataloaders
• listings::apdx_e::create_candle_datasets
• listings::apdx_e::download_and_load_gpt2
• listings::apdx_e::download_and_prepare_spam_dataset
• listings::apdx_e::get_mask
• listings::apdx_e::masked_fill
• listings::apdx_e::replace_linear_with_lora
• listings::apdx_e::seqtransformers
• listings::apdx_e::train_classifier_simple
• listings::ch02::create_dataloader_v1
• listings::ch02::sample_create_vocab
• listings::ch02::sample_read_text
• listings::ch03::get_mask
• listings::ch03::masked_fill
• listings::ch04::generate_text_simple
• listings::ch04::seqtransformers
• listings::ch05::calc_loss_batch
• listings::ch05::calc_loss_loader
• listings::ch05::evaluate_model
• listings::ch05::generate
• listings::ch05::generate_and_print_sample
• listings::ch05::load_weights_into_gpt
• listings::ch05::plot_losses
• listings::ch05::print_sampled_tokens
• listings::ch05::sample_multinomial
• listings::ch05::text_to_token_ids
• listings::ch05::token_ids_to_text
• listings::ch05::train_model_simple
• listings::ch06::calc_accuracy_loader
• listings::ch06::calc_loss_batch
• listings::ch06::calc_loss_loader
• listings::ch06::calc_num_correct_batch
• listings::ch06::classify_review
• listings::ch06::create_balanced_dataset
• listings::ch06::download_and_load_gpt2
• listings::ch06::download_and_unzip_spam_data
• listings::ch06::download_smsspam_parquet
• listings::ch06::evaluate_model
• listings::ch06::modify_out_head_for_classification
• listings::ch06::plot_values
• listings::ch06::random_split
• listings::ch06::train_classifier_simple
• listings::ch07::bonus::compute_dpo_loss
• listings::ch07::bonus::compute_dpo_loss_batch
• listings::ch07::bonus::compute_dpo_loss_loader
• listings::ch07::bonus::compute_logprobs
• listings::ch07::bonus::evaluate_dpo_loss_loader
• listings::ch07::bonus::generate_chosen_and_rejected_response
• listings::ch07::bonus::generate_preference_dataset
• listings::ch07::bonus::train_model_dpo_simple
• listings::ch07::delete_hf_cache
• listings::ch07::download_and_load_file
• listings::ch07::download_and_load_gpt2
• listings::ch07::generate_model_scores
• listings::ch07::generate_test_set_responses
• listings::ch07::load_instruction_data_from_json
• listings::ch07::partition_data
• listings::ch07::query_model
• listings::ch07::train_model_simple
• listings::ch07::write_instruction_data_to_json

Type Aliases

• listings::ch02::GPTDataBatcher
• listings::ch06::SpamDataBatcher

Constants

• listings::ch05::DEFAULT_IGNORE_INDEX
• listings::ch06::EXTRACTED_FILENAME
• listings::ch06::EXTRACTED_PATH
• listings::ch06::HF_GPT2_MODEL_ID
• listings::ch06::PAD_TOKEN_ID
• listings::ch06::PARQUET_FILENAME
• listings::ch06::PARQUET_URL
• listings::ch06::URL
• listings::ch06::ZIP_PATH
• listings::ch07::DATA_DIR
• listings::ch07::DEFAULT_OLLAMA_API_URL
• listings::ch07::DEFAULT_PAD_TOKEN_ID
• listings::ch07::INSTRUCTION_DATA_FILENAME
• listings::ch07::INSTRUCTION_DATA_URL