Expand description
§Build A Large Language Model From Scratch — Rust Translations
§Intro
This crate provides Rust translations of the examples, exercises and listings found in the book Build A LLM From Scratch by Sebastian Raschka (github), which is a great resource for careful learning of LLMs. The book provides several examples and listings which are written in PyTorch in order to learn how to build a GPT (decoder-only) language model. This crate provides the Rust equivalent for nearly all of the code provided in the book using candle (a Minimalist ML framework for Rust).
The lib crate consists of three modules: examples
, exercises
and listings
.
Additionally there is a companion binary crate that executes all of the examples
and exercises.
Modules§
- candle_
addons - Custom addons module to Candle
- examples
- Examples
- exercises
- Exercises
- listings
- Listings