Crate llms_from_scratch_rs

Source
Expand description

§Build A Large Language Model From Scratch — Rust Translations

§Intro

This crate provides Rust translations of the examples, exercises and listings found in the book Build A LLM From Scratch by Sebastian Raschka (github), which is a great resource for careful learning of LLMs. The book provides several examples and listings which are written in PyTorch in order to learn how to build a GPT (decoder-only) language model. This crate provides the Rust equivalent for nearly all of the code provided in the book using candle (a Minimalist ML framework for Rust).

The lib crate consists of three modules: examples, exercises and listings. Additionally there is a companion binary crate that executes all of the examples and exercises.

Modules§

candle_addons
Custom addons module to Candle
examples
Examples
exercises
Exercises
listings
Listings

Traits§

Example
Example Trait
Exercise
Exercise Trait