Solution Notebooks
Complete, executed solution notebooks for the eight steps of the Build Your Own LLM project. Each is available to read in the browser or to download as a Jupyter notebook.
- Step 1 — A Bigram Model from Countsread online · download .ipynb
- Step 2 — Wire a Neural Network by Handread online · download .ipynb
- Step 3 — Autodiff, and a Neural n-gram Modelread online · download .ipynb
- Step 4 — A Causal Self-Attention Headread online · download .ipynb
- Step 5 — Assembling the GPTread online · download .ipynb
- Step 6 — Training the Baby GPTread online · download .ipynb
- Step 7 — Tokenizer and Samplerread online · download .ipynb
- Step 8 — Capstoneread online · download .ipynb