CS336 Language Modeling From Scratch

All NLP Transformers

CS336 Language Modeling from Scratch: Assignment 1

June 14, 2026

Implementation notes on training a byte-level BPE tokenizer from scratch.

Transformers NLP