
Building BPE from Scratch: How a Tokenizer Learns Its Vocabulary
Building a Transformer from Scratch, Part 2
I'm Yash Singh, a Computer Science student exploring AI, machine learning and deep learning. I learn best by building things from scratch, and here I document what I learn, build and discover along the way, mistakes included. Right now: building a GPT-style transformer from scratch, tokenizer included.