Language Model Builder

Interactive textbook

A short textbook with interactive playgrounds

I often find myself explaining how language models are built and trained to friends and family. I finally wrote the introduction I always wanted: It’s friendly to non-programmers, contains many interactive examples, and covers all the fundamentals without treating the reader like a child or a machine learning expert.

• #### Interactive from the first page
Run the experiments yourself: build a tokenizer, move through embedding space, inspect attention, and watch a tiny model learn.
• #### Go as deep as you like
No coding, machine learning, or math experience required. Where useful, I’ve added opportunities for those curious to dive a little deeper.
• #### No artificial additives