youtube.nixfred.com nixfred.com
Creator

Sasha Rush

Associate professor at Cornell Tech and researcher at Hugging Face. Turns the parts of large language models we can actually measure into clean formulas.

1video

← All videos

Sasha Rush

Large Language Models in Five Formulas

Sasha Rush's tutorial takes the opposite approach to hype: pick the five places where large language models can actually be measured, bounded, or forecast, and be honest that the rest is hard. Perplexity for generation, attention for memory, matrix multiplication for efficiency, Chinchilla for scaling, and RASP for reasoning. Each formula gets its history, its intuition, and the limits of what it explains. The result is a compact quantitative frame you can hang everything else on.

AIDeep LearningScienceJan 30, 2024