NeuroGenesys All reference videosAcademy • Video series • 46 videosOpen on YouTube
EfficientML.ai Course, 2023 Fall (MIT 6.5940)
MIT HAN Lab
Why watch
Song Han's course on pruning, quantization, distillation and efficient LLM serving.
This is a full series. The player starts at the first episode; use its playlist menu, or open it on YouTube, to pick an episode.
Featured in
Watch next
1:22:52Stanford OnlineStanford CS336 Language Modeling from Scratch | Spring 2025 | Lecture 10: Inference
Where inference cost goes: memory bandwidth, batching, KV caches.
Watch
8:33Efficient NLPThe KV Cache: Memory Usage in Transformers
A short explanation of KV-cache memory.
Watch
19:44Maarten GrootendorstA Visual Guide to Mixture of Experts (MoE) in LLMs
Routing, experts and load balancing, drawn out.
Watch
20:34Julia TurcHow LLMs survive in low precision | Quantization Fundamentals
Number formats and quantization from first principles.
Watch
Hosted by YouTube and played through its privacy-enhanced embed. The creator is not affiliated with NeuroGenesys; a video is a way in, not a source.
