Lecture 6 LLM’s Inference & Reasoning

In-class Material

1. Slides

2. Notebook

Extra Reading

1. LLM Inference and its Challenges

2. Foundation of LLM Inference

3. vLLM: open-source library for high-through

4. Demystifying Reasoning Models

5. A Visual Guide to Reasoning LLMs

6. The Illustrated DeepSeek-R1