Lecture 4 LLM Fundamentals

In-class Material

1. Slides

2. Notebook

Extra Reading

1. Large Language Models: A Survey

2. GPT1: Improving Language Understanding by Generative Pre-Training

3. GPT2: Language Models are Unsupervised Multitask Learners

4. GPT3: Language Models are Few-Shot Learners

5. InstructGPT: Training language models to follow instructions with human feedback

6. Llama2