Editor's Synopsis
Wei Xu, a professor at Georgia Tech, shares the reading list from her Fall 2024 course CS 8803 "Large Language Model". The course covered three major topic areas: learning from human preferences (including techniques like PPO, DPO, SimPO, CPO, RRHF, ORPO, and CTO), real-world LLM applications (covering Llama-3, Aya, and Arena benchmarks), and efficient LLM methods (such as MoMa, LoRA, QLoRA, and LESS).
This post serves as a useful reference for anyone looking to understand the current landscape of LLM research and training methodologies, particularly around reinforcement learning from human feedback variants and parameter-efficient fine-tuning approaches that have become central to modern LLM development.