Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe
Paper • 2604.13016 • Published • 105
Chandler.JQ.ZHANG
JqzAugUST
AI & ML interests
(Master of Science, HKUST) NLP, Sparse Attn. Trying to play with GPU Kernels.
Recent Activity
upvoted a paper about 1 month ago
Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe liked a model 3 months ago
openbmb/MiniCPM-SALA liked a dataset 3 months ago
openbmb/UltraData-MathOrganizations
