Tag: reasoning

All the articles with the tag "reasoning".

• Notes on: Rethinking On-Policy Distillation of LLMs

  6 Sep, 2026

  The actual mechanism behind when on-policy distillation works — token overlap ratio rising toward 91%, a "stronger teacher can fail while a weaker one succeeds" result, and a reverse-distillation experiment that undercuts the whole premise.