A Theory of Policy Optimization in Post-Training: Coverage Collapse and Reference Resets
arXiv:2611.14467v1 Announce Type: cross Abstract: Policy optimization is central to language model post-training, yet principled guidance remains limited. We re…