When Does Blockwise Additivity Break? Diagnosing and Repairing the Additive Assumption in Distillation-Based Architecture Search
arXiv:2611.07487v1 Announce Type: new Abstract: Blockwise distillation methods for architecture search, such as DNA, DONNA, LANA and Puzzle, score each candidat…