arXiv · Artificial Intelligence· Yunbo Long, WenJie Chen, Jiaquan Zhang, Guangya Hao, Zihang Zeng, Pengze Li, Xi Chen·· 4 hr agoAI score34
SPECTRUM:用于循环自蒸馏的近端谱调制
SPECTRUM: Proximal Spectral Modulation for Looped Self-Distillation
AI brief
论文提出 SPECTRUM,一种面向代码生成循环自蒸馏(Looped Self-Distillation)的方法,在固定信息预算下让模型反复生成并学习自身原始输出,无需外部评估或基于测试的样本筛选。
Source: arXiv · Artificial Intelligence · arxiv.org