Skip to content
arXiv · Artificial Intelligence· Yunbo Long, WenJie Chen, Jiaquan Zhang, Guangya Hao, Zihang Zeng, Pengze Li, Xi Chen·· 4 hr agoAI score34

SPECTRUM:用于循环自蒸馏的近端谱调制

SPECTRUM: Proximal Spectral Modulation for Looped Self-Distillation

AI brief

论文提出 SPECTRUM,一种面向代码生成循环自蒸馏(Looped Self-Distillation)的方法,在固定信息预算下让模型反复生成并学习自身原始输出,无需外部评估或基于测试的样本筛选。

Source: arXiv · Artificial Intelligence · arxiv.org