LLM压缩能力缩放递减规律研究

1. 12:00
   arXiv · Machine Learning Theory

   LLM 压缩的能力缩放递减规律研究

   研究系统考察 LLM 压缩中剪枝、量化与蒸馏的能力缩放递减规律，覆盖数学、代码生成与问答任务，并建立与模型规模、训练阶段、压缩设置、数据可用性及训练暴露相关的预测关系。

Current heat 7·Comparable peak 10（Oct 5）·Comparable change over 24 hours –

The trend compares only the same participants observed continuously; its range may be smaller than the current heat count. Move or click on the chart to inspect hourly heat; use the left and right arrow keys to switch.