σTransfer：μP下不确定性从小网络迁移到大网络

1. 12:00
   arXiv · Statistics Machine Learning

   σTransfer：在 μP 下将不确定性从小网络迁移到大网络

   论文提出 σTransfer，在 Maximal Update Parametrization（μP）下推导出先验协方差的缩放规则，使选定先验精度随模型宽度增大保持稳定，从而可在小模型上选定精度并零样本迁移到大模型，无需在大模型上重新搜索。

Current heat 9·Comparable peak 10（Oct 9）·Comparable change over 24 hours –

The trend compares only the same participants observed continuously; its range may be smaller than the current heat count. Move or click on the chart to inspect hourly heat; use the left and right arrow keys to switch.