CoT验证器小校准预算无分布保证研究

1. 12:00
   arXiv · Statistics Machine Learning

   以弃答换取认证：小校准预算下 CoT 验证器的无分布保证

   研究比较 CoT 轨迹正确性信号时指出，部署验证器需要带保证的阈值，而无分布选择性保证在数十到数百个标注问题的校准预算下存在局限。实验用七个开源模型、五种验证信号和 37,000 条已评分轨迹发现，标准证书在最多 0.3% 的校准抽样中失效，但在其触发的抽样中失效比例可达 69%。

Current heat 9·Comparable peak 10（Oct 8）·Comparable change over 24 hours –

The trend compares only the same participants observed continuously; its range may be smaller than the current heat count. Move or click on the chart to inspect hourly heat; use the left and right arrow keys to switch.