arXiv · Computation and Language· Jerzy Kami\'nski, Ilya Galyukshev, Artem Kuznetsov, Danil Fedorov, Kirill Redko, Sergey Chuprin, Aidar Shumbalov, Stanislav Chumakov, Anna Kalyuzhnaya·· 4 hr agoAI score33
Knowing When Not to Answer:潜在欠规范信号的跨域与多轮泛化研究
Knowing When Not to Answer: Cross-Domain and Multi-Turn Generalization of Latent Underspecification Signals
AI brief
研究用 423 段对话、1,661 个标注轮次状态和模拟用户评测框架,在六个数据集与六个开源权重 LLM 上测试不可回答性探针。探针在共享同一不可回答基础的数学(AUROC 0.77-0.97)与段落(SQuAD 2.0、MuSiQue,0.77-0.90)数据集间稳健迁移,但单轮探针零样本无法检测对话何时变得可回答。
Source: arXiv · Computation and Language · arxiv.org