arXiv · Computation and Language· Mohsen Larni (Department of Computer Science, University of Nevada, Las Vegas), Sobhan Ebrahimi Azar (Department of Computer Science, University of Nevada, Las Vegas), Pouyan Nahed (Department of Computer Science, University of Nevada, Las Vegas), Kazem Taghva (Department of Computer Science, University of Nevada, Las Vegas)·· 16 小时前AI 评分27
SyntaxBench：面向大语言模型字符级推理的统计诊断框架
SyntaxBench: A Statistical Diagnostic Framework for Character-Level Reasoning in Large Language Models
AI 导读
SyntaxBench 是一个面向字符级推理的诊断基准与统计评估框架，包含字符计数、字母包含、回文检测、编辑距离、最长字符串选择五项核心任务，以及更难的子串抽取压力测试 index_to_span。
来源：arXiv · Computation and Language · arxiv.org