arXiv · Computation and Language· Jianpeng Cheng, Guangyu Sun, Aashu Singh, Benyu Zhang, Haixing Dai, Hossein Mansour, Jiangfan Zhang, Shlok Kumar Mishra, Wei Sun, Xuanming Cui, Yanli Liu, Qi Guo, Max Xiangjun Fan, Jun Xiao·· 4 hr agoAI score30
MetaEncoder：探索双编码器在自然语言接口多模态 System One 决策中的极限
MetaEncoder: Exploring the Limit of Bi-Encoders for Multimodal System One Decision Making with Natural Language Interface
AI brief
MetaEncoder 将预训练的 Muse-Glimmer 30B 解码器微调为可遵循指令的决策编码器，用自然语言表达用户请求与候选选项，并辅以图像和视频输入。
Source: arXiv · Computation and Language · arxiv.org