arXiv · Computer Vision· Jeonghwan Kim, Sofia Stoica, Jiwan Chung, Ansel Blume, Hyeonjeong Ha, Zhenhailong Wang, Xin Luna Dong, Heng Ji·· 4 hr agoAI score34
Mixture of Layers:面向视觉推理的动态层路由
Mixture of Layers: Dynamic Layer Routing for Visual Reasoning
AI brief
提出 Mixture of Layers(MoL),一种以指令为条件的视觉 patch 级层路由方法,按文本查询对视觉编码器中间层的隐藏状态做 top-k 稀疏聚合。
Source: arXiv · Computer Vision · arxiv.org