Skip to content
arXiv · Robotics· Shuang Luo, Yilun Kong, Yunpeng Qing, Yihang Jiao, Zhi Hou, Shunyu Liu, Xiaogang Wang, Dacheng Tao·· 4 hr agoAI score26

ACT³:面向动作的三流 Transformer,重构语义、动力学与控制

Rewiring Semantics, Dynamics, and Control: A Simple yet Effective Action-Centric Tri-Stream Transformer

AI brief

研究者提出 ACT³(Action-Centric Tri-Stream Transformer),一种面向动作的三流架构,将 VLM 的语义理解与视频生成 World Model 的动力学预测融合进控制动作,同时保留各上下文流的独立角色。

Source: arXiv · Robotics · arxiv.org