Skip to content
arXiv · Audio and Speech· Mohan Shi, Zilai Wang, Natarajan Balaji Shankar, Kaiyuan Zhang, Eray Eren, Abeer Alwan·· 3 hr agoAI score27

EAVA:用适配器唤醒编码器,实现 Speech-LLM 的有效领域自适应微调

Encoder Awakening via Adapters: Effective Domain-Adaptive Fine-tuning of Speech-LLMs

AI brief

论文提出 Encoder Awakening via Adapters(EAVA),一种面向 Speech-LLM 语音识别(ASR)的领域自适应微调方法,先在编码器各层插入轻量适配器单独训练,再对全模型结合 LLM 上的 LoRA 进行联合微调。

Source: arXiv · Audio and Speech · arxiv.org