Skip to content
Hot eventLive

FourierQK提出带通滤波注意力替代点积注意力

1 reports1 sources5 hr ago updated

Get the story

AI overview

FourierQK 提出用带通滤波内积替代标准点积注意力，在字符级语言模型 TinyShakespeare（6 层 GPT）上验证五种滤波器假设。该研究来自 arXiv Machine Learning Theory 板块，属于理论探索类工作。

Generated from reports · updated 4 hr ago

LatestOct 2
2026-10-02 arXiv 发布 FourierQK 论文，提出带通滤波注意力并在 TinyShakespeare 上验证五种滤波器假设。

Timeline

Follow the coverage from different angles.

Oct 2, 2026
  1. arXiv · Machine Learning Theory
    FourierQK：滤波器形状、可容许性与泄漏-覆盖律

    FourierQK 用带通滤波内积替代标准点积注意力，在字符级语言模型（TinyShakespeare，6 层 GPT）上验证五种滤波器假设。

Heat trend

Current heat 9·Comparable peak 10（Oct 2）·Comparable change over 24 hours –

02.557.510Oct2Oct2Oct2Oct2

The trend compares only the same participants observed continuously; its range may be smaller than the current heat count. Move or click on the chart to inspect hourly heat; use the left and right arrow keys to switch.