英语质量分类器适配多语言LLM预训练数据筛选

1. 12:00
   arXiv · Computation and Language

   英语质量分类器如何适配多语言 LLM 预训练数据筛选

   研究提出一种多语言适配方法，把现有英语质量分类器扩展至 100 多种语言：在 Transformer encoder-only 模型嵌入之上训练一个小型多层感知机，以多语言文本为输入、以机器翻译后英语分类器给出的分数为标签。

Current heat 9·Comparable peak 10（Oct 9）·Comparable change over 24 hours –

The trend compares only the same participants observed continuously; its range may be smaller than the current heat count. Move or click on the chart to inspect hourly heat; use the left and right arrow keys to switch.