---
id: 20260519-T0-11
title: "RoPE在长上下文中无法区分位置与token"
title_en: "RoPE Fails to Distinguish Position/Tokens in Long Context"
url: https://ai.daily.yangsir.net/daily/20260519-T0-11
issue_date: 2026-05-19
publish_date: 2026-05-18T04:00:00.000Z
category: research
source_name: "arXiv cs.CL (NLP)"
source_url: https://arxiv.org/abs/2605.15514
---

# RoPE在长上下文中无法区分位置与token

arXiv论文证明Rotary Positional Embeddings(RoPE)在长上下文语言模型中存在理论局限。研究指出RoPE的编码机制无法区分不同位置的相同token，导致长文本理解错误。此发现对长上下文LLM架构设计有重要影响。

## English Version

**RoPE Fails to Distinguish Position/Tokens in Long Context**

Theoretical analysis proves RoPE cannot distinguish positions and tokens in long-context models, causing errors in long-text understanding. This finding significantly impacts LLM architecture design for extended contexts.

---

**来源**：[arXiv cs.CL (NLP)](https://arxiv.org/abs/2605.15514)

**详情页**：https://ai.daily.yangsir.net/daily/20260519-T0-11

---

*智语观潮 · Daily — https://ai.daily.yangsir.net/llms.txt*