---
id: 20261105-T0-14
title: "FlagRot：不是所有旋转都有用，低比特KV缓存要选择性旋转"
title_en: "FlagRot: Selective Rotation for Low-Bit KV Caches"
url: https://ai.daily.yangsir.net/daily/20261105-T0-14
issue_date: 2026-11-05
publish_date: 2026-11-04T05:00:00.000Z
category: research
source_name: "arXiv cs.CL (NLP)"
source_url: https://arxiv.org/abs/2611.03992
---

# FlagRot：不是所有旋转都有用，低比特KV缓存要选择性旋转

长上下文推理受限于KV缓存，2比特编码理论上可将其压缩约六倍，前提是误差可控。常用做法是量化前对key做旋转，前提是旋转总能降低误差，但论文观测到并非如此。FlagRot提出选择性旋转策略，只对确实受益的部分施加旋转，从而在低比特下把误差压住。

## English Version

**FlagRot: Selective Rotation for Low-Bit KV Caches**

Long-context inference is bound by the KV cache, and 2-bit codes could shrink it roughly sixfold if the error stays in check. The standard remedy rotates keys before quantizing on the assumption that rotation always helps, but the paper observes that it does not. FlagRot applies rotation selectively, only where it actually reduces error, keeping quantization error contained at low bit widths.

---

**来源**：[arXiv cs.CL (NLP)](https://arxiv.org/abs/2611.03992)

**详情页**：https://ai.daily.yangsir.net/daily/20261105-T0-14

---

*智语观潮 · Daily — https://ai.daily.yangsir.net/llms.txt*