---
id: 20260822-T0-11
title: "DeltaMomentum优化器：基于Delta规则的各向异性动量更新"
title_en: "DeltaMomentum: Anisotropic Momentum via Delta Rule"
url: https://ai.daily.yangsir.net/daily/20260822-T0-11
issue_date: 2026-08-22
publish_date: 2026-08-21T04:00:00.000Z
category: research
source_name: "arXiv cs.LG (ML)"
source_url: https://arxiv.org/abs/2608.19491
---

# DeltaMomentum优化器：基于Delta规则的各向异性动量更新

一篇新论文提出DeltaMomentum，这是一种基于Delta规则（Delta Rule）的Key-Value架构优化器。传统优化器（如Adam）对梯度方向使用固定的指数移动平均（EMA），忽略了数据中的各向异性。DeltaMomentum通过Delta规则动态调整更新方向，让优化器对不同方向的变化更敏感。该方法在理论上能更好地适应深度网络训练中非均匀的数据分布，或可提升训练效率和模型性能。

## English Version

**DeltaMomentum: Anisotropic Momentum via Delta Rule**

A new paper introduces DeltaMomentum, a Key-Value based optimizer that uses the Delta Rule for momentum updates. Unlike traditional optimizers (like Adam) that apply a fixed EMA across all gradient directions, DeltaMomentum dynamically adjusts updates to account for anisotropy in training data. The approach could better adapt to non-uniform data distributions in deep network training and potentially improve training efficiency and model performance.

---

**来源**：[arXiv cs.LG (ML)](https://arxiv.org/abs/2608.19491)

**详情页**：https://ai.daily.yangsir.net/daily/20260822-T0-11

---

*智语观潮 · Daily — https://ai.daily.yangsir.net/llms.txt*