arXiv 2512.24880
mHC: Manifold-Constrained Hyper-Connections
By Zhenda Xie, Yixuan Wei, et al.
Published 2025-12-31
Mindmap
Browse the paper's core ideas, clusters, and relationships in a structured outline.
Recently, studies exemplified by Hyper-Connections (HC) have extended the ubiquitous residual connection paradigm established over the past decade by expanding the residual stream width and diversifying connectivity patterns. While yielding substantial performance gains, this diversification fundamentally compromises the identity mapping property intrinsic to the residual connection, which causes severe training ins…