arXiv 2602.07265
XShare: Collaborative in-Batch Expert Sharing for Faster MoE Inference
By Daniil Vankov, Nikita Ivkin, et al.
Published 2026-02-06
Wiki summary
Explore the paper's summary, context, and related research on Papiers.
Mixture-of-Experts (MoE) architectures are increasingly used to efficiently scale large language models. However, in production inference, request batching and speculative decoding significantly amplify expert activation, eroding these efficiency benefits. We address this issue by modeling batch-aware expert selection as a modular optimization problem and designing efficient greedy algorithms for different deploymen…