arXiv 2507.12704
PinFM: Foundation Model for User Activity Sequences at a Billion-scale Visual Discovery Platform
By Xiangyi Chen, Kousik Rajesh, et al.
Published 2025-07-17
Citation lineage
Review the prior work and downstream research connected to this paper.
User activity sequences have emerged as one of the most important signals in recommender systems. We present a foundational model, PinFM, for understanding user activity sequences across multiple applications at a billion-scale visual discovery platform. We pretrain a transformer model with 20B+ parameters using extensive user activity data, then fine-tune it for specific applications, efficiently coupling it with e…