arXiv 2402.00838
OLMo: Accelerating the Science of Language Models
By Dirk Groeneveld, Iz Beltagy, et al.
Published 2024-02-01
Citation lineage
Review the prior work and downstream research connected to this paper.
Language models (LMs) have become ubiquitous in both NLP research and in commercial product offerings. As their commercial importance has surged, the most powerful models have become closed off, gated behind proprietary interfaces, with important details of their training data, architectures, and development undisclosed. Given the importance of these details in scientifically studying these models, including their b…