arXiv 2402.00838
OLMo: Accelerating the Science of Language Models
By Dirk Groeneveld, Iz Beltagy, et al.
Published 2024-02-01
Wiki summary
Explore the paper's summary, context, and related research on Papiers.
Language models (LMs) have become ubiquitous in both NLP research and in commercial product offerings. As their commercial importance has surged, the most powerful models have become closed off, gated behind proprietary interfaces, with important details of their training data, architectures, and development undisclosed. Given the importance of these details in scientifically studying these models, including their b…