arXiv 2402.00838
OLMo: Accelerating the Science of Language Models
By Dirk Groeneveld, Iz Beltagy, et al.
Published 2024-02-01
Discussion
Read the public discussion and references gathered around this paper.
Language models (LMs) have become ubiquitous in both NLP research and in commercial product offerings. As their commercial importance has surged, the most powerful models have become closed off, gated behind proprietary interfaces, with important details of their training data, architectures, and development undisclosed. Given the importance of these details in scientifically studying these models, including their b…