arXiv 2402.00838
OLMo: Accelerating the Science of Language Models
By Dirk Groeneveld, Iz Beltagy, et al.
Published 2024-02-01
Mindmap
Browse the paper's core ideas, clusters, and relationships in a structured outline.
Language models (LMs) have become ubiquitous in both NLP research and in commercial product offerings. As their commercial importance has surged, the most powerful models have become closed off, gated behind proprietary interfaces, with important details of their training data, architectures, and development undisclosed. Given the importance of these details in scientifically studying these models, including their b…