arXiv 2302.13971
LLaMA: Open and Efficient Foundation Language Models
By Hugo Touvron, Thibaut Lavril, et al.
Published 2023-02-27
Citation lineage
Review the prior work and downstream research connected to this paper.
We introduce LLaMA, a collection of foundation language models ranging from 7B to 65B parameters. We train our models on trillions of tokens, and show that it is possible to train state-of-the-art models using publicly available datasets exclusively, without resorting to proprietary and inaccessible datasets. In particular, LLaMA-13B outperforms GPT-3 (175B) on most benchmarks, and LLaMA-65B is competitive with the…