arXiv 2403.10131
RAFT: Adapting Language Model to Domain Specific RAG
By Tianjun Zhang, Shishir G. Patil, et al.
Published 2024-03-15
Citation lineage
Review the prior work and downstream research connected to this paper.
Pretraining Large Language Models (LLMs) on large corpora of textual data is now a standard paradigm. When using these LLMs for many downstream applications, it is common to additionally bake in new knowledge (e.g., time-critical news, or private domain knowledge) into the pretrained model either through RAG-based-prompting, or fine-tuning. However, the optimal methodology for the model to gain such new knowledge re…