arXiv 2403.10131
RAFT: Adapting Language Model to Domain Specific RAG
By Tianjun Zhang, Shishir G. Patil, et al.
Published 2024-03-15
Wiki summary
Explore the paper's summary, context, and related research on Papiers.
Pretraining Large Language Models (LLMs) on large corpora of textual data is now a standard paradigm. When using these LLMs for many downstream applications, it is common to additionally bake in new knowledge (e.g., time-critical news, or private domain knowledge) into the pretrained model either through RAG-based-prompting, or fine-tuning. However, the optimal methodology for the model to gain such new knowledge re…