arXiv 2403.10131
RAFT: Adapting Language Model to Domain Specific RAG
By Tianjun Zhang, Shishir G. Patil, et al.
Published 2024-03-15
Mindmap
Browse the paper's core ideas, clusters, and relationships in a structured outline.
Pretraining Large Language Models (LLMs) on large corpora of textual data is now a standard paradigm. When using these LLMs for many downstream applications, it is common to additionally bake in new knowledge (e.g., time-critical news, or private domain knowledge) into the pretrained model either through RAG-based-prompting, or fine-tuning. However, the optimal methodology for the model to gain such new knowledge re…