arXiv 2005.11401
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
By Patrick Lewis, Ethan Perez, et al.
Published 2020-05-22
Mindmap
Browse the paper's core ideas, clusters, and relationships in a structured outline.
Large pre-trained language models have been shown to store factual knowledge in their parameters, and achieve state-of-the-art results when fine-tuned on downstream NLP tasks. However, their ability to access and precisely manipulate knowledge is still limited, and hence on knowledge-intensive tasks, their performance lags behind task-specific architectures. Additionally, providing provenance for their decisions and…