arXiv 2005.11401
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
By Patrick Lewis, Ethan Perez, et al.
Published 2020-05-22
Discussion
Read the public discussion and references gathered around this paper.
Large pre-trained language models have been shown to store factual knowledge in their parameters, and achieve state-of-the-art results when fine-tuned on downstream NLP tasks. However, their ability to access and precisely manipulate knowledge is still limited, and hence on knowledge-intensive tasks, their performance lags behind task-specific architectures. Additionally, providing provenance for their decisions and…