arXiv 2410.16090
Analysing the Residual Stream of Language Models Under Knowledge Conflicts
By Yu Zhao, Xiaotang Du, et al.
Published 2024-10-21
Citation lineage
Review the prior work and downstream research connected to this paper.
Large language models (LLMs) can store a significant amount of factual knowledge in their parameters. However, their parametric knowledge may conflict with the information provided in the context. Such conflicts can lead to undesirable model behaviour, such as reliance on outdated or incorrect information. In this work, we investigate whether LLMs can identify knowledge conflicts and whether it is possible to know w…