arXiv 2312.12141
Neuron-Level Knowledge Attribution in Large Language Models
By Zeping Yu and Sophia Ananiadou
Published 2023-12-19
Mindmap
Browse the paper's core ideas, clusters, and relationships in a structured outline.
Identifying important neurons for final predictions is essential for understanding the mechanisms of large language models. Due to computational constraints, current attribution techniques struggle to operate at neuron level. In this paper, we propose a static method for pinpointing significant neurons. Compared to seven other methods, our approach demonstrates superior performance across three metrics. Additionally…