arXiv 1905.13497
Attention Is (not) All You Need for Commonsense Reasoning
By Tassilo Klein and Moin Nabi
Published 2019-05-31
Wiki summary
Explore the paper's summary, context, and related research on Papiers.
The recently introduced BERT model exhibits strong performance on several language understanding benchmarks. In this paper, we describe a simple re-implementation of BERT for commonsense reasoning. We show that the attentions produced by BERT can be directly utilized for tasks such as the Pronoun Disambiguation Problem and Winograd Schema Challenge. Our proposed attention-guided commonsense reasoning method is conce…