arXiv 2304.04052
Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decoder
By Zihao Fu, Wai Lam, et al.
Published 2023-04-08
Mindmap
Browse the paper's core ideas, clusters, and relationships in a structured outline.
The sequence-to-sequence (seq2seq) task aims at generating the target sequence based on the given input source sequence. Traditionally, most of the seq2seq task is resolved by the Encoder-Decoder framework which requires an encoder to encode the source sequence and a decoder to generate the target text. Recently, a bunch of new approaches have emerged that apply decoder-only language models directly to the seq2seq t…