arXiv 2212.04356
Robust Speech Recognition via Large-Scale Weak Supervision
By Alec Radford, Jong Wook Kim, et al.
Published 2022-12-06
Citation lineage
Review the prior work and downstream research connected to this paper.
We study the capabilities of speech processing systems trained simply to predict large amounts of transcripts of audio on the internet. When scaled to 680,000 hours of multilingual and multitask supervision, the resulting models generalize well to standard benchmarks and are often competitive with prior fully supervised results but in a zero-shot transfer setting without the need for any fine-tuning. When compared t…