arXiv 2310.02207
Language Models Represent Space and Time
By Wes Gurnee and Max Tegmark
Published 2023-10-03
Citation lineage
Review the prior work and downstream research connected to this paper.
The capabilities of large language models (LLMs) have sparked debate over whether such systems just learn an enormous collection of superficial statistics or a set of more coherent and grounded representations that reflect the real world. We find evidence for the latter by analyzing the learned representations of three spatial datasets (world, US, NYC places) and three temporal datasets (historical figures, artworks…