arXiv 2310.02207
Language Models Represent Space and Time
By Wes Gurnee and Max Tegmark
Published 2023-10-03
Wiki summary
Explore the paper's summary, context, and related research on Papiers.
The capabilities of large language models (LLMs) have sparked debate over whether such systems just learn an enormous collection of superficial statistics or a set of more coherent and grounded representations that reflect the real world. We find evidence for the latter by analyzing the learned representations of three spatial datasets (world, US, NYC places) and three temporal datasets (historical figures, artworks…