arXiv 2402.09552
STEER: Assessing the Economic Rationality of Large Language Models
By Narun Raman, Taylor Lundy, et al.
Published 2024-02-14
Citation lineage
Review the prior work and downstream research connected to this paper.
There is increasing interest in using LLMs as decision-making "agents." Doing so includes many degrees of freedom: which model should be used; how should it be prompted; should it be asked to introspect, conduct chain-of-thought reasoning, etc? Settling these questions -- and more broadly, determining whether an LLM agent is reliable enough to be trusted -- requires a methodology for assessing such an agent's econom…