arXiv 2505.14425
From Templates to Natural Language: Generalization Challenges in Instruction-Tuned LLMs for Spatial Reasoning
By Chalamalasetti Kranti, Sherzod Hakimov, et al.
Published 2025-05-20
Discussion
Read the public discussion and references gathered around this paper.
Instruction-tuned large language models (LLMs) have shown strong performance on a variety of tasks; however, generalizing from synthetic to human-authored instructions in grounded environments remains a challenge for them. In this work, we study generalization challenges in spatial grounding tasks where models interpret and translate instructions for building object arrangements on a D grid. We fine-tune LLMs using…