arXiv 2408.09121
Selective Prompt Anchoring for Code Generation
By Yuan Tian and Tianyi Zhang
Published 2024-08-17
Citation lineage
Review the prior work and downstream research connected to this paper.
Recent advances in large language models (LLMs) have transformed software development by automatically generating code from natural language. Yet challenges remain in generating fully correct code that aligns with user intent. Our study reveals that LLMs tend to pay less attention to user prompts as more code tokens are generated. We hypothesize that this attention dilution issue is an important reason for code gene…