arXiv 2408.09121
Selective Prompt Anchoring for Code Generation
By Yuan Tian and Tianyi Zhang
Published 2024-08-17
Wiki summary
Explore the paper's summary, context, and related research on Papiers.
Recent advances in large language models (LLMs) have transformed software development by automatically generating code from natural language. Yet challenges remain in generating fully correct code that aligns with user intent. Our study reveals that LLMs tend to pay less attention to user prompts as more code tokens are generated. We hypothesize that this attention dilution issue is an important reason for code gene…