arXiv 2409.13697
Prompt Baking
By Aman Bhargava, Cameron Witkowski, et al.
Published 2024-09-04
Mindmap
Browse the paper's core ideas, clusters, and relationships in a structured outline.
Two primary ways to change LLM behavior are prompting and weight updates (e.g., fine-tuning). Prompting LLMs is simple and effective, specifying the desired changes explicitly in natural language, whereas weight updates provide more expressive and permanent behavior changes, specified implicitly via training on large datasets. We present a technique for "baking" prompts into the weights of an LLM. Prompt Baking conv…