arXiv 2409.13697
Prompt Baking
By Aman Bhargava, Cameron Witkowski, et al.
Published 2024-09-04
Wiki summary
Explore the paper's summary, context, and related research on Papiers.
Two primary ways to change LLM behavior are prompting and weight updates (e.g., fine-tuning). Prompting LLMs is simple and effective, specifying the desired changes explicitly in natural language, whereas weight updates provide more expressive and permanent behavior changes, specified implicitly via training on large datasets. We present a technique for "baking" prompts into the weights of an LLM. Prompt Baking conv…