arXiv 2406.11695
Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programs
By Krista Opsahl-Ong, Michael J Ryan, et al.
Published 2024-06-17
Citation lineage
Review the prior work and downstream research connected to this paper.
Language Model Programs, i.e. sophisticated pipelines of modular language model (LM) calls, are increasingly advancing NLP tasks, but they require crafting prompts that are jointly effective for all modules. We study prompt optimization for LM programs, i.e. how to update these prompts to maximize a downstream metric without access to module-level labels or gradients. To make this tractable, we factorize our problem…