arXiv 2305.05176
FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance
By Lingjiao Chen, Matei Zaharia, et al.
Published 2023-05-09
Citation lineage
Review the prior work and downstream research connected to this paper.
There is a rapidly growing number of large language models (LLMs) that users can query for a fee. We review the cost associated with querying popular LLM APIs, e.g. GPT-4, ChatGPT, J1-Jumbo, and find that these models have heterogeneous pricing structures, with fees that can differ by two orders of magnitude. In particular, using LLMs on large collections of queries and text can be expensive. Motivated by this, we o…