arXiv 2305.05176
FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance
By Lingjiao Chen, Matei Zaharia, et al.
Published 2023-05-09
Discussion
Read the public discussion and references gathered around this paper.
There is a rapidly growing number of large language models (LLMs) that users can query for a fee. We review the cost associated with querying popular LLM APIs, e.g. GPT-4, ChatGPT, J1-Jumbo, and find that these models have heterogeneous pricing structures, with fees that can differ by two orders of magnitude. In particular, using LLMs on large collections of queries and text can be expensive. Motivated by this, we o…