arXiv 2305.05176
FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance
By Lingjiao Chen, Matei Zaharia, et al.
Published 2023-05-09
Mindmap
Browse the paper's core ideas, clusters, and relationships in a structured outline.
There is a rapidly growing number of large language models (LLMs) that users can query for a fee. We review the cost associated with querying popular LLM APIs, e.g. GPT-4, ChatGPT, J1-Jumbo, and find that these models have heterogeneous pricing structures, with fees that can differ by two orders of magnitude. In particular, using LLMs on large collections of queries and text can be expensive. Motivated by this, we o…