arXiv 2310.12963
AutoMix: Automatically Mixing Language Models
By Pranjal Aggarwal, Aman Madaan, et al.
Published 2023-10-19
Discussion
Read the public discussion and references gathered around this paper.
Large language models (LLMs) are now available from cloud API providers in various sizes and configurations. While this diversity offers a broad spectrum of choices, effectively leveraging the options to optimize computational cost and performance remains challenging. In this work, we present Automix, an approach that strategically routes queries to larger LMs, based on the approximate correctness of outputs from a…