LLM model routing: choosing a model for each request
Model routing selects among models according to task, quality, budget, latency, availability, and data-residency requirements. A practical guide to routing policies, evaluation, cache locality, and their tradeoffs.