by iknownthing on 10/1/24, 11:35 PM with 4 comments
Basically I have a use-case where I am building an llm-based tutor where some questions you ask the tutor can be adequately answered by gpt-4o-mini but others required gpt-4o. I'm looking for a router that can route to gpt-4o only when necessary and otherwise route to the cheaper gpt-4o-mini. First of all, is this even something that can be done reliably at this point? If so, are there any recommendations for LLM routers that can do this?
by LifeOverIP on 10/2/24, 12:48 AM
by phren0logy on 10/2/24, 12:13 AM
The best option I have seen for routing is LiteLLM. Worth a look.
by gbertb on 10/2/24, 5:11 AM