from Hacker News

RoRF (Routing on Random Forests)

by t5-notdiamond on 9/24/24, 2:35 PM with 1 comments

• by t5-notdiamond on 9/24/24, 2:35 PM

  Hey hn, this is Tomás, founder of Not Diamond. Today we're open-sourcing RoRF (Routing on Random Forests), a pairwise AI model router that beats all closed and open-source approaches, along with 12 pre-trained model routers:

  Hugging Face: https://lnkd.in/gE4FKZWR Github: https://lnkd.in/gn2uKWaY Blog: https://lnkd.in/gutaamm4

  When routing between two strong models, RoRF achieves higher accuracy than either individual model at significant cost reductions. When routing between a strong and a weak model pair, we outperform other routing approaches at a lower cost.

  The architecture for RoRF is based on a Random Forest Classifier and supports both open-source embedding models like Jina which you can run locally, or closed-source embedding models like Voyage or OpenAI for lower compute requirements.

  We developed RoRF earlier this year as a previous iteration of the more powerful router we released through our API. Excited to share this :)