from Hacker News

An open source lib for OpenAI/Azure API failures

by azianmike on 11/22/23, 4:02 PM with 1 comments

• by azianmike on 11/22/23, 4:02 PM

  Stemming from OpenAI's APIs being down the last few days (and us being down subsequently), we launched an open source OpenAI + Azure fallback and retry tool: https://github.com/Spryngtime/openai-load-balancer

  This open source library helps you mitigate errors & downtime from @OpenAI's APIs by retrying and falling back to Azure (and vice versa).

  About 5 minutes to setup - syntatically the exact same as OpenAI's library.

  If you need expedited access to Azure, feel free to email me - I can get you connected to our Azure account executive! (Startups with funding ONLY please!)

  Hope this helps some people out there!