by nichochar on 9/19/23, 3:46 PM with 2 comments
We just released a new library for building LLM-powered applications: @axflow/models. It is part of a larger suite of libraries we're developing for TypeScript developers working with generative AI.
This library provides the simplest APIs for 1) invoking the most popular LLM and embedding models (openai, anthropic, cohere, huggingface, etc.) 2) streaming LLM responses to clients, including augmenting the streams with additional arbitrary data and 3) building client-side applications with React hooks.
@axflow/models has zero dependencies and is built using only the JavaScript standard library. As such, it works in all environments including edge environments like the Next.js edge runtime.
We'd love any feedback you may have. You can check out the code and more on our GitHub (https://github.com/axflow/axflow)
by skp1995 on 9/19/23, 4:55 PM
I would love to know a bit more on the future, coming from non ML/AI related background can axflow in the future help me with making my own ML/AI products better? Since all prompts/completions are passing through the APIs that would be neat to have
by benjreinhart on 9/19/23, 4:56 PM