from Hacker News

Ask HN: Does something like an AI distribution exist?

by theletterf on 5/13/25, 3:35 PM with 2 comments

I was wondering if something like AI/LLM distros exist, in the sense of bundled models, interfaces, prompts, and tools (as in tools called by the LLM) tested to work well together and ready to run on modest hardware.

Picture an open source ChatGPT (meaning UI, LLM, tools to generate and run scripts, etc.), but entirely open source. Everything bundled and ready to run. GNUbot? GPTKnoppix? Geminibuntu? :)

by bigyabai on 5/13/25, 3:39 PM
It's not necessary. Most distros contain all the packaging required to hardware-accelerate AI already, packages that need AI-specific tooling can specify it as a dependency and pull it in as-needed.
> Picture an open source ChatGPT (meaning UI, LLM, tools to generate and run scripts, etc.), but entirely open source.
We're kinda already past that: https://flathub.org/apps/com.jeffser.Alpaca
by theletterf on 5/13/25, 3:39 PM
Perhaps something like https://www.redhat.com/en/products/ai/enterprise-linux-ai ?