from Hacker News

Ask HN: How are you using LLMs in your personal projects today?

by angelmm on 11/23/23, 3:42 PM with 1 comments

I started working with AI / LLMs recently, and now I'm learning about the ecosystem. The possibilities seems unlimited and I know many use cases for big companies. However, I'm curious to learn about what people are hacking with LLMs on a personal side.

What are you building? What are you solving with LLMs? How do you run them? How do you integrate them in your app / service?

  • by mark_l_watson on 11/23/23, 4:17 PM

    I am mostly running local models using Ollama on a 32G on chip memory Mac Mini. This morning I am experimenting with function calling. Yesterday was a RAG app with a simple web UI.

    Historically I have worked in NLP, and LLMs have made many older techniques obsolete, and that has been fun.

    I have also been using OpenAI APIs for about 2 years and now I also experiment with Anthropic’s Claude 2 and Google Bard. Nothing important, I just want to have a solid intuition on what different commercial models can do.