by behrlich on 4/7/23, 1:15 PM with 0 comments
I'm loving everyone's GPT projects so I thought I'd share mine. Most other projects I've seen (including the discord bots I've run across) stick to "call/response" and force you to manually separate separate conversations.
The primary goal of EhrlichGPT is to more naturally participate in discord conversations - both DMs and group chats. Here are some of the things I've tried:
* Include a snippet of short term memory, a summarized "medium term" memory, and finally do an even more succinct summary and store those summaries as documents in a faiss embedding index as "long term" memory
* Multi-layer prompt - first prompt is an agent-ish tool prompt that selects whether the user is asking for long term memory, a web request, etc - this information is used to build the final prompt
* Reasoning prompt for the final output e.g. "Investigation result: [Info you gathered from the conversation] Final Response: [Response]"
I have an hour or two to work on this per night, so if anyone thinks this is neat I'd be happy for help (see CONTRIBUTING for some ideas). I'd especially appreciate any ideas on how to more objectively measure progress - i.e. how "good" is the bot, are prompt changes making it better or worse?