from Hacker News

Ask HN: Any success or horror stories when connecting DB and LLM?

by yonisto on 11/25/24, 11:30 AM with 1 comments

It seems that the next sprint will include an effort to connect our database with LLM.

while researching this, I noticed there was a lot of buzz last year. but now it is more quiet on that front.

Can you share how it worked for you? especially from the user perspective?

Thanks,

  • by defnotai on 11/25/24, 11:37 AM

    I recommend building an intermediary data access layer like a graphQL API that the LLM consumes, otherwise you run the risk of someone successfully tricking the LLM to drop all or part of the DB via a raw input-to-SQL step.