from Hacker News

First generation on my AI platform was illegal sexual content

by rogutkuba on 9/7/24, 6:38 PM with 3 comments

I wanted to try making my own AI wrapper product in only a couple of days, as well as wanting to try out Cursor. I built an AI sound effect generator, (shameless plug https://sfxengine.com/), deployed it, posted the links a couple places and went straight to bed. When I woke up I went to look at the logs, only to see that my first ever user tried to generate sexual content with a minor...

For those also working on AI platforms/wrappers, how are you dealing with these kinds of issues? Any tips or helpful information would be appreciated!

  • by tahmidd on 9/7/24, 6:41 PM

    ChatGPT has a free moderation tool.