from Hacker News

Show HN: AI / LLM bot blocker web server configs

by anthonyhn on 4/26/24, 1:29 PM with 0 comments

Hello HN. I recently released the source code for a set of AI / LLM bot blocker web server configs that are used by my search engine (Ichido Search [0]) to block AI bots from crawling the pages. Sharing here, as others may have use cases for these configs as well. Supports the following web servers:

* Apache (and .htaccess) * Nginx * Lighttpd * Caddy * IIS (untested)

[0] https://ichi.do/