from
Hacker News
Top
New
Reddit now blocks all search engines other than Google following 'misuse'
by
tevelee
on 7/25/24, 10:40 AM with 1 comments
by
nness
on 7/25/24, 10:52 AM
robots.txt has always been a gentleman's agreement and for such a large site to abuse it in that way is ridiculous, and possibly, anti-competitive.