from Hacker News

Texting Robots: Taming robots.txt with Rust and 34M tests

by Smerity on 6/30/22, 1:39 AM with 0 comments