from Hacker News

Texting Robots: Taming robots.txt with Rust and 34M tests

by Smerity on 4/3/22, 8:23 PM with 0 comments