from Hacker News

Show HN: Now tracking the number of unique URLs in the Mwmbl index

by daoudc on 3/29/24, 8:39 AM with 0 comments

This is actually a lot harder to do than you might imagine, we need to scan the whole index and use a hyperloglog (handily implemented for us in Redis) to count the URLs.