from
Hacker News
Top
New
Show HN: Now tracking the number of unique URLs in the Mwmbl index
by
daoudc
on 3/29/24, 8:39 AM with 0 comments
This is actually a lot harder to do than you might imagine, we need to scan the whole index and use a hyperloglog (handily implemented for us in Redis) to count the URLs.