from Hacker News

How much does it cost to crawl all urls that are linked from hackernews submissions and comments? Ballpark at least 3.5 million story urls.

Several services would likely do this for several thousand dollars but I'm hoping for something cheaper.