from Hacker News

Ask HN: Where can I find datasets of size greater than 1 GB?

by alagappanr on 2/18/14, 7:53 PM with 9 comments

• by benologist on 2/18/14, 8:02 PM

  http://aws.amazon.com/datasets/

• by tobias2014 on 2/18/14, 8:18 PM

  Try http://academictorrents.com/ See also the comments in https://news.ycombinator.com/item?id=7149006

• by rellimevad on 2/18/14, 9:45 PM

  Historical weather would fit your description. The NOAA has a large collection going back a century or more from different weather stations.

  ftp://ftp.ncdc.noaa.gov/pub/data/

• by maxerickson on 2/18/14, 11:25 PM

  Openstreetmap?

  Not sure that is the sort of data you want. In the U.S., lots of states and the federal government also have extensive geographical data sets (so you mind find one with a theme you are more interested in).

• by bloodorange on 2/18/14, 7:57 PM

  Look for the following:

  Census data

  Maybe wikipedia's data is available?

  Is there some open search engine, which gives its data free?

  There could be more but I'm tired and this will hopefully be of help.

• by jakeogh on 2/20/14, 3:34 AM

  http://911datasets.org/images/911datasets.org_all_torrents_J...

• by blamarvt on 2/19/14, 8:40 PM

  http://www.imdb.com/interfaces

• by jenno on 2/18/14, 8:17 PM

  You can download Wikipedia data; with only articles, it's around 20gb.

• by AznHisoka on 2/19/14, 5:00 PM

  OpenCrawl has TBs worth of info.