from Hacker News

Show HN: Turn web search results into an LLM friendly downloadable Markdown file

by timz on 12/15/24, 5:04 PM with 1 comments

The purpose of this tool is to make it easy collect seed information for use with LLM.

Just enter a query or a URL, it will search and scrape the web, to produce one markdown file with all the results.

Searching for a URL prefix to get result from a particular site only.

Example:

- https://llminer.deno.dev/?q=https%3A%2F%2Fdocs.deno.com%2F

- https://llminer.deno.dev/?q=cocktail%20recipes

Once the markdown file has been downloaded, you can insert it into LLM of your choice.

WIP, looking for feedback, thank you.

  • by smcleod on 12/16/24, 5:36 AM

    I'm seeing a lot of these pop up at the moment - but that's a good thing.

    Some feedback:

    - Tables are not rendered properly, it places cells on new lines without clear relationships.

    - There needs to be a "concatenate and download all" button that takes all results and downloads a single markdown file.

    - Add a link to the source code on the main page, you'll get people wanting to contribute and will be able to track bugs.