by machinelearning on 6/16/23, 8:29 AM with 15 comments
It uses LLMs to answer queries from videos so you don't have to watch them yourself! Each video found is also included with a summary of its transcript for further exploration. Most importantly, it uses up-to-date videos and can answer question about real and recent things unlike ChatGPT.
It is particularly useful for:
1. Getting up to date information about the news from different sources E.g.
- What are the features of the recently released Apple Vision Pro?
- How many people were evacuated from the recent eruption in Hawaii?
2. Product reviews E.g.
- What's the best vegan & cruelty-free skin cream?
- What is best GPU for deep learning in 2023?
3. Learning about a specific topic E.g.
- What are the requirements for the commercial pilot's license?
- How do I do a cartwheel?
Let me know what you tried and submit feedback in the interface, I read all of them! Also do include your email if you want a follow up for your feedback
Email: askutubeai@gmail.com
by WA on 6/16/23, 11:38 AM
You probably have to give some other indicator to show the user whether your site is working at all or not.
by HanClinto on 6/16/23, 12:01 PM
Previously, I had already tried using YouTube's searching tool to find videos for this, but didn't come up with much. Your tool returned several results I had not seen before, and they look super laser-targeted. REALLY impressive work! This is insanely cool, and FAR better than YouTube's search algorithm. Very very well done!
I'm interested in doing a similar YouTube indexing project (but indexing with pose detection rather than semantic segmentation) -- do you have any guidance for people wanting to do a similar project?
by ggordbegli on 6/16/23, 12:26 PM
If you can just get search time down, and make the summarization a little better, that would be amazing.
For instance, I tried this with 'what Toyotas should I avoid' and it found good relevant videos, but in the summary of 'Bad Toyotas you need to avoid' it misses that certain Toyotas from 2007-2009 had an oil burning issue, which was the main topic of the video. Querying the transcript of the video with 'what Toyotas do I need to avoid' gives a more complete answer. I'm curious how your handling the initial summary.
by mdrzn on 6/16/23, 12:42 PM
I'd say show me some progress?
Write down some text like "searching for videos.. summarizing.. finding answers.." so we know when it's moving forward.
by HanClinto on 6/16/23, 11:46 AM
I'm guessing you're using LLMs to generate vectors for the search query, and then using that to index into your database of vectors generated from the transcript of each video? Is that correct?
If so, which LLM are you using to generate the vectors? What does your backend look like? How many videos are currently in your database?
by freediver on 6/16/23, 8:48 AM
Hope it inspires some features.
by aerio on 6/16/23, 12:14 PM
by Graffur on 6/16/23, 10:46 PM