from Hacker News

After All Is Said and Indexed – Unlocking Information in Recorded Speech

by jeadie on 4/12/23, 7:01 AM with 13 comments

• by rektide on 4/15/23, 2:41 PM

  Hadn't heard of the thing they were putting their data into, Marqo, a "tensor search for humans" , https://github.com/marqo-ai/marqo

• by jeadie on 4/12/23, 7:01 AM

  A really interesting blog post I found using LLMs for audio search which I think is a pretty nifty/new idea.

  I've found it cumbersome using some of the new vector DBs (chroma, faiss, etc) to make end to end systems, but with Marqo it doesn't seem too hard.

• by notjulianjaynes on 4/15/23, 7:18 PM

  This is interesting but what problem does it solve better than CTRL+F-ing a transcript? It seems like this would be a worse solution for when the precise way someone says something could be important (ex. journalists parsing an interview, students studying their recorded lectures) and that it would be most useful if you were working with a large volume of recorded audio, such as customer service calls. This makes me somewhat uncomfortable, but perhaps I am not fully understanding how it works.

  Edit: wording

• by password4321 on 4/15/23, 2:28 PM

  Both speaker and speech recognition are done in the article using huggingface.

  Is there anything as good ready to use on-prem for the diarization (speaker recognition)?

  I've heard good things about whisper(.cpp) for speech recognition and vosk used to be king of that hill...

• by moneywoes on 4/15/23, 5:40 PM

  How does this compare to using Whisper and feeding that into a vector DB and querying with a LLM

  Pardon the dumb question I only have an elementary understanding