from Hacker News

Rerank 3: A new foundation model for efficient enterprise search and retrieval

by bguberfain on 4/11/24, 5:38 PM with 5 comments

• by dvt on 4/11/24, 5:59 PM

  Being as charitable as possible here, and Rerank 3 might be the bee's knees, but the examples are absolutely awful. Do you really need to use embeddings + a large language model to search for "action" and "Christian Bale" in two columns[1]?

  Your interface can literally just be two dropdowns. I'd like to see things like "the actor that played the Joker in that movie about Bob Dylan" if you're really trying to flex your semantic search muscles.

  [1] https://colab.research.google.com/drive/1sKEZY_7G9icbsVxkeEI...

• by esafak on 4/11/24, 6:57 PM

  Someone correct me if I'm mistaken, but Cohere appears to be using BM25 and semantic search (Embed Multilingual) individually as baselines in order to look better. A more suitable baseline would be the Reciprocal rank fusion (RRF) of BM25 and semantic search. And those latencies seem high; seconds to rerank?

• by bigcat12345678 on 4/11/24, 5:55 PM

  El5 me what is rerank model? Why 4k context window size is considered large?