from Hacker News

Arc AGI: – Ryan gets 71% accuracy on a set of examples where humans get 85%

by obiefernandez on 6/17/24, 6:48 PM with 1 comments

  • by lawlessone on 6/17/24, 7:27 PM

    How many shots did he give LLMs at solving each question?

    If you do it enough times I am sure you would eventually get 100% on these tests. but if you only get 100% every 10,000 tries it's probably not AGI..