by timerol on 2/19/25, 7:30 PM
The headline reads very oddly, and I was wondering how GPT4 got significantly less intelligent. It's that the cost of GPT4-level intelligence has dropped 1000x in 18 months
by jcuenod on 2/19/25, 10:09 PM
Lmsys is not a measure of intelligence. It's a measure of human preference. People prefer correct answers (assuming they are qualified to identify the correct one), but they also prefer answers formatted nicely for reading, for example, which has nothing to do with "intelligence". That is why "reasoning" models, which often do better on benchmarks, do not necessarily do correspondingly well on lmsys.
by glimshe on 2/20/25, 2:01 PM
Not only the headline is misleading but uses a very annoying way of describing the cost drop... "1000x" instead of "by 99.9%".
by kencausey on 2/19/25, 7:34 PM
For the OP: If you edit the title within the 1st hour of posting it should pass HN filtering unedited.
by anakaine on 2/19/25, 7:33 PM
The COST of GPT4 level intelligence fell 1000x over 4 years in the competitive market.
That headline is poorly written.
by hnuser123456 on 2/19/25, 7:34 PM
I would pay $1000/Mtoken for an LLM that actually does what it's asked
by gmuslera on 2/19/25, 8:17 PM
Feeding it with social networks posts was a bad move.
by amonon on 2/19/25, 7:29 PM
(Cost of)