by inciampati on 2/3/25, 5:54 PM with 1 comments
by inciampati on 2/3/25, 5:54 PM
Reasoning models from OpenAI forget what their past reasoning. The reasoning tokens are removed from context after the user-visible response is generated. It's not what I expected, given that memory of reasoning is the key to chain or thought's success.