Ask HN: Agents get dumber before release of new model version?

9 points by sporkland 133 days ago 7 comments
Summary not yet generated for this article.

Original Text

I've noticed an effect with openai where my codex agents seem to perform worse in the week(s) leading up to a new release. I'm wondering if the vendors tweak effort params at all to free up hardware to host the new version. It's a double win as the new model will look night and day better to their regular users when the new model is released presumably with effort back at normal levels.

Is this a known phenomenon? Are any folks trying to measure any of this objectively?

Comments (7 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open