The Two MMLU Scores: What a Benchmark Name Does Not Fix

Two accuracy numbers under the same MMLU label, taken apart by variable — split, runner, prompt format, grader, network access — and what a verifier outputs once each one is written into the frame.
6 points by gmays 38 days ago zatona.dev 0 comments
Summary not yet generated for this article.

Comments (0 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open