I checked 30 frontier model cards. Here are the benchmarks labs report
A live ranking of the benchmarks reported in frontier model cards, system cards, and technical reports. Measures vendor reporting convention, not benchmark quality.
Summary
The article presents a live ranking of benchmarks from various frontier model cards and technical reports, focusing on how vendors report their data rather than the quality of the benchmarks themselves. It’s a useful resource for those interested in understanding the reporting standards across different models.
Comments (7 of ) ⌛