Show HN: FrontierHarness Eval – 9 harness, same model, cost per pass varies 17x
Same model. Similar pass rates. 17.5x cost differences across 12 harness configurations.
Summary
A comparison of 12 harness configurations reveals significant cost discrepancies, with one model showing a staggering 17.5 times variation in cost per pass despite similar performance metrics. This analysis highlights the importance of cost efficiency in harness selection for tech applications.
Comments (55 of ) ⌛