Show HN: JevBench, a reproducible benchmark for typed decision models
52 Jev-class systems tested on 534 decisions. Jev 1.13.0 leads JevBench v1.3.0 with 74.4; compare open-source, self-hostable and hosted options.
Summary
JevBench offers a way to benchmark typed decision models, allowing users to compare the performance of Jev-class models against other projects in terms of accuracy, latency, and cost. With customizable weighting options, it aims to provide a clearer picture of how these models stack up against traditional LLMs.
Comments (39 of ) ⌛