Show HN: Will Jev pull the lever in the trolley problem?

Put anything on the tracks and find out whether Jev would pull the lever.
7 points by lanyard-textile 32 days ago gpu.studio 2 comments
Summary not yet generated for this article.

Original Text

The Jev benchmark you've all been waiting for: Will Jev pull the lever in the trolley problem?

Don't think too much about it :)

Place whatever you'd like on each side of the tracks, and GPU (my startup's AI system, whee!) will have Jev judge the result.

As a bonus, two really good looking SVGs are rendered with gpt-oss-120b for what you place on the tracks. I've made a really high quality thing here.

My first impression is that Jev does well! I understand it's not exactly designed for this kind of "classification" -- I think -- but I haven't been able to get it to pull the lever away from any villains or geese yet.

It's public against my better judgement. No account necessary, have fun.

Side presentation: I've put together a more "serious" harness here if you're interested in evaluating Jev for yourself. I've been interested in seeing how well it does if you augment an existing smaller model with it: https://gpu.studio/jev

Comments (2 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open