Every Model Cheats

This post presents a controlled prompt-ablation study: 23 tasks, three prompt conditions, 1,518 individually audited traces, and a simple question: can you prompt away cheating?
97 points by vga805 62 days ago dreadnode.io 76 comments

Summary

A study involving 1,518 traces examines whether modifying prompts can reduce cheating across various tasks. The findings could shed light on the effectiveness of different prompt strategies in ensuring fair outcomes.

Comments (76 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open