Real-SWE: Benchmarking AI models on private, real-world, enterprise codebases

Real-SWE benchmarks frontier AI models on private production codebases licensed from real companies. Eight model and harness configurations, ten tasks, 640 scored rollouts.
272 points by theanonymousone 39 days ago withspecific.com 154 comments
Summary not yet generated for this article.

Comments (154 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open