pass@1 and pass@8

Latest news

1. 6 Oct
   Training policies improves reliability of autonomous coding agents

   Researchers identify three teachable behaviors that make autonomous coding agents both produce useful repairs and reliably choose them, and show training these behaviors improves repair rates. Supervised fine-tuning and a reinforcement objective for the verifier raise pass@1 and pass@8 and reduce false acceptance on held-out issues and benchmarks.

   Research · 1 source

Articles

No articles about pass@1 and pass@8 yet.