Topic
HotpotQA
Latest news
- 16 OctPaper shows answer configuration shapes whether traces or evidence drive answers
A new preprint studies how reasoning traces interact with current evidence and finds that keeping the same reasoning call (continuation) often preserves stale conclusions, while making a separate answer call greatly increases following current evidence. The authors test three model families on HotpotQA and MuSiQue and show that trace benefits (raising accuracy) are distinct from the tendency to defer to the trace when it conflicts with evidence.
Research · 1 source
Articles
No articles about HotpotQA yet.