TaPR: Test-Aware Policy Refinement Boosts Multi-Turn Code Repair
So, there’s this new approach called Test-aware Policy Refinement, or TaPR, that tackles a big problem in multi-turn code generation agents. Instead of just chasing quick rewards like traditional reinforcement learning, TaPR focuses on the ongoing process of refining code based on feedback. It changes the feedback from code execution into a detailed reward system for each turn, helping these agents learn to fix themselves. Tests on six different models, covering 219 tasks from LiveCodeBench, showed that TaPR boosted the success rate for three-turn interactions by 2.44 percentage points. In the high-headroom category, accuracy increased from 30.25% to 33.56%, leading to 42 improvements and 13 setbacks. You can check out the research on arXiv (2608.00494v1); it’s a significant step forward for AI in coding!
Key facts
- TaPR transforms execution feedback into a dense per-turn test-pass-ratio reward.
- It uses a consistent multi-turn interaction protocol.
- Experiments used six models on 219 code-generation problems from LiveCodeBench.
- TaPR improved pooled three-turn success rate (Pass@3) by 2.44 percentage points.
- In the 7B/8B high-headroom slice, accuracy rose from 30.25% to 33.56% (+3.31 pp).
- Paired trials showed 42 improvements and 13 regressions.
- The paper is available on arXiv with ID 2608.00494v1.
- The work addresses the misalignment between single-shot rewards and feedback-driven refinement.
Entities
Institutions
- arXiv
- LiveCodeBench