StratMem-Bench: New Benchmark for Strategic Memory in Virtual Characters
StratMem-Bench has been unveiled by researchers as a new benchmark aimed at assessing the strategic utilization of memory in dialogues with virtual characters, extending past mere factual recollection. This dataset comprises 657 examples in which characters manage diverse memory pools that include necessary, supportive, and irrelevant memories. The framework introduces evaluation metrics like Strict Memory Compliance, Memory Integration Quality, and Proactive Enrichment Score to measure effectiveness. This initiative fills a void in existing benchmarks that view memory as a fixed store instead of a dynamic tool for social interaction.
Key facts
- StratMem-Bench evaluates strategic memory use in virtual character dialogues.
- Dataset comprises 657 instances with heterogeneous memory pools.
- Memory types include required, supportive, and irrelevant memories.
- Metrics include Strict Memory Compliance, Memory Integration Quality, Proactive Enrichment Score.
- Current benchmarks overlook strategic memory utilization.
- The work is published on arXiv with ID 2604.26243.
- The benchmark targets character-centric dialogues.
- The framework aims to improve human-like conversation realism.
Entities
Institutions
- arXiv