Consolidator: Persistent Routed Memory Across Context Boundaries
A new paper on arXiv (2608.11701) introduces Consolidator, a mechanism for Phasor Memory Networks (PMNet) that enables persistent memory across context boundaries. The approach transforms routed short-term memory (STM) into long-term memory (LTM) without replaying source tokens, clearing the KV cache and STM after each consolidation. The retained LTM is fed into a hierarchical router, conditioning subsequent memory access. Evaluated on a two-segment modulo-10 mapping task, the method allows a held-out query to recover updated mappings after a second consolidation and reset. The backbone and memory interface remain frozen, with only 12.35K parameters trainable. This work addresses the distinction between persistence and influence in memory retention, a key challenge in AI context handling.
Key facts
- Paper arXiv:2608.11701 introduces Consolidator for Phasor Memory Networks (PMNet).
- Consolidator transforms routed short-term memory (STM) into long-term memory (LTM) without replaying source tokens.
- After each consolidation, the KV cache and STM are cleared.
- Retained LTM is fed into the hierarchical router, conditioning subsequent memory access.
- Evaluated on a two-segment modulo-10 mapping task.
- The second segment updates the mapping at the same memory address.
- Following a second consolidation and reset, a held-out query must recover the updated mapping from LTM.
- The backbone and memory interface are frozen, leaving only 12.35K trainable parameters.
Entities
Institutions
- arXiv