HEDP Framework Boosts Domain Incremental Learning by 2.57%
A team of researchers has introduced the Hybrid Energy-Distance Prompt (HEDP), a framework for domain-incremental learning that draws inspiration from Helmholtz free energy principles. This approach incorporates an energy regularization loss to improve the separability of domain representations, alongside a hybrid mechanism that combines energy-based and distance-based cues for better domain selection and generalization. Testing on benchmarks like CORe50 revealed a 2.57% increase in accuracy for previously unseen domains, effectively reducing catastrophic forgetting and boosting adaptability in open-world scenarios. The code for this framework is accessible online.
Key facts
- HEDP stands for Hybrid Energy-Distance Prompt.
- Framework is inspired by Helmholtz free energy.
- Includes energy regularization loss and hybrid energy-distance weighted mechanism.
- Tested on CORe50 and other benchmarks.
- Achieves 2.57% accuracy gain on unseen domains.
- Addresses catastrophic forgetting and open-world adaptability.
- Code is publicly available.
Entities
Institutions
- arXiv