FusionProxy: Real-Time Thermal Fusion for Vision Systems
FusionProxy is a real-time image fusion module that adds thermal awareness to RGB-based vision systems. It addresses the failure of purely RGB models in challenging conditions like nighttime and fog. The module uses distilled diffusion models to fuse infrared and visual data with high fidelity and low latency, making it suitable for edge deployment. FusionProxy is a plug-and-play component that requires no joint optimization with existing systems. It leverages per-pixel variance from a teacher sample ensemble for pixel-level supervision and feature-level alignment. The approach aims to improve safety and reliability in autonomous systems.
Key facts
- FusionProxy is a real-time image fusion module.
- It adds thermal awareness to RGB-based vision systems.
- Purely RGB models fail in nighttime and fog.
- Infrared imaging provides complementary information.
- Existing fusion methods have prohibitive latency.
- FusionProxy uses distilled diffusion models.
- It is a plug-and-play component.
- No joint optimization is required.
Entities
Institutions
- arXiv