UltraArUco: A Lightweight Library for Low-Latency Mobile AR Tracking
Hey, so there’s this new framework called UltraArUco that just came out, and it’s designed for mobile augmented reality. It’s a lightweight library that really speeds up marker-based tracking, cutting down latency by five times compared to the usual OpenCV methods, while still being super accurate. It connects your phone’s camera to a PC app using Wi-Fi, which makes things really interactive. They even showcased it with a piano simulation where ArUco markers on the keys trigger notes, and using markers on your hands lets you control gestures in space. UltraArUco is perfect for mobile AR apps that don’t have a lot of resources. You can check out the research paper on arXiv under Computer Science > Human-Computer Interaction.
Key facts
- UltraArUco is a lightweight multilingual library and framework for marker-based tracking in mobile AR.
- It reduces per-frame latency by five times compared to standard OpenCV-based implementations.
- The framework uses a distributed Wi-Fi architecture connecting a mobile device with a PC-based visual application.
- Validation was done through an interactive piano simulation with static ArUco markers on keys and hand-mounted markers.
- The system is designed for resource-constrained mobile AR applications.
- The paper is available on arXiv under Computer Science > Human-Computer Interaction.
- The framework maintains high accuracy while achieving low latency.
- It demonstrates a viable AR music application without specialized equipment.
Entities
Institutions
- arXiv