UltraGS: Real-Time Gaussian Splatting for Ultrasound Imaging
UltraGS is an innovative framework designed for real-time applications, enhancing Gaussian Splatting for sensorless ultrasound imaging. It merges explicit radiance fields with acoustic modeling grounded in physics. By utilizing depth-aware Gaussian primitives and adjustable fields of view, it enhances geometric consistency even with unrestricted probe movement. Additionally, it features PD Rendering, a differentiable acoustic operator that integrates low-order spherical harmonics with first-order wave effects. A clinical ultrasound dataset, gathered using actual scanning protocols, is introduced. Evaluations conducted on three datasets demonstrate leading PSNR results, reaching as high as 29.55.
Key facts
- UltraGS adapts Gaussian Splatting to sensorless ultrasound imaging
- Integrates explicit radiance fields with physics-inspired acoustic modeling
- Uses depth-aware Gaussian primitives with learnable fields of view
- Introduces PD Rendering, a differentiable acoustic operator
- Combines low-order spherical harmonics with first-order wave effects
- Presents a clinical ultrasound dataset from real-world scanning protocols
- Achieves state-of-the-art PSNR up to 29.55 across three datasets
- Framework operates in real-time
Entities
—