CADTestBench: First Test-Based Benchmark for Text-to-CAD Evaluation
Researchers have introduced CADTestBench, the first test-based benchmark for evaluating Text-to-CAD models. The benchmark uses CADTests, executable software tests that verify whether generated CAD models meet geometric and topological requirements specified in input prompts. The team conducted comprehensive benchmarking of recent Text-to-CAD methods and demonstrated that CADTests can also guide model generation, yielding simple baselines that surpass current methods. Code and data are available on GitHub and Hugging Face.
Key facts
- CADTestBench is the first test-based benchmark for Text-to-CAD.
- CADTests are executable software tests for verifying CAD models.
- Tests check geometric and topological requirements from prompts.
- Comprehensive benchmarking of recent Text-to-CAD methods was conducted.
- CADTests can guide model generation to improve performance.
- Simple baselines using CADTests surpass current methods.
- Code and data are available on GitHub and Hugging Face dataset.
- The work addresses the lack of evaluation in Text-to-CAD.
Entities
Institutions
- arXiv
- GitHub
- Hugging Face