CFM-Bench: Unified Benchmark for Channel Foundation Models
Researchers have unveiled CFM-Bench, a detailed benchmark designed to evaluate channel foundation models (CFMs) across different fields and tasks. It features 157,900 validated single-frame instances from six areas, including 3GPP statistical simulations and two ray-tracing methods, as well as terrestrial and aerial data, plus synchronized vehicular simulations. CFM-Bench addresses the challenge of making reliable comparisons between CFMs by providing source-specific interfaces that preserve complex channel state information (CSI) and physical metadata, while also documenting model-specific preprocessing. To avoid spatio-temporal leakage, it utilizes official partitions for entire trajectories and sessions. This initiative aims to create standardized evaluations across diverse datasets and metrics. The paper can be found on arXiv under ID 2607.14975.
Key facts
- CFM-Bench is a unified multi-domain, multi-task benchmark for channel foundation models.
- It includes 157,900 official single-frame examples.
- The benchmark covers six domains: 3GPP statistical simulation, two ray-tracing pipelines, terrestrial and aerial measurements, and synchronized vehicular multimodal simulation.
- Source-specific interfaces preserve complex channel state information (CSI) and physical metadata.
- Official partitions isolate complete trajectories, measurement sessions, flights, vehicle links, simulation realizations, or buffered spatial regions to reduce spatio-temporal leakage.
- The benchmark aims to enable reproducible comparison across CFMs and against task-specific networks.
- The announcement was made on arXiv with ID 2607.14975.
- The paper is available at https://arxiv.org/abs/2607.14975.
Entities
Institutions
- arXiv