TS-Arena: A Live Forecasting Platform with Pre-Registration Protocol
TS-Arena is a live forecasting platform introduced to address evaluation challenges in time series foundation models (TSFMs). It shifts model evaluation from historical data to future data, implementing a strict pre-registration protocol where models submit predictions before ground-truth data exists, making test-set contamination impossible. The platform uses a modular microservice architecture to harmonize data from different sources and orchestrate containerized model submissions. This approach aims to provide more reliable and unbiased evaluation of TSFMs by eliminating temporal overlaps and train-test sample overlaps.
Key facts
- TS-Arena is a live forecasting platform for time series foundation models.
- It shifts evaluation from historical data to future data.
- The platform enforces a strict pre-registration protocol for model predictions.
- Predictions must be submitted before ground-truth data physically exists.
- Test-set contamination is made impossible by design.
- The platform uses a modular microservice architecture.
- It harmonizes and structures data from different sources.
- It orchestrates containerized model submissions.
Entities
—