FinDeepIndicator: New Benchmark for Deep Research Agents in Financial Indicator Construction
A new benchmark, FinDeepIndicator, has been introduced to evaluate Deep Research (DR) agents in the end-to-end construction of financial indicators. Unlike existing benchmarks that focus on answer-level accuracy and assume data is provided, FinDeepIndicator assesses the entire intermediate process. It covers four stages: formula specification, data collection, indicator calculation, and answer generation. The benchmark includes fundamental, technical, and macroeconomic indicators, organized into 21 fine-grained sub-categories, and contains 3,350 curated question-answer (QA) pairs derived from U.S. data. This initiative addresses a gap in evaluating the process of indicator construction, which is crucial for valuation, risk assessment, and economic analysis. The benchmark is detailed in a paper available on arXiv (arXiv:2608.00764).
Key facts
- FinDeepIndicator is the first benchmark dedicated to evaluating Deep Research (DR) agents in end-to-end financial indicator construction.
- It evaluates DR agents across four stages: formula specification, data collection, indicator calculation, and answer generation.
- The benchmark covers fundamental, technical, and macroeconomic indicators.
- Indicators are organized into 21 fine-grained sub-categories.
- It contains 3,350 curated question-answer (QA) pairs.
- The QA pairs are derived from U.S. data.
- Existing benchmarks focus on answer-level accuracy and assume data is provided.
- The benchmark is presented in a paper on arXiv with identifier 2608.00764.
Entities
Institutions
- arXiv
Locations
- United States